2024-06-02T03:42:02.185 INFO:root:teuthology version: 0.0.1.dev296+ge1979f0 2024-06-02T03:42:02.186 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/postgres}} --name teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi --verbose --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi/7733635 -- /home/teuthworker/archive/teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi/7733635/orig.config.yaml 2024-06-02T03:42:02.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-02T03:42:02.340 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi/7733635 branch: reef description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/postgres}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7733635' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: reef ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 3bb45379356e8aa965152e0b8c663715c5df9bda subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 3bb45379356e8aa965152e0b8c663715c5df9bda kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs mntopts: - ms_mode=crc - wsync syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: 111a617aaeda17ec8908c7a46e47c4a09ebf905d owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 4691 sha1: 3bb45379356e8aa965152e0b8c663715c5df9bda sleep_before_teardown: 0 subset: 327/512 suite: fs suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_111a617aaeda17ec8908c7a46e47c4a09ebf905d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 111a617aaeda17ec8908c7a46e47c4a09ebf905d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi123.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLc4A5vz1vReXmdvH7B2MLuBn4K/5zKy4lEMYRwcNnrOvc/UbVfmeW8OkghgZw27KMyx8QxoAqOU0bHoI38ehus= smithi136.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGim9pHdCicyRGNvG5d+VfWROKw4td9suY1C+aH0uu9Gg2evwNOi1c0J/tqKexNEiSmsr/TwgysGutaIMoaE2es= smithi162.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIy/i8ESCC3iwFSGjDpR3DHO4xybxKkQ09iSJfApdbmZxH5+eZ1zCBjs29uJPNwib/TSGjRn4AhUVLoJeChsTkA= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: e1979f064b0becde2020282c7e87cf3c5e98026c timestamp: 2024-05-29_22:24:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-06-02T03:42:02.341 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_111a617aaeda17ec8908c7a46e47c4a09ebf905d/qa; will attempt to use it 2024-06-02T03:42:02.342 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_111a617aaeda17ec8908c7a46e47c4a09ebf905d/qa/tasks 2024-06-02T03:42:02.342 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-06-02T03:42:02.344 INFO:teuthology.task.internal:Checking packages... 2024-06-02T03:42:02.371 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '3bb45379356e8aa965152e0b8c663715c5df9bda' 2024-06-02T03:42:02.371 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-06-02T03:42:02.372 INFO:teuthology.packaging:ref: None 2024-06-02T03:42:02.372 INFO:teuthology.packaging:tag: None 2024-06-02T03:42:02.372 INFO:teuthology.packaging:branch: reef 2024-06-02T03:42:02.372 INFO:teuthology.packaging:sha1: 3bb45379356e8aa965152e0b8c663715c5df9bda 2024-06-02T03:42:02.372 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2024-06-02T03:42:02.683 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1387.g71c5cfc9 2024-06-02T03:42:02.684 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-06-02T03:42:02.692 INFO:teuthology.task.internal:no buildpackages task found 2024-06-02T03:42:02.693 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-06-02T03:42:02.702 INFO:teuthology.task.internal:Saving configuration 2024-06-02T03:42:02.721 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-06-02T03:42:02.730 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-06-02T03:42:02.754 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi123.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi/7733635', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-02 03:36:48.358864', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLc4A5vz1vReXmdvH7B2MLuBn4K/5zKy4lEMYRwcNnrOvc/UbVfmeW8OkghgZw27KMyx8QxoAqOU0bHoI38ehus='} 2024-06-02T03:42:02.775 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi/7733635', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-02 03:36:48.360494', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGim9pHdCicyRGNvG5d+VfWROKw4td9suY1C+aH0uu9Gg2evwNOi1c0J/tqKexNEiSmsr/TwgysGutaIMoaE2es='} 2024-06-02T03:42:02.797 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi/7733635', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-06-02 03:36:48.361865', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIy/i8ESCC3iwFSGjDpR3DHO4xybxKkQ09iSJfApdbmZxH5+eZ1zCBjs29uJPNwib/TSGjRn4AhUVLoJeChsTkA='} 2024-06-02T03:42:02.797 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-06-02T03:42:02.805 INFO:teuthology.task.internal:roles: ubuntu@smithi123.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-06-02T03:42:02.805 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-06-02T03:42:02.805 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-06-02T03:42:02.805 INFO:teuthology.run_tasks:Running task console_log... 2024-06-02T03:42:02.885 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff101e2bbe0>, signals=[15]) 2024-06-02T03:42:02.885 INFO:teuthology.run_tasks:Running task internal.connect... 2024-06-02T03:42:02.892 INFO:teuthology.task.internal:Opening connections... 2024-06-02T03:42:02.893 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi123.front.sepia.ceph.com 2024-06-02T03:42:02.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T03:42:02.969 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi136.front.sepia.ceph.com 2024-06-02T03:42:02.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T03:42:03.039 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi162.front.sepia.ceph.com 2024-06-02T03:42:03.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T03:42:03.114 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-06-02T03:42:03.122 DEBUG:teuthology.orchestra.run.smithi123:> uname -m 2024-06-02T03:42:03.142 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2024-06-02T03:42:03.142 DEBUG:teuthology.orchestra.run.smithi123:> cat /etc/os-release 2024-06-02T03:42:03.202 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Red Hat Enterprise Linux" 2024-06-02T03:42:03.202 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8.6 (Ootpa)" 2024-06-02T03:42:03.202 INFO:teuthology.orchestra.run.smithi123.stdout:ID="rhel" 2024-06-02T03:42:03.203 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="fedora" 2024-06-02T03:42:03.203 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8.6" 2024-06-02T03:42:03.203 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8" 2024-06-02T03:42:03.203 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-06-02T03:42:03.203 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2024-06-02T03:42:03.203 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-06-02T03:42:03.203 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.redhat.com/" 2024-06-02T03:42:03.203 INFO:teuthology.orchestra.run.smithi123.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-06-02T03:42:03.203 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-02T03:42:03.203 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T03:42:03.203 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-06-02T03:42:03.203 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-06-02T03:42:03.204 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-06-02T03:42:03.204 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-06-02T03:42:03.204 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2024-06-02T03:42:03.229 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2024-06-02T03:42:03.250 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2024-06-02T03:42:03.250 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2024-06-02T03:42:03.310 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="Red Hat Enterprise Linux" 2024-06-02T03:42:03.311 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8.6 (Ootpa)" 2024-06-02T03:42:03.311 INFO:teuthology.orchestra.run.smithi136.stdout:ID="rhel" 2024-06-02T03:42:03.311 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="fedora" 2024-06-02T03:42:03.311 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8.6" 2024-06-02T03:42:03.311 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8" 2024-06-02T03:42:03.311 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-06-02T03:42:03.311 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2024-06-02T03:42:03.311 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-06-02T03:42:03.311 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://www.redhat.com/" 2024-06-02T03:42:03.311 INFO:teuthology.orchestra.run.smithi136.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-06-02T03:42:03.311 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-02T03:42:03.311 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-06-02T03:42:03.312 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-06-02T03:42:03.312 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-06-02T03:42:03.312 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-06-02T03:42:03.312 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-06-02T03:42:03.313 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2024-06-02T03:42:03.328 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2024-06-02T03:42:03.349 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2024-06-02T03:42:03.350 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-06-02T03:42:03.412 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="Red Hat Enterprise Linux" 2024-06-02T03:42:03.412 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="8.6 (Ootpa)" 2024-06-02T03:42:03.412 INFO:teuthology.orchestra.run.smithi162.stdout:ID="rhel" 2024-06-02T03:42:03.412 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="fedora" 2024-06-02T03:42:03.412 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="8.6" 2024-06-02T03:42:03.412 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el8" 2024-06-02T03:42:03.412 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-06-02T03:42:03.412 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2024-06-02T03:42:03.413 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-06-02T03:42:03.413 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://www.redhat.com/" 2024-06-02T03:42:03.413 INFO:teuthology.orchestra.run.smithi162.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-06-02T03:42:03.413 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-06-02T03:42:03.413 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T03:42:03.413 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-06-02T03:42:03.413 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-06-02T03:42:03.413 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-06-02T03:42:03.413 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-06-02T03:42:03.413 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-06-02T03:42:03.437 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-06-02T03:42:03.447 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-06-02T03:42:03.455 INFO:teuthology.task.internal:Checking for old test directory... 2024-06-02T03:42:03.455 DEBUG:teuthology.orchestra.run.smithi123:> test '!' -e /home/ubuntu/cephtest 2024-06-02T03:42:03.457 DEBUG:teuthology.orchestra.run.smithi136:> test '!' -e /home/ubuntu/cephtest 2024-06-02T03:42:03.460 DEBUG:teuthology.orchestra.run.smithi162:> test '!' -e /home/ubuntu/cephtest 2024-06-02T03:42:03.477 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-06-02T03:42:03.485 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-06-02T03:42:03.485 DEBUG:teuthology.orchestra.run.smithi123:> test -z $(ls -A /var/lib/ceph) 2024-06-02T03:42:03.517 DEBUG:teuthology.orchestra.run.smithi136:> test -z $(ls -A /var/lib/ceph) 2024-06-02T03:42:03.519 DEBUG:teuthology.orchestra.run.smithi162:> test -z $(ls -A /var/lib/ceph) 2024-06-02T03:42:03.550 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-06-02T03:42:03.619 INFO:teuthology.run_tasks:Running task kernel... 2024-06-02T03:42:03.636 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-06-02T03:42:03.636 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-06-02T03:42:03.636 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-06-02T03:42:03.636 DEBUG:teuthology.orchestra.run.smithi123:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-02T03:42:03.655 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T03:42:03.656 DEBUG:teuthology.orchestra.run.smithi123:> uname -r 2024-06-02T03:42:03.719 INFO:teuthology.orchestra.run.smithi123.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-06-02T03:42:03.719 INFO:teuthology.task.kernel:Running kernel on smithi123: 4.18.0-513.9.1.el8_9.x86_64 2024-06-02T03:42:03.719 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum install -y kernel 2024-06-02T03:42:05.285 INFO:teuthology.orchestra.run.smithi123.stdout:Updating Subscription Management repositories. 2024-06-02T03:42:05.285 INFO:teuthology.orchestra.run.smithi123.stdout:Unable to read consumer identity 2024-06-02T03:42:05.556 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T03:42:05.556 INFO:teuthology.orchestra.run.smithi123.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-06-02T03:42:05.556 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T03:42:07.473 INFO:teuthology.orchestra.run.smithi123.stdout:Copr repo for python3-asyncssh owned by ceph 13 kB/s | 3.5 kB 00:00 2024-06-02T03:42:12.899 INFO:teuthology.orchestra.run.smithi123.stdout:Extra Packages for Enterprise Linux 2.5 MB/s | 14 MB 00:05 2024-06-02T03:42:17.090 INFO:teuthology.orchestra.run.smithi123.stdout:lab-extras 248 kB/s | 24 kB 00:00 2024-06-02T03:42:17.851 INFO:teuthology.orchestra.run.smithi123.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2024-06-02T03:42:17.851 INFO:teuthology.orchestra.run.smithi123.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2024-06-02T03:42:17.931 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-06-02T03:42:17.933 INFO:teuthology.orchestra.run.smithi123.stdout:Nothing to do. 2024-06-02T03:42:17.933 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-06-02T03:42:18.082 DEBUG:teuthology.orchestra.run.smithi123:> echo no | sudo yum reinstall kernel || true 2024-06-02T03:42:18.417 INFO:teuthology.orchestra.run.smithi123.stdout:Updating Subscription Management repositories. 2024-06-02T03:42:18.417 INFO:teuthology.orchestra.run.smithi123.stdout:Unable to read consumer identity 2024-06-02T03:42:18.609 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T03:42:18.609 INFO:teuthology.orchestra.run.smithi123.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-06-02T03:42:18.609 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T03:42:18.922 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:00:02 ago on Sun 02 Jun 2024 03:42:16 AM UTC. 2024-06-02T03:42:18.996 INFO:teuthology.orchestra.run.smithi123.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-06-02T03:42:19.004 INFO:teuthology.orchestra.run.smithi123.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-06-02T03:42:19.050 INFO:teuthology.orchestra.run.smithi123.stderr:Error: No packages marked for reinstall. 2024-06-02T03:42:19.103 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum reinstall -y kernel || true 2024-06-02T03:42:19.438 INFO:teuthology.orchestra.run.smithi123.stdout:Updating Subscription Management repositories. 2024-06-02T03:42:19.438 INFO:teuthology.orchestra.run.smithi123.stdout:Unable to read consumer identity 2024-06-02T03:42:19.663 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T03:42:19.664 INFO:teuthology.orchestra.run.smithi123.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-06-02T03:42:19.664 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T03:42:19.970 INFO:teuthology.orchestra.run.smithi123.stdout:Last metadata expiration check: 0:00:03 ago on Sun 02 Jun 2024 03:42:16 AM UTC. 2024-06-02T03:42:20.033 INFO:teuthology.orchestra.run.smithi123.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-06-02T03:42:20.033 INFO:teuthology.orchestra.run.smithi123.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-06-02T03:42:20.073 INFO:teuthology.orchestra.run.smithi123.stderr:Error: No packages marked for reinstall. 2024-06-02T03:42:20.121 DEBUG:teuthology.orchestra.run.smithi123:> rpm -q kernel | sort -rV | head -n 1 2024-06-02T03:42:20.293 INFO:teuthology.orchestra.run.smithi123.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2024-06-02T03:42:20.293 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2024-06-02T03:42:20.293 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-06-02T03:42:20.294 DEBUG:teuthology.parallel:result is None 2024-06-02T03:42:20.294 INFO:teuthology.run_tasks:Running task internal.base... 2024-06-02T03:42:20.303 INFO:teuthology.task.internal:Creating test directory... 2024-06-02T03:42:20.303 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-02T03:42:20.305 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-02T03:42:20.308 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-06-02T03:42:20.329 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-06-02T03:42:20.343 INFO:teuthology.run_tasks:Running task internal.archive... 2024-06-02T03:42:20.358 INFO:teuthology.task.internal:Creating archive directory... 2024-06-02T03:42:20.358 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-02T03:42:20.363 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-02T03:42:20.368 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-06-02T03:42:20.406 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-06-02T03:42:20.418 INFO:teuthology.task.internal:Enabling coredump saving... 2024-06-02T03:42:20.418 DEBUG:teuthology.orchestra.run.smithi136:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-02T03:42:20.456 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T03:42:20.457 DEBUG:teuthology.orchestra.run.smithi162:> test -f /run/.containerenv -o -f /.dockerenv 2024-06-02T03:42:20.475 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T03:42:20.476 DEBUG:teuthology.orchestra.run.smithi123:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-02T03:42:20.478 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-02T03:42:20.499 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-06-02T03:42:20.512 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T03:42:20.533 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T03:42:20.542 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T03:42:20.551 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T03:42:20.573 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T03:42:20.575 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-06-02T03:42:20.576 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-06-02T03:42:20.588 INFO:teuthology.task.internal:Configuring sudo... 2024-06-02T03:42:20.589 DEBUG:teuthology.orchestra.run.smithi123:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-02T03:42:20.591 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-02T03:42:20.593 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-06-02T03:42:20.643 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-06-02T03:42:20.654 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-06-02T03:42:20.655 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-02T03:42:20.657 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-02T03:42:20.663 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-06-02T03:42:20.701 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T03:42:20.753 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T03:42:20.807 DEBUG:teuthology.orchestra.run.smithi123:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T03:42:20.885 DEBUG:teuthology.orchestra.run.smithi123:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T03:42:20.931 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-06-02T03:42:20.932 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-02T03:42:20.997 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T03:42:21.039 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T03:42:21.103 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T03:42:21.182 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T03:42:21.235 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-06-02T03:42:21.235 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-02T03:42:21.304 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T03:42:21.349 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-06-02T03:42:21.407 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T03:42:21.486 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-06-02T03:42:21.538 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T03:42:21.538 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-06-02T03:42:21.607 DEBUG:teuthology.orchestra.run.smithi123:> sudo service rsyslog restart 2024-06-02T03:42:21.610 DEBUG:teuthology.orchestra.run.smithi136:> sudo service rsyslog restart 2024-06-02T03:42:21.612 DEBUG:teuthology.orchestra.run.smithi162:> sudo service rsyslog restart 2024-06-02T03:42:21.663 INFO:teuthology.orchestra.run.smithi123.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T03:42:21.677 INFO:teuthology.orchestra.run.smithi136.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T03:42:21.733 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T03:42:22.103 INFO:teuthology.run_tasks:Running task internal.timer... 2024-06-02T03:42:22.114 INFO:teuthology.task.internal:Starting timer... 2024-06-02T03:42:22.114 INFO:teuthology.run_tasks:Running task pcp... 2024-06-02T03:42:22.131 INFO:teuthology.run_tasks:Running task selinux... 2024-06-02T03:42:22.146 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2024-06-02T03:42:22.147 DEBUG:teuthology.orchestra.run.smithi123:> sudo service auditd rotate 2024-06-02T03:42:22.221 INFO:teuthology.orchestra.run.smithi123.stdout:Rotating logs: 2024-06-02T03:42:22.222 DEBUG:teuthology.orchestra.run.smithi136:> sudo service auditd rotate 2024-06-02T03:42:22.283 INFO:teuthology.orchestra.run.smithi136.stdout:Rotating logs: 2024-06-02T03:42:22.284 DEBUG:teuthology.orchestra.run.smithi162:> sudo service auditd rotate 2024-06-02T03:42:22.339 INFO:teuthology.orchestra.run.smithi162.stdout:Rotating logs: 2024-06-02T03:42:22.340 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-06-02T03:42:22.340 DEBUG:teuthology.orchestra.run.smithi123:> /usr/sbin/getenforce 2024-06-02T03:42:22.377 INFO:teuthology.orchestra.run.smithi123.stdout:Permissive 2024-06-02T03:42:22.377 DEBUG:teuthology.orchestra.run.smithi136:> /usr/sbin/getenforce 2024-06-02T03:42:22.404 INFO:teuthology.orchestra.run.smithi136.stdout:Permissive 2024-06-02T03:42:22.405 DEBUG:teuthology.orchestra.run.smithi162:> /usr/sbin/getenforce 2024-06-02T03:42:22.425 INFO:teuthology.orchestra.run.smithi162.stdout:Permissive 2024-06-02T03:42:22.426 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi123.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi136.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi162.front.sepia.ceph.com': 'permissive'} 2024-06-02T03:42:22.426 DEBUG:teuthology.orchestra.run.smithi123:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-06-02T03:42:22.453 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T03:42:22.453 DEBUG:teuthology.orchestra.run.smithi136:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-06-02T03:42:22.480 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T03:42:22.480 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-06-02T03:42:22.507 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T03:42:22.508 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-06-02T03:42:22.508 DEBUG:teuthology.orchestra.run.smithi123:> sudo /usr/sbin/setenforce permissive 2024-06-02T03:42:22.536 DEBUG:teuthology.orchestra.run.smithi136:> sudo /usr/sbin/setenforce permissive 2024-06-02T03:42:22.580 DEBUG:teuthology.orchestra.run.smithi162:> sudo /usr/sbin/setenforce permissive 2024-06-02T03:42:22.608 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-06-02T03:42:22.618 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-06-02T03:42:22.629 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-06-02T03:42:22.630 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi123.front.sepia.ceph.com,smithi136.front.sepia.ceph.com,smithi162.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-06-02T03:52:44.049 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi123.front.sepia.ceph.com'), Remote(name='ubuntu@smithi136.front.sepia.ceph.com'), Remote(name='ubuntu@smithi162.front.sepia.ceph.com')] 2024-06-02T03:52:44.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-06-02T03:52:44.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi123.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T03:52:44.133 DEBUG:teuthology.orchestra.run.smithi123:> true 2024-06-02T03:52:44.200 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi123.front.sepia.ceph.com' 2024-06-02T03:52:44.201 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-06-02T03:52:44.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T03:52:44.275 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-06-02T03:52:44.345 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-06-02T03:52:44.345 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-06-02T03:52:44.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-06-02T03:52:44.423 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-06-02T03:52:44.498 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-06-02T03:52:44.498 INFO:teuthology.run_tasks:Running task clock... 2024-06-02T03:52:44.511 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-06-02T03:52:44.511 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-02T03:52:44.512 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T03:52:44.514 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-02T03:52:44.515 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T03:52:44.517 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-06-02T03:52:44.517 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T03:52:44.545 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-02T03:52:44.551 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-02T03:52:44.560 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-02T03:52:44.567 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-02T03:52:44.572 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-06-02T03:52:44.588 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-06-02T03:52:44.630 INFO:teuthology.orchestra.run.smithi123.stderr:sudo: ntpd: command not found 2024-06-02T03:52:44.642 INFO:teuthology.orchestra.run.smithi123.stdout:506 Cannot talk to daemon 2024-06-02T03:52:44.647 INFO:teuthology.orchestra.run.smithi136.stderr:sudo: ntpd: command not found 2024-06-02T03:52:44.656 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-02T03:52:44.660 INFO:teuthology.orchestra.run.smithi136.stdout:506 Cannot talk to daemon 2024-06-02T03:52:44.670 INFO:teuthology.orchestra.run.smithi123.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-02T03:52:44.673 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: ntpd: command not found 2024-06-02T03:52:44.675 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-02T03:52:44.686 INFO:teuthology.orchestra.run.smithi162.stdout:506 Cannot talk to daemon 2024-06-02T03:52:44.690 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-02T03:52:44.701 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-06-02T03:52:44.715 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-06-02T03:52:44.755 INFO:teuthology.orchestra.run.smithi123.stderr:bash: ntpq: command not found 2024-06-02T03:52:44.758 INFO:teuthology.orchestra.run.smithi123.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T03:52:44.758 INFO:teuthology.orchestra.run.smithi123.stdout:=============================================================================== 2024-06-02T03:52:44.758 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T03:52:44.758 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T03:52:44.759 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T03:52:44.759 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T03:52:44.767 INFO:teuthology.orchestra.run.smithi136.stderr:bash: ntpq: command not found 2024-06-02T03:52:44.770 INFO:teuthology.orchestra.run.smithi136.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T03:52:44.770 INFO:teuthology.orchestra.run.smithi136.stdout:=============================================================================== 2024-06-02T03:52:44.771 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T03:52:44.771 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T03:52:44.771 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T03:52:44.771 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T03:52:44.791 INFO:teuthology.orchestra.run.smithi162.stderr:bash: ntpq: command not found 2024-06-02T03:52:44.795 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T03:52:44.795 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-06-02T03:52:44.795 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T03:52:44.795 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T03:52:44.795 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T03:52:44.795 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T03:52:44.795 INFO:teuthology.run_tasks:Running task pexec... 2024-06-02T03:52:44.805 INFO:teuthology.task.pexec:Executing custom commands... 2024-06-02T03:52:44.805 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi123.front.sepia.ceph.com 2024-06-02T03:52:44.806 DEBUG:teuthology.orchestra.run.smithi123:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-06-02T03:52:44.806 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi136.front.sepia.ceph.com 2024-06-02T03:52:44.806 DEBUG:teuthology.orchestra.run.smithi136:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-06-02T03:52:44.806 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi162.front.sepia.ceph.com 2024-06-02T03:52:44.807 DEBUG:teuthology.orchestra.run.smithi162:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-06-02T03:52:45.180 INFO:teuthology.orchestra.run.smithi123.stdout:Updating Subscription Management repositories. 2024-06-02T03:52:45.188 INFO:teuthology.orchestra.run.smithi136.stdout:Updating Subscription Management repositories. 2024-06-02T03:52:45.215 INFO:teuthology.orchestra.run.smithi162.stdout:Updating Subscription Management repositories. 2024-06-02T03:52:47.318 INFO:teuthology.orchestra.run.smithi123.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 39 kB/s | 4.5 kB 00:00 2024-06-02T03:52:47.452 INFO:teuthology.orchestra.run.smithi162.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 31 kB/s | 4.1 kB 00:00 2024-06-02T03:52:47.567 INFO:teuthology.orchestra.run.smithi136.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 38 kB/s | 4.1 kB 00:00 2024-06-02T03:52:47.804 INFO:teuthology.orchestra.run.smithi162.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 32 kB/s | 4.5 kB 00:00 2024-06-02T03:52:47.927 INFO:teuthology.orchestra.run.smithi136.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 32 kB/s | 4.5 kB 00:00 2024-06-02T03:52:47.933 INFO:teuthology.orchestra.run.smithi123.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 35 kB/s | 4.1 kB 00:00 2024-06-02T03:52:50.819 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-06-02T03:52:50.820 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-06-02T03:52:50.820 INFO:teuthology.orchestra.run.smithi123.stdout: Package Architecture Version Repository Size 2024-06-02T03:52:50.821 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-06-02T03:52:50.821 INFO:teuthology.orchestra.run.smithi123.stdout:Resetting modules: 2024-06-02T03:52:50.821 INFO:teuthology.orchestra.run.smithi123.stdout: container-tools 2024-06-02T03:52:50.821 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T03:52:50.821 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-06-02T03:52:50.821 INFO:teuthology.orchestra.run.smithi123.stdout:================================================================================ 2024-06-02T03:52:50.821 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T03:52:50.869 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-06-02T03:52:50.870 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-06-02T03:52:50.870 INFO:teuthology.orchestra.run.smithi136.stdout: Package Architecture Version Repository Size 2024-06-02T03:52:50.870 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-06-02T03:52:50.870 INFO:teuthology.orchestra.run.smithi136.stdout:Resetting modules: 2024-06-02T03:52:50.871 INFO:teuthology.orchestra.run.smithi136.stdout: container-tools 2024-06-02T03:52:50.871 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-06-02T03:52:50.871 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-06-02T03:52:50.871 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-06-02T03:52:50.871 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-06-02T03:52:50.918 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-06-02T03:52:50.919 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-06-02T03:52:50.919 INFO:teuthology.orchestra.run.smithi162.stdout: Package Architecture Version Repository Size 2024-06-02T03:52:50.919 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-06-02T03:52:50.919 INFO:teuthology.orchestra.run.smithi162.stdout:Resetting modules: 2024-06-02T03:52:50.919 INFO:teuthology.orchestra.run.smithi162.stdout: container-tools 2024-06-02T03:52:50.919 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T03:52:50.920 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-06-02T03:52:50.920 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-06-02T03:52:50.920 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T03:53:05.000 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-06-02T03:53:05.463 INFO:teuthology.orchestra.run.smithi123.stdout:Updating Subscription Management repositories. 2024-06-02T03:53:05.847 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-06-02T03:53:05.911 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-06-02T03:53:06.302 INFO:teuthology.orchestra.run.smithi136.stdout:Updating Subscription Management repositories. 2024-06-02T03:53:06.384 INFO:teuthology.orchestra.run.smithi162.stdout:Updating Subscription Management repositories. 2024-06-02T03:53:07.324 INFO:teuthology.orchestra.run.smithi123.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 31 kB/s | 4.5 kB 00:00 2024-06-02T03:53:07.968 INFO:teuthology.orchestra.run.smithi123.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 24 kB/s | 4.1 kB 00:00 2024-06-02T03:53:08.115 INFO:teuthology.orchestra.run.smithi136.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 29 kB/s | 4.1 kB 00:00 2024-06-02T03:53:08.233 INFO:teuthology.orchestra.run.smithi162.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 27 kB/s | 4.1 kB 00:00 2024-06-02T03:53:08.443 INFO:teuthology.orchestra.run.smithi136.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 38 kB/s | 4.5 kB 00:00 2024-06-02T03:53:08.573 INFO:teuthology.orchestra.run.smithi162.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 35 kB/s | 4.5 kB 00:00 2024-06-02T03:53:10.802 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-06-02T03:53:10.973 INFO:teuthology.orchestra.run.smithi123.stdout:========================================================================================================== 2024-06-02T03:53:10.973 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2024-06-02T03:53:10.973 INFO:teuthology.orchestra.run.smithi123.stdout:========================================================================================================== 2024-06-02T03:53:10.973 INFO:teuthology.orchestra.run.smithi123.stdout:Installing group/module packages: 2024-06-02T03:53:10.973 INFO:teuthology.orchestra.run.smithi123.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 1.0 M 2024-06-02T03:53:10.973 INFO:teuthology.orchestra.run.smithi123.stdout: buildah x86_64 1:1.31.5-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.8 M 2024-06-02T03:53:10.973 INFO:teuthology.orchestra.run.smithi123.stdout: cockpit-podman noarch 75-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 739 k 2024-06-02T03:53:10.973 INFO:teuthology.orchestra.run.smithi123.stdout: crun x86_64 1.8.7-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 239 k 2024-06-02T03:53:10.973 INFO:teuthology.orchestra.run.smithi123.stdout: netavark x86_64 2:1.7.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-06-02T03:53:10.973 INFO:teuthology.orchestra.run.smithi123.stdout: python3-podman noarch 4.6.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 154 k 2024-06-02T03:53:10.974 INFO:teuthology.orchestra.run.smithi123.stdout: skopeo x86_64 2:1.13.3-3.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.1 M 2024-06-02T03:53:10.974 INFO:teuthology.orchestra.run.smithi123.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 2.5 M 2024-06-02T03:53:10.974 INFO:teuthology.orchestra.run.smithi123.stdout: udica noarch 0.2.6-20.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 49 k 2024-06-02T03:53:10.974 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2024-06-02T03:53:10.974 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2024-06-02T03:53:10.974 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2024-06-02T03:53:10.974 INFO:teuthology.orchestra.run.smithi123.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2024-06-02T03:53:10.974 INFO:teuthology.orchestra.run.smithi123.stdout:Installing weak dependencies: 2024-06-02T03:53:10.974 INFO:teuthology.orchestra.run.smithi123.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2024-06-02T03:53:10.974 INFO:teuthology.orchestra.run.smithi123.stdout:Installing module profiles: 2024-06-02T03:53:10.974 INFO:teuthology.orchestra.run.smithi123.stdout: container-tools/common 2024-06-02T03:53:10.974 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T03:53:10.974 INFO:teuthology.orchestra.run.smithi123.stdout:Enabling module streams: 2024-06-02T03:53:10.975 INFO:teuthology.orchestra.run.smithi123.stdout: container-tools rhel8 2024-06-02T03:53:10.975 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T03:53:10.975 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-06-02T03:53:10.975 INFO:teuthology.orchestra.run.smithi123.stdout:========================================================================================================== 2024-06-02T03:53:10.975 INFO:teuthology.orchestra.run.smithi123.stdout:Install 13 Packages 2024-06-02T03:53:10.975 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T03:53:10.975 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 26 M 2024-06-02T03:53:10.976 INFO:teuthology.orchestra.run.smithi123.stdout:Installed size: 87 M 2024-06-02T03:53:10.976 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-06-02T03:53:11.134 INFO:teuthology.orchestra.run.smithi123.stdout:(1/13): python3-pyxdg-0.25-16.el8.noarch.rpm 594 kB/s | 94 kB 00:00 2024-06-02T03:53:11.160 INFO:teuthology.orchestra.run.smithi123.stdout:(2/13): criu-libs-3.18-4.module+el8.9.0+20326+3 214 kB/s | 39 kB 00:00 2024-06-02T03:53:11.185 INFO:teuthology.orchestra.run.smithi123.stdout:(3/13): python3-pytoml-0.1.14-5.git7dea353.el8. 119 kB/s | 25 kB 00:00 2024-06-02T03:53:11.252 INFO:teuthology.orchestra.run.smithi123.stdout:(4/13): yajl-2.1.0-12.el8.x86_64.rpm 348 kB/s | 41 kB 00:00 2024-06-02T03:53:11.387 INFO:teuthology.orchestra.run.smithi123.stdout:(5/13): aardvark-dns-1.7.0-1.module+el8.9.0+216 4.4 MB/s | 1.0 MB 00:00 2024-06-02T03:53:11.427 INFO:teuthology.orchestra.run.smithi123.stdout:(6/13): cockpit-podman-75-1.module+el8.9.0+2169 4.1 MB/s | 739 kB 00:00 2024-06-02T03:53:11.519 INFO:teuthology.orchestra.run.smithi123.stdout:(7/13): buildah-1.31.5-1.module+el8.9.0+21697+6 26 MB/s | 8.8 MB 00:00 2024-06-02T03:53:11.544 INFO:teuthology.orchestra.run.smithi123.stdout:(8/13): crun-1.8.7-1.module+el8.9.0+21697+6a5e9 1.5 MB/s | 239 kB 00:00 2024-06-02T03:53:11.553 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-06-02T03:53:11.661 INFO:teuthology.orchestra.run.smithi123.stdout:(9/13): netavark-1.7.0-2.module+el8.9.0+21697+6 16 MB/s | 3.7 MB 00:00 2024-06-02T03:53:11.685 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-06-02T03:53:11.686 INFO:teuthology.orchestra.run.smithi123.stdout:(10/13): python3-podman-4.6.0-2.module+el8.9.0+ 920 kB/s | 154 kB 00:00 2024-06-02T03:53:11.720 INFO:teuthology.orchestra.run.smithi136.stdout:========================================================================================================== 2024-06-02T03:53:11.720 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2024-06-02T03:53:11.720 INFO:teuthology.orchestra.run.smithi136.stdout:========================================================================================================== 2024-06-02T03:53:11.720 INFO:teuthology.orchestra.run.smithi136.stdout:Installing group/module packages: 2024-06-02T03:53:11.720 INFO:teuthology.orchestra.run.smithi136.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 1.0 M 2024-06-02T03:53:11.720 INFO:teuthology.orchestra.run.smithi136.stdout: buildah x86_64 1:1.31.5-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.8 M 2024-06-02T03:53:11.720 INFO:teuthology.orchestra.run.smithi136.stdout: cockpit-podman noarch 75-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 739 k 2024-06-02T03:53:11.720 INFO:teuthology.orchestra.run.smithi136.stdout: crun x86_64 1.8.7-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 239 k 2024-06-02T03:53:11.720 INFO:teuthology.orchestra.run.smithi136.stdout: netavark x86_64 2:1.7.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-06-02T03:53:11.721 INFO:teuthology.orchestra.run.smithi136.stdout: python3-podman noarch 4.6.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 154 k 2024-06-02T03:53:11.721 INFO:teuthology.orchestra.run.smithi136.stdout: skopeo x86_64 2:1.13.3-3.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.1 M 2024-06-02T03:53:11.721 INFO:teuthology.orchestra.run.smithi136.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 2.5 M 2024-06-02T03:53:11.721 INFO:teuthology.orchestra.run.smithi136.stdout: udica noarch 0.2.6-20.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 49 k 2024-06-02T03:53:11.721 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-06-02T03:53:11.721 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2024-06-02T03:53:11.721 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2024-06-02T03:53:11.721 INFO:teuthology.orchestra.run.smithi136.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2024-06-02T03:53:11.721 INFO:teuthology.orchestra.run.smithi136.stdout:Installing weak dependencies: 2024-06-02T03:53:11.721 INFO:teuthology.orchestra.run.smithi136.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2024-06-02T03:53:11.721 INFO:teuthology.orchestra.run.smithi136.stdout:Installing module profiles: 2024-06-02T03:53:11.721 INFO:teuthology.orchestra.run.smithi136.stdout: container-tools/common 2024-06-02T03:53:11.721 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-06-02T03:53:11.722 INFO:teuthology.orchestra.run.smithi136.stdout:Enabling module streams: 2024-06-02T03:53:11.722 INFO:teuthology.orchestra.run.smithi136.stdout: container-tools rhel8 2024-06-02T03:53:11.722 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-06-02T03:53:11.722 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-06-02T03:53:11.722 INFO:teuthology.orchestra.run.smithi136.stdout:========================================================================================================== 2024-06-02T03:53:11.722 INFO:teuthology.orchestra.run.smithi136.stdout:Install 13 Packages 2024-06-02T03:53:11.722 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-06-02T03:53:11.723 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 26 M 2024-06-02T03:53:11.723 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 87 M 2024-06-02T03:53:11.723 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-06-02T03:53:11.853 INFO:teuthology.orchestra.run.smithi162.stdout:========================================================================================================== 2024-06-02T03:53:11.853 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-06-02T03:53:11.853 INFO:teuthology.orchestra.run.smithi162.stdout:========================================================================================================== 2024-06-02T03:53:11.853 INFO:teuthology.orchestra.run.smithi162.stdout:Installing group/module packages: 2024-06-02T03:53:11.853 INFO:teuthology.orchestra.run.smithi162.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 1.0 M 2024-06-02T03:53:11.853 INFO:teuthology.orchestra.run.smithi162.stdout: buildah x86_64 1:1.31.5-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.8 M 2024-06-02T03:53:11.853 INFO:teuthology.orchestra.run.smithi162.stdout: cockpit-podman noarch 75-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 739 k 2024-06-02T03:53:11.854 INFO:teuthology.orchestra.run.smithi162.stdout: crun x86_64 1.8.7-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 239 k 2024-06-02T03:53:11.854 INFO:teuthology.orchestra.run.smithi162.stdout: netavark x86_64 2:1.7.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-06-02T03:53:11.854 INFO:teuthology.orchestra.run.smithi162.stdout: python3-podman noarch 4.6.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 154 k 2024-06-02T03:53:11.854 INFO:teuthology.orchestra.run.smithi162.stdout: skopeo x86_64 2:1.13.3-3.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.1 M 2024-06-02T03:53:11.854 INFO:teuthology.orchestra.run.smithi162.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 2.5 M 2024-06-02T03:53:11.854 INFO:teuthology.orchestra.run.smithi162.stdout: udica noarch 0.2.6-20.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 49 k 2024-06-02T03:53:11.854 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-06-02T03:53:11.854 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2024-06-02T03:53:11.855 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2024-06-02T03:53:11.855 INFO:teuthology.orchestra.run.smithi162.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2024-06-02T03:53:11.855 INFO:teuthology.orchestra.run.smithi162.stdout:Installing weak dependencies: 2024-06-02T03:53:11.855 INFO:teuthology.orchestra.run.smithi162.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2024-06-02T03:53:11.855 INFO:teuthology.orchestra.run.smithi162.stdout:Installing module profiles: 2024-06-02T03:53:11.855 INFO:teuthology.orchestra.run.smithi162.stdout: container-tools/common 2024-06-02T03:53:11.855 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T03:53:11.855 INFO:teuthology.orchestra.run.smithi162.stdout:Enabling module streams: 2024-06-02T03:53:11.855 INFO:teuthology.orchestra.run.smithi162.stdout: container-tools rhel8 2024-06-02T03:53:11.855 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T03:53:11.855 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-06-02T03:53:11.855 INFO:teuthology.orchestra.run.smithi162.stdout:========================================================================================================== 2024-06-02T03:53:11.855 INFO:teuthology.orchestra.run.smithi162.stdout:Install 13 Packages 2024-06-02T03:53:11.855 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T03:53:11.856 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 26 M 2024-06-02T03:53:11.856 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 87 M 2024-06-02T03:53:11.856 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-06-02T03:53:11.865 INFO:teuthology.orchestra.run.smithi136.stdout:(1/13): python3-pyxdg-0.25-16.el8.noarch.rpm 658 kB/s | 94 kB 00:00 2024-06-02T03:53:11.878 INFO:teuthology.orchestra.run.smithi123.stdout:(11/13): skopeo-1.13.3-3.module+el8.9.0+21697+6 24 MB/s | 8.1 MB 00:00 2024-06-02T03:53:11.883 INFO:teuthology.orchestra.run.smithi136.stdout:(2/13): python3-pytoml-0.1.14-5.git7dea353.el8. 155 kB/s | 25 kB 00:00 2024-06-02T03:53:11.895 INFO:teuthology.orchestra.run.smithi123.stdout:(12/13): udica-0.2.6-20.module+el8.9.0+21697+6a 237 kB/s | 49 kB 00:00 2024-06-02T03:53:11.899 INFO:teuthology.orchestra.run.smithi136.stdout:(3/13): criu-libs-3.18-4.module+el8.9.0+20326+3 223 kB/s | 39 kB 00:00 2024-06-02T03:53:11.954 INFO:teuthology.orchestra.run.smithi123.stdout:(13/13): toolbox-0.0.99.4-5.module+el8.9.0+2169 8.7 MB/s | 2.5 MB 00:00 2024-06-02T03:53:11.954 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-06-02T03:53:11.955 INFO:teuthology.orchestra.run.smithi123.stdout:Total 26 MB/s | 26 MB 00:00 2024-06-02T03:53:12.026 INFO:teuthology.orchestra.run.smithi162.stdout:(1/13): python3-pytoml-0.1.14-5.git7dea353.el8. 146 kB/s | 25 kB 00:00 2024-06-02T03:53:12.041 INFO:teuthology.orchestra.run.smithi136.stdout:(4/13): yajl-2.1.0-12.el8.x86_64.rpm 233 kB/s | 41 kB 00:00 2024-06-02T03:53:12.052 INFO:teuthology.orchestra.run.smithi162.stdout:(2/13): python3-pyxdg-0.25-16.el8.noarch.rpm 480 kB/s | 94 kB 00:00 2024-06-02T03:53:12.100 INFO:teuthology.orchestra.run.smithi162.stdout:(3/13): criu-libs-3.18-4.module+el8.9.0+20326+3 161 kB/s | 39 kB 00:00 2024-06-02T03:53:12.150 INFO:teuthology.orchestra.run.smithi136.stdout:(5/13): aardvark-dns-1.7.0-1.module+el8.9.0+216 3.8 MB/s | 1.0 MB 00:00 2024-06-02T03:53:12.160 INFO:teuthology.orchestra.run.smithi162.stdout:(4/13): yajl-2.1.0-12.el8.x86_64.rpm 306 kB/s | 41 kB 00:00 2024-06-02T03:53:12.200 INFO:teuthology.orchestra.run.smithi136.stdout:(6/13): cockpit-podman-75-1.module+el8.9.0+2169 4.6 MB/s | 739 kB 00:00 2024-06-02T03:53:12.202 INFO:teuthology.orchestra.run.smithi162.stdout:(5/13): aardvark-dns-1.7.0-1.module+el8.9.0+216 6.7 MB/s | 1.0 MB 00:00 2024-06-02T03:53:12.234 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-06-02T03:53:12.255 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-06-02T03:53:12.256 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-06-02T03:53:12.300 INFO:teuthology.orchestra.run.smithi136.stdout:(7/13): buildah-1.31.5-1.module+el8.9.0+21697+6 22 MB/s | 8.8 MB 00:00 2024-06-02T03:53:12.302 INFO:teuthology.orchestra.run.smithi162.stdout:(6/13): cockpit-podman-75-1.module+el8.9.0+2169 5.1 MB/s | 739 kB 00:00 2024-06-02T03:53:12.326 INFO:teuthology.orchestra.run.smithi136.stdout:(8/13): crun-1.8.7-1.module+el8.9.0+21697+6a5e9 1.3 MB/s | 239 kB 00:00 2024-06-02T03:53:12.328 INFO:teuthology.orchestra.run.smithi162.stdout:(7/13): crun-1.8.7-1.module+el8.9.0+21697+6a5e9 1.9 MB/s | 239 kB 00:00 2024-06-02T03:53:12.410 INFO:teuthology.orchestra.run.smithi136.stdout:(9/13): netavark-1.7.0-2.module+el8.9.0+21697+6 18 MB/s | 3.7 MB 00:00 2024-06-02T03:53:12.437 INFO:teuthology.orchestra.run.smithi162.stdout:(8/13): buildah-1.31.5-1.module+el8.9.0+21697+6 26 MB/s | 8.8 MB 00:00 2024-06-02T03:53:12.460 INFO:teuthology.orchestra.run.smithi136.stdout:(10/13): python3-podman-4.6.0-2.module+el8.9.0+ 968 kB/s | 154 kB 00:00 2024-06-02T03:53:12.462 INFO:teuthology.orchestra.run.smithi162.stdout:(9/13): python3-podman-4.6.0-2.module+el8.9.0+2 1.1 MB/s | 154 kB 00:00 2024-06-02T03:53:12.485 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-06-02T03:53:12.494 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-06-02T03:53:12.568 INFO:teuthology.orchestra.run.smithi136.stdout:(11/13): toolbox-0.0.99.4-5.module+el8.9.0+2169 16 MB/s | 2.5 MB 00:00 2024-06-02T03:53:12.579 INFO:teuthology.orchestra.run.smithi162.stdout:(10/13): netavark-1.7.0-2.module+el8.9.0+21697+ 13 MB/s | 3.7 MB 00:00 2024-06-02T03:53:12.610 INFO:teuthology.orchestra.run.smithi136.stdout:(12/13): udica-0.2.6-20.module+el8.9.0+21697+6a 329 kB/s | 49 kB 00:00 2024-06-02T03:53:12.654 INFO:teuthology.orchestra.run.smithi162.stdout:(11/13): toolbox-0.0.99.4-5.module+el8.9.0+2169 13 MB/s | 2.5 MB 00:00 2024-06-02T03:53:12.702 INFO:teuthology.orchestra.run.smithi136.stdout:(13/13): skopeo-1.13.3-3.module+el8.9.0+21697+6 22 MB/s | 8.1 MB 00:00 2024-06-02T03:53:12.702 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-06-02T03:53:12.702 INFO:teuthology.orchestra.run.smithi136.stdout:Total 26 MB/s | 26 MB 00:00 2024-06-02T03:53:12.796 INFO:teuthology.orchestra.run.smithi162.stdout:(12/13): skopeo-1.13.3-3.module+el8.9.0+21697+6 23 MB/s | 8.1 MB 00:00 2024-06-02T03:53:12.821 INFO:teuthology.orchestra.run.smithi162.stdout:(13/13): udica-0.2.6-20.module+el8.9.0+21697+6a 204 kB/s | 49 kB 00:00 2024-06-02T03:53:12.822 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-06-02T03:53:12.822 INFO:teuthology.orchestra.run.smithi162.stdout:Total 26 MB/s | 26 MB 00:00 2024-06-02T03:53:12.979 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-06-02T03:53:13.000 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-06-02T03:53:13.000 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-06-02T03:53:13.102 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-06-02T03:53:13.124 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-06-02T03:53:13.124 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-06-02T03:53:13.229 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-06-02T03:53:13.238 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-06-02T03:53:13.273 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-06-02T03:53:13.353 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-06-02T03:53:13.361 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-06-02T03:53:13.814 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 1/13 2024-06-02T03:53:13.992 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-06-02T03:53:14.045 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 2/13 2024-06-02T03:53:14.105 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-06-02T03:53:14.230 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : yajl-2.1.0-12.el8.x86_64 3/13 2024-06-02T03:53:14.423 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 4/13 2024-06-02T03:53:14.512 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 1/13 2024-06-02T03:53:14.635 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2024-06-02T03:53:14.635 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 1/13 2024-06-02T03:53:14.739 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 2/13 2024-06-02T03:53:14.844 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 2/13 2024-06-02T03:53:14.877 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : yajl-2.1.0-12.el8.x86_64 3/13 2024-06-02T03:53:14.894 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2024-06-02T03:53:15.006 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : yajl-2.1.0-12.el8.x86_64 3/13 2024-06-02T03:53:15.063 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 4/13 2024-06-02T03:53:15.163 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 7/13 2024-06-02T03:53:15.200 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 4/13 2024-06-02T03:53:15.224 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2024-06-02T03:53:15.370 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2024-06-02T03:53:15.461 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2024-06-02T03:53:15.580 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2024-06-02T03:53:15.685 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 7/13 2024-06-02T03:53:15.807 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 7/13 2024-06-02T03:53:16.083 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-06-02T03:53:16.351 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-06-02T03:53:16.570 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-06-02T03:53:16.687 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-06-02T03:53:16.763 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 10/13 2024-06-02T03:53:16.869 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-06-02T03:53:16.933 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-06-02T03:53:17.294 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 10/13 2024-06-02T03:53:17.299 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 10/13 2024-06-02T03:53:17.696 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 11/13 2024-06-02T03:53:18.008 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 12/13 2024-06-02T03:53:18.176 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 11/13 2024-06-02T03:53:18.193 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 11/13 2024-06-02T03:53:18.216 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-06-02T03:53:18.393 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 12/13 2024-06-02T03:53:18.422 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 12/13 2024-06-02T03:53:18.543 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-06-02T03:53:18.631 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-06-02T03:53:18.631 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2024-06-02T03:53:18.631 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2024-06-02T03:53:18.632 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 3/13 2024-06-02T03:53:18.632 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 4/13 2024-06-02T03:53:18.632 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 5/13 2024-06-02T03:53:18.632 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 6/13 2024-06-02T03:53:18.632 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 7/13 2024-06-02T03:53:18.632 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-06-02T03:53:18.632 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-06-02T03:53:18.632 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 10/13 2024-06-02T03:53:18.632 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 11/13 2024-06-02T03:53:18.632 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 12/13 2024-06-02T03:53:18.638 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-06-02T03:53:18.978 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-06-02T03:53:18.978 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2024-06-02T03:53:18.978 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2024-06-02T03:53:18.978 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 3/13 2024-06-02T03:53:18.978 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 4/13 2024-06-02T03:53:18.978 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 5/13 2024-06-02T03:53:18.978 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 6/13 2024-06-02T03:53:18.978 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 7/13 2024-06-02T03:53:18.978 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-06-02T03:53:18.979 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-06-02T03:53:18.979 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 10/13 2024-06-02T03:53:18.979 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 11/13 2024-06-02T03:53:18.979 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 12/13 2024-06-02T03:53:19.049 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-06-02T03:53:19.049 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2024-06-02T03:53:19.049 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2024-06-02T03:53:19.049 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 3/13 2024-06-02T03:53:19.049 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 4/13 2024-06-02T03:53:19.049 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 5/13 2024-06-02T03:53:19.050 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 6/13 2024-06-02T03:53:19.050 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 7/13 2024-06-02T03:53:19.050 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-06-02T03:53:19.050 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-06-02T03:53:19.050 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 10/13 2024-06-02T03:53:19.050 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 11/13 2024-06-02T03:53:19.050 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 12/13 2024-06-02T03:53:29.355 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 13/13 2024-06-02T03:53:29.355 INFO:teuthology.orchestra.run.smithi162.stdout:Installed products updated. 2024-06-02T03:53:29.933 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T03:53:29.933 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-06-02T03:53:29.933 INFO:teuthology.orchestra.run.smithi162.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T03:53:29.933 INFO:teuthology.orchestra.run.smithi162.stdout: buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T03:53:29.933 INFO:teuthology.orchestra.run.smithi162.stdout: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7.noarch 2024-06-02T03:53:29.933 INFO:teuthology.orchestra.run.smithi162.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2024-06-02T03:53:29.933 INFO:teuthology.orchestra.run.smithi162.stdout: crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T03:53:29.934 INFO:teuthology.orchestra.run.smithi162.stdout: netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T03:53:29.934 INFO:teuthology.orchestra.run.smithi162.stdout: python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98e7.noarch 2024-06-02T03:53:29.934 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-06-02T03:53:29.934 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-06-02T03:53:29.934 INFO:teuthology.orchestra.run.smithi162.stdout: skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T03:53:29.934 INFO:teuthology.orchestra.run.smithi162.stdout: toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T03:53:29.934 INFO:teuthology.orchestra.run.smithi162.stdout: udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarch 2024-06-02T03:53:29.934 INFO:teuthology.orchestra.run.smithi162.stdout: yajl-2.1.0-12.el8.x86_64 2024-06-02T03:53:29.934 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T03:53:29.934 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-06-02T03:53:30.112 DEBUG:teuthology.parallel:result is None 2024-06-02T03:53:31.472 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 13/13 2024-06-02T03:53:31.472 INFO:teuthology.orchestra.run.smithi123.stdout:Installed products updated. 2024-06-02T03:53:31.791 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 13/13 2024-06-02T03:53:31.791 INFO:teuthology.orchestra.run.smithi136.stdout:Installed products updated. 2024-06-02T03:53:32.103 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T03:53:32.103 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-06-02T03:53:32.103 INFO:teuthology.orchestra.run.smithi123.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T03:53:32.103 INFO:teuthology.orchestra.run.smithi123.stdout: buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T03:53:32.103 INFO:teuthology.orchestra.run.smithi123.stdout: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7.noarch 2024-06-02T03:53:32.103 INFO:teuthology.orchestra.run.smithi123.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2024-06-02T03:53:32.104 INFO:teuthology.orchestra.run.smithi123.stdout: crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T03:53:32.104 INFO:teuthology.orchestra.run.smithi123.stdout: netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T03:53:32.104 INFO:teuthology.orchestra.run.smithi123.stdout: python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98e7.noarch 2024-06-02T03:53:32.104 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-06-02T03:53:32.104 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-06-02T03:53:32.104 INFO:teuthology.orchestra.run.smithi123.stdout: skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T03:53:32.104 INFO:teuthology.orchestra.run.smithi123.stdout: toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T03:53:32.104 INFO:teuthology.orchestra.run.smithi123.stdout: udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarch 2024-06-02T03:53:32.104 INFO:teuthology.orchestra.run.smithi123.stdout: yajl-2.1.0-12.el8.x86_64 2024-06-02T03:53:32.104 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T03:53:32.104 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-06-02T03:53:32.314 DEBUG:teuthology.parallel:result is None 2024-06-02T03:53:32.402 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-06-02T03:53:32.402 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-06-02T03:53:32.402 INFO:teuthology.orchestra.run.smithi136.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T03:53:32.402 INFO:teuthology.orchestra.run.smithi136.stdout: buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T03:53:32.402 INFO:teuthology.orchestra.run.smithi136.stdout: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7.noarch 2024-06-02T03:53:32.403 INFO:teuthology.orchestra.run.smithi136.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2024-06-02T03:53:32.403 INFO:teuthology.orchestra.run.smithi136.stdout: crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T03:53:32.403 INFO:teuthology.orchestra.run.smithi136.stdout: netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T03:53:32.403 INFO:teuthology.orchestra.run.smithi136.stdout: python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98e7.noarch 2024-06-02T03:53:32.403 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-06-02T03:53:32.403 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-06-02T03:53:32.403 INFO:teuthology.orchestra.run.smithi136.stdout: skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T03:53:32.403 INFO:teuthology.orchestra.run.smithi136.stdout: toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x86_64 2024-06-02T03:53:32.403 INFO:teuthology.orchestra.run.smithi136.stdout: udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarch 2024-06-02T03:53:32.404 INFO:teuthology.orchestra.run.smithi136.stdout: yajl-2.1.0-12.el8.x86_64 2024-06-02T03:53:32.404 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-06-02T03:53:32.404 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-06-02T03:53:32.570 DEBUG:teuthology.parallel:result is None 2024-06-02T03:53:32.570 INFO:teuthology.run_tasks:Running task install... 2024-06-02T03:53:32.579 DEBUG:teuthology.task.install:project ceph 2024-06-02T03:53:32.579 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3bb45379356e8aa965152e0b8c663715c5df9bda'}} 2024-06-02T03:53:32.580 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3bb45379356e8aa965152e0b8c663715c5df9bda'} 2024-06-02T03:53:32.580 INFO:teuthology.task.install:Using flavor: default 2024-06-02T03:53:32.586 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-06-02T03:53:32.586 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-06-02T03:53:32.586 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3bb45379356e8aa965152e0b8c663715c5df9bda', 'tag': None, 'wait_for_package': False} 2024-06-02T03:53:32.587 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3bb45379356e8aa965152e0b8c663715c5df9bda 2024-06-02T03:53:32.589 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3bb45379356e8aa965152e0b8c663715c5df9bda', 'tag': None, 'wait_for_package': False} 2024-06-02T03:53:32.589 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3bb45379356e8aa965152e0b8c663715c5df9bda 2024-06-02T03:53:32.590 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3bb45379356e8aa965152e0b8c663715c5df9bda', 'tag': None, 'wait_for_package': False} 2024-06-02T03:53:32.590 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3bb45379356e8aa965152e0b8c663715c5df9bda 2024-06-02T03:53:32.744 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/flavors/default/ 2024-06-02T03:53:32.744 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1381.g3bb45379 2024-06-02T03:53:32.818 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/flavors/default/ 2024-06-02T03:53:32.818 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1381.g3bb45379 2024-06-02T03:53:32.825 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/flavors/default/ 2024-06-02T03:53:32.826 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1381.g3bb45379 2024-06-02T03:53:32.929 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-02T03:53:32.930 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T03:53:32.930 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-02T03:53:32.964 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-02T03:53:32.965 DEBUG:teuthology.orchestra.run.smithi162:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3bb45379356e8aa965152e0b8c663715c5df9bda/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-02T03:53:33.002 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-02T03:53:33.002 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-06-02T03:53:33.002 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-02T03:53:33.008 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-06-02T03:53:33.008 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-06-02T03:53:33.008 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-06-02T03:53:33.033 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-02T03:53:33.034 DEBUG:teuthology.orchestra.run.smithi123:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3bb45379356e8aa965152e0b8c663715c5df9bda/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-02T03:53:33.038 DEBUG:teuthology.orchestra.run.smithi162:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-02T03:53:33.038 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-06-02T03:53:33.039 DEBUG:teuthology.orchestra.run.smithi136:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3bb45379356e8aa965152e0b8c663715c5df9bda/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-06-02T03:53:33.103 DEBUG:teuthology.orchestra.run.smithi123:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-02T03:53:33.107 DEBUG:teuthology.orchestra.run.smithi136:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-06-02T03:53:33.119 DEBUG:teuthology.orchestra.run.smithi162:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-02T03:53:33.183 DEBUG:teuthology.orchestra.run.smithi123:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-02T03:53:33.185 DEBUG:teuthology.orchestra.run.smithi136:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-06-02T03:53:33.187 INFO:teuthology.orchestra.run.smithi162.stdout:check_obsoletes = 1 2024-06-02T03:53:33.189 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum clean all 2024-06-02T03:53:33.249 INFO:teuthology.orchestra.run.smithi123.stdout:check_obsoletes = 1 2024-06-02T03:53:33.251 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum clean all 2024-06-02T03:53:33.251 INFO:teuthology.orchestra.run.smithi136.stdout:check_obsoletes = 1 2024-06-02T03:53:33.253 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum clean all 2024-06-02T03:53:33.567 INFO:teuthology.orchestra.run.smithi162.stdout:Updating Subscription Management repositories. 2024-06-02T03:53:33.626 INFO:teuthology.orchestra.run.smithi123.stdout:Updating Subscription Management repositories. 2024-06-02T03:53:33.630 INFO:teuthology.orchestra.run.smithi136.stdout:Updating Subscription Management repositories. 2024-06-02T03:53:35.137 INFO:teuthology.orchestra.run.smithi123.stdout:47 files removed 2024-06-02T03:53:35.139 INFO:teuthology.orchestra.run.smithi162.stdout:47 files removed 2024-06-02T03:53:35.188 DEBUG:teuthology.orchestra.run.smithi123:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-02T03:53:35.192 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-02T03:53:35.236 INFO:teuthology.orchestra.run.smithi136.stdout:47 files removed 2024-06-02T03:53:35.290 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-06-02T03:53:35.523 INFO:teuthology.orchestra.run.smithi123.stdout:Updating Subscription Management repositories. 2024-06-02T03:53:35.532 INFO:teuthology.orchestra.run.smithi162.stdout:Updating Subscription Management repositories. 2024-06-02T03:53:35.628 INFO:teuthology.orchestra.run.smithi136.stdout:Updating Subscription Management repositories. 2024-06-02T03:53:37.386 INFO:teuthology.orchestra.run.smithi162.stdout:ceph packages for x86_64 256 kB/s | 80 kB 00:00 2024-06-02T03:53:37.425 INFO:teuthology.orchestra.run.smithi123.stdout:ceph packages for x86_64 212 kB/s | 80 kB 00:00 2024-06-02T03:53:37.488 INFO:teuthology.orchestra.run.smithi136.stdout:ceph packages for x86_64 199 kB/s | 80 kB 00:00 2024-06-02T03:53:37.768 INFO:teuthology.orchestra.run.smithi123.stdout:ceph noarch packages 37 kB/s | 11 kB 00:00 2024-06-02T03:53:37.770 INFO:teuthology.orchestra.run.smithi162.stdout:ceph noarch packages 33 kB/s | 11 kB 00:00 2024-06-02T03:53:37.872 INFO:teuthology.orchestra.run.smithi136.stdout:ceph noarch packages 33 kB/s | 11 kB 00:00 2024-06-02T03:53:38.062 INFO:teuthology.orchestra.run.smithi162.stdout:ceph source packages 5.6 kB/s | 1.5 kB 00:00 2024-06-02T03:53:38.135 INFO:teuthology.orchestra.run.smithi123.stdout:ceph source packages 4.4 kB/s | 1.5 kB 00:00 2024-06-02T03:53:38.221 INFO:teuthology.orchestra.run.smithi162.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2024-06-02T03:53:38.222 INFO:teuthology.orchestra.run.smithi136.stdout:ceph source packages 4.6 kB/s | 1.5 kB 00:00 2024-06-02T03:53:38.311 INFO:teuthology.orchestra.run.smithi123.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2024-06-02T03:53:38.381 INFO:teuthology.orchestra.run.smithi136.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2024-06-02T03:53:39.253 INFO:teuthology.orchestra.run.smithi123.stdout:Extra Packages for Enterprise Linux 15 MB/s | 14 MB 00:00 2024-06-02T03:53:39.508 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 11 MB/s | 14 MB 00:01 2024-06-02T03:53:39.674 INFO:teuthology.orchestra.run.smithi136.stdout:Extra Packages for Enterprise Linux 11 MB/s | 14 MB 00:01 2024-06-02T03:53:43.362 INFO:teuthology.orchestra.run.smithi123.stdout:lab-extras 392 kB/s | 24 kB 00:00 2024-06-02T03:53:43.614 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 506 kB/s | 24 kB 00:00 2024-06-02T03:53:43.724 INFO:teuthology.orchestra.run.smithi136.stdout:lab-extras 334 kB/s | 24 kB 00:00 2024-06-02T03:53:44.089 INFO:teuthology.orchestra.run.smithi123.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 13 MB/s | 8.8 MB 00:00 2024-06-02T03:53:44.307 INFO:teuthology.orchestra.run.smithi162.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 14 MB/s | 8.8 MB 00:00 2024-06-02T03:53:44.425 INFO:teuthology.orchestra.run.smithi136.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 14 MB/s | 8.8 MB 00:00 2024-06-02T03:53:46.957 INFO:teuthology.orchestra.run.smithi123.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 45 MB/s | 61 MB 00:01 2024-06-02T03:53:47.325 INFO:teuthology.orchestra.run.smithi162.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 46 MB/s | 67 MB 00:01 2024-06-02T03:53:47.401 INFO:teuthology.orchestra.run.smithi136.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 46 MB/s | 67 MB 00:01 2024-06-02T03:53:58.326 INFO:teuthology.orchestra.run.smithi162.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 48 MB/s | 61 MB 00:01 2024-06-02T03:53:58.425 INFO:teuthology.orchestra.run.smithi123.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 51 MB/s | 67 MB 00:01 2024-06-02T03:53:58.560 INFO:teuthology.orchestra.run.smithi136.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 46 MB/s | 61 MB 00:01 2024-06-02T03:54:13.447 INFO:teuthology.orchestra.run.smithi123.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-06-02T03:54:13.448 INFO:teuthology.orchestra.run.smithi123.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-06-02T03:54:13.466 INFO:teuthology.orchestra.run.smithi123.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-06-02T03:54:13.467 INFO:teuthology.orchestra.run.smithi123.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-06-02T03:54:13.469 INFO:teuthology.orchestra.run.smithi123.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-06-02T03:54:13.470 INFO:teuthology.orchestra.run.smithi123.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-06-02T03:54:13.473 INFO:teuthology.orchestra.run.smithi123.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-06-02T03:54:13.477 INFO:teuthology.orchestra.run.smithi123.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-06-02T03:54:13.478 INFO:teuthology.orchestra.run.smithi123.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-06-02T03:54:13.702 INFO:teuthology.orchestra.run.smithi123.stdout:Dependencies resolved. 2024-06-02T03:54:13.805 INFO:teuthology.orchestra.run.smithi123.stdout:=================================================================================================================================== 2024-06-02T03:54:13.805 INFO:teuthology.orchestra.run.smithi123.stdout: Package Arch Version Repository Size 2024-06-02T03:54:13.805 INFO:teuthology.orchestra.run.smithi123.stdout:=================================================================================================================================== 2024-06-02T03:54:13.806 INFO:teuthology.orchestra.run.smithi123.stdout:Installing: 2024-06-02T03:54:13.806 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-15.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-06-02T03:54:13.806 INFO:teuthology.orchestra.run.smithi123.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-06-02T03:54:13.806 INFO:teuthology.orchestra.run.smithi123.stdout: ceph x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 6.4 k 2024-06-02T03:54:13.806 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 5.5 M 2024-06-02T03:54:13.806 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-fuse x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 859 k 2024-06-02T03:54:13.806 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 166 k 2024-06-02T03:54:13.806 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 1.6 M 2024-06-02T03:54:13.806 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 138 k 2024-06-02T03:54:13.806 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 3.5 M 2024-06-02T03:54:13.806 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 7.4 M 2024-06-02T03:54:13.806 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-rook noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 49 k 2024-06-02T03:54:13.807 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-radosgw x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 13 M 2024-06-02T03:54:13.807 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-test x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 47 M 2024-06-02T03:54:13.807 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-volume noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 263 k 2024-06-02T03:54:13.807 INFO:teuthology.orchestra.run.smithi123.stdout: cephadm noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 170 k 2024-06-02T03:54:13.807 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-mirror x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 261 k 2024-06-02T03:54:13.807 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-top noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 18 k 2024-06-02T03:54:13.807 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-06-02T03:54:13.807 INFO:teuthology.orchestra.run.smithi123.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-06-02T03:54:13.807 INFO:teuthology.orchestra.run.smithi123.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-06-02T03:54:13.807 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs-devel x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 31 k 2024-06-02T03:54:13.807 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2 x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 780 k 2024-06-02T03:54:13.807 INFO:teuthology.orchestra.run.smithi123.stdout: librados-devel x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 139 k 2024-06-02T03:54:13.808 INFO:teuthology.orchestra.run.smithi123.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-06-02T03:54:13.808 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-06-02T03:54:13.808 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-06-02T03:54:13.808 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-06-02T03:54:13.808 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-contrib x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 812 k 2024-06-02T03:54:13.808 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-server x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-06-02T03:54:13.808 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cephfs x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 196 k 2024-06-02T03:54:13.808 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 371 k 2024-06-02T03:54:13.808 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rbd x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 365 k 2024-06-02T03:54:13.808 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rgw x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 107 k 2024-06-02T03:54:13.809 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-fuse x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 96 k 2024-06-02T03:54:13.809 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-mirror x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 3.5 M 2024-06-02T03:54:13.809 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-nbd x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 181 k 2024-06-02T03:54:13.809 INFO:teuthology.orchestra.run.smithi123.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-06-02T03:54:13.809 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrading: 2024-06-02T03:54:13.809 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-06-02T03:54:13.809 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-06-02T03:54:13.809 INFO:teuthology.orchestra.run.smithi123.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-06-02T03:54:13.809 INFO:teuthology.orchestra.run.smithi123.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-06-02T03:54:13.809 INFO:teuthology.orchestra.run.smithi123.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-06-02T03:54:13.809 INFO:teuthology.orchestra.run.smithi123.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-06-02T03:54:13.809 INFO:teuthology.orchestra.run.smithi123.stdout: librados2 x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 3.7 M 2024-06-02T03:54:13.810 INFO:teuthology.orchestra.run.smithi123.stdout: librbd1 x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 3.6 M 2024-06-02T03:54:13.810 INFO:teuthology.orchestra.run.smithi123.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-06-02T03:54:13.810 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-06-02T03:54:13.810 INFO:teuthology.orchestra.run.smithi123.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-06-02T03:54:13.810 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-06-02T03:54:13.810 INFO:teuthology.orchestra.run.smithi123.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-06-02T03:54:13.810 INFO:teuthology.orchestra.run.smithi123.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-06-02T03:54:13.810 INFO:teuthology.orchestra.run.smithi123.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-06-02T03:54:13.810 INFO:teuthology.orchestra.run.smithi123.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-06-02T03:54:13.810 INFO:teuthology.orchestra.run.smithi123.stdout:Installing dependencies: 2024-06-02T03:54:13.811 INFO:teuthology.orchestra.run.smithi123.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-06-02T03:54:13.811 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-common x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 22 M 2024-06-02T03:54:13.811 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 24 k 2024-06-02T03:54:13.811 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mds x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 2.3 M 2024-06-02T03:54:13.811 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 246 k 2024-06-02T03:54:13.811 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mon x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 4.8 M 2024-06-02T03:54:13.811 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-osd x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 18 M 2024-06-02T03:54:13.811 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 16 k 2024-06-02T03:54:13.811 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-selinux x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 24 k 2024-06-02T03:54:13.811 INFO:teuthology.orchestra.run.smithi123.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-06-02T03:54:13.811 INFO:teuthology.orchestra.run.smithi123.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-06-02T03:54:13.811 INFO:teuthology.orchestra.run.smithi123.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-06-02T03:54:13.812 INFO:teuthology.orchestra.run.smithi123.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-06-02T03:54:13.812 INFO:teuthology.orchestra.run.smithi123.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-06-02T03:54:13.812 INFO:teuthology.orchestra.run.smithi123.stdout: libcephsqlite x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 142 k 2024-06-02T03:54:13.812 INFO:teuthology.orchestra.run.smithi123.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-06-02T03:54:13.812 INFO:teuthology.orchestra.run.smithi123.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-06-02T03:54:13.812 INFO:teuthology.orchestra.run.smithi123.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-06-02T03:54:13.812 INFO:teuthology.orchestra.run.smithi123.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-06-02T03:54:13.812 INFO:teuthology.orchestra.run.smithi123.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-06-02T03:54:13.813 INFO:teuthology.orchestra.run.smithi123.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-06-02T03:54:13.813 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1 x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 474 k 2024-06-02T03:54:13.813 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-06-02T03:54:13.813 INFO:teuthology.orchestra.run.smithi123.stdout: librgw2 x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 6.5 M 2024-06-02T03:54:13.813 INFO:teuthology.orchestra.run.smithi123.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-06-02T03:54:13.813 INFO:teuthology.orchestra.run.smithi123.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-06-02T03:54:13.813 INFO:teuthology.orchestra.run.smithi123.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-06-02T03:54:13.813 INFO:teuthology.orchestra.run.smithi123.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-06-02T03:54:13.813 INFO:teuthology.orchestra.run.smithi123.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-06-02T03:54:13.813 INFO:teuthology.orchestra.run.smithi123.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-06-02T03:54:13.813 INFO:teuthology.orchestra.run.smithi123.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-06-02T03:54:13.813 INFO:teuthology.orchestra.run.smithi123.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-06-02T03:54:13.814 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-06-02T03:54:13.814 INFO:teuthology.orchestra.run.smithi123.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-06-02T03:54:13.814 INFO:teuthology.orchestra.run.smithi123.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-06-02T03:54:13.814 INFO:teuthology.orchestra.run.smithi123.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-06-02T03:54:13.814 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-06-02T03:54:13.814 INFO:teuthology.orchestra.run.smithi123.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-06-02T03:54:13.814 INFO:teuthology.orchestra.run.smithi123.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-06-02T03:54:13.815 INFO:teuthology.orchestra.run.smithi123.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-06-02T03:54:13.815 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-06-02T03:54:13.815 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 45 k 2024-06-02T03:54:13.815 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 129 k 2024-06-02T03:54:13.815 INFO:teuthology.orchestra.run.smithi123.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-06-02T03:54:13.815 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-06-02T03:54:13.815 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-06-02T03:54:13.815 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-06-02T03:54:13.815 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-06-02T03:54:13.815 INFO:teuthology.orchestra.run.smithi123.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-06-02T03:54:13.815 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-06-02T03:54:13.815 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-06-02T03:54:13.816 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-06-02T03:54:13.816 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-06-02T03:54:13.816 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-06-02T03:54:13.816 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-06-02T03:54:13.816 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-06-02T03:54:13.816 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-06-02T03:54:13.816 INFO:teuthology.orchestra.run.smithi123.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-06-02T03:54:13.816 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-06-02T03:54:13.816 INFO:teuthology.orchestra.run.smithi123.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-06-02T03:54:13.816 INFO:teuthology.orchestra.run.smithi123.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-06-02T03:54:13.817 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-06-02T03:54:13.817 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-06-02T03:54:13.817 INFO:teuthology.orchestra.run.smithi123.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-06-02T03:54:13.817 INFO:teuthology.orchestra.run.smithi123.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-06-02T03:54:13.817 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-06-02T03:54:13.817 INFO:teuthology.orchestra.run.smithi123.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-06-02T03:54:13.818 INFO:teuthology.orchestra.run.smithi123.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-06-02T03:54:13.818 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-06-02T03:54:13.818 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-06-02T03:54:13.818 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-06-02T03:54:13.818 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-06-02T03:54:13.818 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-06-02T03:54:13.818 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-06-02T03:54:13.818 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-06-02T03:54:13.819 INFO:teuthology.orchestra.run.smithi123.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-06-02T03:54:13.819 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-06-02T03:54:13.819 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-06-02T03:54:13.819 INFO:teuthology.orchestra.run.smithi123.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-06-02T03:54:13.819 INFO:teuthology.orchestra.run.smithi123.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-06-02T03:54:13.819 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-06-02T03:54:13.819 INFO:teuthology.orchestra.run.smithi123.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-06-02T03:54:13.819 INFO:teuthology.orchestra.run.smithi123.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-06-02T03:54:13.819 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-06-02T03:54:13.819 INFO:teuthology.orchestra.run.smithi123.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-06-02T03:54:13.820 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-06-02T03:54:13.820 INFO:teuthology.orchestra.run.smithi123.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-06-02T03:54:13.820 INFO:teuthology.orchestra.run.smithi123.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-06-02T03:54:13.820 INFO:teuthology.orchestra.run.smithi123.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-06-02T03:54:13.820 INFO:teuthology.orchestra.run.smithi123.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-06-02T03:54:13.820 INFO:teuthology.orchestra.run.smithi123.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-06-02T03:54:13.820 INFO:teuthology.orchestra.run.smithi123.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-06-02T03:54:13.820 INFO:teuthology.orchestra.run.smithi123.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-06-02T03:54:13.820 INFO:teuthology.orchestra.run.smithi123.stdout:Enabling module streams: 2024-06-02T03:54:13.820 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql 10 2024-06-02T03:54:13.820 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T03:54:13.820 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction Summary 2024-06-02T03:54:13.821 INFO:teuthology.orchestra.run.smithi123.stdout:=================================================================================================================================== 2024-06-02T03:54:13.821 INFO:teuthology.orchestra.run.smithi123.stdout:Install 130 Packages 2024-06-02T03:54:13.821 INFO:teuthology.orchestra.run.smithi123.stdout:Upgrade 16 Packages 2024-06-02T03:54:13.821 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T03:54:13.821 INFO:teuthology.orchestra.run.smithi123.stdout:Total download size: 215 M 2024-06-02T03:54:13.821 INFO:teuthology.orchestra.run.smithi123.stdout:Downloading Packages: 2024-06-02T03:54:13.998 INFO:teuthology.orchestra.run.smithi123.stdout:(1/146): ceph-18.2.2-1381.g3bb45379.el8.x86_64. 48 kB/s | 6.4 kB 00:00 2024-06-02T03:54:14.014 INFO:teuthology.orchestra.run.smithi162.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-06-02T03:54:14.016 INFO:teuthology.orchestra.run.smithi162.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-06-02T03:54:14.035 INFO:teuthology.orchestra.run.smithi162.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-06-02T03:54:14.039 INFO:teuthology.orchestra.run.smithi162.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-06-02T03:54:14.040 INFO:teuthology.orchestra.run.smithi162.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-06-02T03:54:14.040 INFO:teuthology.orchestra.run.smithi162.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-06-02T03:54:14.041 INFO:teuthology.orchestra.run.smithi162.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-06-02T03:54:14.046 INFO:teuthology.orchestra.run.smithi162.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-06-02T03:54:14.047 INFO:teuthology.orchestra.run.smithi162.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-06-02T03:54:14.065 INFO:teuthology.orchestra.run.smithi136.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-06-02T03:54:14.067 INFO:teuthology.orchestra.run.smithi136.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-06-02T03:54:14.085 INFO:teuthology.orchestra.run.smithi136.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-06-02T03:54:14.088 INFO:teuthology.orchestra.run.smithi136.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-06-02T03:54:14.089 INFO:teuthology.orchestra.run.smithi136.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-06-02T03:54:14.089 INFO:teuthology.orchestra.run.smithi136.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-06-02T03:54:14.091 INFO:teuthology.orchestra.run.smithi136.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-06-02T03:54:14.097 INFO:teuthology.orchestra.run.smithi136.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-06-02T03:54:14.098 INFO:teuthology.orchestra.run.smithi136.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-06-02T03:54:14.270 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-06-02T03:54:14.285 INFO:teuthology.orchestra.run.smithi162.stdout:=================================================================================================================================== 2024-06-02T03:54:14.285 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-06-02T03:54:14.285 INFO:teuthology.orchestra.run.smithi162.stdout:=================================================================================================================================== 2024-06-02T03:54:14.285 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-06-02T03:54:14.285 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-15.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-06-02T03:54:14.285 INFO:teuthology.orchestra.run.smithi162.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-06-02T03:54:14.285 INFO:teuthology.orchestra.run.smithi162.stdout: ceph x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 6.4 k 2024-06-02T03:54:14.285 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 5.5 M 2024-06-02T03:54:14.285 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 859 k 2024-06-02T03:54:14.285 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 166 k 2024-06-02T03:54:14.285 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 1.6 M 2024-06-02T03:54:14.286 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 138 k 2024-06-02T03:54:14.286 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 3.5 M 2024-06-02T03:54:14.286 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 7.4 M 2024-06-02T03:54:14.286 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 49 k 2024-06-02T03:54:14.286 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 13 M 2024-06-02T03:54:14.286 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 47 M 2024-06-02T03:54:14.286 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 263 k 2024-06-02T03:54:14.286 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 170 k 2024-06-02T03:54:14.286 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 261 k 2024-06-02T03:54:14.286 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-top noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 18 k 2024-06-02T03:54:14.286 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-06-02T03:54:14.287 INFO:teuthology.orchestra.run.smithi162.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-06-02T03:54:14.287 INFO:teuthology.orchestra.run.smithi162.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-06-02T03:54:14.287 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 31 k 2024-06-02T03:54:14.287 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2 x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 780 k 2024-06-02T03:54:14.287 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 139 k 2024-06-02T03:54:14.287 INFO:teuthology.orchestra.run.smithi162.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-06-02T03:54:14.287 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-06-02T03:54:14.287 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-06-02T03:54:14.287 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-06-02T03:54:14.287 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-contrib x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 812 k 2024-06-02T03:54:14.287 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-server x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-06-02T03:54:14.287 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 196 k 2024-06-02T03:54:14.287 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 371 k 2024-06-02T03:54:14.288 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 365 k 2024-06-02T03:54:14.288 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 107 k 2024-06-02T03:54:14.288 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 96 k 2024-06-02T03:54:14.288 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 3.5 M 2024-06-02T03:54:14.288 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 181 k 2024-06-02T03:54:14.288 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-06-02T03:54:14.288 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrading: 2024-06-02T03:54:14.288 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-06-02T03:54:14.288 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-06-02T03:54:14.288 INFO:teuthology.orchestra.run.smithi162.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-06-02T03:54:14.288 INFO:teuthology.orchestra.run.smithi162.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-06-02T03:54:14.288 INFO:teuthology.orchestra.run.smithi162.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-06-02T03:54:14.288 INFO:teuthology.orchestra.run.smithi162.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-06-02T03:54:14.288 INFO:teuthology.orchestra.run.smithi162.stdout: librados2 x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 3.7 M 2024-06-02T03:54:14.289 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1 x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 3.6 M 2024-06-02T03:54:14.289 INFO:teuthology.orchestra.run.smithi162.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-06-02T03:54:14.289 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-06-02T03:54:14.289 INFO:teuthology.orchestra.run.smithi162.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-06-02T03:54:14.289 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-06-02T03:54:14.289 INFO:teuthology.orchestra.run.smithi162.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-06-02T03:54:14.289 INFO:teuthology.orchestra.run.smithi162.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-06-02T03:54:14.289 INFO:teuthology.orchestra.run.smithi162.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-06-02T03:54:14.289 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-06-02T03:54:14.289 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-06-02T03:54:14.289 INFO:teuthology.orchestra.run.smithi162.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-06-02T03:54:14.289 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 22 M 2024-06-02T03:54:14.289 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 24 k 2024-06-02T03:54:14.290 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 2.3 M 2024-06-02T03:54:14.290 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 246 k 2024-06-02T03:54:14.290 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 4.8 M 2024-06-02T03:54:14.290 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 18 M 2024-06-02T03:54:14.290 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 16 k 2024-06-02T03:54:14.290 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 24 k 2024-06-02T03:54:14.290 INFO:teuthology.orchestra.run.smithi162.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-06-02T03:54:14.290 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-06-02T03:54:14.290 INFO:teuthology.orchestra.run.smithi162.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-06-02T03:54:14.290 INFO:teuthology.orchestra.run.smithi162.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-06-02T03:54:14.290 INFO:teuthology.orchestra.run.smithi162.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-06-02T03:54:14.290 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 142 k 2024-06-02T03:54:14.291 INFO:teuthology.orchestra.run.smithi162.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-06-02T03:54:14.291 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-06-02T03:54:14.291 INFO:teuthology.orchestra.run.smithi162.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-06-02T03:54:14.291 INFO:teuthology.orchestra.run.smithi162.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-06-02T03:54:14.291 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-06-02T03:54:14.291 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-06-02T03:54:14.291 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1 x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 474 k 2024-06-02T03:54:14.291 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-06-02T03:54:14.291 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2 x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 6.5 M 2024-06-02T03:54:14.291 INFO:teuthology.orchestra.run.smithi162.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-06-02T03:54:14.291 INFO:teuthology.orchestra.run.smithi162.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-06-02T03:54:14.291 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-06-02T03:54:14.291 INFO:teuthology.orchestra.run.smithi162.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-06-02T03:54:14.292 INFO:teuthology.orchestra.run.smithi162.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-06-02T03:54:14.292 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-06-02T03:54:14.292 INFO:teuthology.orchestra.run.smithi162.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-06-02T03:54:14.292 INFO:teuthology.orchestra.run.smithi162.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-06-02T03:54:14.292 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-06-02T03:54:14.292 INFO:teuthology.orchestra.run.smithi162.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-06-02T03:54:14.292 INFO:teuthology.orchestra.run.smithi162.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-06-02T03:54:14.292 INFO:teuthology.orchestra.run.smithi162.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-06-02T03:54:14.292 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-06-02T03:54:14.292 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-06-02T03:54:14.292 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-06-02T03:54:14.292 INFO:teuthology.orchestra.run.smithi162.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-06-02T03:54:14.292 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-06-02T03:54:14.293 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 45 k 2024-06-02T03:54:14.293 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 129 k 2024-06-02T03:54:14.293 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-06-02T03:54:14.293 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-06-02T03:54:14.293 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-06-02T03:54:14.293 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-06-02T03:54:14.293 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-06-02T03:54:14.293 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-06-02T03:54:14.293 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-06-02T03:54:14.293 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-06-02T03:54:14.293 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-06-02T03:54:14.293 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-06-02T03:54:14.293 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-06-02T03:54:14.293 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-06-02T03:54:14.294 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-06-02T03:54:14.294 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-06-02T03:54:14.294 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-06-02T03:54:14.294 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-06-02T03:54:14.294 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-06-02T03:54:14.294 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-06-02T03:54:14.294 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-06-02T03:54:14.294 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-06-02T03:54:14.294 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-06-02T03:54:14.294 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-06-02T03:54:14.294 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-06-02T03:54:14.294 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-06-02T03:54:14.295 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-06-02T03:54:14.295 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-06-02T03:54:14.295 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-06-02T03:54:14.295 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-06-02T03:54:14.295 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-06-02T03:54:14.295 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-06-02T03:54:14.295 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-06-02T03:54:14.295 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-06-02T03:54:14.295 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-06-02T03:54:14.295 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-06-02T03:54:14.295 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-06-02T03:54:14.295 INFO:teuthology.orchestra.run.smithi162.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-06-02T03:54:14.295 INFO:teuthology.orchestra.run.smithi162.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-06-02T03:54:14.296 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-06-02T03:54:14.296 INFO:teuthology.orchestra.run.smithi162.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-06-02T03:54:14.296 INFO:teuthology.orchestra.run.smithi162.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-06-02T03:54:14.296 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-06-02T03:54:14.296 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-06-02T03:54:14.296 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-06-02T03:54:14.296 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-06-02T03:54:14.296 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-06-02T03:54:14.296 INFO:teuthology.orchestra.run.smithi162.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-06-02T03:54:14.296 INFO:teuthology.orchestra.run.smithi162.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-06-02T03:54:14.296 INFO:teuthology.orchestra.run.smithi162.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-06-02T03:54:14.296 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-06-02T03:54:14.296 INFO:teuthology.orchestra.run.smithi162.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-06-02T03:54:14.297 INFO:teuthology.orchestra.run.smithi162.stdout:Enabling module streams: 2024-06-02T03:54:14.297 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql 10 2024-06-02T03:54:14.297 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T03:54:14.297 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-06-02T03:54:14.297 INFO:teuthology.orchestra.run.smithi162.stdout:=================================================================================================================================== 2024-06-02T03:54:14.297 INFO:teuthology.orchestra.run.smithi162.stdout:Install 130 Packages 2024-06-02T03:54:14.297 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrade 16 Packages 2024-06-02T03:54:14.297 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T03:54:14.298 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 215 M 2024-06-02T03:54:14.298 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-06-02T03:54:14.325 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-06-02T03:54:14.339 INFO:teuthology.orchestra.run.smithi136.stdout:=================================================================================================================================== 2024-06-02T03:54:14.339 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2024-06-02T03:54:14.339 INFO:teuthology.orchestra.run.smithi136.stdout:=================================================================================================================================== 2024-06-02T03:54:14.340 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-06-02T03:54:14.340 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-15.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-06-02T03:54:14.340 INFO:teuthology.orchestra.run.smithi136.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-06-02T03:54:14.340 INFO:teuthology.orchestra.run.smithi136.stdout: ceph x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 6.4 k 2024-06-02T03:54:14.340 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 5.5 M 2024-06-02T03:54:14.340 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 859 k 2024-06-02T03:54:14.340 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 166 k 2024-06-02T03:54:14.340 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 1.6 M 2024-06-02T03:54:14.340 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 138 k 2024-06-02T03:54:14.341 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 3.5 M 2024-06-02T03:54:14.341 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 7.4 M 2024-06-02T03:54:14.341 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-rook noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 49 k 2024-06-02T03:54:14.341 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 13 M 2024-06-02T03:54:14.341 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 47 M 2024-06-02T03:54:14.341 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-volume noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 263 k 2024-06-02T03:54:14.341 INFO:teuthology.orchestra.run.smithi136.stdout: cephadm noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 170 k 2024-06-02T03:54:14.341 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-mirror x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 261 k 2024-06-02T03:54:14.342 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-top noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 18 k 2024-06-02T03:54:14.342 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-06-02T03:54:14.342 INFO:teuthology.orchestra.run.smithi136.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-06-02T03:54:14.342 INFO:teuthology.orchestra.run.smithi136.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-06-02T03:54:14.342 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-devel x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 31 k 2024-06-02T03:54:14.342 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2 x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 780 k 2024-06-02T03:54:14.342 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 139 k 2024-06-02T03:54:14.342 INFO:teuthology.orchestra.run.smithi136.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-06-02T03:54:14.343 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-06-02T03:54:14.343 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-06-02T03:54:14.343 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-06-02T03:54:14.343 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-contrib x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 812 k 2024-06-02T03:54:14.343 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-server x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-06-02T03:54:14.343 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 196 k 2024-06-02T03:54:14.343 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 371 k 2024-06-02T03:54:14.343 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 365 k 2024-06-02T03:54:14.343 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 107 k 2024-06-02T03:54:14.344 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 96 k 2024-06-02T03:54:14.344 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 3.5 M 2024-06-02T03:54:14.344 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 181 k 2024-06-02T03:54:14.344 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-06-02T03:54:14.344 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrading: 2024-06-02T03:54:14.344 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-06-02T03:54:14.344 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-06-02T03:54:14.344 INFO:teuthology.orchestra.run.smithi136.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-06-02T03:54:14.344 INFO:teuthology.orchestra.run.smithi136.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-06-02T03:54:14.345 INFO:teuthology.orchestra.run.smithi136.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-06-02T03:54:14.345 INFO:teuthology.orchestra.run.smithi136.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-06-02T03:54:14.345 INFO:teuthology.orchestra.run.smithi136.stdout: librados2 x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 3.7 M 2024-06-02T03:54:14.345 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1 x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 3.6 M 2024-06-02T03:54:14.345 INFO:teuthology.orchestra.run.smithi136.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-06-02T03:54:14.345 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-06-02T03:54:14.345 INFO:teuthology.orchestra.run.smithi136.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-06-02T03:54:14.345 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-06-02T03:54:14.345 INFO:teuthology.orchestra.run.smithi136.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-06-02T03:54:14.345 INFO:teuthology.orchestra.run.smithi136.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-06-02T03:54:14.345 INFO:teuthology.orchestra.run.smithi136.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-06-02T03:54:14.345 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-06-02T03:54:14.346 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-06-02T03:54:14.346 INFO:teuthology.orchestra.run.smithi136.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-06-02T03:54:14.346 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 22 M 2024-06-02T03:54:14.346 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 24 k 2024-06-02T03:54:14.346 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 2.3 M 2024-06-02T03:54:14.346 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 246 k 2024-06-02T03:54:14.346 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 4.8 M 2024-06-02T03:54:14.346 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 18 M 2024-06-02T03:54:14.346 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1381.g3bb45379.el8 ceph-noarch 16 k 2024-06-02T03:54:14.346 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-selinux x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 24 k 2024-06-02T03:54:14.346 INFO:teuthology.orchestra.run.smithi136.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-06-02T03:54:14.346 INFO:teuthology.orchestra.run.smithi136.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-06-02T03:54:14.347 INFO:teuthology.orchestra.run.smithi136.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-06-02T03:54:14.347 INFO:teuthology.orchestra.run.smithi136.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-06-02T03:54:14.347 INFO:teuthology.orchestra.run.smithi136.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-06-02T03:54:14.347 INFO:teuthology.orchestra.run.smithi136.stdout: libcephsqlite x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 142 k 2024-06-02T03:54:14.347 INFO:teuthology.orchestra.run.smithi136.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-06-02T03:54:14.347 INFO:teuthology.orchestra.run.smithi136.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-06-02T03:54:14.347 INFO:teuthology.orchestra.run.smithi136.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-06-02T03:54:14.348 INFO:teuthology.orchestra.run.smithi136.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-06-02T03:54:14.348 INFO:teuthology.orchestra.run.smithi136.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-06-02T03:54:14.348 INFO:teuthology.orchestra.run.smithi136.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-06-02T03:54:14.348 INFO:teuthology.orchestra.run.smithi136.stdout: libradosstriper1 x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 474 k 2024-06-02T03:54:14.348 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-06-02T03:54:14.348 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2 x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 6.5 M 2024-06-02T03:54:14.348 INFO:teuthology.orchestra.run.smithi136.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-06-02T03:54:14.348 INFO:teuthology.orchestra.run.smithi136.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-06-02T03:54:14.348 INFO:teuthology.orchestra.run.smithi136.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-06-02T03:54:14.348 INFO:teuthology.orchestra.run.smithi136.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-06-02T03:54:14.348 INFO:teuthology.orchestra.run.smithi136.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-06-02T03:54:14.348 INFO:teuthology.orchestra.run.smithi136.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-06-02T03:54:14.349 INFO:teuthology.orchestra.run.smithi136.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-06-02T03:54:14.349 INFO:teuthology.orchestra.run.smithi136.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-06-02T03:54:14.349 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-06-02T03:54:14.349 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-06-02T03:54:14.349 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-06-02T03:54:14.349 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-06-02T03:54:14.349 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-06-02T03:54:14.349 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-06-02T03:54:14.349 INFO:teuthology.orchestra.run.smithi136.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-06-02T03:54:14.349 INFO:teuthology.orchestra.run.smithi136.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-06-02T03:54:14.349 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-06-02T03:54:14.349 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 45 k 2024-06-02T03:54:14.349 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common x86_64 2:18.2.2-1381.g3bb45379.el8 ceph 129 k 2024-06-02T03:54:14.350 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-06-02T03:54:14.350 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-06-02T03:54:14.350 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-06-02T03:54:14.350 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-06-02T03:54:14.350 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-06-02T03:54:14.350 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-06-02T03:54:14.350 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-06-02T03:54:14.350 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-06-02T03:54:14.350 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-06-02T03:54:14.350 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-06-02T03:54:14.350 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-06-02T03:54:14.350 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-06-02T03:54:14.351 INFO:teuthology.orchestra.run.smithi136.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-06-02T03:54:14.351 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-06-02T03:54:14.351 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-06-02T03:54:14.351 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-06-02T03:54:14.351 INFO:teuthology.orchestra.run.smithi136.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-06-02T03:54:14.351 INFO:teuthology.orchestra.run.smithi136.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-06-02T03:54:14.351 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-06-02T03:54:14.351 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-06-02T03:54:14.351 INFO:teuthology.orchestra.run.smithi136.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-06-02T03:54:14.351 INFO:teuthology.orchestra.run.smithi136.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-06-02T03:54:14.351 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-06-02T03:54:14.351 INFO:teuthology.orchestra.run.smithi136.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-06-02T03:54:14.351 INFO:teuthology.orchestra.run.smithi136.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-06-02T03:54:14.352 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-06-02T03:54:14.352 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-06-02T03:54:14.352 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-06-02T03:54:14.352 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-06-02T03:54:14.352 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-06-02T03:54:14.352 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-06-02T03:54:14.352 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-06-02T03:54:14.352 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-06-02T03:54:14.352 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-06-02T03:54:14.352 INFO:teuthology.orchestra.run.smithi136.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-06-02T03:54:14.353 INFO:teuthology.orchestra.run.smithi136.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-06-02T03:54:14.353 INFO:teuthology.orchestra.run.smithi136.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-06-02T03:54:14.353 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-06-02T03:54:14.353 INFO:teuthology.orchestra.run.smithi136.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-06-02T03:54:14.353 INFO:teuthology.orchestra.run.smithi136.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-06-02T03:54:14.353 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-06-02T03:54:14.353 INFO:teuthology.orchestra.run.smithi136.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-06-02T03:54:14.353 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-06-02T03:54:14.353 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-06-02T03:54:14.353 INFO:teuthology.orchestra.run.smithi136.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-06-02T03:54:14.353 INFO:teuthology.orchestra.run.smithi136.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-06-02T03:54:14.353 INFO:teuthology.orchestra.run.smithi136.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-06-02T03:54:14.354 INFO:teuthology.orchestra.run.smithi136.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-06-02T03:54:14.354 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-06-02T03:54:14.354 INFO:teuthology.orchestra.run.smithi136.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-06-02T03:54:14.354 INFO:teuthology.orchestra.run.smithi136.stdout:Enabling module streams: 2024-06-02T03:54:14.354 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql 10 2024-06-02T03:54:14.354 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-06-02T03:54:14.354 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-06-02T03:54:14.354 INFO:teuthology.orchestra.run.smithi136.stdout:=================================================================================================================================== 2024-06-02T03:54:14.354 INFO:teuthology.orchestra.run.smithi136.stdout:Install 130 Packages 2024-06-02T03:54:14.354 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrade 16 Packages 2024-06-02T03:54:14.354 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-06-02T03:54:14.355 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 215 M 2024-06-02T03:54:14.355 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-06-02T03:54:14.525 INFO:teuthology.orchestra.run.smithi136.stdout:(1/146): ceph-18.2.2-1381.g3bb45379.el8.x86_64. 44 kB/s | 6.4 kB 00:00 2024-06-02T03:54:14.640 INFO:teuthology.orchestra.run.smithi123.stdout:(2/146): ceph-fuse-18.2.2-1381.g3bb45379.el8.x8 1.3 MB/s | 859 kB 00:00 2024-06-02T03:54:14.724 INFO:teuthology.orchestra.run.smithi123.stdout:(3/146): ceph-base-18.2.2-1381.g3bb45379.el8.x8 6.4 MB/s | 5.5 MB 00:00 2024-06-02T03:54:14.749 INFO:teuthology.orchestra.run.smithi123.stdout:(4/146): ceph-immutable-object-cache-18.2.2-138 1.5 MB/s | 166 kB 00:00 2024-06-02T03:54:14.774 INFO:teuthology.orchestra.run.smithi162.stdout:(1/146): ceph-18.2.2-1381.g3bb45379.el8.x86_64. 48 kB/s | 6.4 kB 00:00 2024-06-02T03:54:15.058 INFO:teuthology.orchestra.run.smithi123.stdout:(5/146): ceph-mds-18.2.2-1381.g3bb45379.el8.x86 6.8 MB/s | 2.3 MB 00:00 2024-06-02T03:54:15.242 INFO:teuthology.orchestra.run.smithi136.stdout:(2/146): ceph-fuse-18.2.2-1381.g3bb45379.el8.x8 1.2 MB/s | 859 kB 00:00 2024-06-02T03:54:15.459 INFO:teuthology.orchestra.run.smithi136.stdout:(3/146): ceph-immutable-object-cache-18.2.2-138 766 kB/s | 166 kB 00:00 2024-06-02T03:54:15.658 INFO:teuthology.orchestra.run.smithi162.stdout:(2/146): ceph-fuse-18.2.2-1381.g3bb45379.el8.x8 973 kB/s | 859 kB 00:00 2024-06-02T03:54:15.733 INFO:teuthology.orchestra.run.smithi123.stdout:(6/146): ceph-mgr-18.2.2-1381.g3bb45379.el8.x86 1.6 MB/s | 1.6 MB 00:00 2024-06-02T03:54:15.826 INFO:teuthology.orchestra.run.smithi162.stdout:(3/146): ceph-immutable-object-cache-18.2.2-138 996 kB/s | 166 kB 00:00 2024-06-02T03:54:16.142 INFO:teuthology.orchestra.run.smithi123.stdout:(7/146): ceph-common-18.2.2-1381.g3bb45379.el8. 9.5 MB/s | 22 MB 00:02 2024-06-02T03:54:16.217 INFO:teuthology.orchestra.run.smithi123.stdout:(8/146): ceph-mon-18.2.2-1381.g3bb45379.el8.x86 4.2 MB/s | 4.8 MB 00:01 2024-06-02T03:54:16.225 INFO:teuthology.orchestra.run.smithi136.stdout:(4/146): ceph-base-18.2.2-1381.g3bb45379.el8.x8 3.0 MB/s | 5.5 MB 00:01 2024-06-02T03:54:16.300 INFO:teuthology.orchestra.run.smithi123.stdout:(9/146): ceph-selinux-18.2.2-1381.g3bb45379.el8 292 kB/s | 24 kB 00:00 2024-06-02T03:54:16.834 INFO:teuthology.orchestra.run.smithi162.stdout:(4/146): ceph-mds-18.2.2-1381.g3bb45379.el8.x86 2.3 MB/s | 2.3 MB 00:01 2024-06-02T03:54:16.884 INFO:teuthology.orchestra.run.smithi136.stdout:(5/146): ceph-mgr-18.2.2-1381.g3bb45379.el8.x86 2.4 MB/s | 1.6 MB 00:00 2024-06-02T03:54:17.692 INFO:teuthology.orchestra.run.smithi162.stdout:(5/146): ceph-mgr-18.2.2-1381.g3bb45379.el8.x86 1.8 MB/s | 1.6 MB 00:00 2024-06-02T03:54:17.792 INFO:teuthology.orchestra.run.smithi162.stdout:(6/146): ceph-base-18.2.2-1381.g3bb45379.el8.x8 1.8 MB/s | 5.5 MB 00:03 2024-06-02T03:54:17.851 INFO:teuthology.orchestra.run.smithi123.stdout:(10/146): ceph-radosgw-18.2.2-1381.g3bb45379.el 7.7 MB/s | 13 MB 00:01 2024-06-02T03:54:17.934 INFO:teuthology.orchestra.run.smithi123.stdout:(11/146): cephfs-mirror-18.2.2-1381.g3bb45379.e 3.1 MB/s | 261 kB 00:00 2024-06-02T03:54:17.968 INFO:teuthology.orchestra.run.smithi136.stdout:(6/146): ceph-mds-18.2.2-1381.g3bb45379.el8.x86 928 kB/s | 2.3 MB 00:02 2024-06-02T03:54:17.993 INFO:teuthology.orchestra.run.smithi123.stdout:(12/146): libcephfs-devel-18.2.2-1381.g3bb45379 530 kB/s | 31 kB 00:00 2024-06-02T03:54:18.151 INFO:teuthology.orchestra.run.smithi123.stdout:(13/146): libcephfs2-18.2.2-1381.g3bb45379.el8. 4.8 MB/s | 780 kB 00:00 2024-06-02T03:54:18.226 INFO:teuthology.orchestra.run.smithi123.stdout:(14/146): libcephsqlite-18.2.2-1381.g3bb45379.e 1.9 MB/s | 142 kB 00:00 2024-06-02T03:54:18.327 INFO:teuthology.orchestra.run.smithi123.stdout:(15/146): librados-devel-18.2.2-1381.g3bb45379. 1.4 MB/s | 139 kB 00:00 2024-06-02T03:54:18.342 INFO:teuthology.orchestra.run.smithi136.stdout:(7/146): ceph-mon-18.2.2-1381.g3bb45379.el8.x86 3.3 MB/s | 4.8 MB 00:01 2024-06-02T03:54:18.402 INFO:teuthology.orchestra.run.smithi123.stdout:(16/146): libradosstriper1-18.2.2-1381.g3bb4537 6.2 MB/s | 474 kB 00:00 2024-06-02T03:54:18.951 INFO:teuthology.orchestra.run.smithi136.stdout:(8/146): ceph-common-18.2.2-1381.g3bb45379.el8. 4.7 MB/s | 22 MB 00:04 2024-06-02T03:54:19.085 INFO:teuthology.orchestra.run.smithi136.stdout:(9/146): ceph-selinux-18.2.2-1381.g3bb45379.el8 182 kB/s | 24 kB 00:00 2024-06-02T03:54:19.210 INFO:teuthology.orchestra.run.smithi123.stdout:(17/146): librgw2-18.2.2-1381.g3bb45379.el8.x86 8.1 MB/s | 6.5 MB 00:00 2024-06-02T03:54:19.286 INFO:teuthology.orchestra.run.smithi123.stdout:(18/146): python3-ceph-argparse-18.2.2-1381.g3b 596 kB/s | 45 kB 00:00 2024-06-02T03:54:19.361 INFO:teuthology.orchestra.run.smithi123.stdout:(19/146): python3-ceph-common-18.2.2-1381.g3bb4 1.7 MB/s | 129 kB 00:00 2024-06-02T03:54:19.384 INFO:teuthology.orchestra.run.smithi162.stdout:(7/146): ceph-mon-18.2.2-1381.g3bb45379.el8.x86 2.9 MB/s | 4.8 MB 00:01 2024-06-02T03:54:19.436 INFO:teuthology.orchestra.run.smithi123.stdout:(20/146): python3-cephfs-18.2.2-1381.g3bb45379. 2.6 MB/s | 196 kB 00:00 2024-06-02T03:54:19.536 INFO:teuthology.orchestra.run.smithi123.stdout:(21/146): python3-rados-18.2.2-1381.g3bb45379.e 3.6 MB/s | 371 kB 00:00 2024-06-02T03:54:19.628 INFO:teuthology.orchestra.run.smithi123.stdout:(22/146): python3-rbd-18.2.2-1381.g3bb45379.el8 3.9 MB/s | 365 kB 00:00 2024-06-02T03:54:19.703 INFO:teuthology.orchestra.run.smithi123.stdout:(23/146): python3-rgw-18.2.2-1381.g3bb45379.el8 1.4 MB/s | 107 kB 00:00 2024-06-02T03:54:19.795 INFO:teuthology.orchestra.run.smithi123.stdout:(24/146): rbd-fuse-18.2.2-1381.g3bb45379.el8.x8 1.0 MB/s | 96 kB 00:00 2024-06-02T03:54:20.363 INFO:teuthology.orchestra.run.smithi123.stdout:(25/146): rbd-mirror-18.2.2-1381.g3bb45379.el8. 6.1 MB/s | 3.5 MB 00:00 2024-06-02T03:54:20.475 INFO:teuthology.orchestra.run.smithi123.stdout:(26/146): rbd-nbd-18.2.2-1381.g3bb45379.el8.x86 1.6 MB/s | 181 kB 00:00 2024-06-02T03:54:20.555 INFO:teuthology.orchestra.run.smithi123.stdout:(27/146): ceph-grafana-dashboards-18.2.2-1381.g 308 kB/s | 24 kB 00:00 2024-06-02T03:54:20.638 INFO:teuthology.orchestra.run.smithi123.stdout:(28/146): ceph-mgr-cephadm-18.2.2-1381.g3bb4537 1.6 MB/s | 138 kB 00:00 2024-06-02T03:54:21.247 INFO:teuthology.orchestra.run.smithi123.stdout:(29/146): ceph-mgr-dashboard-18.2.2-1381.g3bb45 5.8 MB/s | 3.5 MB 00:00 2024-06-02T03:54:22.468 INFO:teuthology.orchestra.run.smithi136.stdout:(10/146): ceph-radosgw-18.2.2-1381.g3bb45379.el 3.2 MB/s | 13 MB 00:04 2024-06-02T03:54:22.539 INFO:teuthology.orchestra.run.smithi123.stdout:(30/146): ceph-mgr-diskprediction-local-18.2.2- 5.7 MB/s | 7.4 MB 00:01 2024-06-02T03:54:22.601 INFO:teuthology.orchestra.run.smithi136.stdout:(11/146): cephfs-mirror-18.2.2-1381.g3bb45379.e 1.9 MB/s | 261 kB 00:00 2024-06-02T03:54:22.647 INFO:teuthology.orchestra.run.smithi123.stdout:(31/146): ceph-mgr-modules-core-18.2.2-1381.g3b 2.2 MB/s | 246 kB 00:00 2024-06-02T03:54:22.685 INFO:teuthology.orchestra.run.smithi136.stdout:(12/146): libcephfs-devel-18.2.2-1381.g3bb45379 372 kB/s | 31 kB 00:00 2024-06-02T03:54:22.731 INFO:teuthology.orchestra.run.smithi123.stdout:(32/146): ceph-mgr-rook-18.2.2-1381.g3bb45379.e 592 kB/s | 49 kB 00:00 2024-06-02T03:54:22.806 INFO:teuthology.orchestra.run.smithi123.stdout:(33/146): ceph-prometheus-alerts-18.2.2-1381.g3 218 kB/s | 16 kB 00:00 2024-06-02T03:54:22.907 INFO:teuthology.orchestra.run.smithi123.stdout:(34/146): ceph-volume-18.2.2-1381.g3bb45379.el8 2.6 MB/s | 263 kB 00:00 2024-06-02T03:54:22.927 INFO:teuthology.orchestra.run.smithi136.stdout:(13/146): libcephfs2-18.2.2-1381.g3bb45379.el8. 3.2 MB/s | 780 kB 00:00 2024-06-02T03:54:22.933 INFO:teuthology.orchestra.run.smithi162.stdout:(8/146): ceph-osd-18.2.2-1381.g3bb45379.el8.x86 3.6 MB/s | 18 MB 00:05 2024-06-02T03:54:22.948 INFO:teuthology.orchestra.run.smithi123.stdout:(35/146): cephadm-18.2.2-1381.g3bb45379.el8.noa 4.0 MB/s | 170 kB 00:00 2024-06-02T03:54:23.002 INFO:teuthology.orchestra.run.smithi136.stdout:(14/146): libcephsqlite-18.2.2-1381.g3bb45379.e 1.9 MB/s | 142 kB 00:00 2024-06-02T03:54:23.015 INFO:teuthology.orchestra.run.smithi123.stdout:(36/146): cephfs-top-18.2.2-1381.g3bb45379.el8. 272 kB/s | 18 kB 00:00 2024-06-02T03:54:23.033 INFO:teuthology.orchestra.run.smithi162.stdout:(9/146): ceph-selinux-18.2.2-1381.g3bb45379.el8 244 kB/s | 24 kB 00:00 2024-06-02T03:54:23.060 INFO:teuthology.orchestra.run.smithi136.stdout:(15/146): librados-devel-18.2.2-1381.g3bb45379. 2.3 MB/s | 139 kB 00:00 2024-06-02T03:54:23.242 INFO:teuthology.orchestra.run.smithi162.stdout:(10/146): ceph-common-18.2.2-1381.g3bb45379.el8 2.5 MB/s | 22 MB 00:08 2024-06-02T03:54:23.244 INFO:teuthology.orchestra.run.smithi136.stdout:(16/146): libradosstriper1-18.2.2-1381.g3bb4537 2.5 MB/s | 474 kB 00:00 2024-06-02T03:54:23.426 INFO:teuthology.orchestra.run.smithi162.stdout:(11/146): cephfs-mirror-18.2.2-1381.g3bb45379.e 1.4 MB/s | 261 kB 00:00 2024-06-02T03:54:23.499 INFO:teuthology.orchestra.run.smithi123.stdout:(37/146): ceph-osd-18.2.2-1381.g3bb45379.el8.x8 2.4 MB/s | 18 MB 00:07 2024-06-02T03:54:23.509 INFO:teuthology.orchestra.run.smithi162.stdout:(12/146): libcephfs-devel-18.2.2-1381.g3bb45379 372 kB/s | 31 kB 00:00 2024-06-02T03:54:23.516 INFO:teuthology.orchestra.run.smithi123.stdout:(38/146): gperftools-libs-2.7-9.el8.x86_64.rpm 612 kB/s | 306 kB 00:00 2024-06-02T03:54:23.625 INFO:teuthology.orchestra.run.smithi123.stdout:(39/146): libunwind-1.3.1-3.el8.x86_64.rpm 693 kB/s | 75 kB 00:00 2024-06-02T03:54:23.783 INFO:teuthology.orchestra.run.smithi123.stdout:(40/146): python3-asyncssh-2.7.0-2.el8.noarch.r 2.9 MB/s | 476 kB 00:00 2024-06-02T03:54:23.858 INFO:teuthology.orchestra.run.smithi123.stdout:(41/146): liboath-2.6.2-3.el8.x86_64.rpm 164 kB/s | 59 kB 00:00 2024-06-02T03:54:23.868 INFO:teuthology.orchestra.run.smithi162.stdout:(13/146): ceph-radosgw-18.2.2-1381.g3bb45379.el 2.9 MB/s | 13 MB 00:04 2024-06-02T03:54:23.884 INFO:teuthology.orchestra.run.smithi123.stdout:(42/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 436 kB/s | 44 kB 00:00 2024-06-02T03:54:23.902 INFO:teuthology.orchestra.run.smithi162.stdout:(14/146): libcephfs2-18.2.2-1381.g3bb45379.el8. 1.9 MB/s | 780 kB 00:00 2024-06-02T03:54:23.935 INFO:teuthology.orchestra.run.smithi162.stdout:(15/146): libcephsqlite-18.2.2-1381.g3bb45379.e 2.1 MB/s | 142 kB 00:00 2024-06-02T03:54:23.967 INFO:teuthology.orchestra.run.smithi123.stdout:(43/146): python3-cachetools-3.1.1-4.el8.noarch 397 kB/s | 33 kB 00:00 2024-06-02T03:54:23.994 INFO:teuthology.orchestra.run.smithi162.stdout:(16/146): librados-devel-18.2.2-1381.g3bb45379. 1.5 MB/s | 139 kB 00:00 2024-06-02T03:54:24.035 INFO:teuthology.orchestra.run.smithi123.stdout:(44/146): python3-certifi-2018.10.15-7.el8.noar 244 kB/s | 16 kB 00:00 2024-06-02T03:54:24.126 INFO:teuthology.orchestra.run.smithi123.stdout:(45/146): python3-cheroot-8.5.2-1.el8.noarch.rp 1.8 MB/s | 173 kB 00:00 2024-06-02T03:54:24.127 INFO:teuthology.orchestra.run.smithi162.stdout:(17/146): libradosstriper1-18.2.2-1381.g3bb4537 2.4 MB/s | 474 kB 00:00 2024-06-02T03:54:24.193 INFO:teuthology.orchestra.run.smithi123.stdout:(46/146): python3-beautifulsoup4-4.6.3-2.el8.1. 554 kB/s | 185 kB 00:00 2024-06-02T03:54:24.202 INFO:teuthology.orchestra.run.smithi162.stdout:(18/146): python3-ceph-argparse-18.2.2-1381.g3b 596 kB/s | 45 kB 00:00 2024-06-02T03:54:24.219 INFO:teuthology.orchestra.run.smithi123.stdout:(47/146): python3-cherrypy-18.4.0-1.el8.noarch. 4.1 MB/s | 384 kB 00:00 2024-06-02T03:54:24.303 INFO:teuthology.orchestra.run.smithi162.stdout:(19/146): python3-ceph-common-18.2.2-1381.g3bb4 1.3 MB/s | 129 kB 00:00 2024-06-02T03:54:24.387 INFO:teuthology.orchestra.run.smithi162.stdout:(20/146): python3-cephfs-18.2.2-1381.g3bb45379. 2.3 MB/s | 196 kB 00:00 2024-06-02T03:54:24.520 INFO:teuthology.orchestra.run.smithi162.stdout:(21/146): python3-rados-18.2.2-1381.g3bb45379.e 2.7 MB/s | 371 kB 00:00 2024-06-02T03:54:24.577 INFO:teuthology.orchestra.run.smithi123.stdout:(48/146): python3-jaraco-6.2-6.el8.noarch.rpm 31 kB/s | 11 kB 00:00 2024-06-02T03:54:24.594 INFO:teuthology.orchestra.run.smithi136.stdout:(17/146): librgw2-18.2.2-1381.g3bb45379.el8.x86 4.9 MB/s | 6.5 MB 00:01 2024-06-02T03:54:24.629 INFO:teuthology.orchestra.run.smithi162.stdout:(22/146): python3-rbd-18.2.2-1381.g3bb45379.el8 3.3 MB/s | 365 kB 00:00 2024-06-02T03:54:24.661 INFO:teuthology.orchestra.run.smithi136.stdout:(18/146): python3-ceph-argparse-18.2.2-1381.g3b 670 kB/s | 45 kB 00:00 2024-06-02T03:54:24.727 INFO:teuthology.orchestra.run.smithi123.stdout:(49/146): python3-jaraco-functools-2.0-4.el8.no 117 kB/s | 18 kB 00:00 2024-06-02T03:54:24.729 INFO:teuthology.orchestra.run.smithi162.stdout:(23/146): python3-rgw-18.2.2-1381.g3bb45379.el8 1.0 MB/s | 107 kB 00:00 2024-06-02T03:54:24.745 INFO:teuthology.orchestra.run.smithi136.stdout:(19/146): python3-ceph-common-18.2.2-1381.g3bb4 1.5 MB/s | 129 kB 00:00 2024-06-02T03:54:24.788 INFO:teuthology.orchestra.run.smithi162.stdout:(24/146): rbd-fuse-18.2.2-1381.g3bb45379.el8.x8 1.6 MB/s | 96 kB 00:00 2024-06-02T03:54:24.828 INFO:teuthology.orchestra.run.smithi123.stdout:(50/146): python3-google-auth-1.1.1-10.el8.noar 128 kB/s | 81 kB 00:00 2024-06-02T03:54:24.836 INFO:teuthology.orchestra.run.smithi136.stdout:(20/146): python3-cephfs-18.2.2-1381.g3bb45379. 2.1 MB/s | 196 kB 00:00 2024-06-02T03:54:24.928 INFO:teuthology.orchestra.run.smithi123.stdout:(51/146): python3-kubernetes-11.0.0-6.el8.noarc 5.8 MB/s | 1.2 MB 00:00 2024-06-02T03:54:24.978 INFO:teuthology.orchestra.run.smithi136.stdout:(21/146): python3-rados-18.2.2-1381.g3bb45379.e 2.6 MB/s | 371 kB 00:00 2024-06-02T03:54:25.003 INFO:teuthology.orchestra.run.smithi123.stdout:(52/146): python3-more-itertools-7.2.0-3.el8.no 783 kB/s | 59 kB 00:00 2024-06-02T03:54:25.070 INFO:teuthology.orchestra.run.smithi123.stdout:(53/146): python3-natsort-7.1.1-2.el8.noarch.rp 905 kB/s | 60 kB 00:00 2024-06-02T03:54:25.139 INFO:teuthology.orchestra.run.smithi136.stdout:(22/146): python3-rbd-18.2.2-1381.g3bb45379.el8 2.2 MB/s | 365 kB 00:00 2024-06-02T03:54:25.212 INFO:teuthology.orchestra.run.smithi136.stdout:(23/146): python3-rgw-18.2.2-1381.g3bb45379.el8 1.4 MB/s | 107 kB 00:00 2024-06-02T03:54:25.287 INFO:teuthology.orchestra.run.smithi136.stdout:(24/146): rbd-fuse-18.2.2-1381.g3bb45379.el8.x8 1.2 MB/s | 96 kB 00:00 2024-06-02T03:54:25.513 INFO:teuthology.orchestra.run.smithi123.stdout:(54/146): python3-pecan-1.3.2-9.el8.noarch.rpm 639 kB/s | 283 kB 00:00 2024-06-02T03:54:25.571 INFO:teuthology.orchestra.run.smithi123.stdout:(55/146): python3-logutils-0.3.5-11.el8.noarch. 66 kB/s | 49 kB 00:00 2024-06-02T03:54:25.588 INFO:teuthology.orchestra.run.smithi123.stdout:(56/146): python3-portend-2.6-1.el8.noarch.rpm 211 kB/s | 16 kB 00:00 2024-06-02T03:54:25.621 INFO:teuthology.orchestra.run.smithi162.stdout:(25/146): rbd-mirror-18.2.2-1381.g3bb45379.el8. 4.1 MB/s | 3.5 MB 00:00 2024-06-02T03:54:25.638 INFO:teuthology.orchestra.run.smithi123.stdout:(57/146): python3-repoze-lru-0.7-6.el8.noarch.r 502 kB/s | 34 kB 00:00 2024-06-02T03:54:25.696 INFO:teuthology.orchestra.run.smithi123.stdout:(58/146): python3-routes-2.4.1-12.el8.noarch.rp 1.8 MB/s | 196 kB 00:00 2024-06-02T03:54:25.713 INFO:teuthology.orchestra.run.smithi162.stdout:(26/146): rbd-nbd-18.2.2-1381.g3bb45379.el8.x86 1.9 MB/s | 181 kB 00:00 2024-06-02T03:54:25.722 INFO:teuthology.orchestra.run.smithi123.stdout:(59/146): python3-rsa-4.9-2.el8.noarch.rpm 769 kB/s | 64 kB 00:00 2024-06-02T03:54:25.772 INFO:teuthology.orchestra.run.smithi162.stdout:(27/146): ceph-grafana-dashboards-18.2.2-1381.g 417 kB/s | 24 kB 00:00 2024-06-02T03:54:25.789 INFO:teuthology.orchestra.run.smithi123.stdout:(60/146): python3-singledispatch-3.4.0.3-18.el8 358 kB/s | 24 kB 00:00 2024-06-02T03:54:25.822 INFO:teuthology.orchestra.run.smithi123.stdout:(61/146): python3-simplegeneric-0.8.1-17.el8.no 149 kB/s | 19 kB 00:00 2024-06-02T03:54:25.872 INFO:teuthology.orchestra.run.smithi162.stdout:(28/146): librgw2-18.2.2-1381.g3bb45379.el8.x86 3.5 MB/s | 6.5 MB 00:01 2024-06-02T03:54:25.890 INFO:teuthology.orchestra.run.smithi123.stdout:(62/146): python3-trustme-0.6.0-4.el8.noarch.rp 413 kB/s | 27 kB 00:00 2024-06-02T03:54:25.898 INFO:teuthology.orchestra.run.smithi162.stdout:(29/146): ceph-mgr-cephadm-18.2.2-1381.g3bb4537 1.1 MB/s | 138 kB 00:00 2024-06-02T03:54:25.957 INFO:teuthology.orchestra.run.smithi123.stdout:(63/146): python3-tempora-1.14.1-5.el8.noarch.r 175 kB/s | 29 kB 00:00 2024-06-02T03:54:25.982 INFO:teuthology.orchestra.run.smithi123.stdout:(64/146): python3-waitress-1.4.3-1.el8.noarch.r 2.7 MB/s | 255 kB 00:00 2024-06-02T03:54:26.038 INFO:teuthology.orchestra.run.smithi136.stdout:(25/146): rbd-mirror-18.2.2-1381.g3bb45379.el8. 4.6 MB/s | 3.5 MB 00:00 2024-06-02T03:54:26.051 INFO:teuthology.orchestra.run.smithi123.stdout:(65/146): python3-websocket-client-0.56.0-5.el8 919 kB/s | 61 kB 00:00 2024-06-02T03:54:26.074 INFO:teuthology.orchestra.run.smithi123.stdout:(66/146): python3-webob-1.8.5-1.el8.1.noarch.rp 2.1 MB/s | 251 kB 00:00 2024-06-02T03:54:26.121 INFO:teuthology.orchestra.run.smithi136.stdout:(26/146): rbd-nbd-18.2.2-1381.g3bb45379.el8.x86 2.1 MB/s | 181 kB 00:00 2024-06-02T03:54:26.124 INFO:teuthology.orchestra.run.smithi123.stdout:(67/146): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2024-06-02T03:54:26.191 INFO:teuthology.orchestra.run.smithi123.stdout:(68/146): python3-zc-lockfile-2.0-2.el8.noarch. 196 kB/s | 23 kB 00:00 2024-06-02T03:54:26.196 INFO:teuthology.orchestra.run.smithi136.stdout:(27/146): ceph-grafana-dashboards-18.2.2-1381.g 323 kB/s | 24 kB 00:00 2024-06-02T03:54:26.208 INFO:teuthology.orchestra.run.smithi123.stdout:(69/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 4.1 MB/s | 70 kB 00:00 2024-06-02T03:54:26.250 INFO:teuthology.orchestra.run.smithi123.stdout:(70/146): thrift-0.13.0-2.el8.x86_64.rpm 14 MB/s | 1.7 MB 00:00 2024-06-02T03:54:26.280 INFO:teuthology.orchestra.run.smithi136.stdout:(28/146): ceph-mgr-cephadm-18.2.2-1381.g3bb4537 1.6 MB/s | 138 kB 00:00 2024-06-02T03:54:26.334 INFO:teuthology.orchestra.run.smithi123.stdout:(71/146): python3-packaging-16.8-9.el8.noarch.r 385 kB/s | 48 kB 00:00 2024-06-02T03:54:26.442 INFO:teuthology.orchestra.run.smithi123.stdout:(72/146): python3-jsonpointer-1.10-11.el8.noarc 107 kB/s | 20 kB 00:00 2024-06-02T03:54:26.484 INFO:teuthology.orchestra.run.smithi123.stdout:(73/146): python3-prettytable-0.7.2-14.el8.noar 292 kB/s | 44 kB 00:00 2024-06-02T03:54:26.576 INFO:teuthology.orchestra.run.smithi123.stdout:(74/146): python3-pyasn1-modules-0.3.7-6.el8.no 825 kB/s | 110 kB 00:00 2024-06-02T03:54:26.601 INFO:teuthology.orchestra.run.smithi123.stdout:(75/146): python3-jsonpatch-1.21-2.el8.noarch.r 227 kB/s | 27 kB 00:00 2024-06-02T03:54:26.677 INFO:teuthology.orchestra.run.smithi123.stdout:(76/146): python3-werkzeug-0.12.2-4.el8.noarch. 6.0 MB/s | 457 kB 00:00 2024-06-02T03:54:26.702 INFO:teuthology.orchestra.run.smithi123.stdout:(77/146): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.0 MB/s | 126 kB 00:00 2024-06-02T03:54:26.802 INFO:teuthology.orchestra.run.smithi123.stdout:(78/146): bison-3.0.4-10.el8.x86_64.rpm 5.4 MB/s | 688 kB 00:00 2024-06-02T03:54:26.828 INFO:teuthology.orchestra.run.smithi123.stdout:(79/146): flex-2.6.1-9.el8.x86_64.rpm 2.5 MB/s | 320 kB 00:00 2024-06-02T03:54:26.855 INFO:teuthology.orchestra.run.smithi136.stdout:(29/146): ceph-osd-18.2.2-1381.g3bb45379.el8.x8 2.1 MB/s | 18 MB 00:08 2024-06-02T03:54:26.948 INFO:teuthology.orchestra.run.smithi162.stdout:(30/146): ceph-mgr-dashboard-18.2.2-1381.g3bb45 3.3 MB/s | 3.5 MB 00:01 2024-06-02T03:54:26.961 INFO:teuthology.orchestra.run.smithi123.stdout:(80/146): libtool-2.4.6-25.el8.x86_64.rpm 4.4 MB/s | 709 kB 00:00 2024-06-02T03:54:26.978 INFO:teuthology.orchestra.run.smithi123.stdout:(81/146): python3-markupsafe-0.23-19.el8.x86_64 258 kB/s | 39 kB 00:00 2024-06-02T03:54:27.065 INFO:teuthology.orchestra.run.smithi162.stdout:(31/146): ceph-mgr-modules-core-18.2.2-1381.g3b 2.1 MB/s | 246 kB 00:00 2024-06-02T03:54:27.148 INFO:teuthology.orchestra.run.smithi162.stdout:(32/146): ceph-mgr-rook-18.2.2-1381.g3bb45379.e 591 kB/s | 49 kB 00:00 2024-06-02T03:54:27.153 INFO:teuthology.orchestra.run.smithi136.stdout:(30/146): ceph-mgr-dashboard-18.2.2-1381.g3bb45 4.0 MB/s | 3.5 MB 00:00 2024-06-02T03:54:27.215 INFO:teuthology.orchestra.run.smithi162.stdout:(33/146): ceph-prometheus-alerts-18.2.2-1381.g3 245 kB/s | 16 kB 00:00 2024-06-02T03:54:27.223 INFO:teuthology.orchestra.run.smithi136.stdout:(31/146): ceph-mgr-modules-core-18.2.2-1381.g3b 3.5 MB/s | 246 kB 00:00 2024-06-02T03:54:27.281 INFO:teuthology.orchestra.run.smithi136.stdout:(32/146): ceph-mgr-rook-18.2.2-1381.g3bb45379.e 846 kB/s | 49 kB 00:00 2024-06-02T03:54:27.340 INFO:teuthology.orchestra.run.smithi136.stdout:(33/146): ceph-prometheus-alerts-18.2.2-1381.g3 281 kB/s | 16 kB 00:00 2024-06-02T03:54:27.407 INFO:teuthology.orchestra.run.smithi136.stdout:(34/146): ceph-volume-18.2.2-1381.g3bb45379.el8 3.9 MB/s | 263 kB 00:00 2024-06-02T03:54:27.471 INFO:teuthology.orchestra.run.smithi123.stdout:(82/146): ceph-test-18.2.2-1381.g3bb45379.el8.x 4.2 MB/s | 47 MB 00:11 2024-06-02T03:54:27.487 INFO:teuthology.orchestra.run.smithi123.stdout:(83/146): uuid-1.6.2-43.el8.x86_64.rpm 126 kB/s | 64 kB 00:00 2024-06-02T03:54:27.507 INFO:teuthology.orchestra.run.smithi136.stdout:(35/146): cephadm-18.2.2-1381.g3bb45379.el8.noa 1.7 MB/s | 170 kB 00:00 2024-06-02T03:54:27.529 INFO:teuthology.orchestra.run.smithi123.stdout:(84/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 457 kB/s | 259 kB 00:00 2024-06-02T03:54:27.557 INFO:teuthology.orchestra.run.smithi136.stdout:(36/146): cephfs-top-18.2.2-1381.g3bb45379.el8. 363 kB/s | 18 kB 00:00 2024-06-02T03:54:27.579 INFO:teuthology.orchestra.run.smithi123.stdout:(85/146): python3-pyOpenSSL-19.0.0-1.el8.noarch 955 kB/s | 103 kB 00:00 2024-06-02T03:54:27.582 INFO:teuthology.orchestra.run.smithi162.stdout:(34/146): ceph-volume-18.2.2-1381.g3bb45379.el8 717 kB/s | 263 kB 00:00 2024-06-02T03:54:27.629 INFO:teuthology.orchestra.run.smithi123.stdout:(86/146): python3-jinja2-2.10.1-3.el8.noarch.rp 5.3 MB/s | 538 kB 00:00 2024-06-02T03:54:27.675 INFO:teuthology.orchestra.run.smithi162.stdout:(35/146): ceph-mgr-diskprediction-local-18.2.2- 4.2 MB/s | 7.4 MB 00:01 2024-06-02T03:54:27.730 INFO:teuthology.orchestra.run.smithi123.stdout:(87/146): python3-babel-2.5.1-7.el8.noarch.rpm 20 MB/s | 4.8 MB 00:00 2024-06-02T03:54:27.742 INFO:teuthology.orchestra.run.smithi162.stdout:(36/146): cephadm-18.2.2-1381.g3bb45379.el8.noa 1.0 MB/s | 170 kB 00:00 2024-06-02T03:54:27.755 INFO:teuthology.orchestra.run.smithi123.stdout:(88/146): socat-1.7.4.1-1.el8.x86_64.rpm 2.5 MB/s | 323 kB 00:00 2024-06-02T03:54:27.775 INFO:teuthology.orchestra.run.smithi162.stdout:(37/146): cephfs-top-18.2.2-1381.g3bb45379.el8. 181 kB/s | 18 kB 00:00 2024-06-02T03:54:27.839 INFO:teuthology.orchestra.run.smithi123.stdout:(89/146): python3-numpy-1.14.3-10.el8.x86_64.rp 14 MB/s | 3.7 MB 00:00 2024-06-02T03:54:27.872 INFO:teuthology.orchestra.run.smithi123.stdout:(90/146): librdkafka-0.11.4-3.el8.x86_64.rpm 3.0 MB/s | 354 kB 00:00 2024-06-02T03:54:27.908 INFO:teuthology.orchestra.run.smithi136.stdout:(37/146): ceph-mgr-diskprediction-local-18.2.2- 7.0 MB/s | 7.4 MB 00:01 2024-06-02T03:54:27.923 INFO:teuthology.orchestra.run.smithi123.stdout:(91/146): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.1 MB/s | 225 kB 00:00 2024-06-02T03:54:28.006 INFO:teuthology.orchestra.run.smithi123.stdout:(92/146): python3-mako-1.0.6-14.el8.noarch.rpm 1.1 MB/s | 157 kB 00:00 2024-06-02T03:54:28.008 INFO:teuthology.orchestra.run.smithi136.stdout:(38/146): gperftools-libs-2.7-9.el8.x86_64.rpm 680 kB/s | 306 kB 00:00 2024-06-02T03:54:28.090 INFO:teuthology.orchestra.run.smithi123.stdout:(93/146): openblas-threads-0.3.15-6.el8.x86_64. 21 MB/s | 5.2 MB 00:00 2024-06-02T03:54:28.134 INFO:teuthology.orchestra.run.smithi136.stdout:(39/146): libunwind-1.3.1-3.el8.x86_64.rpm 598 kB/s | 75 kB 00:00 2024-06-02T03:54:28.142 INFO:teuthology.orchestra.run.smithi162.stdout:(38/146): liboath-2.6.2-3.el8.x86_64.rpm 160 kB/s | 59 kB 00:00 2024-06-02T03:54:28.207 INFO:teuthology.orchestra.run.smithi123.stdout:(94/146): openblas-0.3.15-6.el8.x86_64.rpm 18 MB/s | 5.0 MB 00:00 2024-06-02T03:54:28.232 INFO:teuthology.orchestra.run.smithi123.stdout:(95/146): libpq-13.11-1.el8.x86_64.rpm 1.4 MB/s | 198 kB 00:00 2024-06-02T03:54:28.266 INFO:teuthology.orchestra.run.smithi123.stdout:(96/146): automake-1.16.1-8.el8.noarch.rpm 2.7 MB/s | 714 kB 00:00 2024-06-02T03:54:28.301 INFO:teuthology.orchestra.run.smithi162.stdout:(39/146): gperftools-libs-2.7-9.el8.x86_64.rpm 549 kB/s | 306 kB 00:00 2024-06-02T03:54:28.334 INFO:teuthology.orchestra.run.smithi162.stdout:(40/146): libunwind-1.3.1-3.el8.x86_64.rpm 391 kB/s | 75 kB 00:00 2024-06-02T03:54:28.341 INFO:teuthology.orchestra.run.smithi123.stdout:(97/146): jq-1.6-7.el8.x86_64.rpm 1.5 MB/s | 202 kB 00:00 2024-06-02T03:54:28.393 INFO:teuthology.orchestra.run.smithi123.stdout:(98/146): python3-pytz-2017.2-11.el8.noarch.rpm 337 kB/s | 54 kB 00:00 2024-06-02T03:54:28.443 INFO:teuthology.orchestra.run.smithi162.stdout:(41/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 403 kB/s | 44 kB 00:00 2024-06-02T03:54:28.466 INFO:teuthology.orchestra.run.smithi123.stdout:(99/146): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-06-02T03:54:28.502 INFO:teuthology.orchestra.run.smithi162.stdout:(42/146): python3-asyncssh-2.7.0-2.el8.noarch.r 2.3 MB/s | 476 kB 00:00 2024-06-02T03:54:28.567 INFO:teuthology.orchestra.run.smithi123.stdout:(100/146): postgresql-10.23-4.module+el8.9.0+21 8.7 MB/s | 1.5 MB 00:00 2024-06-02T03:54:28.592 INFO:teuthology.orchestra.run.smithi136.stdout:(40/146): ceph-test-18.2.2-1381.g3bb45379.el8.x 5.0 MB/s | 47 MB 00:09 2024-06-02T03:54:28.617 INFO:teuthology.orchestra.run.smithi136.stdout:(41/146): liboath-2.6.2-3.el8.x86_64.rpm 83 kB/s | 59 kB 00:00 2024-06-02T03:54:28.635 INFO:teuthology.orchestra.run.smithi162.stdout:(43/146): python3-cachetools-3.1.1-4.el8.noarch 248 kB/s | 33 kB 00:00 2024-06-02T03:54:28.642 INFO:teuthology.orchestra.run.smithi136.stdout:(42/146): python3-asyncssh-2.7.0-2.el8.noarch.r 937 kB/s | 476 kB 00:00 2024-06-02T03:54:28.660 INFO:teuthology.orchestra.run.smithi162.stdout:(44/146): python3-beautifulsoup4-4.6.3-2.el8.1. 853 kB/s | 185 kB 00:00 2024-06-02T03:54:28.717 INFO:teuthology.orchestra.run.smithi136.stdout:(43/146): python3-cachetools-3.1.1-4.el8.noarch 468 kB/s | 33 kB 00:00 2024-06-02T03:54:28.725 INFO:teuthology.orchestra.run.smithi123.stdout:(101/146): python3-scipy-1.0.0-21.module+el8.9. 30 MB/s | 14 MB 00:00 2024-06-02T03:54:28.752 INFO:teuthology.orchestra.run.smithi162.stdout:(45/146): python3-certifi-2018.10.15-7.el8.noar 139 kB/s | 16 kB 00:00 2024-06-02T03:54:28.758 INFO:teuthology.orchestra.run.smithi123.stdout:(102/146): postgresql-contrib-10.23-4.module+el 2.7 MB/s | 812 kB 00:00 2024-06-02T03:54:28.776 INFO:teuthology.orchestra.run.smithi136.stdout:(44/146): python3-beautifulsoup4-4.6.3-2.el8.1. 1.1 MB/s | 185 kB 00:00 2024-06-02T03:54:28.778 INFO:teuthology.orchestra.run.smithi162.stdout:(46/146): python3-cheroot-8.5.2-1.el8.noarch.rp 1.4 MB/s | 173 kB 00:00 2024-06-02T03:54:28.801 INFO:teuthology.orchestra.run.smithi136.stdout:(45/146): python3-certifi-2018.10.15-7.el8.noar 197 kB/s | 16 kB 00:00 2024-06-02T03:54:28.868 INFO:teuthology.orchestra.run.smithi136.stdout:(46/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 158 kB/s | 44 kB 00:00 2024-06-02T03:54:28.878 INFO:teuthology.orchestra.run.smithi162.stdout:(47/146): python3-cherrypy-18.4.0-1.el8.noarch. 3.0 MB/s | 384 kB 00:00 2024-06-02T03:54:28.892 INFO:teuthology.orchestra.run.smithi123.stdout:(103/146): postgresql-server-10.23-4.module+el8 16 MB/s | 5.1 MB 00:00 2024-06-02T03:54:28.895 INFO:teuthology.orchestra.run.smithi162.stdout:(48/146): python3-google-auth-1.1.1-10.el8.noar 695 kB/s | 81 kB 00:00 2024-06-02T03:54:28.917 INFO:teuthology.orchestra.run.smithi123.stdout:(104/146): libverto-devel-0.3.0-5.el8.x86_64.rp 93 kB/s | 18 kB 00:00 2024-06-02T03:54:28.918 INFO:teuthology.orchestra.run.smithi136.stdout:(47/146): python3-cheroot-8.5.2-1.el8.noarch.rp 1.2 MB/s | 173 kB 00:00 2024-06-02T03:54:28.935 INFO:teuthology.orchestra.run.smithi136.stdout:(48/146): python3-cherrypy-18.4.0-1.el8.noarch. 2.8 MB/s | 384 kB 00:00 2024-06-02T03:54:28.943 INFO:teuthology.orchestra.run.smithi123.stdout:(105/146): python3-jwt-1.6.1-2.el8.noarch.rpm 231 kB/s | 43 kB 00:00 2024-06-02T03:54:28.970 INFO:teuthology.orchestra.run.smithi162.stdout:(49/146): python3-jaraco-6.2-6.el8.noarch.rpm 121 kB/s | 11 kB 00:00 2024-06-02T03:54:28.986 INFO:teuthology.orchestra.run.smithi136.stdout:(49/146): python3-jaraco-6.2-6.el8.noarch.rpm 166 kB/s | 11 kB 00:00 2024-06-02T03:54:28.996 INFO:teuthology.orchestra.run.smithi162.stdout:(50/146): python3-jaraco-functools-2.0-4.el8.no 175 kB/s | 18 kB 00:00 2024-06-02T03:54:29.002 INFO:teuthology.orchestra.run.smithi136.stdout:(50/146): python3-google-auth-1.1.1-10.el8.noar 606 kB/s | 81 kB 00:00 2024-06-02T03:54:29.028 INFO:teuthology.orchestra.run.smithi136.stdout:(51/146): python3-jaraco-functools-2.0-4.el8.no 191 kB/s | 18 kB 00:00 2024-06-02T03:54:29.035 INFO:teuthology.orchestra.run.smithi123.stdout:(106/146): python3-oauthlib-2.1.0-1.el8.noarch. 1.1 MB/s | 155 kB 00:00 2024-06-02T03:54:29.103 INFO:teuthology.orchestra.run.smithi136.stdout:(52/146): python3-logutils-0.3.5-11.el8.noarch. 652 kB/s | 49 kB 00:00 2024-06-02T03:54:29.104 INFO:teuthology.orchestra.run.smithi162.stdout:(51/146): python3-logutils-0.3.5-11.el8.noarch. 450 kB/s | 49 kB 00:00 2024-06-02T03:54:29.128 INFO:teuthology.orchestra.run.smithi136.stdout:(53/146): python3-more-itertools-7.2.0-3.el8.no 587 kB/s | 59 kB 00:00 2024-06-02T03:54:29.178 INFO:teuthology.orchestra.run.smithi136.stdout:(54/146): python3-natsort-7.1.1-2.el8.noarch.rp 802 kB/s | 60 kB 00:00 2024-06-02T03:54:29.188 INFO:teuthology.orchestra.run.smithi162.stdout:(52/146): python3-kubernetes-11.0.0-6.el8.noarc 5.4 MB/s | 1.2 MB 00:00 2024-06-02T03:54:29.213 INFO:teuthology.orchestra.run.smithi162.stdout:(53/146): python3-more-itertools-7.2.0-3.el8.no 540 kB/s | 59 kB 00:00 2024-06-02T03:54:29.227 INFO:teuthology.orchestra.run.smithi123.stdout:(107/146): python3-requests-oauthlib-1.0.0-1.el 150 kB/s | 43 kB 00:00 2024-06-02T03:54:29.237 INFO:teuthology.orchestra.run.smithi136.stdout:(55/146): python3-kubernetes-11.0.0-6.el8.noarc 4.6 MB/s | 1.2 MB 00:00 2024-06-02T03:54:29.243 INFO:teuthology.orchestra.run.smithi123.stdout:(108/146): python3-pycparser-2.14-14.el8.noarch 335 kB/s | 109 kB 00:00 2024-06-02T03:54:29.262 INFO:teuthology.orchestra.run.smithi136.stdout:(56/146): python3-portend-2.6-1.el8.noarch.rpm 186 kB/s | 16 kB 00:00 2024-06-02T03:54:29.279 INFO:teuthology.orchestra.run.smithi136.stdout:(57/146): python3-pecan-1.3.2-9.el8.noarch.rpm 1.8 MB/s | 283 kB 00:00 2024-06-02T03:54:29.297 INFO:teuthology.orchestra.run.smithi162.stdout:(54/146): python3-natsort-7.1.1-2.el8.noarch.rp 554 kB/s | 60 kB 00:00 2024-06-02T03:54:29.313 INFO:teuthology.orchestra.run.smithi136.stdout:(58/146): python3-repoze-lru-0.7-6.el8.noarch.r 446 kB/s | 34 kB 00:00 2024-06-02T03:54:29.338 INFO:teuthology.orchestra.run.smithi136.stdout:(59/146): python3-routes-2.4.1-12.el8.noarch.rp 2.5 MB/s | 196 kB 00:00 2024-06-02T03:54:29.347 INFO:teuthology.orchestra.run.smithi162.stdout:(55/146): python3-pecan-1.3.2-9.el8.noarch.rpm 2.1 MB/s | 283 kB 00:00 2024-06-02T03:54:29.351 INFO:teuthology.orchestra.run.smithi123.stdout:(109/146): libaio-devel-0.3.112-1.el8.x86_64.rp 59 kB/s | 19 kB 00:00 2024-06-02T03:54:29.363 INFO:teuthology.orchestra.run.smithi136.stdout:(60/146): python3-rsa-4.9-2.el8.noarch.rpm 765 kB/s | 64 kB 00:00 2024-06-02T03:54:29.387 INFO:teuthology.orchestra.run.smithi123.stdout:(110/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 276 kB/s | 44 kB 00:00 2024-06-02T03:54:29.389 INFO:teuthology.orchestra.run.smithi136.stdout:(61/146): python3-simplegeneric-0.8.1-17.el8.no 247 kB/s | 19 kB 00:00 2024-06-02T03:54:29.390 INFO:teuthology.orchestra.run.smithi162.stdout:(56/146): python3-portend-2.6-1.el8.noarch.rpm 170 kB/s | 16 kB 00:00 2024-06-02T03:54:29.414 INFO:teuthology.orchestra.run.smithi136.stdout:(62/146): python3-singledispatch-3.4.0.3-18.el8 316 kB/s | 24 kB 00:00 2024-06-02T03:54:29.448 INFO:teuthology.orchestra.run.smithi136.stdout:(63/146): python3-tempora-1.14.1-5.el8.noarch.r 348 kB/s | 29 kB 00:00 2024-06-02T03:54:29.473 INFO:teuthology.orchestra.run.smithi136.stdout:(64/146): python3-trustme-0.6.0-4.el8.noarch.rp 329 kB/s | 27 kB 00:00 2024-06-02T03:54:29.490 INFO:teuthology.orchestra.run.smithi162.stdout:(57/146): python3-repoze-lru-0.7-6.el8.noarch.r 237 kB/s | 34 kB 00:00 2024-06-02T03:54:29.498 INFO:teuthology.orchestra.run.smithi136.stdout:(65/146): python3-waitress-1.4.3-1.el8.noarch.r 3.0 MB/s | 255 kB 00:00 2024-06-02T03:54:29.515 INFO:teuthology.orchestra.run.smithi162.stdout:(58/146): python3-routes-2.4.1-12.el8.noarch.rp 1.5 MB/s | 196 kB 00:00 2024-06-02T03:54:29.544 INFO:teuthology.orchestra.run.smithi123.stdout:(111/146): pcre2-devel-10.32-2.el8.x86_64.rpm 2.0 MB/s | 605 kB 00:00 2024-06-02T03:54:29.565 INFO:teuthology.orchestra.run.smithi136.stdout:(66/146): python3-webob-1.8.5-1.el8.1.noarch.rp 2.1 MB/s | 251 kB 00:00 2024-06-02T03:54:29.591 INFO:teuthology.orchestra.run.smithi136.stdout:(67/146): python3-websocket-client-0.56.0-5.el8 523 kB/s | 61 kB 00:00 2024-06-02T03:54:29.607 INFO:teuthology.orchestra.run.smithi162.stdout:(59/146): python3-simplegeneric-0.8.1-17.el8.no 204 kB/s | 19 kB 00:00 2024-06-02T03:54:29.613 INFO:teuthology.orchestra.run.smithi123.stdout:(112/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 876 kB/s | 229 kB 00:00 2024-06-02T03:54:29.616 INFO:teuthology.orchestra.run.smithi136.stdout:(68/146): python3-webtest-2.0.33-1.el8.noarch.r 729 kB/s | 85 kB 00:00 2024-06-02T03:54:29.632 INFO:teuthology.orchestra.run.smithi162.stdout:(60/146): python3-rsa-4.9-2.el8.noarch.rpm 452 kB/s | 64 kB 00:00 2024-06-02T03:54:29.646 INFO:teuthology.orchestra.run.smithi123.stdout:(113/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 852 kB/s | 220 kB 00:00 2024-06-02T03:54:29.650 INFO:teuthology.orchestra.run.smithi136.stdout:(69/146): python3-zc-lockfile-2.0-2.el8.noarch. 274 kB/s | 23 kB 00:00 2024-06-02T03:54:29.675 INFO:teuthology.orchestra.run.smithi136.stdout:(70/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.2 MB/s | 70 kB 00:00 2024-06-02T03:54:29.699 INFO:teuthology.orchestra.run.smithi162.stdout:(61/146): python3-singledispatch-3.4.0.3-18.el8 260 kB/s | 24 kB 00:00 2024-06-02T03:54:29.733 INFO:teuthology.orchestra.run.smithi162.stdout:(62/146): python3-tempora-1.14.1-5.el8.noarch.r 291 kB/s | 29 kB 00:00 2024-06-02T03:54:29.733 INFO:teuthology.orchestra.run.smithi136.stdout:(71/146): python3-packaging-16.8-9.el8.noarch.r 579 kB/s | 48 kB 00:00 2024-06-02T03:54:29.775 INFO:teuthology.orchestra.run.smithi136.stdout:(72/146): thrift-0.13.0-2.el8.x86_64.rpm 9.4 MB/s | 1.7 MB 00:00 2024-06-02T03:54:29.791 INFO:teuthology.orchestra.run.smithi162.stdout:(63/146): python3-trustme-0.6.0-4.el8.noarch.rp 300 kB/s | 27 kB 00:00 2024-06-02T03:54:29.842 INFO:teuthology.orchestra.run.smithi123.stdout:(114/146): libselinux-devel-2.9-5.el8.x86_64.rp 673 kB/s | 200 kB 00:00 2024-06-02T03:54:29.858 INFO:teuthology.orchestra.run.smithi162.stdout:(64/146): python3-waitress-1.4.3-1.el8.noarch.r 2.0 MB/s | 255 kB 00:00 2024-06-02T03:54:29.875 INFO:teuthology.orchestra.run.smithi136.stdout:(73/146): python3-jwt-1.6.1-2.el8.noarch.rpm 300 kB/s | 43 kB 00:00 2024-06-02T03:54:29.896 INFO:teuthology.orchestra.run.smithi123.stdout:(115/146): libsepol-devel-2.9-3.el8.x86_64.rpm 348 kB/s | 87 kB 00:00 2024-06-02T03:54:29.917 INFO:teuthology.orchestra.run.smithi162.stdout:(65/146): python3-webob-1.8.5-1.el8.1.noarch.rp 2.0 MB/s | 251 kB 00:00 2024-06-02T03:54:29.943 INFO:teuthology.orchestra.run.smithi136.stdout:(74/146): python3-oauthlib-2.1.0-1.el8.noarch.r 928 kB/s | 155 kB 00:00 2024-06-02T03:54:29.946 INFO:teuthology.orchestra.run.smithi123.stdout:(116/146): keyutils-libs-devel-1.5.10-9.el8.x86 145 kB/s | 48 kB 00:00 2024-06-02T03:54:29.959 INFO:teuthology.orchestra.run.smithi136.stdout:(75/146): libverto-devel-0.3.0-5.el8.x86_64.rpm 63 kB/s | 18 kB 00:00 2024-06-02T03:54:29.968 INFO:teuthology.orchestra.run.smithi162.stdout:(66/146): python3-websocket-client-0.56.0-5.el8 564 kB/s | 61 kB 00:00 2024-06-02T03:54:30.009 INFO:teuthology.orchestra.run.smithi136.stdout:(76/146): python3-pycparser-2.14-14.el8.noarch. 816 kB/s | 109 kB 00:00 2024-06-02T03:54:30.018 INFO:teuthology.orchestra.run.smithi162.stdout:(67/146): python3-webtest-2.0.33-1.el8.noarch.r 852 kB/s | 85 kB 00:00 2024-06-02T03:54:30.038 INFO:teuthology.orchestra.run.smithi123.stdout:(117/146): zlib-devel-1.2.11-18.el8_5.x86_64.rp 294 kB/s | 58 kB 00:00 2024-06-02T03:54:30.051 INFO:teuthology.orchestra.run.smithi136.stdout:(77/146): python3-requests-oauthlib-1.0.0-1.el8 393 kB/s | 43 kB 00:00 2024-06-02T03:54:30.060 INFO:teuthology.orchestra.run.smithi162.stdout:(68/146): python3-zc-lockfile-2.0-2.el8.noarch. 249 kB/s | 23 kB 00:00 2024-06-02T03:54:30.085 INFO:teuthology.orchestra.run.smithi162.stdout:(69/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2024-06-02T03:54:30.085 INFO:teuthology.orchestra.run.smithi136.stdout:(78/146): libaio-devel-0.3.112-1.el8.x86_64.rpm 149 kB/s | 19 kB 00:00 2024-06-02T03:54:30.113 INFO:teuthology.orchestra.run.smithi123.stdout:(118/146): libcom_err-devel-1.45.6-4.el8.x86_64 178 kB/s | 39 kB 00:00 2024-06-02T03:54:30.180 INFO:teuthology.orchestra.run.smithi123.stdout:(119/146): fuse-2.9.7-17.el8.x86_64.rpm 355 kB/s | 83 kB 00:00 2024-06-02T03:54:30.185 INFO:teuthology.orchestra.run.smithi162.stdout:(70/146): thrift-0.13.0-2.el8.x86_64.rpm 10 MB/s | 1.7 MB 00:00 2024-06-02T03:54:30.193 INFO:teuthology.orchestra.run.smithi136.stdout:(79/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 238 kB/s | 44 kB 00:00 2024-06-02T03:54:30.261 INFO:teuthology.orchestra.run.smithi136.stdout:(80/146): pcre2-devel-10.32-2.el8.x86_64.rpm 2.8 MB/s | 605 kB 00:00 2024-06-02T03:54:30.302 INFO:teuthology.orchestra.run.smithi136.stdout:(81/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 2.0 MB/s | 220 kB 00:00 2024-06-02T03:54:30.327 INFO:teuthology.orchestra.run.smithi136.stdout:(82/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 945 kB/s | 229 kB 00:00 2024-06-02T03:54:30.352 INFO:teuthology.orchestra.run.smithi162.stdout:(71/146): libverto-devel-0.3.0-5.el8.x86_64.rpm 107 kB/s | 18 kB 00:00 2024-06-02T03:54:30.380 INFO:teuthology.orchestra.run.smithi123.stdout:(120/146): libquadmath-8.5.0-20.el8.x86_64.rpm 645 kB/s | 172 kB 00:00 2024-06-02T03:54:30.386 INFO:teuthology.orchestra.run.smithi136.stdout:(83/146): libselinux-devel-2.9-5.el8.x86_64.rpm 1.6 MB/s | 200 kB 00:00 2024-06-02T03:54:30.411 INFO:teuthology.orchestra.run.smithi136.stdout:(84/146): libsepol-devel-2.9-3.el8.x86_64.rpm 1.0 MB/s | 87 kB 00:00 2024-06-02T03:54:30.422 INFO:teuthology.orchestra.run.smithi123.stdout:(121/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 982 kB/s | 238 kB 00:00 2024-06-02T03:54:30.447 INFO:teuthology.orchestra.run.smithi123.stdout:(122/146): libgfortran-8.5.0-20.el8.x86_64.rpm 1.5 MB/s | 645 kB 00:00 2024-06-02T03:54:30.511 INFO:teuthology.orchestra.run.smithi136.stdout:(85/146): keyutils-libs-devel-1.5.10-9.el8.x86_ 230 kB/s | 48 kB 00:00 2024-06-02T03:54:30.537 INFO:teuthology.orchestra.run.smithi136.stdout:(86/146): libcom_err-devel-1.45.6-4.el8.x86_64. 308 kB/s | 39 kB 00:00 2024-06-02T03:54:30.631 INFO:teuthology.orchestra.run.smithi123.stdout:(123/146): krb5-devel-1.18.2-26.el8_9.x86_64.rp 3.0 MB/s | 562 kB 00:00 2024-06-02T03:54:30.656 INFO:teuthology.orchestra.run.smithi123.stdout:(124/146): elfutils-libelf-devel-0.189-3.el8.x8 264 kB/s | 62 kB 00:00 2024-06-02T03:54:30.662 INFO:teuthology.orchestra.run.smithi136.stdout:(87/146): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 209 kB/s | 58 kB 00:00 2024-06-02T03:54:30.687 INFO:teuthology.orchestra.run.smithi136.stdout:(88/146): libgfortran-8.5.0-20.el8.x86_64.rpm 4.2 MB/s | 645 kB 00:00 2024-06-02T03:54:30.811 INFO:teuthology.orchestra.run.smithi162.stdout:(72/146): ceph-test-18.2.2-1381.g3bb45379.el8.x 6.1 MB/s | 47 MB 00:07 2024-06-02T03:54:30.845 INFO:teuthology.orchestra.run.smithi162.stdout:(73/146): python3-jwt-1.6.1-2.el8.noarch.rpm 87 kB/s | 43 kB 00:00 2024-06-02T03:54:30.878 INFO:teuthology.orchestra.run.smithi162.stdout:(74/146): python3-packaging-16.8-9.el8.noarch.r 61 kB/s | 48 kB 00:00 2024-06-02T03:54:30.898 INFO:teuthology.orchestra.run.smithi123.stdout:(125/146): xfsprogs-devel-5.0.0-12.el8.x86_64.r 140 kB/s | 73 kB 00:00 2024-06-02T03:54:30.962 INFO:teuthology.orchestra.run.smithi162.stdout:(75/146): python3-pycparser-2.14-14.el8.noarch. 981 kB/s | 109 kB 00:00 2024-06-02T03:54:31.120 INFO:teuthology.orchestra.run.smithi162.stdout:(76/146): python3-oauthlib-2.1.0-1.el8.noarch.r 502 kB/s | 155 kB 00:00 2024-06-02T03:54:31.123 INFO:teuthology.orchestra.run.smithi123.stdout:(126/146): openssl-devel-1.1.1k-12.el8_9.x86_64 4.7 MB/s | 2.3 MB 00:00 2024-06-02T03:54:31.146 INFO:teuthology.orchestra.run.smithi162.stdout:(77/146): python3-requests-oauthlib-1.0.0-1.el8 160 kB/s | 43 kB 00:00 2024-06-02T03:54:31.161 INFO:teuthology.orchestra.run.smithi136.stdout:(89/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 503 kB/s | 238 kB 00:00 2024-06-02T03:54:31.213 INFO:teuthology.orchestra.run.smithi136.stdout:(90/146): fuse-2.9.7-17.el8.x86_64.rpm 118 kB/s | 83 kB 00:00 2024-06-02T03:54:31.216 INFO:teuthology.orchestra.run.smithi123.stdout:(127/146): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 84 kB/s | 47 kB 00:00 2024-06-02T03:54:31.221 INFO:teuthology.orchestra.run.smithi162.stdout:(78/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 437 kB/s | 44 kB 00:00 2024-06-02T03:54:31.238 INFO:teuthology.orchestra.run.smithi136.stdout:(91/146): libquadmath-8.5.0-20.el8.x86_64.rpm 299 kB/s | 172 kB 00:00 2024-06-02T03:54:31.263 INFO:teuthology.orchestra.run.smithi162.stdout:(79/146): pcre2-devel-10.32-2.el8.x86_64.rpm 5.1 MB/s | 605 kB 00:00 2024-06-02T03:54:31.288 INFO:teuthology.orchestra.run.smithi162.stdout:(80/146): libaio-devel-0.3.112-1.el8.x86_64.rpm 57 kB/s | 19 kB 00:00 2024-06-02T03:54:31.298 INFO:teuthology.orchestra.run.smithi123.stdout:(128/146): NetworkManager-initscripts-updown-1. 827 kB/s | 144 kB 00:00 2024-06-02T03:54:31.339 INFO:teuthology.orchestra.run.smithi136.stdout:(92/146): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 408 kB/s | 73 kB 00:00 2024-06-02T03:54:31.364 INFO:teuthology.orchestra.run.smithi136.stdout:(93/146): elfutils-libelf-devel-0.189-3.el8.x86 410 kB/s | 62 kB 00:00 2024-06-02T03:54:31.383 INFO:teuthology.orchestra.run.smithi123.stdout:(129/146): python3-cryptography-3.2.1-7.el8_9.x 1.1 MB/s | 559 kB 00:00 2024-06-02T03:54:31.398 INFO:teuthology.orchestra.run.smithi136.stdout:(94/146): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 3.5 MB/s | 562 kB 00:00 2024-06-02T03:54:31.413 INFO:teuthology.orchestra.run.smithi162.stdout:(81/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.2 MB/s | 229 kB 00:00 2024-06-02T03:54:31.425 INFO:teuthology.orchestra.run.smithi123.stdout:(130/146): libuuid-devel-2.32.1-44.el8_9.1.x86_ 478 kB/s | 100 kB 00:00 2024-06-02T03:54:31.431 INFO:teuthology.orchestra.run.smithi136.stdout:(95/146): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 704 kB/s | 47 kB 00:00 2024-06-02T03:54:31.439 INFO:teuthology.orchestra.run.smithi162.stdout:(82/146): libselinux-devel-2.9-5.el8.x86_64.rpm 1.3 MB/s | 200 kB 00:00 2024-06-02T03:54:31.472 INFO:teuthology.orchestra.run.smithi162.stdout:(83/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.0 MB/s | 220 kB 00:00 2024-06-02T03:54:31.548 INFO:teuthology.orchestra.run.smithi136.stdout:(96/146): openssl-devel-1.1.1k-12.el8_9.x86_64. 11 MB/s | 2.3 MB 00:00 2024-06-02T03:54:31.581 INFO:teuthology.orchestra.run.smithi162.stdout:(84/146): keyutils-libs-devel-1.5.10-9.el8.x86_ 287 kB/s | 48 kB 00:00 2024-06-02T03:54:31.581 INFO:teuthology.orchestra.run.smithi136.stdout:(97/146): python3-cryptography-3.2.1-7.el8_9.x8 3.0 MB/s | 559 kB 00:00 2024-06-02T03:54:31.648 INFO:teuthology.orchestra.run.smithi162.stdout:(85/146): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 329 kB/s | 58 kB 00:00 2024-06-02T03:54:31.673 INFO:teuthology.orchestra.run.smithi162.stdout:(86/146): libsepol-devel-2.9-3.el8.x86_64.rpm 371 kB/s | 87 kB 00:00 2024-06-02T03:54:31.674 INFO:teuthology.orchestra.run.smithi136.stdout:(98/146): libuuid-devel-2.32.1-44.el8_9.1.x86_6 799 kB/s | 100 kB 00:00 2024-06-02T03:54:31.699 INFO:teuthology.orchestra.run.smithi136.stdout:(99/146): python3-jsonpointer-1.10-11.el8.noarc 171 kB/s | 20 kB 00:00 2024-06-02T03:54:31.723 INFO:teuthology.orchestra.run.smithi162.stdout:(87/146): libcom_err-devel-1.45.6-4.el8.x86_64. 271 kB/s | 39 kB 00:00 2024-06-02T03:54:31.781 INFO:teuthology.orchestra.run.smithi123.stdout:(131/146): librbd1-18.2.2-1381.g3bb45379.el8.x8 9.0 MB/s | 3.6 MB 00:00 2024-06-02T03:54:31.815 INFO:teuthology.orchestra.run.smithi162.stdout:(88/146): fuse-2.9.7-17.el8.x86_64.rpm 497 kB/s | 83 kB 00:00 2024-06-02T03:54:31.817 INFO:teuthology.orchestra.run.smithi123.stdout:(132/146): elfutils-libelf-0.189-3.el8.x86_64.r 592 kB/s | 232 kB 00:00 2024-06-02T03:54:31.846 INFO:teuthology.orchestra.run.smithi136.stdout:(100/146): python3-pyasn1-modules-0.3.7-6.el8.n 750 kB/s | 110 kB 00:00 2024-06-02T03:54:31.849 INFO:teuthology.orchestra.run.smithi162.stdout:(89/146): libgfortran-8.5.0-20.el8.x86_64.rpm 3.6 MB/s | 645 kB 00:00 2024-06-02T03:54:31.874 INFO:teuthology.orchestra.run.smithi162.stdout:(90/146): libquadmath-8.5.0-20.el8.x86_64.rpm 1.1 MB/s | 172 kB 00:00 2024-06-02T03:54:31.875 INFO:teuthology.orchestra.run.smithi136.stdout:(101/146): python3-prettytable-0.7.2-14.el8.noa 221 kB/s | 44 kB 00:00 2024-06-02T03:54:31.900 INFO:teuthology.orchestra.run.smithi162.stdout:(91/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.8 MB/s | 238 kB 00:00 2024-06-02T03:54:31.917 INFO:teuthology.orchestra.run.smithi123.stdout:(133/146): librados2-18.2.2-1381.g3bb45379.el8. 6.0 MB/s | 3.7 MB 00:00 2024-06-02T03:54:31.975 INFO:teuthology.orchestra.run.smithi162.stdout:(92/146): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 578 kB/s | 73 kB 00:00 2024-06-02T03:54:31.976 INFO:teuthology.orchestra.run.smithi123.stdout:(134/146): elfutils-libs-0.189-3.el8.x86_64.rpm 1.5 MB/s | 303 kB 00:00 2024-06-02T03:54:31.991 INFO:teuthology.orchestra.run.smithi136.stdout:(102/146): python3-jsonpatch-1.21-2.el8.noarch. 183 kB/s | 27 kB 00:00 2024-06-02T03:54:32.050 INFO:teuthology.orchestra.run.smithi136.stdout:(103/146): python3-pyasn1-0.3.7-6.el8.noarch.rp 721 kB/s | 126 kB 00:00 2024-06-02T03:54:32.067 INFO:teuthology.orchestra.run.smithi123.stdout:(135/146): iproute-6.2.0-5.el8_9.x86_64.rpm 3.3 MB/s | 854 kB 00:00 2024-06-02T03:54:32.108 INFO:teuthology.orchestra.run.smithi162.stdout:(93/146): elfutils-libelf-devel-0.189-3.el8.x86 264 kB/s | 62 kB 00:00 2024-06-02T03:54:32.209 INFO:teuthology.orchestra.run.smithi136.stdout:(104/146): bison-3.0.4-10.el8.x86_64.rpm 4.3 MB/s | 688 kB 00:00 2024-06-02T03:54:32.226 INFO:teuthology.orchestra.run.smithi162.stdout:(94/146): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 1.7 MB/s | 562 kB 00:00 2024-06-02T03:54:32.259 INFO:teuthology.orchestra.run.smithi162.stdout:(95/146): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 313 kB/s | 47 kB 00:00 2024-06-02T03:54:32.284 INFO:teuthology.orchestra.run.smithi136.stdout:(105/146): flex-2.6.1-9.el8.x86_64.rpm 4.2 MB/s | 320 kB 00:00 2024-06-02T03:54:32.301 INFO:teuthology.orchestra.run.smithi162.stdout:(96/146): python3-cryptography-3.2.1-7.el8_9.x8 7.3 MB/s | 559 kB 00:00 2024-06-02T03:54:32.393 INFO:teuthology.orchestra.run.smithi162.stdout:(97/146): openssl-devel-1.1.1k-12.el8_9.x86_64. 5.6 MB/s | 2.3 MB 00:00 2024-06-02T03:54:32.418 INFO:teuthology.orchestra.run.smithi162.stdout:(98/146): NetworkManager-initscripts-updown-1.4 909 kB/s | 144 kB 00:00 2024-06-02T03:54:32.426 INFO:teuthology.orchestra.run.smithi123.stdout:(136/146): xfsdump-3.1.8-7.el8_9.x86_64.rpm 930 kB/s | 333 kB 00:00 2024-06-02T03:54:32.434 INFO:teuthology.orchestra.run.smithi136.stdout:(106/146): python3-werkzeug-0.12.2-4.el8.noarch 1.0 MB/s | 457 kB 00:00 2024-06-02T03:54:32.444 INFO:teuthology.orchestra.run.smithi162.stdout:(99/146): libuuid-devel-2.32.1-44.el8_9.1.x86_6 701 kB/s | 100 kB 00:00 2024-06-02T03:54:32.509 INFO:teuthology.orchestra.run.smithi136.stdout:(107/146): libtool-2.4.6-25.el8.x86_64.rpm 3.1 MB/s | 709 kB 00:00 2024-06-02T03:54:32.561 INFO:teuthology.orchestra.run.smithi162.stdout:(100/146): python3-prettytable-0.7.2-14.el8.noa 309 kB/s | 44 kB 00:00 2024-06-02T03:54:32.568 INFO:teuthology.orchestra.run.smithi136.stdout:(108/146): python3-markupsafe-0.23-19.el8.x86_6 291 kB/s | 39 kB 00:00 2024-06-02T03:54:32.586 INFO:teuthology.orchestra.run.smithi162.stdout:(101/146): python3-pyasn1-modules-0.3.7-6.el8.n 776 kB/s | 110 kB 00:00 2024-06-02T03:54:32.643 INFO:teuthology.orchestra.run.smithi123.stdout:(137/146): openssl-1.1.1k-12.el8_9.x86_64.rpm 980 kB/s | 711 kB 00:00 2024-06-02T03:54:32.660 INFO:teuthology.orchestra.run.smithi136.stdout:(109/146): uuid-1.6.2-43.el8.x86_64.rpm 699 kB/s | 64 kB 00:00 2024-06-02T03:54:32.678 INFO:teuthology.orchestra.run.smithi162.stdout:(102/146): python3-jsonpointer-1.10-11.el8.noar 70 kB/s | 20 kB 00:00 2024-06-02T03:54:32.685 INFO:teuthology.orchestra.run.smithi123.stdout:(138/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 4.1 MB/s | 1.1 MB 00:00 2024-06-02T03:54:32.703 INFO:teuthology.orchestra.run.smithi162.stdout:(103/146): python3-jsonpatch-1.21-2.el8.noarch. 187 kB/s | 27 kB 00:00 2024-06-02T03:54:32.737 INFO:teuthology.orchestra.run.smithi162.stdout:(104/146): python3-pyasn1-0.3.7-6.el8.noarch.rp 839 kB/s | 126 kB 00:00 2024-06-02T03:54:32.771 INFO:teuthology.orchestra.run.smithi162.stdout:(105/146): python3-werkzeug-0.12.2-4.el8.noarch 4.8 MB/s | 457 kB 00:00 2024-06-02T03:54:32.777 INFO:teuthology.orchestra.run.smithi123.stdout:(139/146): openssl-libs-1.1.1k-12.el8_9.x86_64. 1.8 MB/s | 1.5 MB 00:00 2024-06-02T03:54:32.821 INFO:teuthology.orchestra.run.smithi162.stdout:(106/146): bison-3.0.4-10.el8.x86_64.rpm 5.7 MB/s | 688 kB 00:00 2024-06-02T03:54:32.824 INFO:teuthology.orchestra.run.smithi136.stdout:(110/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 824 kB/s | 259 kB 00:00 2024-06-02T03:54:32.852 INFO:teuthology.orchestra.run.smithi136.stdout:(111/146): python3-pyOpenSSL-19.0.0-1.el8.noarc 540 kB/s | 103 kB 00:00 2024-06-02T03:54:32.854 INFO:teuthology.orchestra.run.smithi162.stdout:(107/146): libtool-2.4.6-25.el8.x86_64.rpm 8.3 MB/s | 709 kB 00:00 2024-06-02T03:54:32.919 INFO:teuthology.orchestra.run.smithi123.stdout:(140/146): libblkid-2.32.1-44.el8_9.1.x86_64.rp 801 kB/s | 221 kB 00:00 2024-06-02T03:54:32.932 INFO:teuthology.orchestra.run.smithi162.stdout:(108/146): flex-2.6.1-9.el8.x86_64.rpm 1.6 MB/s | 320 kB 00:00 2024-06-02T03:54:32.952 INFO:teuthology.orchestra.run.smithi136.stdout:(112/146): python3-jinja2-2.10.1-3.el8.noarch.r 5.3 MB/s | 538 kB 00:00 2024-06-02T03:54:33.011 INFO:teuthology.orchestra.run.smithi123.stdout:(141/146): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 780 kB/s | 254 kB 00:00 2024-06-02T03:54:33.030 INFO:teuthology.orchestra.run.smithi162.stdout:(109/146): python3-markupsafe-0.23-19.el8.x86_6 186 kB/s | 39 kB 00:00 2024-06-02T03:54:33.036 INFO:teuthology.orchestra.run.smithi123.stdout:(142/146): libmount-2.32.1-44.el8_9.1.x86_64.rp 916 kB/s | 237 kB 00:00 2024-06-02T03:54:33.053 INFO:teuthology.orchestra.run.smithi136.stdout:(113/146): python3-babel-2.5.1-7.el8.noarch.rpm 21 MB/s | 4.8 MB 00:00 2024-06-02T03:54:33.055 INFO:teuthology.orchestra.run.smithi162.stdout:(110/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.3 MB/s | 259 kB 00:00 2024-06-02T03:54:33.081 INFO:teuthology.orchestra.run.smithi162.stdout:(111/146): uuid-1.6.2-43.el8.x86_64.rpm 431 kB/s | 64 kB 00:00 2024-06-02T03:54:33.164 INFO:teuthology.orchestra.run.smithi162.stdout:(112/146): python3-pyOpenSSL-19.0.0-1.el8.noarc 774 kB/s | 103 kB 00:00 2024-06-02T03:54:33.170 INFO:teuthology.orchestra.run.smithi123.stdout:(143/146): libsmartcols-2.32.1-44.el8_9.1.x86_6 717 kB/s | 180 kB 00:00 2024-06-02T03:54:33.186 INFO:teuthology.orchestra.run.smithi136.stdout:(114/146): python3-numpy-1.14.3-10.el8.x86_64.r 16 MB/s | 3.7 MB 00:00 2024-06-02T03:54:33.206 INFO:teuthology.orchestra.run.smithi162.stdout:(113/146): python3-jinja2-2.10.1-3.el8.noarch.r 4.2 MB/s | 538 kB 00:00 2024-06-02T03:54:33.211 INFO:teuthology.orchestra.run.smithi136.stdout:(115/146): socat-1.7.4.1-1.el8.x86_64.rpm 2.0 MB/s | 323 kB 00:00 2024-06-02T03:54:33.312 INFO:teuthology.orchestra.run.smithi123.stdout:(144/146): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 330 kB/s | 99 kB 00:00 2024-06-02T03:54:33.323 INFO:teuthology.orchestra.run.smithi162.stdout:(114/146): python3-babel-2.5.1-7.el8.noarch.rpm 18 MB/s | 4.8 MB 00:00 2024-06-02T03:54:33.370 INFO:teuthology.orchestra.run.smithi136.stdout:(116/146): librdkafka-0.11.4-3.el8.x86_64.rpm 2.2 MB/s | 354 kB 00:00 2024-06-02T03:54:33.378 INFO:teuthology.orchestra.run.smithi123.stdout:(145/146): util-linux-user-2.32.1-44.el8_9.1.x8 493 kB/s | 103 kB 00:00 2024-06-02T03:54:33.390 INFO:teuthology.orchestra.run.smithi162.stdout:(115/146): socat-1.7.4.1-1.el8.x86_64.rpm 1.7 MB/s | 323 kB 00:00 2024-06-02T03:54:33.437 INFO:teuthology.orchestra.run.smithi136.stdout:(117/146): python3-numpy-f2py-1.14.3-10.el8.x86 899 kB/s | 225 kB 00:00 2024-06-02T03:54:33.474 INFO:teuthology.orchestra.run.smithi162.stdout:(116/146): python3-numpy-1.14.3-10.el8.x86_64.r 12 MB/s | 3.7 MB 00:00 2024-06-02T03:54:33.495 INFO:teuthology.orchestra.run.smithi123.stdout:(146/146): util-linux-2.32.1-44.el8_9.1.x86_64. 5.4 MB/s | 2.5 MB 00:00 2024-06-02T03:54:33.498 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-06-02T03:54:33.498 INFO:teuthology.orchestra.run.smithi123.stdout:Total 11 MB/s | 215 MB 00:19 2024-06-02T03:54:33.499 INFO:teuthology.orchestra.run.smithi162.stdout:(117/146): python3-numpy-f2py-1.14.3-10.el8.x86 1.3 MB/s | 225 kB 00:00 2024-06-02T03:54:33.533 INFO:teuthology.orchestra.run.smithi162.stdout:(118/146): librdkafka-0.11.4-3.el8.x86_64.rpm 2.4 MB/s | 354 kB 00:00 2024-06-02T03:54:33.612 INFO:teuthology.orchestra.run.smithi136.stdout:(118/146): openblas-threads-0.3.15-6.el8.x86_64 22 MB/s | 5.2 MB 00:00 2024-06-02T03:54:33.633 INFO:teuthology.orchestra.run.smithi162.stdout:(119/146): python3-mako-1.0.6-14.el8.noarch.rpm 1.1 MB/s | 157 kB 00:00 2024-06-02T03:54:33.637 INFO:teuthology.orchestra.run.smithi136.stdout:(119/146): python3-mako-1.0.6-14.el8.noarch.rpm 784 kB/s | 157 kB 00:00 2024-06-02T03:54:33.742 INFO:teuthology.orchestra.run.smithi162.stdout:(120/146): openblas-threads-0.3.15-6.el8.x86_64 19 MB/s | 5.2 MB 00:00 2024-06-02T03:54:33.806 INFO:teuthology.orchestra.run.smithi162.stdout:(121/146): automake-1.16.1-8.el8.noarch.rpm 4.0 MB/s | 714 kB 00:00 2024-06-02T03:54:33.854 INFO:teuthology.orchestra.run.smithi136.stdout:(120/146): openblas-0.3.15-6.el8.x86_64.rpm 21 MB/s | 5.0 MB 00:00 2024-06-02T03:54:33.884 INFO:teuthology.orchestra.run.smithi162.stdout:(122/146): openblas-0.3.15-6.el8.x86_64.rpm 14 MB/s | 5.0 MB 00:00 2024-06-02T03:54:33.887 INFO:teuthology.orchestra.run.smithi136.stdout:(121/146): automake-1.16.1-8.el8.noarch.rpm 2.8 MB/s | 714 kB 00:00 2024-06-02T03:54:33.909 INFO:teuthology.orchestra.run.smithi162.stdout:(123/146): libpq-13.11-1.el8.x86_64.rpm 1.2 MB/s | 198 kB 00:00 2024-06-02T03:54:33.960 INFO:teuthology.orchestra.run.smithi162.stdout:(124/146): jq-1.6-7.el8.x86_64.rpm 1.3 MB/s | 202 kB 00:00 2024-06-02T03:54:33.963 INFO:teuthology.orchestra.run.smithi136.stdout:(122/146): libpq-13.11-1.el8.x86_64.rpm 1.8 MB/s | 198 kB 00:00 2024-06-02T03:54:33.985 INFO:teuthology.orchestra.run.smithi162.stdout:(125/146): python3-pytz-2017.2-11.el8.noarch.rp 540 kB/s | 54 kB 00:00 2024-06-02T03:54:33.997 INFO:teuthology.orchestra.run.smithi136.stdout:(123/146): jq-1.6-7.el8.x86_64.rpm 1.8 MB/s | 202 kB 00:00 2024-06-02T03:54:34.085 INFO:teuthology.orchestra.run.smithi162.stdout:(126/146): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-06-02T03:54:34.128 INFO:teuthology.orchestra.run.smithi136.stdout:(124/146): python3-pytz-2017.2-11.el8.noarch.rp 330 kB/s | 54 kB 00:00 2024-06-02T03:54:34.160 INFO:teuthology.orchestra.run.smithi162.stdout:(127/146): postgresql-contrib-10.23-4.module+el 11 MB/s | 812 kB 00:00 2024-06-02T03:54:34.243 INFO:teuthology.orchestra.run.smithi162.stdout:(128/146): postgresql-10.23-4.module+el8.9.0+21 5.8 MB/s | 1.5 MB 00:00 2024-06-02T03:54:34.394 INFO:teuthology.orchestra.run.smithi162.stdout:(129/146): python3-scipy-1.0.0-21.module+el8.9. 28 MB/s | 14 MB 00:00 2024-06-02T03:54:34.405 INFO:teuthology.orchestra.run.smithi136.stdout:(125/146): python3-scipy-1.0.0-21.module+el8.9. 34 MB/s | 14 MB 00:00 2024-06-02T03:54:34.472 INFO:teuthology.orchestra.run.smithi136.stdout:(126/146): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 546 kB/s | 188 kB 00:00 2024-06-02T03:54:34.495 INFO:teuthology.orchestra.run.smithi162.stdout:(130/146): postgresql-server-10.23-4.module+el8 15 MB/s | 5.1 MB 00:00 2024-06-02T03:54:34.531 INFO:teuthology.orchestra.run.smithi136.stdout:(127/146): postgresql-10.23-4.module+el8.9.0+21 12 MB/s | 1.5 MB 00:00 2024-06-02T03:54:34.587 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction check 2024-06-02T03:54:34.640 INFO:teuthology.orchestra.run.smithi136.stdout:(128/146): postgresql-contrib-10.23-4.module+el 4.8 MB/s | 812 kB 00:00 2024-06-02T03:54:34.689 INFO:teuthology.orchestra.run.smithi162.stdout:(131/146): elfutils-libelf-0.189-3.el8.x86_64.r 1.2 MB/s | 232 kB 00:00 2024-06-02T03:54:34.820 INFO:teuthology.orchestra.run.smithi162.stdout:(132/146): librados2-18.2.2-1381.g3bb45379.el8. 6.4 MB/s | 3.7 MB 00:00 2024-06-02T03:54:34.854 INFO:teuthology.orchestra.run.smithi162.stdout:(133/146): elfutils-libs-0.189-3.el8.x86_64.rpm 1.8 MB/s | 303 kB 00:00 2024-06-02T03:54:34.856 INFO:teuthology.orchestra.run.smithi136.stdout:(129/146): postgresql-server-10.23-4.module+el8 16 MB/s | 5.1 MB 00:00 2024-06-02T03:54:34.980 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction check succeeded. 2024-06-02T03:54:34.980 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction test 2024-06-02T03:54:35.004 INFO:teuthology.orchestra.run.smithi162.stdout:(134/146): librbd1-18.2.2-1381.g3bb45379.el8.x8 5.9 MB/s | 3.6 MB 00:00 2024-06-02T03:54:35.038 INFO:teuthology.orchestra.run.smithi162.stdout:(135/146): iproute-6.2.0-5.el8_9.x86_64.rpm 3.8 MB/s | 854 kB 00:00 2024-06-02T03:54:35.079 INFO:teuthology.orchestra.run.smithi162.stdout:(136/146): openssl-1.1.1k-12.el8_9.x86_64.rpm 3.1 MB/s | 711 kB 00:00 2024-06-02T03:54:35.132 INFO:teuthology.orchestra.run.smithi136.stdout:(130/146): librados2-18.2.2-1381.g3bb45379.el8. 7.5 MB/s | 3.7 MB 00:00 2024-06-02T03:54:35.146 INFO:teuthology.orchestra.run.smithi162.stdout:(137/146): openssl-libs-1.1.1k-12.el8_9.x86_64. 10 MB/s | 1.5 MB 00:00 2024-06-02T03:54:35.172 INFO:teuthology.orchestra.run.smithi162.stdout:(138/146): xfsdump-3.1.8-7.el8_9.x86_64.rpm 2.4 MB/s | 333 kB 00:00 2024-06-02T03:54:35.214 INFO:teuthology.orchestra.run.smithi162.stdout:(139/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 8.0 MB/s | 1.1 MB 00:00 2024-06-02T03:54:35.306 INFO:teuthology.orchestra.run.smithi162.stdout:(140/146): libblkid-2.32.1-44.el8_9.1.x86_64.rp 1.4 MB/s | 221 kB 00:00 2024-06-02T03:54:35.324 INFO:teuthology.orchestra.run.smithi136.stdout:(131/146): librbd1-18.2.2-1381.g3bb45379.el8.x8 7.6 MB/s | 3.6 MB 00:00 2024-06-02T03:54:35.331 INFO:teuthology.orchestra.run.smithi162.stdout:(141/146): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 1.6 MB/s | 254 kB 00:00 2024-06-02T03:54:35.349 INFO:teuthology.orchestra.run.smithi136.stdout:(132/146): elfutils-libelf-0.189-3.el8.x86_64.r 1.0 MB/s | 232 kB 00:00 2024-06-02T03:54:35.356 INFO:teuthology.orchestra.run.smithi162.stdout:(142/146): libmount-2.32.1-44.el8_9.1.x86_64.rp 1.6 MB/s | 237 kB 00:00 2024-06-02T03:54:35.440 INFO:teuthology.orchestra.run.smithi162.stdout:(143/146): libsmartcols-2.32.1-44.el8_9.1.x86_6 1.3 MB/s | 180 kB 00:00 2024-06-02T03:54:35.457 INFO:teuthology.orchestra.run.smithi162.stdout:(144/146): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 788 kB/s | 99 kB 00:00 2024-06-02T03:54:35.483 INFO:teuthology.orchestra.run.smithi136.stdout:(133/146): elfutils-libs-0.189-3.el8.x86_64.rpm 1.9 MB/s | 303 kB 00:00 2024-06-02T03:54:35.524 INFO:teuthology.orchestra.run.smithi136.stdout:(134/146): iproute-6.2.0-5.el8_9.x86_64.rpm 4.8 MB/s | 854 kB 00:00 2024-06-02T03:54:35.590 INFO:teuthology.orchestra.run.smithi162.stdout:(145/146): util-linux-2.32.1-44.el8_9.1.x86_64. 11 MB/s | 2.5 MB 00:00 2024-06-02T03:54:35.615 INFO:teuthology.orchestra.run.smithi162.stdout:(146/146): util-linux-user-2.32.1-44.el8_9.1.x8 586 kB/s | 103 kB 00:00 2024-06-02T03:54:35.618 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-06-02T03:54:35.618 INFO:teuthology.orchestra.run.smithi162.stdout:Total 10 MB/s | 215 MB 00:21 2024-06-02T03:54:35.674 INFO:teuthology.orchestra.run.smithi136.stdout:(135/146): openssl-libs-1.1.1k-12.el8_9.x86_64. 9.8 MB/s | 1.5 MB 00:00 2024-06-02T03:54:35.741 INFO:teuthology.orchestra.run.smithi136.stdout:(136/146): openssl-1.1.1k-12.el8_9.x86_64.rpm 2.7 MB/s | 711 kB 00:00 2024-06-02T03:54:35.775 INFO:teuthology.orchestra.run.smithi136.stdout:(137/146): xfsdump-3.1.8-7.el8_9.x86_64.rpm 3.3 MB/s | 333 kB 00:00 2024-06-02T03:54:35.825 INFO:teuthology.orchestra.run.smithi136.stdout:(138/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-06-02T03:54:35.959 INFO:teuthology.orchestra.run.smithi136.stdout:(139/146): libblkid-2.32.1-44.el8_9.1.x86_64.rp 1.2 MB/s | 221 kB 00:00 2024-06-02T03:54:35.984 INFO:teuthology.orchestra.run.smithi136.stdout:(140/146): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 1.6 MB/s | 254 kB 00:00 2024-06-02T03:54:36.085 INFO:teuthology.orchestra.run.smithi136.stdout:(141/146): libmount-2.32.1-44.el8_9.1.x86_64.rp 1.8 MB/s | 237 kB 00:00 2024-06-02T03:54:36.110 INFO:teuthology.orchestra.run.smithi136.stdout:(142/146): libsmartcols-2.32.1-44.el8_9.1.x86_6 1.4 MB/s | 180 kB 00:00 2024-06-02T03:54:36.172 INFO:teuthology.orchestra.run.smithi123.stdout:Transaction test succeeded. 2024-06-02T03:54:36.183 INFO:teuthology.orchestra.run.smithi123.stdout:Running transaction 2024-06-02T03:54:36.235 INFO:teuthology.orchestra.run.smithi136.stdout:(143/146): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 660 kB/s | 99 kB 00:00 2024-06-02T03:54:36.302 INFO:teuthology.orchestra.run.smithi136.stdout:(144/146): util-linux-2.32.1-44.el8_9.1.x86_64. 13 MB/s | 2.5 MB 00:00 2024-06-02T03:54:36.335 INFO:teuthology.orchestra.run.smithi136.stdout:(145/146): util-linux-user-2.32.1-44.el8_9.1.x8 1.0 MB/s | 103 kB 00:00 2024-06-02T03:54:36.650 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-06-02T03:54:37.044 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-06-02T03:54:37.044 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-06-02T03:54:38.515 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-06-02T03:54:38.525 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-06-02T03:54:41.576 INFO:teuthology.orchestra.run.smithi136.stdout:(146/146): NetworkManager-initscripts-updown-1. 14 kB/s | 144 kB 00:10 2024-06-02T03:54:41.579 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-06-02T03:54:41.579 INFO:teuthology.orchestra.run.smithi136.stdout:Total 7.9 MB/s | 215 MB 00:27 2024-06-02T03:54:42.013 INFO:teuthology.orchestra.run.smithi123.stdout: Preparing : 1/1 2024-06-02T03:54:42.149 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-06-02T03:54:42.433 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-06-02T03:54:42.609 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-06-02T03:54:42.652 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-06-02T03:54:42.866 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2024-06-02T03:54:43.004 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-06-02T03:54:43.004 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-06-02T03:54:43.037 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-06-02T03:54:43.138 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-06-02T03:54:43.287 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-06-02T03:54:43.391 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-06-02T03:54:43.654 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2024-06-02T03:54:43.870 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 6/162 2024-06-02T03:54:43.924 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 6/162 2024-06-02T03:54:44.089 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-06-02T03:54:44.156 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 7/162 2024-06-02T03:54:44.211 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-06-02T03:54:44.222 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-06-02T03:54:44.223 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-06-02T03:54:44.362 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-06-02T03:54:44.459 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-06-02T03:54:44.680 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-06-02T03:54:44.762 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-06-02T03:54:44.845 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2024-06-02T03:54:44.987 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : librados2-2:18.2.2-1381.g3bb45379.el8.x86_64 9/162 2024-06-02T03:54:45.230 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-06-02T03:54:45.230 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-06-02T03:54:45.308 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-06-02T03:54:45.378 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-06-02T03:54:45.406 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados2-2:18.2.2-1381.g3bb45379.el8.x86_64 9/162 2024-06-02T03:54:45.579 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2024-06-02T03:54:45.604 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : librbd1-2:18.2.2-1381.g3bb45379.el8.x86_64 10/162 2024-06-02T03:54:45.715 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librbd1-2:18.2.2-1381.g3bb45379.el8.x86_64 10/162 2024-06-02T03:54:45.822 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 6/162 2024-06-02T03:54:45.920 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephfs2-2:18.2.2-1381.g3bb45379.el8.x86_64 11/162 2024-06-02T03:54:46.050 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/162 2024-06-02T03:54:46.052 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephfs2-2:18.2.2-1381.g3bb45379.el8.x86_64 11/162 2024-06-02T03:54:46.142 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/162 2024-06-02T03:54:46.308 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-06-02T03:54:46.389 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rados-2:18.2.2-1381.g3bb45379.el8.x86_64 12/162 2024-06-02T03:54:46.678 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-06-02T03:54:46.702 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-06-02T03:54:46.776 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-06-02T03:54:46.941 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librados2-2:18.2.2-1381.g3bb45379.el8.x86_64 9/162 2024-06-02T03:54:47.052 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libpq-13.11-1.el8.x86_64 14/162 2024-06-02T03:54:47.332 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:18.2.2-1381.g3bb45379.el8.x86_64 9/162 2024-06-02T03:54:47.350 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/162 2024-06-02T03:54:47.500 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librbd1-2:18.2.2-1381.g3bb45379.el8.x86_64 10/162 2024-06-02T03:54:47.565 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/162 2024-06-02T03:54:47.629 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:18.2.2-1381.g3bb45379.el8.x86_64 10/162 2024-06-02T03:54:47.849 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs2-2:18.2.2-1381.g3bb45379.el8.x86_64 11/162 2024-06-02T03:54:47.933 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephfs2-2:18.2.2-1381.g3bb45379.el8.x86_64 11/162 2024-06-02T03:54:47.984 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/162 2024-06-02T03:54:48.249 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 18/162 2024-06-02T03:54:48.250 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rados-2:18.2.2-1381.g3bb45379.el8.x86_64 12/162 2024-06-02T03:54:48.461 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephsqlite-2:18.2.2-1381.g3bb45379.el8.x86_64 19/162 2024-06-02T03:54:48.507 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-06-02T03:54:48.561 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1381.g3bb45379.el8.x86_64 19/162 2024-06-02T03:54:48.590 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-06-02T03:54:48.760 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libradosstriper1-2:18.2.2-1381.g3bb45379.el8.x86 20/162 2024-06-02T03:54:48.789 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libpq-13.11-1.el8.x86_64 14/162 2024-06-02T03:54:48.817 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1381.g3bb45379.el8.x86 20/162 2024-06-02T03:54:49.011 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/162 2024-06-02T03:54:49.053 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/162 2024-06-02T03:54:49.153 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/162 2024-06-02T03:54:49.235 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/162 2024-06-02T03:54:49.353 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/162 2024-06-02T03:54:49.594 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/162 2024-06-02T03:54:49.828 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 18/162 2024-06-02T03:54:49.974 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-06-02T03:54:50.007 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephsqlite-2:18.2.2-1381.g3bb45379.el8.x86_64 19/162 2024-06-02T03:54:50.019 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/162 2024-06-02T03:54:50.108 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-06-02T03:54:50.109 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1381.g3bb45379.el8.x86_64 19/162 2024-06-02T03:54:50.246 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 23/162 2024-06-02T03:54:50.290 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libradosstriper1-2:18.2.2-1381.g3bb45379.el8.x86 20/162 2024-06-02T03:54:50.386 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-06-02T03:54:50.406 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1381.g3bb45379.el8.x86 20/162 2024-06-02T03:54:50.582 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-06-02T03:54:50.594 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 21/162 2024-06-02T03:54:50.765 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2024-06-02T03:54:50.854 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 23/162 2024-06-02T03:54:50.899 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 22/162 2024-06-02T03:54:50.961 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-06-02T03:54:51.035 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-06-02T03:54:51.052 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openblas-0.3.15-6.el8.x86_64 24/162 2024-06-02T03:54:51.103 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/162 2024-06-02T03:54:51.228 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-06-02T03:54:51.282 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 24/162 2024-06-02T03:54:51.296 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-06-02T03:54:51.419 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 24/162 2024-06-02T03:54:51.491 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2024-06-02T03:54:51.557 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 25/162 2024-06-02T03:54:51.727 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 6/162 2024-06-02T03:54:51.772 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 24/162 2024-06-02T03:54:51.961 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/162 2024-06-02T03:54:52.059 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/162 2024-06-02T03:54:52.062 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/162 2024-06-02T03:54:52.162 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 25/162 2024-06-02T03:54:52.241 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 26/162 2024-06-02T03:54:52.286 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-06-02T03:54:52.339 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-06-02T03:54:52.439 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/162 2024-06-02T03:54:52.697 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-06-02T03:54:52.711 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/162 2024-06-02T03:54:52.902 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : librados2-2:18.2.2-1381.g3bb45379.el8.x86_64 9/162 2024-06-02T03:54:52.943 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-06-02T03:54:53.032 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 29/162 2024-06-02T03:54:53.114 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-0.3.15-6.el8.x86_64 27/162 2024-06-02T03:54:53.275 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados2-2:18.2.2-1381.g3bb45379.el8.x86_64 9/162 2024-06-02T03:54:53.329 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/162 2024-06-02T03:54:53.436 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : librbd1-2:18.2.2-1381.g3bb45379.el8.x86_64 10/162 2024-06-02T03:54:53.492 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ceph-common-2:18.2.2-1381.g3bb45379.el8. 31/162 2024-06-02T03:54:53.595 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librbd1-2:18.2.2-1381.g3bb45379.el8.x86_64 10/162 2024-06-02T03:54:53.683 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-ceph-argparse-2:18.2.2-1381.g3bb45379.el 32/162 2024-06-02T03:54:53.796 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 27/162 2024-06-02T03:54:53.811 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs2-2:18.2.2-1381.g3bb45379.el8.x86_64 11/162 2024-06-02T03:54:53.907 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephfs2-2:18.2.2-1381.g3bb45379.el8.x86_64 11/162 2024-06-02T03:54:53.969 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cephfs-2:18.2.2-1381.g3bb45379.el8.x86_6 33/162 2024-06-02T03:54:54.062 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 28/162 2024-06-02T03:54:54.236 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 29/162 2024-06-02T03:54:54.254 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rados-2:18.2.2-1381.g3bb45379.el8.x86_64 12/162 2024-06-02T03:54:54.491 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/162 2024-06-02T03:54:54.527 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-06-02T03:54:54.614 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-06-02T03:54:54.645 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-common-2:18.2.2-1381.g3bb45379.el8. 31/162 2024-06-02T03:54:54.816 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-argparse-2:18.2.2-1381.g3bb45379.el 32/162 2024-06-02T03:54:54.841 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libpq-13.11-1.el8.x86_64 14/162 2024-06-02T03:54:54.921 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 34/162 2024-06-02T03:54:55.076 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cephfs-2:18.2.2-1381.g3bb45379.el8.x86_6 33/162 2024-06-02T03:54:55.097 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/162 2024-06-02T03:54:55.273 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 35/162 2024-06-02T03:54:55.280 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/162 2024-06-02T03:54:55.306 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-06-02T03:54:55.597 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 36/162 2024-06-02T03:54:55.705 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/162 2024-06-02T03:54:55.835 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 37/162 2024-06-02T03:54:56.006 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 18/162 2024-06-02T03:54:56.202 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephsqlite-2:18.2.2-1381.g3bb45379.el8.x86_64 19/162 2024-06-02T03:54:56.308 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1381.g3bb45379.el8.x86_64 19/162 2024-06-02T03:54:56.506 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libradosstriper1-2:18.2.2-1381.g3bb45379.el8.x86 20/162 2024-06-02T03:54:56.582 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1381.g3bb45379.el8.x86 20/162 2024-06-02T03:54:56.798 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 21/162 2024-06-02T03:54:57.043 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-06-02T03:54:57.082 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 22/162 2024-06-02T03:54:57.307 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/162 2024-06-02T03:54:57.408 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 35/162 2024-06-02T03:54:57.510 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 24/162 2024-06-02T03:54:57.569 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 37/162 2024-06-02T03:54:57.647 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 24/162 2024-06-02T03:54:57.826 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 25/162 2024-06-02T03:54:57.952 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 38/162 2024-06-02T03:54:58.189 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/162 2024-06-02T03:54:58.347 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 36/162 2024-06-02T03:54:58.444 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 25/162 2024-06-02T03:54:58.453 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/162 2024-06-02T03:54:58.636 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-06-02T03:54:58.669 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 37/162 2024-06-02T03:54:58.682 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rbd-2:18.2.2-1381.g3bb45379.el8.x86_64 41/162 2024-06-02T03:54:58.867 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librados-devel-2:18.2.2-1381.g3bb45379.el8.x86_6 42/162 2024-06-02T03:54:58.898 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 38/162 2024-06-02T03:54:59.076 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-06-02T03:54:59.149 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/162 2024-06-02T03:54:59.199 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-06-02T03:54:59.255 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-06-02T03:54:59.366 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/162 2024-06-02T03:54:59.443 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-06-02T03:54:59.467 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openblas-0.3.15-6.el8.x86_64 27/162 2024-06-02T03:54:59.493 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-06-02T03:54:59.585 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rbd-2:18.2.2-1381.g3bb45379.el8.x86_64 41/162 2024-06-02T03:54:59.746 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 45/162 2024-06-02T03:54:59.754 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librados-devel-2:18.2.2-1381.g3bb45379.el8.x86_6 42/162 2024-06-02T03:54:59.972 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-06-02T03:54:59.995 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/162 2024-06-02T03:55:00.035 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-06-02T03:55:00.138 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 27/162 2024-06-02T03:55:00.218 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-06-02T03:55:00.246 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-06-02T03:55:00.312 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-06-02T03:55:00.407 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 28/162 2024-06-02T03:55:00.567 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 45/162 2024-06-02T03:55:00.607 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 29/162 2024-06-02T03:55:00.643 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-06-02T03:55:00.804 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/162 2024-06-02T03:55:00.869 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/162 2024-06-02T03:55:00.952 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-06-02T03:55:00.968 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-06-02T03:55:01.005 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-06-02T03:55:01.065 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ceph-common-2:18.2.2-1381.g3bb45379.el8. 31/162 2024-06-02T03:55:01.205 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : fuse-2.9.7-17.el8.x86_64 49/162 2024-06-02T03:55:01.246 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ceph-argparse-2:18.2.2-1381.g3bb45379.el 32/162 2024-06-02T03:55:01.437 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-06-02T03:55:01.447 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 50/162 2024-06-02T03:55:01.530 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cephfs-2:18.2.2-1381.g3bb45379.el8.x86_6 33/162 2024-06-02T03:55:01.654 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 51/162 2024-06-02T03:55:01.742 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-06-02T03:55:01.747 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-06-02T03:55:01.775 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-06-02T03:55:01.887 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 52/162 2024-06-02T03:55:01.955 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-06-02T03:55:02.034 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-06-02T03:55:02.113 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 53/162 2024-06-02T03:55:02.306 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : jq-1.6-7.el8.x86_64 50/162 2024-06-02T03:55:02.401 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 54/162 2024-06-02T03:55:02.563 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : automake-1.16.1-8.el8.noarch 51/162 2024-06-02T03:55:02.697 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 55/162 2024-06-02T03:55:02.721 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : uuid-1.6.2-43.el8.x86_64 52/162 2024-06-02T03:55:02.778 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 52/162 2024-06-02T03:55:02.956 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 56/162 2024-06-02T03:55:03.018 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 53/162 2024-06-02T03:55:03.171 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 57/162 2024-06-02T03:55:03.178 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 54/162 2024-06-02T03:55:03.364 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 55/162 2024-06-02T03:55:03.410 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 58/162 2024-06-02T03:55:03.495 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-06-02T03:55:03.576 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : fuse-2.9.7-17.el8.x86_64 56/162 2024-06-02T03:55:03.795 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 57/162 2024-06-02T03:55:03.805 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 59/162 2024-06-02T03:55:03.819 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 35/162 2024-06-02T03:55:04.001 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 58/162 2024-06-02T03:55:04.145 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 60/162 2024-06-02T03:55:04.157 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 59/162 2024-06-02T03:55:04.374 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 60/162 2024-06-02T03:55:04.492 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 61/162 2024-06-02T03:55:04.650 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 61/162 2024-06-02T03:55:04.750 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 62/162 2024-06-02T03:55:04.778 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 36/162 2024-06-02T03:55:04.916 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 62/162 2024-06-02T03:55:04.992 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/162 2024-06-02T03:55:05.113 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 37/162 2024-06-02T03:55:05.117 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 63/162 2024-06-02T03:55:05.272 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 64/162 2024-06-02T03:55:05.308 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 64/162 2024-06-02T03:55:05.351 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 38/162 2024-06-02T03:55:05.523 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 65/162 2024-06-02T03:55:05.538 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 65/162 2024-06-02T03:55:05.612 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/162 2024-06-02T03:55:05.806 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 66/162 2024-06-02T03:55:05.868 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/162 2024-06-02T03:55:05.893 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 66/162 2024-06-02T03:55:06.055 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rbd-2:18.2.2-1381.g3bb45379.el8.x86_64 41/162 2024-06-02T03:55:06.061 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 67/162 2024-06-02T03:55:06.206 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 67/162 2024-06-02T03:55:06.249 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librados-devel-2:18.2.2-1381.g3bb45379.el8.x86_6 42/162 2024-06-02T03:55:06.257 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 68/162 2024-06-02T03:55:06.458 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-06-02T03:55:06.486 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 68/162 2024-06-02T03:55:06.536 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-06-02T03:55:06.579 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 69/162 2024-06-02T03:55:06.695 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 69/162 2024-06-02T03:55:06.741 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-06-02T03:55:06.784 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 70/162 2024-06-02T03:55:06.838 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-06-02T03:55:06.867 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 70/162 2024-06-02T03:55:06.878 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 70/162 2024-06-02T03:55:07.045 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 45/162 2024-06-02T03:55:07.123 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 71/162 2024-06-02T03:55:07.155 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : jq-1.6-7.el8.x86_64 71/162 2024-06-02T03:55:07.276 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/162 2024-06-02T03:55:07.391 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 72/162 2024-06-02T03:55:07.442 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : automake-1.16.1-8.el8.noarch 72/162 2024-06-02T03:55:07.499 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-06-02T03:55:07.637 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 73/162 2024-06-02T03:55:07.666 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : uuid-1.6.2-43.el8.x86_64 73/162 2024-06-02T03:55:07.735 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 73/162 2024-06-02T03:55:07.889 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 74/162 2024-06-02T03:55:07.949 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 74/162 2024-06-02T03:55:07.969 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-06-02T03:55:08.077 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 75/162 2024-06-02T03:55:08.191 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 75/162 2024-06-02T03:55:08.283 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-06-02T03:55:08.310 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-06-02T03:55:08.355 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 76/162 2024-06-02T03:55:08.435 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 76/162 2024-06-02T03:55:08.516 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-06-02T03:55:08.529 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-packaging-16.8-9.el8.noarch 77/162 2024-06-02T03:55:08.593 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-06-02T03:55:08.685 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-packaging-16.8-9.el8.noarch 77/162 2024-06-02T03:55:08.720 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 78/162 2024-06-02T03:55:08.876 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : jq-1.6-7.el8.x86_64 50/162 2024-06-02T03:55:08.883 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 78/162 2024-06-02T03:55:08.915 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 79/162 2024-06-02T03:55:09.092 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 79/162 2024-06-02T03:55:09.133 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : automake-1.16.1-8.el8.noarch 51/162 2024-06-02T03:55:09.242 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 80/162 2024-06-02T03:55:09.299 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : uuid-1.6.2-43.el8.x86_64 52/162 2024-06-02T03:55:09.352 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 52/162 2024-06-02T03:55:09.421 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 80/162 2024-06-02T03:55:09.526 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 81/162 2024-06-02T03:55:09.575 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 53/162 2024-06-02T03:55:09.682 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 82/162 2024-06-02T03:55:09.698 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 81/162 2024-06-02T03:55:09.773 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 54/162 2024-06-02T03:55:09.848 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 83/162 2024-06-02T03:55:09.912 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 82/162 2024-06-02T03:55:09.950 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 55/162 2024-06-02T03:55:10.078 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 84/162 2024-06-02T03:55:10.135 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 83/162 2024-06-02T03:55:10.170 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : fuse-2.9.7-17.el8.x86_64 56/162 2024-06-02T03:55:10.274 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 85/162 2024-06-02T03:55:10.372 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 57/162 2024-06-02T03:55:10.373 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 84/162 2024-06-02T03:55:10.523 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 86/162 2024-06-02T03:55:10.562 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 58/162 2024-06-02T03:55:10.612 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 85/162 2024-06-02T03:55:10.706 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 87/162 2024-06-02T03:55:10.743 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 59/162 2024-06-02T03:55:10.872 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 86/162 2024-06-02T03:55:10.875 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 88/162 2024-06-02T03:55:10.928 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 60/162 2024-06-02T03:55:11.069 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 87/162 2024-06-02T03:55:11.106 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 89/162 2024-06-02T03:55:11.262 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 61/162 2024-06-02T03:55:11.298 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 88/162 2024-06-02T03:55:11.324 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 90/162 2024-06-02T03:55:11.475 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 91/162 2024-06-02T03:55:11.563 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 62/162 2024-06-02T03:55:11.594 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 89/162 2024-06-02T03:55:11.723 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-portend-2.6-1.el8.noarch 92/162 2024-06-02T03:55:11.787 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 63/162 2024-06-02T03:55:11.827 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 90/162 2024-06-02T03:55:11.928 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 64/162 2024-06-02T03:55:11.959 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 93/162 2024-06-02T03:55:12.022 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 91/162 2024-06-02T03:55:12.167 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 94/162 2024-06-02T03:55:12.176 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 65/162 2024-06-02T03:55:12.286 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-portend-2.6-1.el8.noarch 92/162 2024-06-02T03:55:12.392 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 95/162 2024-06-02T03:55:12.507 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 66/162 2024-06-02T03:55:12.557 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 93/162 2024-06-02T03:55:12.773 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 94/162 2024-06-02T03:55:12.843 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 67/162 2024-06-02T03:55:13.047 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 95/162 2024-06-02T03:55:13.156 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 68/162 2024-06-02T03:55:13.414 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 69/162 2024-06-02T03:55:13.504 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 96/162 2024-06-02T03:55:13.626 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 70/162 2024-06-02T03:55:13.797 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 97/162 2024-06-02T03:55:13.894 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 71/162 2024-06-02T03:55:14.034 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/162 2024-06-02T03:55:14.133 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 96/162 2024-06-02T03:55:14.161 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 72/162 2024-06-02T03:55:14.309 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 99/162 2024-06-02T03:55:14.440 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 73/162 2024-06-02T03:55:14.494 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 97/162 2024-06-02T03:55:14.633 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 74/162 2024-06-02T03:55:14.739 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/162 2024-06-02T03:55:14.846 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 75/162 2024-06-02T03:55:15.057 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 99/162 2024-06-02T03:55:15.061 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 100/162 2024-06-02T03:55:15.125 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 76/162 2024-06-02T03:55:15.260 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 101/162 2024-06-02T03:55:15.308 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 100/162 2024-06-02T03:55:15.350 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-packaging-16.8-9.el8.noarch 77/162 2024-06-02T03:55:15.515 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 78/162 2024-06-02T03:55:15.548 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 101/162 2024-06-02T03:55:15.770 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 79/162 2024-06-02T03:55:16.042 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 102/162 2024-06-02T03:55:16.102 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 80/162 2024-06-02T03:55:16.257 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librgw2-2:18.2.2-1381.g3bb45379.el8.x86_64 103/162 2024-06-02T03:55:16.312 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librgw2-2:18.2.2-1381.g3bb45379.el8.x86_64 103/162 2024-06-02T03:55:16.340 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 102/162 2024-06-02T03:55:16.354 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 81/162 2024-06-02T03:55:16.494 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rgw-2:18.2.2-1381.g3bb45379.el8.x86_64 104/162 2024-06-02T03:55:16.527 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 82/162 2024-06-02T03:55:16.541 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : librgw2-2:18.2.2-1381.g3bb45379.el8.x86_64 103/162 2024-06-02T03:55:16.654 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librgw2-2:18.2.2-1381.g3bb45379.el8.x86_64 103/162 2024-06-02T03:55:16.709 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 83/162 2024-06-02T03:55:16.874 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : python3-rgw-2:18.2.2-1381.g3bb45379.el8.x86_64 104/162 2024-06-02T03:55:16.923 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 84/162 2024-06-02T03:55:17.176 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 85/162 2024-06-02T03:55:17.433 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 86/162 2024-06-02T03:55:17.650 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 87/162 2024-06-02T03:55:17.828 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 88/162 2024-06-02T03:55:18.126 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 89/162 2024-06-02T03:55:18.367 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 90/162 2024-06-02T03:55:18.594 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 91/162 2024-06-02T03:55:18.883 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-portend-2.6-1.el8.noarch 92/162 2024-06-02T03:55:19.138 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 93/162 2024-06-02T03:55:19.337 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 94/162 2024-06-02T03:55:19.588 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 95/162 2024-06-02T03:55:20.315 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 105/162 2024-06-02T03:55:20.659 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 96/162 2024-06-02T03:55:20.734 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 105/162 2024-06-02T03:55:20.999 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 97/162 2024-06-02T03:55:21.227 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 105/162 2024-06-02T03:55:21.237 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/162 2024-06-02T03:55:21.326 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 105/162 2024-06-02T03:55:21.507 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 105/162 2024-06-02T03:55:21.529 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 99/162 2024-06-02T03:55:21.635 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-base-2:18.2.2-1381.g3bb45379.el8.x86_64 106/162 2024-06-02T03:55:21.716 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-base-2:18.2.2-1381.g3bb45379.el8.x86_64 106/162 2024-06-02T03:55:21.813 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 100/162 2024-06-02T03:55:21.850 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-selinux-2:18.2.2-1381.g3bb45379.el8.x86_64 107/162 2024-06-02T03:55:22.004 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 101/162 2024-06-02T03:55:22.096 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 105/162 2024-06-02T03:55:22.377 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-base-2:18.2.2-1381.g3bb45379.el8.x86_64 106/162 2024-06-02T03:55:22.458 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-base-2:18.2.2-1381.g3bb45379.el8.x86_64 106/162 2024-06-02T03:55:22.622 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-selinux-2:18.2.2-1381.g3bb45379.el8.x86_64 107/162 2024-06-02T03:55:22.777 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 102/162 2024-06-02T03:55:22.951 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librgw2-2:18.2.2-1381.g3bb45379.el8.x86_64 103/162 2024-06-02T03:55:23.066 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librgw2-2:18.2.2-1381.g3bb45379.el8.x86_64 103/162 2024-06-02T03:55:24.180 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rgw-2:18.2.2-1381.g3bb45379.el8.x86_64 104/162 2024-06-02T03:55:27.918 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 105/162 2024-06-02T03:55:28.145 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 105/162 2024-06-02T03:55:28.735 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 105/162 2024-06-02T03:55:29.003 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-base-2:18.2.2-1381.g3bb45379.el8.x86_64 106/162 2024-06-02T03:55:29.082 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-base-2:18.2.2-1381.g3bb45379.el8.x86_64 106/162 2024-06-02T03:55:29.685 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-selinux-2:18.2.2-1381.g3bb45379.el8.x86_64 107/162 2024-06-02T03:55:41.294 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1381.g3bb45379.el8.x86_64 107/162 2024-06-02T03:55:41.294 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /sys 2024-06-02T03:55:41.294 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /proc 2024-06-02T03:55:41.294 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /dev 2024-06-02T03:55:41.294 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /run 2024-06-02T03:55:41.294 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /mnt 2024-06-02T03:55:41.294 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /var/tmp 2024-06-02T03:55:41.295 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /home 2024-06-02T03:55:41.295 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /tmp 2024-06-02T03:55:41.295 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /dev 2024-06-02T03:55:41.295 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T03:55:41.615 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1381.g3bb45379.el8.x86_64 107/162 2024-06-02T03:55:41.616 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /sys 2024-06-02T03:55:41.616 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /proc 2024-06-02T03:55:41.616 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /dev 2024-06-02T03:55:41.616 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /run 2024-06-02T03:55:41.616 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /mnt 2024-06-02T03:55:41.616 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /var/tmp 2024-06-02T03:55:41.616 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /home 2024-06-02T03:55:41.616 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /tmp 2024-06-02T03:55:41.616 INFO:teuthology.orchestra.run.smithi123.stdout:skipping the directory /dev 2024-06-02T03:55:41.616 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T03:55:41.662 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-volume-2:18.2.2-1381.g3bb45379.el8.noarch 108/162 2024-06-02T03:55:41.995 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-volume-2:18.2.2-1381.g3bb45379.el8.noarch 108/162 2024-06-02T03:55:43.299 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-volume-2:18.2.2-1381.g3bb45379.el8.noarch 108/162 2024-06-02T03:55:43.496 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-osd-2:18.2.2-1381.g3bb45379.el8.x86_64 109/162 2024-06-02T03:55:43.628 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-volume-2:18.2.2-1381.g3bb45379.el8.noarch 108/162 2024-06-02T03:55:43.715 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-osd-2:18.2.2-1381.g3bb45379.el8.x86_64 109/162 2024-06-02T03:55:43.862 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mds-2:18.2.2-1381.g3bb45379.el8.x86_64 110/162 2024-06-02T03:55:43.881 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-osd-2:18.2.2-1381.g3bb45379.el8.x86_64 109/162 2024-06-02T03:55:44.099 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-osd-2:18.2.2-1381.g3bb45379.el8.x86_64 109/162 2024-06-02T03:55:44.303 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mds-2:18.2.2-1381.g3bb45379.el8.x86_64 110/162 2024-06-02T03:55:44.338 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mds-2:18.2.2-1381.g3bb45379.el8.x86_64 110/162 2024-06-02T03:55:44.545 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mon-2:18.2.2-1381.g3bb45379.el8.x86_64 111/162 2024-06-02T03:55:44.566 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mon-2:18.2.2-1381.g3bb45379.el8.x86_64 111/162 2024-06-02T03:55:44.778 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mds-2:18.2.2-1381.g3bb45379.el8.x86_64 110/162 2024-06-02T03:55:44.969 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mon-2:18.2.2-1381.g3bb45379.el8.x86_64 111/162 2024-06-02T03:55:44.987 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mon-2:18.2.2-1381.g3bb45379.el8.x86_64 111/162 2024-06-02T03:55:46.475 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephadm-2:18.2.2-1381.g3bb45379.el8.noarch 112/162 2024-06-02T03:55:46.665 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephadm-2:18.2.2-1381.g3bb45379.el8.noarch 112/162 2024-06-02T03:55:46.784 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1381.g3bb45379.e 113/162 2024-06-02T03:55:46.885 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: cephadm-2:18.2.2-1381.g3bb45379.el8.noarch 112/162 2024-06-02T03:55:46.987 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1381.g3bb45379. 114/162 2024-06-02T03:55:47.092 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephadm-2:18.2.2-1381.g3bb45379.el8.noarch 112/162 2024-06-02T03:55:47.236 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1381.g3bb45379.el8.noa 115/162 2024-06-02T03:55:47.258 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1381.g3bb45379.e 113/162 2024-06-02T03:55:47.510 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1381.g3bb45379. 114/162 2024-06-02T03:55:47.760 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1381.g3bb45379.el8.noa 115/162 2024-06-02T03:55:48.270 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1381.g3bb45379.el8.noa 115/162 2024-06-02T03:55:48.536 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1381.g3bb45379.el8.n 116/162 2024-06-02T03:55:48.776 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1381.g3bb45379.el8.noa 115/162 2024-06-02T03:55:49.055 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1381.g3bb45379.el8.n 116/162 2024-06-02T03:55:49.263 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1381.g3bb45379.el8.x86_64 107/162 2024-06-02T03:55:49.263 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /sys 2024-06-02T03:55:49.263 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /proc 2024-06-02T03:55:49.264 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /dev 2024-06-02T03:55:49.264 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /run 2024-06-02T03:55:49.264 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /mnt 2024-06-02T03:55:49.264 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /var/tmp 2024-06-02T03:55:49.264 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /home 2024-06-02T03:55:49.264 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /tmp 2024-06-02T03:55:49.264 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /dev 2024-06-02T03:55:49.264 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-06-02T03:55:49.504 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1381.g3bb45379.el8.n 116/162 2024-06-02T03:55:49.623 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-volume-2:18.2.2-1381.g3bb45379.el8.noarch 108/162 2024-06-02T03:55:49.677 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1381.g3bb 117/162 2024-06-02T03:55:49.770 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1381.g3bb 117/162 2024-06-02T03:55:50.021 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1381.g3bb45379.el8.n 116/162 2024-06-02T03:55:50.124 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1381.g3bb45379.el 118/162 2024-06-02T03:55:50.260 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1381.g3bb 117/162 2024-06-02T03:55:50.320 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-2:18.2.2-1381.g3bb45379.el8.x86_64 119/162 2024-06-02T03:55:50.353 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1381.g3bb 117/162 2024-06-02T03:55:50.358 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1381.g3bb45379.el8.x86_64 119/162 2024-06-02T03:55:50.503 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-rook-2:18.2.2-1381.g3bb45379.el8.noarch 120/162 2024-06-02T03:55:50.514 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1381.g3bb45379.el8.noarch 120/162 2024-06-02T03:55:50.743 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1381.g3bb45379.el 118/162 2024-06-02T03:55:50.980 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-2:18.2.2-1381.g3bb45379.el8.x86_64 119/162 2024-06-02T03:55:51.019 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1381.g3bb45379.el8.x86_64 119/162 2024-06-02T03:55:51.210 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-mgr-rook-2:18.2.2-1381.g3bb45379.el8.noarch 120/162 2024-06-02T03:55:51.221 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1381.g3bb45379.el8.noarch 120/162 2024-06-02T03:55:51.261 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-volume-2:18.2.2-1381.g3bb45379.el8.noarch 108/162 2024-06-02T03:55:51.473 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-osd-2:18.2.2-1381.g3bb45379.el8.x86_64 109/162 2024-06-02T03:55:51.691 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-osd-2:18.2.2-1381.g3bb45379.el8.x86_64 109/162 2024-06-02T03:55:51.787 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-2:18.2.2-1381.g3bb45379.el8.x86_64 121/162 2024-06-02T03:55:51.857 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mds-2:18.2.2-1381.g3bb45379.el8.x86_64 110/162 2024-06-02T03:55:52.028 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-radosgw-2:18.2.2-1381.g3bb45379.el8.x86_64 122/162 2024-06-02T03:55:52.062 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1381.g3bb45379.el8.x86_64 122/162 2024-06-02T03:55:52.244 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1381.g3bb45 123/162 2024-06-02T03:55:52.287 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1381.g3bb45 123/162 2024-06-02T03:55:52.335 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mds-2:18.2.2-1381.g3bb45379.el8.x86_64 110/162 2024-06-02T03:55:52.490 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 124/162 2024-06-02T03:55:52.498 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mon-2:18.2.2-1381.g3bb45379.el8.x86_64 111/162 2024-06-02T03:55:52.508 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-2:18.2.2-1381.g3bb45379.el8.x86_64 121/162 2024-06-02T03:55:52.515 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mon-2:18.2.2-1381.g3bb45379.el8.x86_64 111/162 2024-06-02T03:55:52.767 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-radosgw-2:18.2.2-1381.g3bb45379.el8.x86_64 122/162 2024-06-02T03:55:52.798 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1381.g3bb45379.el8.x86_64 122/162 2024-06-02T03:55:52.838 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 124/162 2024-06-02T03:55:52.994 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 125/162 2024-06-02T03:55:52.994 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1381.g3bb45 123/162 2024-06-02T03:55:53.036 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1381.g3bb45 123/162 2024-06-02T03:55:53.244 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephfs-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 124/162 2024-06-02T03:55:53.591 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 124/162 2024-06-02T03:55:53.810 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 125/162 2024-06-02T03:55:54.285 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: cephadm-2:18.2.2-1381.g3bb45379.el8.noarch 112/162 2024-06-02T03:55:54.433 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephadm-2:18.2.2-1381.g3bb45379.el8.noarch 112/162 2024-06-02T03:55:54.612 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1381.g3bb45379.e 113/162 2024-06-02T03:55:54.799 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1381.g3bb45379. 114/162 2024-06-02T03:55:55.039 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1381.g3bb45379.el8.noa 115/162 2024-06-02T03:55:56.073 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1381.g3bb45379.el8.noa 115/162 2024-06-02T03:55:56.338 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1381.g3bb45379.el8.n 116/162 2024-06-02T03:55:57.309 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1381.g3bb45379.el8.n 116/162 2024-06-02T03:55:57.451 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 125/162 2024-06-02T03:55:57.530 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1381.g3bb 117/162 2024-06-02T03:55:57.624 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1381.g3bb 117/162 2024-06-02T03:55:58.009 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1381.g3bb45379.el 118/162 2024-06-02T03:55:58.213 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-2:18.2.2-1381.g3bb45379.el8.x86_64 119/162 2024-06-02T03:55:58.252 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1381.g3bb45379.el8.x86_64 119/162 2024-06-02T03:55:58.259 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 125/162 2024-06-02T03:55:58.446 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-test-2:18.2.2-1381.g3bb45379.el8.x86_64 126/162 2024-06-02T03:55:58.571 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-rook-2:18.2.2-1381.g3bb45379.el8.noarch 120/162 2024-06-02T03:55:58.584 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1381.g3bb45379.el8.noarch 120/162 2024-06-02T03:55:58.713 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 127/162 2024-06-02T03:55:58.742 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-test-2:18.2.2-1381.g3bb45379.el8.x86_64 126/162 2024-06-02T03:55:58.991 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 128/162 2024-06-02T03:55:59.111 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 127/162 2024-06-02T03:55:59.358 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libtool-2.4.6-25.el8.x86_64 128/162 2024-06-02T03:55:59.375 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 129/162 2024-06-02T03:55:59.669 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 130/162 2024-06-02T03:55:59.858 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-2:18.2.2-1381.g3bb45379.el8.x86_64 121/162 2024-06-02T03:55:59.925 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libtool-2.4.6-25.el8.x86_64 131/162 2024-06-02T03:55:59.938 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 131/162 2024-06-02T03:56:00.038 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 128/162 2024-06-02T03:56:00.063 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-radosgw-2:18.2.2-1381.g3bb45379.el8.x86_64 122/162 2024-06-02T03:56:00.098 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1381.g3bb45379.el8.x86_64 122/162 2024-06-02T03:56:00.169 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 132/162 2024-06-02T03:56:00.304 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1381.g3bb45 123/162 2024-06-02T03:56:00.346 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2024-06-02T03:56:00.346 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 129/162 2024-06-02T03:56:00.347 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1381.g3bb45 123/162 2024-06-02T03:56:00.518 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs-devel-2:18.2.2-1381.g3bb45379.el8.x86_ 134/162 2024-06-02T03:56:00.580 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 124/162 2024-06-02T03:56:00.641 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 130/162 2024-06-02T03:56:00.889 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : ceph-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 131/162 2024-06-02T03:56:00.927 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 124/162 2024-06-02T03:56:01.146 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 125/162 2024-06-02T03:56:01.160 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 132/162 2024-06-02T03:56:01.379 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2024-06-02T03:56:01.617 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libcephfs-devel-2:18.2.2-1381.g3bb45379.el8.x86_ 134/162 2024-06-02T03:56:02.926 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-06-02T03:56:03.244 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-06-02T03:56:03.280 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-06-02T03:56:03.706 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2024-06-02T03:56:03.987 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-06-02T03:56:04.114 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2024-06-02T03:56:04.283 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-06-02T03:56:04.322 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-06-02T03:56:04.353 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 138/162 2024-06-02T03:56:04.566 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-top-2:18.2.2-1381.g3bb45379.el8.noarch 139/162 2024-06-02T03:56:04.757 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 140/162 2024-06-02T03:56:04.816 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2024-06-02T03:56:05.054 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-nbd-2:18.2.2-1381.g3bb45379.el8.x86_64 141/162 2024-06-02T03:56:05.240 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2024-06-02T03:56:05.400 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 142/162 2024-06-02T03:56:05.470 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 138/162 2024-06-02T03:56:05.614 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 125/162 2024-06-02T03:56:05.616 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/162 2024-06-02T03:56:05.657 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : cephfs-top-2:18.2.2-1381.g3bb45379.el8.noarch 139/162 2024-06-02T03:56:05.691 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/162 2024-06-02T03:56:05.874 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 140/162 2024-06-02T03:56:05.965 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/162 2024-06-02T03:56:05.978 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/162 2024-06-02T03:56:06.140 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-06-02T03:56:06.149 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-06-02T03:56:06.216 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : rbd-nbd-2:18.2.2-1381.g3bb45379.el8.x86_64 141/162 2024-06-02T03:56:06.325 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 146/162 2024-06-02T03:56:06.501 INFO:teuthology.orchestra.run.smithi123.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 142/162 2024-06-02T03:56:06.528 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2024-06-02T03:56:06.559 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-test-2:18.2.2-1381.g3bb45379.el8.x86_64 126/162 2024-06-02T03:56:06.715 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-15.e 143/162 2024-06-02T03:56:06.726 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-15.e 143/162 2024-06-02T03:56:06.758 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2024-06-02T03:56:06.849 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 127/162 2024-06-02T03:56:06.927 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2024-06-02T03:56:06.927 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-06-02T03:56:06.958 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 144/162 2024-06-02T03:56:07.185 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 128/162 2024-06-02T03:56:07.226 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-06-02T03:56:07.226 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-06-02T03:56:07.243 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : flex-2.6.1-9.el8.x86_64 145/162 2024-06-02T03:56:07.323 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 145/162 2024-06-02T03:56:07.435 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-06-02T03:56:07.435 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2024-06-02T03:56:07.574 INFO:teuthology.orchestra.run.smithi123.stdout: Installing : bison-3.0.4-10.el8.x86_64 146/162 2024-06-02T03:56:07.587 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 146/162 2024-06-02T03:56:07.616 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 129/162 2024-06-02T03:56:07.695 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2024-06-02T03:56:07.798 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2024-06-02T03:56:07.900 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2024-06-02T03:56:07.947 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 130/162 2024-06-02T03:56:08.001 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2024-06-02T03:56:08.086 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2024-06-02T03:56:08.161 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2024-06-02T03:56:08.161 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-06-02T03:56:08.194 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libtool-2.4.6-25.el8.x86_64 131/162 2024-06-02T03:56:08.208 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 131/162 2024-06-02T03:56:08.300 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2024-06-02T03:56:08.300 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2024-06-02T03:56:08.414 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 132/162 2024-06-02T03:56:08.485 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-06-02T03:56:08.485 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-06-02T03:56:08.567 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2024-06-02T03:56:08.568 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2024-06-02T03:56:08.623 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2024-06-02T03:56:08.752 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-06-02T03:56:08.752 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2024-06-02T03:56:08.817 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2024-06-02T03:56:08.817 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2024-06-02T03:56:08.846 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs-devel-2:18.2.2-1381.g3bb45379.el8.x86_ 134/162 2024-06-02T03:56:09.054 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2024-06-02T03:56:09.058 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2024-06-02T03:56:09.059 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2024-06-02T03:56:09.300 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2024-06-02T03:56:09.334 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2024-06-02T03:56:09.334 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-06-02T03:56:09.507 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2024-06-02T03:56:09.567 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-06-02T03:56:09.767 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2024-06-02T03:56:09.767 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-06-02T03:56:09.792 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2024-06-02T03:56:09.792 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2024-06-02T03:56:10.051 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2024-06-02T03:56:10.051 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2024-06-02T03:56:10.301 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2024-06-02T03:56:10.301 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2024-06-02T03:56:10.543 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2024-06-02T03:56:10.543 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2024-06-02T03:56:10.702 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-06-02T03:56:10.702 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-2:18.2.2-1381.g3bb45379.el8.x86_64 1/162 2024-06-02T03:56:10.702 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-base-2:18.2.2-1381.g3bb45379.el8.x86_64 2/162 2024-06-02T03:56:10.702 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 3/162 2024-06-02T03:56:10.702 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 4/162 2024-06-02T03:56:10.702 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1381.g3bb45 5/162 2024-06-02T03:56:10.702 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mds-2:18.2.2-1381.g3bb45379.el8.x86_64 6/162 2024-06-02T03:56:10.702 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-2:18.2.2-1381.g3bb45379.el8.x86_64 7/162 2024-06-02T03:56:10.703 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mon-2:18.2.2-1381.g3bb45379.el8.x86_64 8/162 2024-06-02T03:56:10.703 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-osd-2:18.2.2-1381.g3bb45379.el8.x86_64 9/162 2024-06-02T03:56:10.703 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-radosgw-2:18.2.2-1381.g3bb45379.el8.x86_64 10/162 2024-06-02T03:56:10.703 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-selinux-2:18.2.2-1381.g3bb45379.el8.x86_64 11/162 2024-06-02T03:56:10.703 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-test-2:18.2.2-1381.g3bb45379.el8.x86_64 12/162 2024-06-02T03:56:10.703 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 13/162 2024-06-02T03:56:10.703 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs-devel-2:18.2.2-1381.g3bb45379.el8.x86_ 14/162 2024-06-02T03:56:10.703 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs2-2:18.2.2-1381.g3bb45379.el8.x86_64 15/162 2024-06-02T03:56:10.703 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephsqlite-2:18.2.2-1381.g3bb45379.el8.x86_64 16/162 2024-06-02T03:56:10.703 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados-devel-2:18.2.2-1381.g3bb45379.el8.x86_6 17/162 2024-06-02T03:56:10.703 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libradosstriper1-2:18.2.2-1381.g3bb45379.el8.x86 18/162 2024-06-02T03:56:10.703 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librgw2-2:18.2.2-1381.g3bb45379.el8.x86_64 19/162 2024-06-02T03:56:10.703 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1381.g3bb45379.el 20/162 2024-06-02T03:56:10.704 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-common-2:18.2.2-1381.g3bb45379.el8. 21/162 2024-06-02T03:56:10.704 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cephfs-2:18.2.2-1381.g3bb45379.el8.x86_6 22/162 2024-06-02T03:56:10.704 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rados-2:18.2.2-1381.g3bb45379.el8.x86_64 23/162 2024-06-02T03:56:10.704 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rbd-2:18.2.2-1381.g3bb45379.el8.x86_64 24/162 2024-06-02T03:56:10.704 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rgw-2:18.2.2-1381.g3bb45379.el8.x86_64 25/162 2024-06-02T03:56:10.704 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 26/162 2024-06-02T03:56:10.704 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 27/162 2024-06-02T03:56:10.716 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-nbd-2:18.2.2-1381.g3bb45379.el8.x86_64 28/162 2024-06-02T03:56:10.716 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1381.g3bb45379. 29/162 2024-06-02T03:56:10.716 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1381.g3bb45379.el8.noa 30/162 2024-06-02T03:56:10.716 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1381.g3bb45379.el8.n 31/162 2024-06-02T03:56:10.716 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1381.g3bb 32/162 2024-06-02T03:56:10.716 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1381.g3bb45379.el 33/162 2024-06-02T03:56:10.716 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1381.g3bb45379.el8.noarch 34/162 2024-06-02T03:56:10.716 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1381.g3bb45379.e 35/162 2024-06-02T03:56:10.716 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-volume-2:18.2.2-1381.g3bb45379.el8.noarch 36/162 2024-06-02T03:56:10.717 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephadm-2:18.2.2-1381.g3bb45379.el8.noarch 37/162 2024-06-02T03:56:10.717 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-top-2:18.2.2-1381.g3bb45379.el8.noarch 38/162 2024-06-02T03:56:10.717 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2024-06-02T03:56:10.717 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2024-06-02T03:56:10.717 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2024-06-02T03:56:10.717 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/162 2024-06-02T03:56:10.717 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/162 2024-06-02T03:56:10.717 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/162 2024-06-02T03:56:10.717 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/162 2024-06-02T03:56:10.717 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/162 2024-06-02T03:56:10.717 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/162 2024-06-02T03:56:10.718 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/162 2024-06-02T03:56:10.718 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/162 2024-06-02T03:56:10.718 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/162 2024-06-02T03:56:10.718 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/162 2024-06-02T03:56:10.718 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/162 2024-06-02T03:56:10.718 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/162 2024-06-02T03:56:10.718 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/162 2024-06-02T03:56:10.718 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/162 2024-06-02T03:56:10.718 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/162 2024-06-02T03:56:10.718 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/162 2024-06-02T03:56:10.718 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/162 2024-06-02T03:56:10.718 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/162 2024-06-02T03:56:10.718 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/162 2024-06-02T03:56:10.719 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/162 2024-06-02T03:56:10.719 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/162 2024-06-02T03:56:10.719 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/162 2024-06-02T03:56:10.719 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/162 2024-06-02T03:56:10.719 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/162 2024-06-02T03:56:10.719 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/162 2024-06-02T03:56:10.719 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/162 2024-06-02T03:56:10.719 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/162 2024-06-02T03:56:10.719 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/162 2024-06-02T03:56:10.719 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/162 2024-06-02T03:56:10.719 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/162 2024-06-02T03:56:10.719 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 72/162 2024-06-02T03:56:10.720 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 73/162 2024-06-02T03:56:10.720 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/162 2024-06-02T03:56:10.720 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/162 2024-06-02T03:56:10.720 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/162 2024-06-02T03:56:10.720 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/162 2024-06-02T03:56:10.720 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 78/162 2024-06-02T03:56:10.720 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 79/162 2024-06-02T03:56:10.720 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 80/162 2024-06-02T03:56:10.720 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 81/162 2024-06-02T03:56:10.720 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 82/162 2024-06-02T03:56:10.720 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 83/162 2024-06-02T03:56:10.720 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 84/162 2024-06-02T03:56:10.721 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 85/162 2024-06-02T03:56:10.721 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 86/162 2024-06-02T03:56:10.721 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 87/162 2024-06-02T03:56:10.721 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 88/162 2024-06-02T03:56:10.721 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 89/162 2024-06-02T03:56:10.721 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 90/162 2024-06-02T03:56:10.721 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 91/162 2024-06-02T03:56:10.721 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 92/162 2024-06-02T03:56:10.721 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 93/162 2024-06-02T03:56:10.721 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 94/162 2024-06-02T03:56:10.721 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 95/162 2024-06-02T03:56:10.721 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 96/162 2024-06-02T03:56:10.721 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 97/162 2024-06-02T03:56:10.722 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-15.e 98/162 2024-06-02T03:56:10.722 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 99/162 2024-06-02T03:56:10.722 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 100/162 2024-06-02T03:56:10.722 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 101/162 2024-06-02T03:56:10.722 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 102/162 2024-06-02T03:56:10.722 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 103/162 2024-06-02T03:56:10.722 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 104/162 2024-06-02T03:56:10.722 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 105/162 2024-06-02T03:56:10.722 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : bison-3.0.4-10.el8.x86_64 106/162 2024-06-02T03:56:10.722 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flex-2.6.1-9.el8.x86_64 107/162 2024-06-02T03:56:10.722 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 108/162 2024-06-02T03:56:10.722 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 109/162 2024-06-02T03:56:10.723 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 110/162 2024-06-02T03:56:10.723 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 111/162 2024-06-02T03:56:10.723 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 112/162 2024-06-02T03:56:10.723 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 113/162 2024-06-02T03:56:10.723 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 114/162 2024-06-02T03:56:10.723 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 115/162 2024-06-02T03:56:10.723 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 116/162 2024-06-02T03:56:10.723 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 117/162 2024-06-02T03:56:10.723 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 118/162 2024-06-02T03:56:10.723 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 119/162 2024-06-02T03:56:10.723 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 120/162 2024-06-02T03:56:10.723 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 121/162 2024-06-02T03:56:10.723 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : automake-1.16.1-8.el8.noarch 122/162 2024-06-02T03:56:10.723 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libpq-13.11-1.el8.x86_64 123/162 2024-06-02T03:56:10.724 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : jq-1.6-7.el8.x86_64 124/162 2024-06-02T03:56:10.724 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 125/162 2024-06-02T03:56:10.724 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 126/162 2024-06-02T03:56:10.724 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 127/162 2024-06-02T03:56:10.724 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 128/162 2024-06-02T03:56:10.724 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 129/162 2024-06-02T03:56:10.724 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-server-10.23-4.module+el8.9.0+21317+d 130/162 2024-06-02T03:56:10.724 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:18.2.2-1381.g3bb45379.el8.x86_64 131/162 2024-06-02T03:56:10.724 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2024-06-02T03:56:10.724 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:18.2.2-1381.g3bb45379.el8.x86_64 133/162 2024-06-02T03:56:10.724 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2024-06-02T03:56:10.724 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 135/162 2024-06-02T03:56:10.724 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 136/162 2024-06-02T03:56:10.725 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 137/162 2024-06-02T03:56:10.725 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 138/162 2024-06-02T03:56:10.725 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 139/162 2024-06-02T03:56:10.725 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 140/162 2024-06-02T03:56:10.725 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 141/162 2024-06-02T03:56:10.725 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 142/162 2024-06-02T03:56:10.725 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 143/162 2024-06-02T03:56:10.725 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 144/162 2024-06-02T03:56:10.725 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 145/162 2024-06-02T03:56:10.725 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 146/162 2024-06-02T03:56:10.725 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 147/162 2024-06-02T03:56:10.725 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 148/162 2024-06-02T03:56:10.725 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 149/162 2024-06-02T03:56:10.725 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 150/162 2024-06-02T03:56:10.725 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 151/162 2024-06-02T03:56:10.726 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 152/162 2024-06-02T03:56:10.726 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 153/162 2024-06-02T03:56:10.726 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 154/162 2024-06-02T03:56:10.726 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 155/162 2024-06-02T03:56:10.726 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 156/162 2024-06-02T03:56:10.726 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 157/162 2024-06-02T03:56:10.726 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 158/162 2024-06-02T03:56:10.726 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 159/162 2024-06-02T03:56:10.726 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 160/162 2024-06-02T03:56:10.726 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 161/162 2024-06-02T03:56:10.784 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2024-06-02T03:56:10.784 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-06-02T03:56:11.025 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-06-02T03:56:11.178 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-06-02T03:56:11.209 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2024-06-02T03:56:11.209 INFO:teuthology.orchestra.run.smithi123.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-06-02T03:56:11.477 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-06-02T03:56:11.517 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-06-02T03:56:11.976 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2024-06-02T03:56:12.135 INFO:teuthology.orchestra.run.smithi123.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-06-02T03:56:12.136 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-2:18.2.2-1381.g3bb45379.el8.x86_64 1/162 2024-06-02T03:56:12.136 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-base-2:18.2.2-1381.g3bb45379.el8.x86_64 2/162 2024-06-02T03:56:12.136 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 3/162 2024-06-02T03:56:12.136 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 4/162 2024-06-02T03:56:12.136 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1381.g3bb45 5/162 2024-06-02T03:56:12.136 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mds-2:18.2.2-1381.g3bb45379.el8.x86_64 6/162 2024-06-02T03:56:12.137 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-2:18.2.2-1381.g3bb45379.el8.x86_64 7/162 2024-06-02T03:56:12.137 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mon-2:18.2.2-1381.g3bb45379.el8.x86_64 8/162 2024-06-02T03:56:12.137 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-osd-2:18.2.2-1381.g3bb45379.el8.x86_64 9/162 2024-06-02T03:56:12.137 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-radosgw-2:18.2.2-1381.g3bb45379.el8.x86_64 10/162 2024-06-02T03:56:12.137 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-selinux-2:18.2.2-1381.g3bb45379.el8.x86_64 11/162 2024-06-02T03:56:12.137 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-test-2:18.2.2-1381.g3bb45379.el8.x86_64 12/162 2024-06-02T03:56:12.137 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephfs-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 13/162 2024-06-02T03:56:12.138 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephfs-devel-2:18.2.2-1381.g3bb45379.el8.x86_ 14/162 2024-06-02T03:56:12.138 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephfs2-2:18.2.2-1381.g3bb45379.el8.x86_64 15/162 2024-06-02T03:56:12.138 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcephsqlite-2:18.2.2-1381.g3bb45379.el8.x86_64 16/162 2024-06-02T03:56:12.138 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados-devel-2:18.2.2-1381.g3bb45379.el8.x86_6 17/162 2024-06-02T03:56:12.138 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libradosstriper1-2:18.2.2-1381.g3bb45379.el8.x86 18/162 2024-06-02T03:56:12.139 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librgw2-2:18.2.2-1381.g3bb45379.el8.x86_64 19/162 2024-06-02T03:56:12.139 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1381.g3bb45379.el 20/162 2024-06-02T03:56:12.139 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-ceph-common-2:18.2.2-1381.g3bb45379.el8. 21/162 2024-06-02T03:56:12.139 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cephfs-2:18.2.2-1381.g3bb45379.el8.x86_6 22/162 2024-06-02T03:56:12.139 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rados-2:18.2.2-1381.g3bb45379.el8.x86_64 23/162 2024-06-02T03:56:12.139 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rbd-2:18.2.2-1381.g3bb45379.el8.x86_64 24/162 2024-06-02T03:56:12.139 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rgw-2:18.2.2-1381.g3bb45379.el8.x86_64 25/162 2024-06-02T03:56:12.140 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 26/162 2024-06-02T03:56:12.140 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 27/162 2024-06-02T03:56:12.140 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : rbd-nbd-2:18.2.2-1381.g3bb45379.el8.x86_64 28/162 2024-06-02T03:56:12.140 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1381.g3bb45379. 29/162 2024-06-02T03:56:12.163 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1381.g3bb45379.el8.noa 30/162 2024-06-02T03:56:12.163 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1381.g3bb45379.el8.n 31/162 2024-06-02T03:56:12.163 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1381.g3bb 32/162 2024-06-02T03:56:12.163 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1381.g3bb45379.el 33/162 2024-06-02T03:56:12.163 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1381.g3bb45379.el8.noarch 34/162 2024-06-02T03:56:12.163 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1381.g3bb45379.e 35/162 2024-06-02T03:56:12.163 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : ceph-volume-2:18.2.2-1381.g3bb45379.el8.noarch 36/162 2024-06-02T03:56:12.163 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephadm-2:18.2.2-1381.g3bb45379.el8.noarch 37/162 2024-06-02T03:56:12.163 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : cephfs-top-2:18.2.2-1381.g3bb45379.el8.noarch 38/162 2024-06-02T03:56:12.164 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2024-06-02T03:56:12.164 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2024-06-02T03:56:12.164 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2024-06-02T03:56:12.164 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/162 2024-06-02T03:56:12.164 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/162 2024-06-02T03:56:12.164 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/162 2024-06-02T03:56:12.164 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/162 2024-06-02T03:56:12.164 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/162 2024-06-02T03:56:12.164 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/162 2024-06-02T03:56:12.164 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/162 2024-06-02T03:56:12.164 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/162 2024-06-02T03:56:12.164 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/162 2024-06-02T03:56:12.164 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/162 2024-06-02T03:56:12.165 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/162 2024-06-02T03:56:12.165 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/162 2024-06-02T03:56:12.165 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/162 2024-06-02T03:56:12.165 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/162 2024-06-02T03:56:12.165 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/162 2024-06-02T03:56:12.165 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/162 2024-06-02T03:56:12.165 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/162 2024-06-02T03:56:12.165 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/162 2024-06-02T03:56:12.165 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/162 2024-06-02T03:56:12.165 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/162 2024-06-02T03:56:12.165 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/162 2024-06-02T03:56:12.165 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/162 2024-06-02T03:56:12.165 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/162 2024-06-02T03:56:12.166 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/162 2024-06-02T03:56:12.166 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/162 2024-06-02T03:56:12.166 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/162 2024-06-02T03:56:12.166 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/162 2024-06-02T03:56:12.166 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/162 2024-06-02T03:56:12.166 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/162 2024-06-02T03:56:12.166 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/162 2024-06-02T03:56:12.166 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 72/162 2024-06-02T03:56:12.166 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 73/162 2024-06-02T03:56:12.166 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 74/162 2024-06-02T03:56:12.166 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 75/162 2024-06-02T03:56:12.167 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 76/162 2024-06-02T03:56:12.167 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 77/162 2024-06-02T03:56:12.167 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 78/162 2024-06-02T03:56:12.167 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : bison-3.0.4-10.el8.x86_64 79/162 2024-06-02T03:56:12.167 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : flex-2.6.1-9.el8.x86_64 80/162 2024-06-02T03:56:12.167 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 81/162 2024-06-02T03:56:12.167 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 82/162 2024-06-02T03:56:12.167 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 83/162 2024-06-02T03:56:12.167 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 84/162 2024-06-02T03:56:12.167 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 85/162 2024-06-02T03:56:12.167 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 86/162 2024-06-02T03:56:12.167 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 87/162 2024-06-02T03:56:12.167 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 88/162 2024-06-02T03:56:12.168 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 89/162 2024-06-02T03:56:12.168 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 90/162 2024-06-02T03:56:12.168 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 91/162 2024-06-02T03:56:12.168 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 92/162 2024-06-02T03:56:12.168 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 93/162 2024-06-02T03:56:12.168 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 94/162 2024-06-02T03:56:12.168 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : automake-1.16.1-8.el8.noarch 95/162 2024-06-02T03:56:12.168 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libpq-13.11-1.el8.x86_64 96/162 2024-06-02T03:56:12.168 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : jq-1.6-7.el8.x86_64 97/162 2024-06-02T03:56:12.168 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 98/162 2024-06-02T03:56:12.168 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 99/162 2024-06-02T03:56:12.168 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 100/162 2024-06-02T03:56:12.168 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 101/162 2024-06-02T03:56:12.169 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 102/162 2024-06-02T03:56:12.169 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : postgresql-server-10.23-4.module+el8.9.0+21317+d 103/162 2024-06-02T03:56:12.169 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 104/162 2024-06-02T03:56:12.169 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/162 2024-06-02T03:56:12.169 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 106/162 2024-06-02T03:56:12.169 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 107/162 2024-06-02T03:56:12.169 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 108/162 2024-06-02T03:56:12.169 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 109/162 2024-06-02T03:56:12.169 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 110/162 2024-06-02T03:56:12.169 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 111/162 2024-06-02T03:56:12.169 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 112/162 2024-06-02T03:56:12.169 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 113/162 2024-06-02T03:56:12.169 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 114/162 2024-06-02T03:56:12.170 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 115/162 2024-06-02T03:56:12.170 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 116/162 2024-06-02T03:56:12.170 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 117/162 2024-06-02T03:56:12.170 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 118/162 2024-06-02T03:56:12.170 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 119/162 2024-06-02T03:56:12.170 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 120/162 2024-06-02T03:56:12.170 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 121/162 2024-06-02T03:56:12.170 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 122/162 2024-06-02T03:56:12.170 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 123/162 2024-06-02T03:56:12.170 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 124/162 2024-06-02T03:56:12.170 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 125/162 2024-06-02T03:56:12.170 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 126/162 2024-06-02T03:56:12.171 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 127/162 2024-06-02T03:56:12.171 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 128/162 2024-06-02T03:56:12.171 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-15.e 129/162 2024-06-02T03:56:12.171 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 130/162 2024-06-02T03:56:12.171 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados2-2:18.2.2-1381.g3bb45379.el8.x86_64 131/162 2024-06-02T03:56:12.171 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2024-06-02T03:56:12.171 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librbd1-2:18.2.2-1381.g3bb45379.el8.x86_64 133/162 2024-06-02T03:56:12.171 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2024-06-02T03:56:12.171 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 135/162 2024-06-02T03:56:12.171 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 136/162 2024-06-02T03:56:12.171 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 137/162 2024-06-02T03:56:12.171 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 138/162 2024-06-02T03:56:12.172 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 139/162 2024-06-02T03:56:12.172 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 140/162 2024-06-02T03:56:12.172 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 141/162 2024-06-02T03:56:12.172 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 142/162 2024-06-02T03:56:12.172 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 143/162 2024-06-02T03:56:12.172 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 144/162 2024-06-02T03:56:12.172 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 145/162 2024-06-02T03:56:12.173 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 146/162 2024-06-02T03:56:12.173 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 147/162 2024-06-02T03:56:12.173 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 148/162 2024-06-02T03:56:12.173 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 149/162 2024-06-02T03:56:12.173 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 150/162 2024-06-02T03:56:12.173 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 151/162 2024-06-02T03:56:12.173 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 152/162 2024-06-02T03:56:12.173 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 153/162 2024-06-02T03:56:12.174 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 154/162 2024-06-02T03:56:12.174 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 155/162 2024-06-02T03:56:12.174 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 156/162 2024-06-02T03:56:12.174 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 157/162 2024-06-02T03:56:12.174 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 158/162 2024-06-02T03:56:12.174 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 159/162 2024-06-02T03:56:12.175 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 160/162 2024-06-02T03:56:12.175 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 161/162 2024-06-02T03:56:12.351 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2024-06-02T03:56:12.606 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 138/162 2024-06-02T03:56:12.802 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-top-2:18.2.2-1381.g3bb45379.el8.noarch 139/162 2024-06-02T03:56:12.985 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 140/162 2024-06-02T03:56:13.285 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-nbd-2:18.2.2-1381.g3bb45379.el8.x86_64 141/162 2024-06-02T03:56:13.628 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 142/162 2024-06-02T03:56:13.863 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/162 2024-06-02T03:56:13.938 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/162 2024-06-02T03:56:14.143 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/162 2024-06-02T03:56:14.156 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/162 2024-06-02T03:56:14.301 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-06-02T03:56:14.310 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-06-02T03:56:14.504 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 146/162 2024-06-02T03:56:14.655 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2024-06-02T03:56:14.878 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2024-06-02T03:56:15.063 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2024-06-02T03:56:15.064 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-06-02T03:56:15.321 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-06-02T03:56:15.322 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-06-02T03:56:15.589 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-06-02T03:56:15.589 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2024-06-02T03:56:15.849 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2024-06-02T03:56:16.086 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2024-06-02T03:56:16.253 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2024-06-02T03:56:16.503 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2024-06-02T03:56:16.503 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2024-06-02T03:56:16.754 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2024-06-02T03:56:16.754 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2024-06-02T03:56:17.020 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2024-06-02T03:56:17.020 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2024-06-02T03:56:17.245 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2024-06-02T03:56:17.245 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2024-06-02T03:56:17.495 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2024-06-02T03:56:17.495 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-06-02T03:56:17.745 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-06-02T03:56:17.887 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2024-06-02T03:56:17.887 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-06-02T03:56:18.853 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-06-02T03:56:18.854 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-2:18.2.2-1381.g3bb45379.el8.x86_64 1/162 2024-06-02T03:56:18.854 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-base-2:18.2.2-1381.g3bb45379.el8.x86_64 2/162 2024-06-02T03:56:18.854 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 3/162 2024-06-02T03:56:18.854 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 4/162 2024-06-02T03:56:18.854 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1381.g3bb45 5/162 2024-06-02T03:56:18.855 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mds-2:18.2.2-1381.g3bb45379.el8.x86_64 6/162 2024-06-02T03:56:18.855 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-2:18.2.2-1381.g3bb45379.el8.x86_64 7/162 2024-06-02T03:56:18.855 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mon-2:18.2.2-1381.g3bb45379.el8.x86_64 8/162 2024-06-02T03:56:18.855 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-osd-2:18.2.2-1381.g3bb45379.el8.x86_64 9/162 2024-06-02T03:56:18.855 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-radosgw-2:18.2.2-1381.g3bb45379.el8.x86_64 10/162 2024-06-02T03:56:18.855 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-selinux-2:18.2.2-1381.g3bb45379.el8.x86_64 11/162 2024-06-02T03:56:18.855 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-test-2:18.2.2-1381.g3bb45379.el8.x86_64 12/162 2024-06-02T03:56:18.855 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 13/162 2024-06-02T03:56:18.855 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs-devel-2:18.2.2-1381.g3bb45379.el8.x86_ 14/162 2024-06-02T03:56:18.856 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs2-2:18.2.2-1381.g3bb45379.el8.x86_64 15/162 2024-06-02T03:56:18.856 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephsqlite-2:18.2.2-1381.g3bb45379.el8.x86_64 16/162 2024-06-02T03:56:18.856 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados-devel-2:18.2.2-1381.g3bb45379.el8.x86_6 17/162 2024-06-02T03:56:18.856 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libradosstriper1-2:18.2.2-1381.g3bb45379.el8.x86 18/162 2024-06-02T03:56:18.856 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librgw2-2:18.2.2-1381.g3bb45379.el8.x86_64 19/162 2024-06-02T03:56:18.856 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1381.g3bb45379.el 20/162 2024-06-02T03:56:18.856 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ceph-common-2:18.2.2-1381.g3bb45379.el8. 21/162 2024-06-02T03:56:18.856 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cephfs-2:18.2.2-1381.g3bb45379.el8.x86_6 22/162 2024-06-02T03:56:18.856 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rados-2:18.2.2-1381.g3bb45379.el8.x86_64 23/162 2024-06-02T03:56:18.856 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rbd-2:18.2.2-1381.g3bb45379.el8.x86_64 24/162 2024-06-02T03:56:18.872 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rgw-2:18.2.2-1381.g3bb45379.el8.x86_64 25/162 2024-06-02T03:56:18.872 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 26/162 2024-06-02T03:56:18.872 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 27/162 2024-06-02T03:56:18.872 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-nbd-2:18.2.2-1381.g3bb45379.el8.x86_64 28/162 2024-06-02T03:56:18.873 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1381.g3bb45379. 29/162 2024-06-02T03:56:18.873 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1381.g3bb45379.el8.noa 30/162 2024-06-02T03:56:18.873 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1381.g3bb45379.el8.n 31/162 2024-06-02T03:56:18.873 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1381.g3bb 32/162 2024-06-02T03:56:18.873 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1381.g3bb45379.el 33/162 2024-06-02T03:56:18.873 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1381.g3bb45379.el8.noarch 34/162 2024-06-02T03:56:18.874 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1381.g3bb45379.e 35/162 2024-06-02T03:56:18.874 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-volume-2:18.2.2-1381.g3bb45379.el8.noarch 36/162 2024-06-02T03:56:18.874 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephadm-2:18.2.2-1381.g3bb45379.el8.noarch 37/162 2024-06-02T03:56:18.874 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-top-2:18.2.2-1381.g3bb45379.el8.noarch 38/162 2024-06-02T03:56:18.874 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2024-06-02T03:56:18.875 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2024-06-02T03:56:18.875 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2024-06-02T03:56:18.875 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/162 2024-06-02T03:56:18.875 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/162 2024-06-02T03:56:18.875 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/162 2024-06-02T03:56:18.875 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/162 2024-06-02T03:56:18.875 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/162 2024-06-02T03:56:18.876 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/162 2024-06-02T03:56:18.876 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/162 2024-06-02T03:56:18.876 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/162 2024-06-02T03:56:18.876 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/162 2024-06-02T03:56:18.876 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/162 2024-06-02T03:56:18.876 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/162 2024-06-02T03:56:18.877 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/162 2024-06-02T03:56:18.877 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/162 2024-06-02T03:56:18.877 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/162 2024-06-02T03:56:18.877 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/162 2024-06-02T03:56:18.877 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/162 2024-06-02T03:56:18.877 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/162 2024-06-02T03:56:18.878 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/162 2024-06-02T03:56:18.878 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/162 2024-06-02T03:56:18.878 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/162 2024-06-02T03:56:18.878 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/162 2024-06-02T03:56:18.878 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/162 2024-06-02T03:56:18.879 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/162 2024-06-02T03:56:18.879 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/162 2024-06-02T03:56:18.879 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/162 2024-06-02T03:56:18.879 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/162 2024-06-02T03:56:18.879 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/162 2024-06-02T03:56:18.880 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/162 2024-06-02T03:56:18.880 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/162 2024-06-02T03:56:18.880 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/162 2024-06-02T03:56:18.880 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 72/162 2024-06-02T03:56:18.880 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 73/162 2024-06-02T03:56:18.881 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/162 2024-06-02T03:56:18.881 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/162 2024-06-02T03:56:18.881 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/162 2024-06-02T03:56:18.881 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/162 2024-06-02T03:56:18.881 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 78/162 2024-06-02T03:56:18.881 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 79/162 2024-06-02T03:56:18.882 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 80/162 2024-06-02T03:56:18.882 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 81/162 2024-06-02T03:56:18.882 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 82/162 2024-06-02T03:56:18.882 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 83/162 2024-06-02T03:56:18.882 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 84/162 2024-06-02T03:56:18.882 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 85/162 2024-06-02T03:56:18.883 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 86/162 2024-06-02T03:56:18.883 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 87/162 2024-06-02T03:56:18.883 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 88/162 2024-06-02T03:56:18.883 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 89/162 2024-06-02T03:56:18.883 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 90/162 2024-06-02T03:56:18.883 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 91/162 2024-06-02T03:56:18.884 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 92/162 2024-06-02T03:56:18.884 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 93/162 2024-06-02T03:56:18.884 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 94/162 2024-06-02T03:56:18.884 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 95/162 2024-06-02T03:56:18.884 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 96/162 2024-06-02T03:56:18.884 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 97/162 2024-06-02T03:56:18.885 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-15.e 98/162 2024-06-02T03:56:18.885 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 99/162 2024-06-02T03:56:18.885 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 100/162 2024-06-02T03:56:18.885 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 101/162 2024-06-02T03:56:18.885 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 102/162 2024-06-02T03:56:18.885 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 103/162 2024-06-02T03:56:18.886 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 104/162 2024-06-02T03:56:18.886 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 105/162 2024-06-02T03:56:18.886 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : bison-3.0.4-10.el8.x86_64 106/162 2024-06-02T03:56:18.886 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flex-2.6.1-9.el8.x86_64 107/162 2024-06-02T03:56:18.886 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 108/162 2024-06-02T03:56:18.886 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 109/162 2024-06-02T03:56:18.887 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 110/162 2024-06-02T03:56:18.887 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 111/162 2024-06-02T03:56:18.887 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 112/162 2024-06-02T03:56:18.887 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 113/162 2024-06-02T03:56:18.887 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 114/162 2024-06-02T03:56:18.888 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 115/162 2024-06-02T03:56:18.888 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 116/162 2024-06-02T03:56:18.888 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 117/162 2024-06-02T03:56:18.888 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 118/162 2024-06-02T03:56:18.888 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 119/162 2024-06-02T03:56:18.888 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 120/162 2024-06-02T03:56:18.889 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 121/162 2024-06-02T03:56:18.889 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : automake-1.16.1-8.el8.noarch 122/162 2024-06-02T03:56:18.889 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libpq-13.11-1.el8.x86_64 123/162 2024-06-02T03:56:18.889 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : jq-1.6-7.el8.x86_64 124/162 2024-06-02T03:56:18.889 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 125/162 2024-06-02T03:56:18.889 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 126/162 2024-06-02T03:56:18.890 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 127/162 2024-06-02T03:56:18.890 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 128/162 2024-06-02T03:56:18.890 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 129/162 2024-06-02T03:56:18.890 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-server-10.23-4.module+el8.9.0+21317+d 130/162 2024-06-02T03:56:18.890 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-2:18.2.2-1381.g3bb45379.el8.x86_64 131/162 2024-06-02T03:56:18.890 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2024-06-02T03:56:18.891 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-2:18.2.2-1381.g3bb45379.el8.x86_64 133/162 2024-06-02T03:56:18.891 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2024-06-02T03:56:18.891 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 135/162 2024-06-02T03:56:18.891 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 136/162 2024-06-02T03:56:18.891 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 137/162 2024-06-02T03:56:18.892 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 138/162 2024-06-02T03:56:18.892 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 139/162 2024-06-02T03:56:18.892 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 140/162 2024-06-02T03:56:18.892 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 141/162 2024-06-02T03:56:18.892 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 142/162 2024-06-02T03:56:18.892 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 143/162 2024-06-02T03:56:18.893 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 144/162 2024-06-02T03:56:18.893 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 145/162 2024-06-02T03:56:18.893 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 146/162 2024-06-02T03:56:18.893 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 147/162 2024-06-02T03:56:18.893 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 148/162 2024-06-02T03:56:18.893 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 149/162 2024-06-02T03:56:18.893 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 150/162 2024-06-02T03:56:18.893 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 151/162 2024-06-02T03:56:18.893 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 152/162 2024-06-02T03:56:18.893 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 153/162 2024-06-02T03:56:18.893 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 154/162 2024-06-02T03:56:18.894 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 155/162 2024-06-02T03:56:18.894 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 156/162 2024-06-02T03:56:18.894 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 157/162 2024-06-02T03:56:18.894 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 158/162 2024-06-02T03:56:18.894 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 159/162 2024-06-02T03:56:18.894 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 160/162 2024-06-02T03:56:18.894 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 161/162 2024-06-02T03:56:26.414 INFO:teuthology.orchestra.run.smithi123.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 162/162 2024-06-02T03:56:26.414 INFO:teuthology.orchestra.run.smithi123.stdout:Installed products updated. 2024-06-02T03:56:26.902 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 162/162 2024-06-02T03:56:26.902 INFO:teuthology.orchestra.run.smithi162.stdout:Installed products updated. 2024-06-02T03:56:27.034 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T03:56:27.034 INFO:teuthology.orchestra.run.smithi123.stdout:Upgraded: 2024-06-02T03:56:27.034 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-06-02T03:56:27.034 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-06-02T03:56:27.034 INFO:teuthology.orchestra.run.smithi123.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-06-02T03:56:27.034 INFO:teuthology.orchestra.run.smithi123.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-06-02T03:56:27.034 INFO:teuthology.orchestra.run.smithi123.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-06-02T03:56:27.035 INFO:teuthology.orchestra.run.smithi123.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-06-02T03:56:27.035 INFO:teuthology.orchestra.run.smithi123.stdout: librados2-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.035 INFO:teuthology.orchestra.run.smithi123.stdout: librbd1-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.035 INFO:teuthology.orchestra.run.smithi123.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-06-02T03:56:27.035 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-06-02T03:56:27.035 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-06-02T03:56:27.035 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-06-02T03:56:27.035 INFO:teuthology.orchestra.run.smithi123.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-06-02T03:56:27.035 INFO:teuthology.orchestra.run.smithi123.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-06-02T03:56:27.035 INFO:teuthology.orchestra.run.smithi123.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-06-02T03:56:27.035 INFO:teuthology.orchestra.run.smithi123.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-06-02T03:56:27.035 INFO:teuthology.orchestra.run.smithi123.stdout:Installed: 2024-06-02T03:56:27.036 INFO:teuthology.orchestra.run.smithi123.stdout: NetworkManager-initscripts-updown-1:1.40.16-15.el8_9.noarch 2024-06-02T03:56:27.036 INFO:teuthology.orchestra.run.smithi123.stdout: automake-1.16.1-8.el8.noarch 2024-06-02T03:56:27.036 INFO:teuthology.orchestra.run.smithi123.stdout: bison-3.0.4-10.el8.x86_64 2024-06-02T03:56:27.036 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.036 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-base-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.036 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.036 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.036 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-grafana-dashboards-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T03:56:27.036 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-immutable-object-cache-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.036 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mds-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.036 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.036 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-cephadm-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T03:56:27.036 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-dashboard-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T03:56:27.037 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T03:56:27.037 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-modules-core-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T03:56:27.037 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mgr-rook-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T03:56:27.037 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-mon-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.037 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-osd-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.037 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-prometheus-alerts-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T03:56:27.037 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-radosgw-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.037 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-selinux-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.037 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-test-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.037 INFO:teuthology.orchestra.run.smithi123.stdout: ceph-volume-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T03:56:27.037 INFO:teuthology.orchestra.run.smithi123.stdout: cephadm-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T03:56:27.037 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.038 INFO:teuthology.orchestra.run.smithi123.stdout: cephfs-top-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T03:56:27.038 INFO:teuthology.orchestra.run.smithi123.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-06-02T03:56:27.038 INFO:teuthology.orchestra.run.smithi123.stdout: flex-2.6.1-9.el8.x86_64 2024-06-02T03:56:27.038 INFO:teuthology.orchestra.run.smithi123.stdout: fuse-2.9.7-17.el8.x86_64 2024-06-02T03:56:27.038 INFO:teuthology.orchestra.run.smithi123.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-06-02T03:56:27.038 INFO:teuthology.orchestra.run.smithi123.stdout: jq-1.6-7.el8.x86_64 2024-06-02T03:56:27.038 INFO:teuthology.orchestra.run.smithi123.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-06-02T03:56:27.038 INFO:teuthology.orchestra.run.smithi123.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-06-02T03:56:27.038 INFO:teuthology.orchestra.run.smithi123.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-06-02T03:56:27.038 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs-devel-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.038 INFO:teuthology.orchestra.run.smithi123.stdout: libcephfs2-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.038 INFO:teuthology.orchestra.run.smithi123.stdout: libcephsqlite-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.039 INFO:teuthology.orchestra.run.smithi123.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-06-02T03:56:27.039 INFO:teuthology.orchestra.run.smithi123.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-06-02T03:56:27.039 INFO:teuthology.orchestra.run.smithi123.stdout: liboath-2.6.2-3.el8.x86_64 2024-06-02T03:56:27.039 INFO:teuthology.orchestra.run.smithi123.stdout: libpq-13.11-1.el8.x86_64 2024-06-02T03:56:27.039 INFO:teuthology.orchestra.run.smithi123.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-06-02T03:56:27.039 INFO:teuthology.orchestra.run.smithi123.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-06-02T03:56:27.039 INFO:teuthology.orchestra.run.smithi123.stdout: librados-devel-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.039 INFO:teuthology.orchestra.run.smithi123.stdout: libradosstriper1-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.039 INFO:teuthology.orchestra.run.smithi123.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-06-02T03:56:27.039 INFO:teuthology.orchestra.run.smithi123.stdout: librgw2-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.039 INFO:teuthology.orchestra.run.smithi123.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-06-02T03:56:27.039 INFO:teuthology.orchestra.run.smithi123.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-06-02T03:56:27.039 INFO:teuthology.orchestra.run.smithi123.stdout: libtool-2.4.6-25.el8.x86_64 2024-06-02T03:56:27.040 INFO:teuthology.orchestra.run.smithi123.stdout: libunwind-1.3.1-3.el8.x86_64 2024-06-02T03:56:27.040 INFO:teuthology.orchestra.run.smithi123.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-06-02T03:56:27.040 INFO:teuthology.orchestra.run.smithi123.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-06-02T03:56:27.040 INFO:teuthology.orchestra.run.smithi123.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-06-02T03:56:27.040 INFO:teuthology.orchestra.run.smithi123.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-06-02T03:56:27.040 INFO:teuthology.orchestra.run.smithi123.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-06-02T03:56:27.040 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-0.3.15-6.el8.x86_64 2024-06-02T03:56:27.040 INFO:teuthology.orchestra.run.smithi123.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-06-02T03:56:27.040 INFO:teuthology.orchestra.run.smithi123.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-06-02T03:56:27.040 INFO:teuthology.orchestra.run.smithi123.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-06-02T03:56:27.040 INFO:teuthology.orchestra.run.smithi123.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-06-02T03:56:27.040 INFO:teuthology.orchestra.run.smithi123.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-06-02T03:56:27.041 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-06-02T03:56:27.041 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-contrib-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-06-02T03:56:27.041 INFO:teuthology.orchestra.run.smithi123.stdout: postgresql-server-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-06-02T03:56:27.041 INFO:teuthology.orchestra.run.smithi123.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-06-02T03:56:27.041 INFO:teuthology.orchestra.run.smithi123.stdout: python3-babel-2.5.1-7.el8.noarch 2024-06-02T03:56:27.041 INFO:teuthology.orchestra.run.smithi123.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-06-02T03:56:27.041 INFO:teuthology.orchestra.run.smithi123.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-06-02T03:56:27.041 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-06-02T03:56:27.041 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-argparse-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.041 INFO:teuthology.orchestra.run.smithi123.stdout: python3-ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.041 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cephfs-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.041 INFO:teuthology.orchestra.run.smithi123.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-06-02T03:56:27.041 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-06-02T03:56:27.041 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-06-02T03:56:27.042 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-06-02T03:56:27.042 INFO:teuthology.orchestra.run.smithi123.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-06-02T03:56:27.042 INFO:teuthology.orchestra.run.smithi123.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-06-02T03:56:27.042 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-6.2-6.el8.noarch 2024-06-02T03:56:27.042 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-06-02T03:56:27.042 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-06-02T03:56:27.042 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-06-02T03:56:27.042 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-06-02T03:56:27.042 INFO:teuthology.orchestra.run.smithi123.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-06-02T03:56:27.042 INFO:teuthology.orchestra.run.smithi123.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-06-02T03:56:27.042 INFO:teuthology.orchestra.run.smithi123.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-06-02T03:56:27.042 INFO:teuthology.orchestra.run.smithi123.stdout: python3-mako-1.0.6-14.el8.noarch 2024-06-02T03:56:27.043 INFO:teuthology.orchestra.run.smithi123.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-06-02T03:56:27.043 INFO:teuthology.orchestra.run.smithi123.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-06-02T03:56:27.043 INFO:teuthology.orchestra.run.smithi123.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-06-02T03:56:27.043 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-06-02T03:56:27.043 INFO:teuthology.orchestra.run.smithi123.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-06-02T03:56:27.043 INFO:teuthology.orchestra.run.smithi123.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-06-02T03:56:27.043 INFO:teuthology.orchestra.run.smithi123.stdout: python3-packaging-16.8-9.el8.noarch 2024-06-02T03:56:27.043 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-06-02T03:56:27.043 INFO:teuthology.orchestra.run.smithi123.stdout: python3-portend-2.6-1.el8.noarch 2024-06-02T03:56:27.043 INFO:teuthology.orchestra.run.smithi123.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-06-02T03:56:27.043 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-06-02T03:56:27.044 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-06-02T03:56:27.044 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-06-02T03:56:27.044 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pycparser-2.14-14.el8.noarch 2024-06-02T03:56:27.044 INFO:teuthology.orchestra.run.smithi123.stdout: python3-pytz-2017.2-11.el8.noarch 2024-06-02T03:56:27.044 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rados-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.044 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rbd-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.044 INFO:teuthology.orchestra.run.smithi123.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-06-02T03:56:27.044 INFO:teuthology.orchestra.run.smithi123.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-06-02T03:56:27.044 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rgw-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.044 INFO:teuthology.orchestra.run.smithi123.stdout: python3-routes-2.4.1-12.el8.noarch 2024-06-02T03:56:27.044 INFO:teuthology.orchestra.run.smithi123.stdout: python3-rsa-4.9-2.el8.noarch 2024-06-02T03:56:27.044 INFO:teuthology.orchestra.run.smithi123.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-06-02T03:56:27.045 INFO:teuthology.orchestra.run.smithi123.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-06-02T03:56:27.045 INFO:teuthology.orchestra.run.smithi123.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-06-02T03:56:27.045 INFO:teuthology.orchestra.run.smithi123.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-06-02T03:56:27.045 INFO:teuthology.orchestra.run.smithi123.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-06-02T03:56:27.045 INFO:teuthology.orchestra.run.smithi123.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-06-02T03:56:27.045 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-06-02T03:56:27.045 INFO:teuthology.orchestra.run.smithi123.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-06-02T03:56:27.045 INFO:teuthology.orchestra.run.smithi123.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-06-02T03:56:27.045 INFO:teuthology.orchestra.run.smithi123.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-06-02T03:56:27.046 INFO:teuthology.orchestra.run.smithi123.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-06-02T03:56:27.046 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.046 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.046 INFO:teuthology.orchestra.run.smithi123.stdout: rbd-nbd-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.046 INFO:teuthology.orchestra.run.smithi123.stdout: socat-1.7.4.1-1.el8.x86_64 2024-06-02T03:56:27.046 INFO:teuthology.orchestra.run.smithi123.stdout: thrift-0.13.0-2.el8.x86_64 2024-06-02T03:56:27.046 INFO:teuthology.orchestra.run.smithi123.stdout: uuid-1.6.2-43.el8.x86_64 2024-06-02T03:56:27.046 INFO:teuthology.orchestra.run.smithi123.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-06-02T03:56:27.046 INFO:teuthology.orchestra.run.smithi123.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-06-02T03:56:27.047 INFO:teuthology.orchestra.run.smithi123.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-06-02T03:56:27.047 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T03:56:27.047 INFO:teuthology.orchestra.run.smithi123.stdout:Complete! 2024-06-02T03:56:27.249 DEBUG:teuthology.parallel:result is None 2024-06-02T03:56:27.531 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T03:56:27.531 INFO:teuthology.orchestra.run.smithi162.stdout:Upgraded: 2024-06-02T03:56:27.531 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-06-02T03:56:27.532 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-06-02T03:56:27.532 INFO:teuthology.orchestra.run.smithi162.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-06-02T03:56:27.532 INFO:teuthology.orchestra.run.smithi162.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-06-02T03:56:27.532 INFO:teuthology.orchestra.run.smithi162.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-06-02T03:56:27.532 INFO:teuthology.orchestra.run.smithi162.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-06-02T03:56:27.532 INFO:teuthology.orchestra.run.smithi162.stdout: librados2-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.532 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.532 INFO:teuthology.orchestra.run.smithi162.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-06-02T03:56:27.532 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-06-02T03:56:27.532 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-06-02T03:56:27.533 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-06-02T03:56:27.533 INFO:teuthology.orchestra.run.smithi162.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-06-02T03:56:27.533 INFO:teuthology.orchestra.run.smithi162.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-06-02T03:56:27.533 INFO:teuthology.orchestra.run.smithi162.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-06-02T03:56:27.533 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-06-02T03:56:27.533 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-06-02T03:56:27.533 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-initscripts-updown-1:1.40.16-15.el8_9.noarch 2024-06-02T03:56:27.533 INFO:teuthology.orchestra.run.smithi162.stdout: automake-1.16.1-8.el8.noarch 2024-06-02T03:56:27.533 INFO:teuthology.orchestra.run.smithi162.stdout: bison-3.0.4-10.el8.x86_64 2024-06-02T03:56:27.533 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.534 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.534 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.534 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.534 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T03:56:27.534 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.534 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.534 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.534 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T03:56:27.534 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T03:56:27.534 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T03:56:27.534 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T03:56:27.535 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T03:56:27.535 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.535 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.535 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T03:56:27.535 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.535 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.535 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.535 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T03:56:27.535 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T03:56:27.535 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.535 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-top-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T03:56:27.536 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-06-02T03:56:27.536 INFO:teuthology.orchestra.run.smithi162.stdout: flex-2.6.1-9.el8.x86_64 2024-06-02T03:56:27.536 INFO:teuthology.orchestra.run.smithi162.stdout: fuse-2.9.7-17.el8.x86_64 2024-06-02T03:56:27.536 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-06-02T03:56:27.536 INFO:teuthology.orchestra.run.smithi162.stdout: jq-1.6-7.el8.x86_64 2024-06-02T03:56:27.536 INFO:teuthology.orchestra.run.smithi162.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-06-02T03:56:27.536 INFO:teuthology.orchestra.run.smithi162.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-06-02T03:56:27.536 INFO:teuthology.orchestra.run.smithi162.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-06-02T03:56:27.536 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.536 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.536 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.537 INFO:teuthology.orchestra.run.smithi162.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-06-02T03:56:27.537 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-06-02T03:56:27.537 INFO:teuthology.orchestra.run.smithi162.stdout: liboath-2.6.2-3.el8.x86_64 2024-06-02T03:56:27.537 INFO:teuthology.orchestra.run.smithi162.stdout: libpq-13.11-1.el8.x86_64 2024-06-02T03:56:27.537 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-06-02T03:56:27.537 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-06-02T03:56:27.537 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.537 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.537 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-06-02T03:56:27.537 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.537 INFO:teuthology.orchestra.run.smithi162.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-06-02T03:56:27.538 INFO:teuthology.orchestra.run.smithi162.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-06-02T03:56:27.538 INFO:teuthology.orchestra.run.smithi162.stdout: libtool-2.4.6-25.el8.x86_64 2024-06-02T03:56:27.538 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind-1.3.1-3.el8.x86_64 2024-06-02T03:56:27.538 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-06-02T03:56:27.538 INFO:teuthology.orchestra.run.smithi162.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-06-02T03:56:27.538 INFO:teuthology.orchestra.run.smithi162.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-06-02T03:56:27.538 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-06-02T03:56:27.538 INFO:teuthology.orchestra.run.smithi162.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-06-02T03:56:27.538 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-0.3.15-6.el8.x86_64 2024-06-02T03:56:27.538 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-06-02T03:56:27.538 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-06-02T03:56:27.539 INFO:teuthology.orchestra.run.smithi162.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-06-02T03:56:27.539 INFO:teuthology.orchestra.run.smithi162.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-06-02T03:56:27.539 INFO:teuthology.orchestra.run.smithi162.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-06-02T03:56:27.539 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-06-02T03:56:27.539 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-contrib-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-06-02T03:56:27.539 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-server-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-06-02T03:56:27.539 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-06-02T03:56:27.539 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel-2.5.1-7.el8.noarch 2024-06-02T03:56:27.539 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-06-02T03:56:27.539 INFO:teuthology.orchestra.run.smithi162.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-06-02T03:56:27.539 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-06-02T03:56:27.540 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.540 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.540 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.540 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-06-02T03:56:27.540 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-06-02T03:56:27.540 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-06-02T03:56:27.540 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-06-02T03:56:27.540 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-06-02T03:56:27.540 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-06-02T03:56:27.540 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-6.2-6.el8.noarch 2024-06-02T03:56:27.541 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-06-02T03:56:27.541 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-06-02T03:56:27.541 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-06-02T03:56:27.541 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-06-02T03:56:27.541 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-06-02T03:56:27.541 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-06-02T03:56:27.542 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-06-02T03:56:27.542 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako-1.0.6-14.el8.noarch 2024-06-02T03:56:27.542 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-06-02T03:56:27.542 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-06-02T03:56:27.542 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-06-02T03:56:27.542 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-06-02T03:56:27.542 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-06-02T03:56:27.542 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-06-02T03:56:27.542 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging-16.8-9.el8.noarch 2024-06-02T03:56:27.542 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-06-02T03:56:27.542 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend-2.6-1.el8.noarch 2024-06-02T03:56:27.542 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-06-02T03:56:27.543 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-06-02T03:56:27.543 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-06-02T03:56:27.543 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-06-02T03:56:27.543 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser-2.14-14.el8.noarch 2024-06-02T03:56:27.543 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz-2017.2-11.el8.noarch 2024-06-02T03:56:27.543 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.543 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.543 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-06-02T03:56:27.543 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-06-02T03:56:27.543 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.543 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes-2.4.1-12.el8.noarch 2024-06-02T03:56:27.543 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa-4.9-2.el8.noarch 2024-06-02T03:56:27.543 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-06-02T03:56:27.544 INFO:teuthology.orchestra.run.smithi162.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-06-02T03:56:27.544 INFO:teuthology.orchestra.run.smithi162.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-06-02T03:56:27.544 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-06-02T03:56:27.544 INFO:teuthology.orchestra.run.smithi162.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-06-02T03:56:27.544 INFO:teuthology.orchestra.run.smithi162.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-06-02T03:56:27.544 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-06-02T03:56:27.544 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-06-02T03:56:27.544 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-06-02T03:56:27.544 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-06-02T03:56:27.544 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-06-02T03:56:27.544 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.544 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.544 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:27.545 INFO:teuthology.orchestra.run.smithi162.stdout: socat-1.7.4.1-1.el8.x86_64 2024-06-02T03:56:27.545 INFO:teuthology.orchestra.run.smithi162.stdout: thrift-0.13.0-2.el8.x86_64 2024-06-02T03:56:27.545 INFO:teuthology.orchestra.run.smithi162.stdout: uuid-1.6.2-43.el8.x86_64 2024-06-02T03:56:27.545 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-06-02T03:56:27.545 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-06-02T03:56:27.545 INFO:teuthology.orchestra.run.smithi162.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-06-02T03:56:27.545 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T03:56:27.545 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-06-02T03:56:27.765 DEBUG:teuthology.parallel:result is None 2024-06-02T03:56:32.992 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 162/162 2024-06-02T03:56:32.992 INFO:teuthology.orchestra.run.smithi136.stdout:Installed products updated. 2024-06-02T03:56:33.684 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-06-02T03:56:33.684 INFO:teuthology.orchestra.run.smithi136.stdout:Upgraded: 2024-06-02T03:56:33.684 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-06-02T03:56:33.684 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-06-02T03:56:33.685 INFO:teuthology.orchestra.run.smithi136.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-06-02T03:56:33.685 INFO:teuthology.orchestra.run.smithi136.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-06-02T03:56:33.685 INFO:teuthology.orchestra.run.smithi136.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-06-02T03:56:33.685 INFO:teuthology.orchestra.run.smithi136.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-06-02T03:56:33.685 INFO:teuthology.orchestra.run.smithi136.stdout: librados2-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:33.685 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:33.685 INFO:teuthology.orchestra.run.smithi136.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-06-02T03:56:33.685 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-06-02T03:56:33.685 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-06-02T03:56:33.685 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-06-02T03:56:33.685 INFO:teuthology.orchestra.run.smithi136.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-06-02T03:56:33.686 INFO:teuthology.orchestra.run.smithi136.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-06-02T03:56:33.686 INFO:teuthology.orchestra.run.smithi136.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-06-02T03:56:33.686 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-06-02T03:56:33.686 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-06-02T03:56:33.686 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-initscripts-updown-1:1.40.16-15.el8_9.noarch 2024-06-02T03:56:33.686 INFO:teuthology.orchestra.run.smithi136.stdout: automake-1.16.1-8.el8.noarch 2024-06-02T03:56:33.686 INFO:teuthology.orchestra.run.smithi136.stdout: bison-3.0.4-10.el8.x86_64 2024-06-02T03:56:33.686 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:33.686 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:33.686 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:33.687 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:33.687 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-grafana-dashboards-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T03:56:33.687 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:33.687 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:33.687 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:33.687 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-cephadm-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T03:56:33.687 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T03:56:33.687 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T03:56:33.688 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T03:56:33.688 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-rook-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T03:56:33.688 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:33.688 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:33.688 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-prometheus-alerts-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T03:56:33.688 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:33.688 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-selinux-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:33.688 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:33.688 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-volume-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T03:56:33.688 INFO:teuthology.orchestra.run.smithi136.stdout: cephadm-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T03:56:33.688 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:33.688 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-top-2:18.2.2-1381.g3bb45379.el8.noarch 2024-06-02T03:56:33.689 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-06-02T03:56:33.689 INFO:teuthology.orchestra.run.smithi136.stdout: flex-2.6.1-9.el8.x86_64 2024-06-02T03:56:33.689 INFO:teuthology.orchestra.run.smithi136.stdout: fuse-2.9.7-17.el8.x86_64 2024-06-02T03:56:33.689 INFO:teuthology.orchestra.run.smithi136.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-06-02T03:56:33.689 INFO:teuthology.orchestra.run.smithi136.stdout: jq-1.6-7.el8.x86_64 2024-06-02T03:56:33.689 INFO:teuthology.orchestra.run.smithi136.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-06-02T03:56:33.689 INFO:teuthology.orchestra.run.smithi136.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-06-02T03:56:33.689 INFO:teuthology.orchestra.run.smithi136.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-06-02T03:56:33.689 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-devel-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:33.689 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:33.689 INFO:teuthology.orchestra.run.smithi136.stdout: libcephsqlite-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:33.689 INFO:teuthology.orchestra.run.smithi136.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-06-02T03:56:33.689 INFO:teuthology.orchestra.run.smithi136.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-06-02T03:56:33.690 INFO:teuthology.orchestra.run.smithi136.stdout: liboath-2.6.2-3.el8.x86_64 2024-06-02T03:56:33.690 INFO:teuthology.orchestra.run.smithi136.stdout: libpq-13.11-1.el8.x86_64 2024-06-02T03:56:33.690 INFO:teuthology.orchestra.run.smithi136.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-06-02T03:56:33.690 INFO:teuthology.orchestra.run.smithi136.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-06-02T03:56:33.690 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:33.690 INFO:teuthology.orchestra.run.smithi136.stdout: libradosstriper1-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:33.690 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-06-02T03:56:33.690 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:33.691 INFO:teuthology.orchestra.run.smithi136.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-06-02T03:56:33.691 INFO:teuthology.orchestra.run.smithi136.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-06-02T03:56:33.691 INFO:teuthology.orchestra.run.smithi136.stdout: libtool-2.4.6-25.el8.x86_64 2024-06-02T03:56:33.691 INFO:teuthology.orchestra.run.smithi136.stdout: libunwind-1.3.1-3.el8.x86_64 2024-06-02T03:56:33.691 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-06-02T03:56:33.691 INFO:teuthology.orchestra.run.smithi136.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-06-02T03:56:33.691 INFO:teuthology.orchestra.run.smithi136.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-06-02T03:56:33.691 INFO:teuthology.orchestra.run.smithi136.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-06-02T03:56:33.691 INFO:teuthology.orchestra.run.smithi136.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-06-02T03:56:33.691 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-0.3.15-6.el8.x86_64 2024-06-02T03:56:33.691 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-06-02T03:56:33.691 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-06-02T03:56:33.692 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-06-02T03:56:33.692 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-06-02T03:56:33.692 INFO:teuthology.orchestra.run.smithi136.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-06-02T03:56:33.692 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-06-02T03:56:33.692 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-contrib-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-06-02T03:56:33.692 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-server-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-06-02T03:56:33.692 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-06-02T03:56:33.692 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel-2.5.1-7.el8.noarch 2024-06-02T03:56:33.692 INFO:teuthology.orchestra.run.smithi136.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-06-02T03:56:33.692 INFO:teuthology.orchestra.run.smithi136.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-06-02T03:56:33.692 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-06-02T03:56:33.693 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:33.693 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:33.693 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:33.693 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-06-02T03:56:33.693 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-06-02T03:56:33.693 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-06-02T03:56:33.693 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-06-02T03:56:33.693 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-06-02T03:56:33.693 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-06-02T03:56:33.693 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-6.2-6.el8.noarch 2024-06-02T03:56:33.693 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-06-02T03:56:33.693 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-06-02T03:56:33.693 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-06-02T03:56:33.694 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-06-02T03:56:33.694 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-06-02T03:56:33.694 INFO:teuthology.orchestra.run.smithi136.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-06-02T03:56:33.694 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-06-02T03:56:33.694 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako-1.0.6-14.el8.noarch 2024-06-02T03:56:33.694 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-06-02T03:56:33.694 INFO:teuthology.orchestra.run.smithi136.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-06-02T03:56:33.694 INFO:teuthology.orchestra.run.smithi136.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-06-02T03:56:33.695 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-06-02T03:56:33.695 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-06-02T03:56:33.695 INFO:teuthology.orchestra.run.smithi136.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-06-02T03:56:33.695 INFO:teuthology.orchestra.run.smithi136.stdout: python3-packaging-16.8-9.el8.noarch 2024-06-02T03:56:33.695 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-06-02T03:56:33.695 INFO:teuthology.orchestra.run.smithi136.stdout: python3-portend-2.6-1.el8.noarch 2024-06-02T03:56:33.695 INFO:teuthology.orchestra.run.smithi136.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-06-02T03:56:33.695 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-06-02T03:56:33.695 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-06-02T03:56:33.695 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-06-02T03:56:33.695 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pycparser-2.14-14.el8.noarch 2024-06-02T03:56:33.696 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytz-2017.2-11.el8.noarch 2024-06-02T03:56:33.696 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:33.696 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:33.696 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-06-02T03:56:33.696 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-06-02T03:56:33.696 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:33.696 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes-2.4.1-12.el8.noarch 2024-06-02T03:56:33.696 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa-4.9-2.el8.noarch 2024-06-02T03:56:33.697 INFO:teuthology.orchestra.run.smithi136.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-06-02T03:56:33.697 INFO:teuthology.orchestra.run.smithi136.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-06-02T03:56:33.697 INFO:teuthology.orchestra.run.smithi136.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-06-02T03:56:33.697 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-06-02T03:56:33.697 INFO:teuthology.orchestra.run.smithi136.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-06-02T03:56:33.697 INFO:teuthology.orchestra.run.smithi136.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-06-02T03:56:33.698 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-06-02T03:56:33.698 INFO:teuthology.orchestra.run.smithi136.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-06-02T03:56:33.698 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-06-02T03:56:33.698 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-06-02T03:56:33.698 INFO:teuthology.orchestra.run.smithi136.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-06-02T03:56:33.698 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:33.699 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:33.699 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd-2:18.2.2-1381.g3bb45379.el8.x86_64 2024-06-02T03:56:33.699 INFO:teuthology.orchestra.run.smithi136.stdout: socat-1.7.4.1-1.el8.x86_64 2024-06-02T03:56:33.699 INFO:teuthology.orchestra.run.smithi136.stdout: thrift-0.13.0-2.el8.x86_64 2024-06-02T03:56:33.699 INFO:teuthology.orchestra.run.smithi136.stdout: uuid-1.6.2-43.el8.x86_64 2024-06-02T03:56:33.699 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-06-02T03:56:33.700 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-06-02T03:56:33.700 INFO:teuthology.orchestra.run.smithi136.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-06-02T03:56:33.701 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-06-02T03:56:33.701 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-06-02T03:56:33.946 DEBUG:teuthology.parallel:result is None 2024-06-02T03:56:33.947 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3bb45379356e8aa965152e0b8c663715c5df9bda 2024-06-02T03:56:34.099 DEBUG:teuthology.orchestra.run.smithi123:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-02T03:56:34.128 INFO:teuthology.orchestra.run.smithi123.stdout:18.2.2-1381.g3bb45379.el8 2024-06-02T03:56:34.128 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1381.g3bb45379.el8 2024-06-02T03:56:34.128 INFO:teuthology.task.install:The correct ceph version 18.2.2-1381.g3bb45379 is installed. 2024-06-02T03:56:34.130 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3bb45379356e8aa965152e0b8c663715c5df9bda 2024-06-02T03:56:34.274 DEBUG:teuthology.orchestra.run.smithi136:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-02T03:56:34.300 INFO:teuthology.orchestra.run.smithi136.stdout:18.2.2-1381.g3bb45379.el8 2024-06-02T03:56:34.300 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1381.g3bb45379.el8 2024-06-02T03:56:34.301 INFO:teuthology.task.install:The correct ceph version 18.2.2-1381.g3bb45379 is installed. 2024-06-02T03:56:34.302 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3bb45379356e8aa965152e0b8c663715c5df9bda 2024-06-02T03:56:34.452 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-06-02T03:56:34.483 INFO:teuthology.orchestra.run.smithi162.stdout:18.2.2-1381.g3bb45379.el8 2024-06-02T03:56:34.483 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1381.g3bb45379.el8 2024-06-02T03:56:34.484 INFO:teuthology.task.install:The correct ceph version 18.2.2-1381.g3bb45379 is installed. 2024-06-02T03:56:34.487 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-06-02T03:56:34.487 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-06-02T03:56:34.488 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-02T03:56:34.540 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-06-02T03:56:34.541 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-02T03:56:34.586 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T03:56:34.587 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-06-02T03:56:34.637 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-06-02T03:56:34.637 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-06-02T03:56:34.637 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/daemon-helper 2024-06-02T03:56:34.672 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-02T03:56:34.746 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-06-02T03:56:34.746 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/daemon-helper 2024-06-02T03:56:34.774 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-02T03:56:34.841 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T03:56:34.841 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/daemon-helper 2024-06-02T03:56:34.875 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-06-02T03:56:34.946 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-06-02T03:56:34.946 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-06-02T03:56:34.946 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-02T03:56:34.979 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-02T03:56:35.051 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-06-02T03:56:35.051 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-02T03:56:35.079 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-02T03:56:35.147 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T03:56:35.147 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/adjust-ulimits 2024-06-02T03:56:35.178 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-06-02T03:56:35.248 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-06-02T03:56:35.249 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-06-02T03:56:35.249 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/usr/bin/stdin-killer 2024-06-02T03:56:35.281 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-02T03:56:35.355 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-06-02T03:56:35.355 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/stdin-killer 2024-06-02T03:56:35.383 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-02T03:56:35.450 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T03:56:35.450 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/stdin-killer 2024-06-02T03:56:35.479 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-06-02T03:56:35.548 INFO:teuthology.run_tasks:Running task cephadm... 2024-06-02T03:56:35.640 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '3bb45379356e8aa965152e0b8c663715c5df9bda', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-06-02T03:56:35.640 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda 2024-06-02T03:56:35.641 INFO:tasks.cephadm:Cluster fsid is 1b432ae0-2094-11ef-bc9b-c7b262605968 2024-06-02T03:56:35.641 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-06-02T03:56:35.641 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.123', 'mon.b': '172.21.15.136', 'mon.c': '172.21.15.162'} 2024-06-02T03:56:35.641 INFO:tasks.cephadm:First mon is mon.a on smithi123 2024-06-02T03:56:35.641 INFO:tasks.cephadm:First mgr is x 2024-06-02T03:56:35.641 INFO:tasks.cephadm:Normalizing hostnames... 2024-06-02T03:56:35.641 DEBUG:teuthology.orchestra.run.smithi123:> sudo hostname $(hostname -s) 2024-06-02T03:56:35.675 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname $(hostname -s) 2024-06-02T03:56:35.704 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname $(hostname -s) 2024-06-02T03:56:35.734 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-06-02T03:56:35.734 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3bb45379356e8aa965152e0b8c663715c5df9bda 2024-06-02T03:56:35.874 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '3bb45379356e8aa965152e0b8c663715c5df9bda', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/55262/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.2.2-1381-g3bb45379', 'node_name': '172.21.2.6+braggi06', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.2.2-1381.g3bb45379'}, 'url': 'https://3.chacra.ceph.com/r/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2024-05-28 23:53:14.366628', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'reef', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-06-02T03:56:36.089 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref reef, sha1 3bb45379356e8aa965152e0b8c663715c5df9bda from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=3bb45379356e8aa965152e0b8c663715c5df9bda 2024-06-02T03:56:36.090 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/x86_64/flavors/default/cephadm 2024-06-02T03:56:36.091 DEBUG:teuthology.orchestra.run.smithi123:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-06-02T03:56:37.064 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-rw-r--. 1 ubuntu ubuntu 703022 Jun 2 03:56 /home/ubuntu/cephtest/cephadm 2024-06-02T03:56:37.064 DEBUG:teuthology.orchestra.run.smithi136:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-06-02T03:56:37.579 INFO:teuthology.orchestra.run.smithi136.stdout:-rw-rw-r--. 1 ubuntu ubuntu 703022 Jun 2 03:56 /home/ubuntu/cephtest/cephadm 2024-06-02T03:56:37.579 DEBUG:teuthology.orchestra.run.smithi162:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/reef/3bb45379356e8aa965152e0b8c663715c5df9bda/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-06-02T03:56:38.501 INFO:teuthology.orchestra.run.smithi162.stdout:-rw-rw-r--. 1 ubuntu ubuntu 703022 Jun 2 03:56 /home/ubuntu/cephtest/cephadm 2024-06-02T03:56:38.501 DEBUG:teuthology.orchestra.run.smithi123:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-06-02T03:56:38.524 DEBUG:teuthology.orchestra.run.smithi136:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-06-02T03:56:38.545 DEBUG:teuthology.orchestra.run.smithi162:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-06-02T03:56:38.582 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda on all hosts... 2024-06-02T03:56:38.582 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda pull 2024-06-02T03:56:38.585 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda pull 2024-06-02T03:56:38.588 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda pull 2024-06-02T03:56:39.577 INFO:teuthology.orchestra.run.smithi162.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda... 2024-06-02T03:56:39.604 INFO:teuthology.orchestra.run.smithi123.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda... 2024-06-02T03:56:40.832 INFO:teuthology.orchestra.run.smithi136.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda... 2024-06-02T03:57:08.688 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-06-02T03:57:08.688 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_version": "ceph version 18.2.2-1381-g3bb45379 (3bb45379356e8aa965152e0b8c663715c5df9bda) reef (stable)", 2024-06-02T03:57:08.689 INFO:teuthology.orchestra.run.smithi136.stdout: "image_id": "a7978103fbbed79c34d6bc7b19af74a59666b4fc905021cc8492bb6508b4172d", 2024-06-02T03:57:08.689 INFO:teuthology.orchestra.run.smithi136.stdout: "repo_digests": [ 2024-06-02T03:57:08.689 INFO:teuthology.orchestra.run.smithi136.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2fdde4b0b6d21699621ed825b2b34390739be611a75e53f0ca47d911ac0106eb" 2024-06-02T03:57:08.689 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-06-02T03:57:08.689 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-06-02T03:57:10.092 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-06-02T03:57:10.092 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_version": "ceph version 18.2.2-1381-g3bb45379 (3bb45379356e8aa965152e0b8c663715c5df9bda) reef (stable)", 2024-06-02T03:57:10.092 INFO:teuthology.orchestra.run.smithi123.stdout: "image_id": "a7978103fbbed79c34d6bc7b19af74a59666b4fc905021cc8492bb6508b4172d", 2024-06-02T03:57:10.092 INFO:teuthology.orchestra.run.smithi123.stdout: "repo_digests": [ 2024-06-02T03:57:10.092 INFO:teuthology.orchestra.run.smithi123.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2fdde4b0b6d21699621ed825b2b34390739be611a75e53f0ca47d911ac0106eb" 2024-06-02T03:57:10.093 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-06-02T03:57:10.093 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-06-02T03:57:10.777 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-06-02T03:57:10.777 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_version": "ceph version 18.2.2-1381-g3bb45379 (3bb45379356e8aa965152e0b8c663715c5df9bda) reef (stable)", 2024-06-02T03:57:10.778 INFO:teuthology.orchestra.run.smithi162.stdout: "image_id": "a7978103fbbed79c34d6bc7b19af74a59666b4fc905021cc8492bb6508b4172d", 2024-06-02T03:57:10.778 INFO:teuthology.orchestra.run.smithi162.stdout: "repo_digests": [ 2024-06-02T03:57:10.778 INFO:teuthology.orchestra.run.smithi162.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:2fdde4b0b6d21699621ed825b2b34390739be611a75e53f0ca47d911ac0106eb" 2024-06-02T03:57:10.778 INFO:teuthology.orchestra.run.smithi162.stdout: ] 2024-06-02T03:57:10.778 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-06-02T03:57:10.797 DEBUG:teuthology.orchestra.run.smithi123:> sudo mkdir -p /etc/ceph 2024-06-02T03:57:10.835 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /etc/ceph 2024-06-02T03:57:10.872 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /etc/ceph 2024-06-02T03:57:10.901 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 777 /etc/ceph 2024-06-02T03:57:10.934 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 777 /etc/ceph 2024-06-02T03:57:10.965 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 777 /etc/ceph 2024-06-02T03:57:10.992 INFO:tasks.cephadm:Writing seed config... 2024-06-02T03:57:10.993 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-06-02T03:57:10.994 INFO:tasks.cephadm: override: [client] debug client = 20 2024-06-02T03:57:10.994 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-06-02T03:57:10.994 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-06-02T03:57:10.994 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-06-02T03:57:10.994 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-06-02T03:57:10.994 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-06-02T03:57:10.994 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-06-02T03:57:10.994 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-06-02T03:57:10.994 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-06-02T03:57:10.994 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-06-02T03:57:10.994 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-06-02T03:57:10.995 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-06-02T03:57:10.995 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-06-02T03:57:10.995 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-06-02T03:57:10.995 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-06-02T03:57:10.995 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-06-02T03:57:10.995 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-06-02T03:57:10.995 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-06-02T03:57:10.995 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-06-02T03:57:10.995 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-06-02T03:57:10.995 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-06-02T03:57:10.996 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-06-02T03:57:10.996 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-06-02T03:57:10.996 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-06-02T03:57:10.996 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-06-02T03:57:10.996 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-06-02T03:57:10.996 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-06-02T03:57:10.996 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-06-02T03:57:10.996 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-06-02T03:57:10.996 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-06-02T03:57:10.997 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-06-02T03:57:10.997 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-06-02T03:57:10.997 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-06-02T03:57:10.997 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-06-02T03:57:10.997 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-06-02T03:57:10.997 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-06-02T03:57:10.997 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-06-02T03:57:10.997 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-06-02T03:57:10.997 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-06-02T03:57:10.997 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-06-02T03:57:10.997 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-06-02T03:57:10.997 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-06-02T03:57:10.998 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-06-02T03:57:10.998 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-06-02T03:57:10.998 DEBUG:teuthology.orchestra.run.smithi123:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-06-02T03:57:11.019 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 1b432ae0-2094-11ef-bc9b-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-06-02T03:57:11.019 DEBUG:teuthology.orchestra.run.smithi123:mon.a> sudo journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mon.a.service 2024-06-02T03:57:11.062 DEBUG:teuthology.orchestra.run.smithi123:mgr.x> sudo journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mgr.x.service 2024-06-02T03:57:11.094 INFO:journalctl@ceph.mon.a.smithi123.stdout:-- Logs begin at Sun 2024-06-02 03:41:15 UTC. -- 2024-06-02T03:57:11.096 INFO:tasks.cephadm:Bootstrapping... 2024-06-02T03:57:11.096 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda -v bootstrap --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.123 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-06-02T03:57:11.127 INFO:journalctl@ceph.mgr.x.smithi123.stdout:-- Logs begin at Sun 2024-06-02 03:41:15 UTC. -- 2024-06-02T03:57:11.285 INFO:teuthology.orchestra.run.smithi123.stdout:-------------------------------------------------------------------------------- 2024-06-02T03:57:11.285 INFO:teuthology.orchestra.run.smithi123.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda', '-v', 'bootstrap', '--fsid', '1b432ae0-2094-11ef-bc9b-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.123', '--skip-admin-label'] 2024-06-02T03:57:11.321 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stdout 4.6.1 2024-06-02T03:57:11.321 INFO:teuthology.orchestra.run.smithi123.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-06-02T03:57:11.322 INFO:teuthology.orchestra.run.smithi123.stdout:Verifying podman|docker is present... 2024-06-02T03:57:11.357 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stdout 4.6.1 2024-06-02T03:57:11.357 INFO:teuthology.orchestra.run.smithi123.stdout:Verifying lvm2 is present... 2024-06-02T03:57:11.357 INFO:teuthology.orchestra.run.smithi123.stdout:Verifying time synchronization is in place... 2024-06-02T03:57:11.365 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-06-02T03:57:11.365 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-06-02T03:57:11.370 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-06-02T03:57:11.370 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout inactive 2024-06-02T03:57:11.376 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout enabled 2024-06-02T03:57:11.382 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout active 2024-06-02T03:57:11.382 INFO:teuthology.orchestra.run.smithi123.stdout:Unit chronyd.service is enabled and running 2024-06-02T03:57:11.382 INFO:teuthology.orchestra.run.smithi123.stdout:Repeating the final host check... 2024-06-02T03:57:11.423 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stdout 4.6.1 2024-06-02T03:57:11.424 INFO:teuthology.orchestra.run.smithi123.stdout:podman (/bin/podman) version 4.6.1 is present 2024-06-02T03:57:11.424 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl is present 2024-06-02T03:57:11.424 INFO:teuthology.orchestra.run.smithi123.stdout:lvcreate is present 2024-06-02T03:57:11.429 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-06-02T03:57:11.430 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-06-02T03:57:11.435 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-06-02T03:57:11.435 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout inactive 2024-06-02T03:57:11.441 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout enabled 2024-06-02T03:57:11.447 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout active 2024-06-02T03:57:11.447 INFO:teuthology.orchestra.run.smithi123.stdout:Unit chronyd.service is enabled and running 2024-06-02T03:57:11.447 INFO:teuthology.orchestra.run.smithi123.stdout:Host looks OK 2024-06-02T03:57:11.447 INFO:teuthology.orchestra.run.smithi123.stdout:Cluster fsid: 1b432ae0-2094-11ef-bc9b-c7b262605968 2024-06-02T03:57:11.448 INFO:teuthology.orchestra.run.smithi123.stdout:Acquiring lock 140351613643240 on /run/cephadm/1b432ae0-2094-11ef-bc9b-c7b262605968.lock 2024-06-02T03:57:11.448 INFO:teuthology.orchestra.run.smithi123.stdout:Lock 140351613643240 acquired on /run/cephadm/1b432ae0-2094-11ef-bc9b-c7b262605968.lock 2024-06-02T03:57:11.448 INFO:teuthology.orchestra.run.smithi123.stdout:Verifying IP 172.21.15.123 port 3300 ... 2024-06-02T03:57:11.448 INFO:teuthology.orchestra.run.smithi123.stdout:Verifying IP 172.21.15.123 port 6789 ... 2024-06-02T03:57:11.448 INFO:teuthology.orchestra.run.smithi123.stdout:Base mon IP(s) is [172.21.15.123:3300, 172.21.15.123:6789], mon addrv is [v2:172.21.15.123:3300,v1:172.21.15.123:6789] 2024-06-02T03:57:11.452 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp metric 100 2024-06-02T03:57:11.452 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.123 metric 100 2024-06-02T03:57:11.454 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-06-02T03:57:11.454 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-06-02T03:57:11.455 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-06-02T03:57:11.457 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-06-02T03:57:11.457 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-06-02T03:57:11.457 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-06-02T03:57:11.457 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-06-02T03:57:11.457 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout inet6 fe80::e0af:e078:ac35:4506/64 scope link noprefixroute 2024-06-02T03:57:11.458 INFO:teuthology.orchestra.run.smithi123.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-06-02T03:57:11.458 INFO:teuthology.orchestra.run.smithi123.stdout:Mon IP `172.21.15.123` is in CIDR network `172.21.0.0/20` 2024-06-02T03:57:11.458 INFO:teuthology.orchestra.run.smithi123.stdout:Mon IP `172.21.15.123` is in CIDR network `172.21.0.0/20` 2024-06-02T03:57:11.458 INFO:teuthology.orchestra.run.smithi123.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-06-02T03:57:11.459 INFO:teuthology.orchestra.run.smithi123.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-06-02T03:57:11.459 INFO:teuthology.orchestra.run.smithi123.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda... 2024-06-02T03:57:11.875 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stdout a7978103fbbed79c34d6bc7b19af74a59666b4fc905021cc8492bb6508b4172d 2024-06-02T03:57:11.875 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda... 2024-06-02T03:57:11.875 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stderr Getting image source signatures 2024-06-02T03:57:11.875 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stderr Copying blob sha256:e5de8de6d8f2d7ca5eeb313a98107a8ae774a9039c20e00677c2d4f3b8375b37 2024-06-02T03:57:11.875 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stderr Copying blob sha256:3ca969c7b6d79946c6f10490fffc00028babe7df67f50ed53c7bc209325e0612 2024-06-02T03:57:11.875 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stderr Copying config sha256:a7978103fbbed79c34d6bc7b19af74a59666b4fc905021cc8492bb6508b4172d 2024-06-02T03:57:11.875 INFO:teuthology.orchestra.run.smithi123.stdout:/bin/podman: stderr Writing manifest to image destination 2024-06-02T03:57:12.528 INFO:teuthology.orchestra.run.smithi123.stdout:ceph: stdout ceph version 18.2.2-1381-g3bb45379 (3bb45379356e8aa965152e0b8c663715c5df9bda) reef (stable) 2024-06-02T03:57:12.529 INFO:teuthology.orchestra.run.smithi123.stdout:Ceph version: ceph version 18.2.2-1381-g3bb45379 (3bb45379356e8aa965152e0b8c663715c5df9bda) reef (stable) 2024-06-02T03:57:12.529 INFO:teuthology.orchestra.run.smithi123.stdout:Extracting ceph user uid/gid from container image... 2024-06-02T03:57:13.147 INFO:teuthology.orchestra.run.smithi123.stdout:stat: stdout 167 167 2024-06-02T03:57:13.148 INFO:teuthology.orchestra.run.smithi123.stdout:Creating initial keys... 2024-06-02T03:57:13.723 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph-authtool: stdout AQCZ7VtmS7HRFhAANtGxWZfjN3u5V+15hRJKxQ== 2024-06-02T03:57:14.334 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph-authtool: stdout AQCZ7VtmppeVOBAA91tab9O2onYJ2oOU7glyCg== 2024-06-02T03:57:14.919 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph-authtool: stdout AQCa7VtmgFk0IhAAR4I1r8A1fknakyg9QcjJig== 2024-06-02T03:57:14.920 INFO:teuthology.orchestra.run.smithi123.stdout:Creating initial monmap... 2024-06-02T03:57:15.558 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-06-02T03:57:15.558 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-06-02T03:57:15.558 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 1b432ae0-2094-11ef-bc9b-c7b262605968 2024-06-02T03:57:15.558 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-06-02T03:57:15.558 INFO:teuthology.orchestra.run.smithi123.stdout:monmaptool for a [v2:172.21.15.123:3300,v1:172.21.15.123:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-06-02T03:57:15.558 INFO:teuthology.orchestra.run.smithi123.stdout:setting min_mon_release = pacific 2024-06-02T03:57:15.558 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/monmaptool: set fsid to 1b432ae0-2094-11ef-bc9b-c7b262605968 2024-06-02T03:57:15.559 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-06-02T03:57:15.559 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T03:57:15.559 INFO:teuthology.orchestra.run.smithi123.stdout:Creating mon... 2024-06-02T03:57:16.139 INFO:teuthology.orchestra.run.smithi123.stdout:create mon.a on 2024-06-02T03:57:16.512 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-06-02T03:57:16.603 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-06-02T03:57:16.737 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-1b432ae0-2094-11ef-bc9b-c7b262605968.target → /etc/systemd/system/ceph-1b432ae0-2094-11ef-bc9b-c7b262605968.target. 2024-06-02T03:57:16.738 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-1b432ae0-2094-11ef-bc9b-c7b262605968.target → /etc/systemd/system/ceph-1b432ae0-2094-11ef-bc9b-c7b262605968.target. 2024-06-02T03:57:16.911 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mon.a 2024-06-02T03:57:16.911 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Failed to reset failed state of unit ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mon.a.service: Unit ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mon.a.service not loaded. 2024-06-02T03:57:17.000 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-1b432ae0-2094-11ef-bc9b-c7b262605968.target.wants/ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mon.a.service → /etc/systemd/system/ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@.service. 2024-06-02T03:57:17.359 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-02T03:57:17.359 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout disabled 2024-06-02T03:57:17.366 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-02T03:57:17.366 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout inactive 2024-06-02T03:57:17.366 INFO:teuthology.orchestra.run.smithi123.stdout:firewalld.service is not enabled 2024-06-02T03:57:17.366 INFO:teuthology.orchestra.run.smithi123.stdout:Not possible to enable service . firewalld.service is not available 2024-06-02T03:57:17.367 INFO:teuthology.orchestra.run.smithi123.stdout:Waiting for mon to start... 2024-06-02T03:57:17.367 INFO:teuthology.orchestra.run.smithi123.stdout:Waiting for mon... 2024-06-02T03:57:17.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:17 smithi123 ceph-mon[42401]: mon.a is new leader, mons a in quorum (ranks 0) 2024-06-02T03:57:18.235 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout cluster: 2024-06-02T03:57:18.235 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout id: 1b432ae0-2094-11ef-bc9b-c7b262605968 2024-06-02T03:57:18.235 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-06-02T03:57:18.236 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-06-02T03:57:18.236 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout services: 2024-06-02T03:57:18.236 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.483597s) 2024-06-02T03:57:18.236 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-06-02T03:57:18.236 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-06-02T03:57:18.236 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-06-02T03:57:18.236 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout data: 2024-06-02T03:57:18.236 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-06-02T03:57:18.236 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-06-02T03:57:18.236 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-06-02T03:57:18.236 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout pgs: 2024-06-02T03:57:18.236 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-06-02T03:57:18.236 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.789+0000 7f6f071d2700 1 Processor -- start 2024-06-02T03:57:18.237 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.789+0000 7f6f071d2700 1 -- start start 2024-06-02T03:57:18.237 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.789+0000 7f6f071d2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f00107200 0x7f6f001095f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:18.237 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.789+0000 7f6f071d2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f00079dd0 con 0x7f6f00107200 2024-06-02T03:57:18.237 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.789+0000 7f6f04f6e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f00107200 0x7f6f001095f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:18.237 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.790+0000 7f6f04f6e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f00107200 0x7f6f001095f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56612/0 (socket says 172.21.15.123:56612) 2024-06-02T03:57:18.237 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.790+0000 7f6f04f6e700 1 -- 172.21.15.123:0/717077415 learned_addr learned my addr 172.21.15.123:0/717077415 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:18.237 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.790+0000 7f6f04f6e700 1 -- 172.21.15.123:0/717077415 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f00079f10 con 0x7f6f00107200 2024-06-02T03:57:18.237 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.790+0000 7f6f04f6e700 1 --2- 172.21.15.123:0/717077415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f00107200 0x7f6f001095f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6ef40098a0 tx=0x7f6ef4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeda15c1242fd3ed server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:18.237 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.790+0000 7f6eff7fe700 1 -- 172.21.15.123:0/717077415 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ef4004160 con 0x7f6f00107200 2024-06-02T03:57:18.237 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.790+0000 7f6eff7fe700 1 -- 172.21.15.123:0/717077415 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef40042c0 con 0x7f6f00107200 2024-06-02T03:57:18.237 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.790+0000 7f6eff7fe700 1 -- 172.21.15.123:0/717077415 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ef40045a0 con 0x7f6f00107200 2024-06-02T03:57:18.237 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.791+0000 7f6f071d2700 1 -- 172.21.15.123:0/717077415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f00107200 msgr2=0x7f6f001095f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:18.238 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.791+0000 7f6f071d2700 1 --2- 172.21.15.123:0/717077415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f00107200 0x7f6f001095f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6ef40098a0 tx=0x7f6ef4009bb0 comp rx=0 tx=0).stop 2024-06-02T03:57:18.238 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.791+0000 7f6f071d2700 1 -- 172.21.15.123:0/717077415 shutdown_connections 2024-06-02T03:57:18.238 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.791+0000 7f6f071d2700 1 --2- 172.21.15.123:0/717077415 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f00107200 0x7f6f001095f0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:18.238 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.791+0000 7f6f071d2700 1 -- 172.21.15.123:0/717077415 >> 172.21.15.123:0/717077415 conn(0x7f6f00100b90 msgr2=0x7f6f00102fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:18.238 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.791+0000 7f6f071d2700 1 -- 172.21.15.123:0/717077415 shutdown_connections 2024-06-02T03:57:18.238 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.791+0000 7f6f071d2700 1 -- 172.21.15.123:0/717077415 wait complete. 2024-06-02T03:57:18.238 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.791+0000 7f6f071d2700 1 Processor -- start 2024-06-02T03:57:18.238 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.791+0000 7f6f071d2700 1 -- start start 2024-06-02T03:57:18.238 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.791+0000 7f6f071d2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f00107200 0x7f6f00106a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:18.239 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.791+0000 7f6f071d2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f00106f70 con 0x7f6f00107200 2024-06-02T03:57:18.239 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.792+0000 7f6f04f6e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f00107200 0x7f6f00106a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:18.239 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.792+0000 7f6f04f6e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f00107200 0x7f6f00106a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56618/0 (socket says 172.21.15.123:56618) 2024-06-02T03:57:18.239 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.792+0000 7f6f04f6e700 1 -- 172.21.15.123:0/857723556 learned_addr learned my addr 172.21.15.123:0/857723556 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:18.239 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.792+0000 7f6f04f6e700 1 -- 172.21.15.123:0/857723556 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef4009550 con 0x7f6f00107200 2024-06-02T03:57:18.239 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.792+0000 7f6f04f6e700 1 --2- 172.21.15.123:0/857723556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f00107200 0x7f6f00106a30 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6f00079210 tx=0x7f6ef4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:18.239 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.792+0000 7f6efdffb700 1 -- 172.21.15.123:0/857723556 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ef4011630 con 0x7f6f00107200 2024-06-02T03:57:18.239 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.792+0000 7f6efdffb700 1 -- 172.21.15.123:0/857723556 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef4011790 con 0x7f6f00107200 2024-06-02T03:57:18.239 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.792+0000 7f6f071d2700 1 -- 172.21.15.123:0/857723556 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f001051b0 con 0x7f6f00107200 2024-06-02T03:57:18.240 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.792+0000 7f6efdffb700 1 -- 172.21.15.123:0/857723556 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ef4011a30 con 0x7f6f00107200 2024-06-02T03:57:18.240 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.792+0000 7f6f071d2700 1 -- 172.21.15.123:0/857723556 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f00105650 con 0x7f6f00107200 2024-06-02T03:57:18.240 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.793+0000 7f6efdffb700 1 -- 172.21.15.123:0/857723556 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f6ef4022070 con 0x7f6f00107200 2024-06-02T03:57:18.240 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.793+0000 7f6efdffb700 1 -- 172.21.15.123:0/857723556 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6ef401c450 con 0x7f6f00107200 2024-06-02T03:57:18.240 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.793+0000 7f6f071d2700 1 -- 172.21.15.123:0/857723556 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f000625d0 con 0x7f6f00107200 2024-06-02T03:57:18.240 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.796+0000 7f6efdffb700 1 -- 172.21.15.123:0/857723556 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f6ef401b450 con 0x7f6f00107200 2024-06-02T03:57:18.240 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.865+0000 7f6f071d2700 1 -- 172.21.15.123:0/857723556 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f6f00109d10 con 0x7f6f00107200 2024-06-02T03:57:18.240 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.866+0000 7f6efdffb700 1 -- 172.21.15.123:0/857723556 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f6ef401b5f0 con 0x7f6f00107200 2024-06-02T03:57:18.240 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.866+0000 7f6f071d2700 1 -- 172.21.15.123:0/857723556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f00107200 msgr2=0x7f6f00106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:18.240 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.866+0000 7f6f071d2700 1 --2- 172.21.15.123:0/857723556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f00107200 0x7f6f00106a30 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6f00079210 tx=0x7f6ef4004750 comp rx=0 tx=0).stop 2024-06-02T03:57:18.240 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.866+0000 7f6f071d2700 1 -- 172.21.15.123:0/857723556 shutdown_connections 2024-06-02T03:57:18.240 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.866+0000 7f6f071d2700 1 --2- 172.21.15.123:0/857723556 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6f00107200 0x7f6f00106a30 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:18.240 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.866+0000 7f6f071d2700 1 -- 172.21.15.123:0/857723556 >> 172.21.15.123:0/857723556 conn(0x7f6f00100b90 msgr2=0x7f6f00102ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:18.241 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.867+0000 7f6f071d2700 1 -- 172.21.15.123:0/857723556 shutdown_connections 2024-06-02T03:57:18.241 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:17.867+0000 7f6f071d2700 1 -- 172.21.15.123:0/857723556 wait complete. 2024-06-02T03:57:18.241 INFO:teuthology.orchestra.run.smithi123.stdout:mon is available 2024-06-02T03:57:18.241 INFO:teuthology.orchestra.run.smithi123.stdout:Assimilating anything we can from ceph.conf... 2024-06-02T03:57:18.422 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:18 smithi123 ceph-mon[42401]: mon.a is new leader, mons a in quorum (ranks 0) 2024-06-02T03:57:18.422 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:18 smithi123 ceph-mon[42401]: monmap e1: 1 mons at {a=[v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-06-02T03:57:18.422 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:18 smithi123 ceph-mon[42401]: fsmap 2024-06-02T03:57:18.422 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:18 smithi123 ceph-mon[42401]: osdmap e1: 0 total, 0 up, 0 in 2024-06-02T03:57:18.422 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:18 smithi123 ceph-mon[42401]: mgrmap e1: no daemons active 2024-06-02T03:57:18.422 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:18 smithi123 ceph-mon[42401]: from='client.? 172.21.15.123:0/857723556' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-06-02T03:57:19.061 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-06-02T03:57:19.061 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout [global] 2024-06-02T03:57:19.061 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout fsid = 1b432ae0-2094-11ef-bc9b-c7b262605968 2024-06-02T03:57:19.061 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.123:3300,v1:172.21.15.123:6789] 2024-06-02T03:57:19.062 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-06-02T03:57:19.062 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-06-02T03:57:19.062 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-06-02T03:57:19.062 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-06-02T03:57:19.062 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-06-02T03:57:19.062 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout [mgr] 2024-06-02T03:57:19.062 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-06-02T03:57:19.062 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-06-02T03:57:19.062 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout [osd] 2024-06-02T03:57:19.062 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-06-02T03:57:19.062 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-06-02T03:57:19.062 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-06-02T03:57:19.062 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-06-02T03:57:19.063 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-06-02T03:57:19.063 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.635+0000 7f29f8ad2700 1 Processor -- start 2024-06-02T03:57:19.063 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.635+0000 7f29f8ad2700 1 -- start start 2024-06-02T03:57:19.063 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.635+0000 7f29f8ad2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29f4107180 0x7f29f4109570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:19.063 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.635+0000 7f29f8ad2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f4079e50 con 0x7f29f4107180 2024-06-02T03:57:19.063 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.635+0000 7f29f259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29f4107180 0x7f29f4109570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:19.063 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.635+0000 7f29f259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29f4107180 0x7f29f4109570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56632/0 (socket says 172.21.15.123:56632) 2024-06-02T03:57:19.063 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.635+0000 7f29f259c700 1 -- 172.21.15.123:0/1808124279 learned_addr learned my addr 172.21.15.123:0/1808124279 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:19.063 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.635+0000 7f29f259c700 1 -- 172.21.15.123:0/1808124279 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f4109ab0 con 0x7f29f4107180 2024-06-02T03:57:19.063 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.636+0000 7f29f259c700 1 --2- 172.21.15.123:0/1808124279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29f4107180 0x7f29f4109570 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f29e40098a0 tx=0x7f29e4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98025199a06fcbfc server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:19.063 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.636+0000 7f29f159a700 1 -- 172.21.15.123:0/1808124279 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29e4004160 con 0x7f29f4107180 2024-06-02T03:57:19.064 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.636+0000 7f29f159a700 1 -- 172.21.15.123:0/1808124279 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e40042c0 con 0x7f29f4107180 2024-06-02T03:57:19.064 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.636+0000 7f29f159a700 1 -- 172.21.15.123:0/1808124279 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29e40045a0 con 0x7f29f4107180 2024-06-02T03:57:19.064 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.636+0000 7f29f8ad2700 1 -- 172.21.15.123:0/1808124279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29f4107180 msgr2=0x7f29f4109570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:19.064 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.636+0000 7f29f8ad2700 1 --2- 172.21.15.123:0/1808124279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29f4107180 0x7f29f4109570 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f29e40098a0 tx=0x7f29e4009bb0 comp rx=0 tx=0).stop 2024-06-02T03:57:19.064 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.636+0000 7f29f8ad2700 1 -- 172.21.15.123:0/1808124279 shutdown_connections 2024-06-02T03:57:19.064 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.636+0000 7f29f8ad2700 1 --2- 172.21.15.123:0/1808124279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29f4107180 0x7f29f4109570 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:19.064 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.636+0000 7f29f8ad2700 1 -- 172.21.15.123:0/1808124279 >> 172.21.15.123:0/1808124279 conn(0x7f29f4100b90 msgr2=0x7f29f4102fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:19.064 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.636+0000 7f29f8ad2700 1 -- 172.21.15.123:0/1808124279 shutdown_connections 2024-06-02T03:57:19.064 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.636+0000 7f29f8ad2700 1 -- 172.21.15.123:0/1808124279 wait complete. 2024-06-02T03:57:19.064 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.637+0000 7f29f8ad2700 1 Processor -- start 2024-06-02T03:57:19.064 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.637+0000 7f29f8ad2700 1 -- start start 2024-06-02T03:57:19.064 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.637+0000 7f29f8ad2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29f4107180 0x7f29f4199b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:19.064 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.637+0000 7f29f8ad2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f419a0d0 con 0x7f29f4107180 2024-06-02T03:57:19.064 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.637+0000 7f29f259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29f4107180 0x7f29f4199b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:19.065 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.637+0000 7f29f259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29f4107180 0x7f29f4199b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56634/0 (socket says 172.21.15.123:56634) 2024-06-02T03:57:19.065 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.637+0000 7f29f259c700 1 -- 172.21.15.123:0/2342472185 learned_addr learned my addr 172.21.15.123:0/2342472185 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:19.065 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.638+0000 7f29f259c700 1 -- 172.21.15.123:0/2342472185 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e4009550 con 0x7f29f4107180 2024-06-02T03:57:19.065 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.638+0000 7f29f259c700 1 --2- 172.21.15.123:0/2342472185 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29f4107180 0x7f29f4199b90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f29f4079290 tx=0x7f29e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:19.065 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.638+0000 7f29eb7fe700 1 -- 172.21.15.123:0/2342472185 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29e4011630 con 0x7f29f4107180 2024-06-02T03:57:19.065 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.638+0000 7f29eb7fe700 1 -- 172.21.15.123:0/2342472185 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e4011790 con 0x7f29f4107180 2024-06-02T03:57:19.065 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.638+0000 7f29f8ad2700 1 -- 172.21.15.123:0/2342472185 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f419a2d0 con 0x7f29f4107180 2024-06-02T03:57:19.065 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.638+0000 7f29eb7fe700 1 -- 172.21.15.123:0/2342472185 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29e4011a30 con 0x7f29f4107180 2024-06-02T03:57:19.065 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.638+0000 7f29f8ad2700 1 -- 172.21.15.123:0/2342472185 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f419a770 con 0x7f29f4107180 2024-06-02T03:57:19.065 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.638+0000 7f29eb7fe700 1 -- 172.21.15.123:0/2342472185 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f29e4022070 con 0x7f29f4107180 2024-06-02T03:57:19.065 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.638+0000 7f29eb7fe700 1 -- 172.21.15.123:0/2342472185 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f29e401c450 con 0x7f29f4107180 2024-06-02T03:57:19.065 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.639+0000 7f29f8ad2700 1 -- 172.21.15.123:0/2342472185 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f41939d0 con 0x7f29f4107180 2024-06-02T03:57:19.065 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.641+0000 7f29eb7fe700 1 -- 172.21.15.123:0/2342472185 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f29e401b450 con 0x7f29f4107180 2024-06-02T03:57:19.066 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.708+0000 7f29f8ad2700 1 -- 172.21.15.123:0/2342472185 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f29f4109f90 con 0x7f29f4107180 2024-06-02T03:57:19.066 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.712+0000 7f29eb7fe700 1 -- 172.21.15.123:0/2342472185 <== mon.0 v2:172.21.15.123:3300/0 7 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f29e401b5f0 con 0x7f29f4107180 2024-06-02T03:57:19.066 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.712+0000 7f29eb7fe700 1 -- 172.21.15.123:0/2342472185 <== mon.0 v2:172.21.15.123:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+431 (secure 0 0 0) 0x7f29e4024510 con 0x7f29f4107180 2024-06-02T03:57:19.066 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.713+0000 7f29f8ad2700 1 -- 172.21.15.123:0/2342472185 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29f4107180 msgr2=0x7f29f4199b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:19.066 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.713+0000 7f29f8ad2700 1 --2- 172.21.15.123:0/2342472185 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29f4107180 0x7f29f4199b90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f29f4079290 tx=0x7f29e4004750 comp rx=0 tx=0).stop 2024-06-02T03:57:19.066 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.713+0000 7f29f8ad2700 1 -- 172.21.15.123:0/2342472185 shutdown_connections 2024-06-02T03:57:19.066 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.713+0000 7f29f8ad2700 1 --2- 172.21.15.123:0/2342472185 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29f4107180 0x7f29f4199b90 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:19.066 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.713+0000 7f29f8ad2700 1 -- 172.21.15.123:0/2342472185 >> 172.21.15.123:0/2342472185 conn(0x7f29f4100b90 msgr2=0x7f29f4102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:19.066 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.713+0000 7f29f8ad2700 1 -- 172.21.15.123:0/2342472185 shutdown_connections 2024-06-02T03:57:19.066 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:18.713+0000 7f29f8ad2700 1 -- 172.21.15.123:0/2342472185 wait complete. 2024-06-02T03:57:19.066 INFO:teuthology.orchestra.run.smithi123.stdout:Generating new minimal ceph.conf... 2024-06-02T03:57:19.728 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:19 smithi123 ceph-mon[42401]: from='client.? 172.21.15.123:0/2342472185' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-06-02T03:57:19.728 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:19 smithi123 ceph-mon[42401]: from='client.? 172.21.15.123:0/2342472185' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-06-02T03:57:19.934 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.464+0000 7f8409c03700 1 Processor -- start 2024-06-02T03:57:19.934 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.464+0000 7f8409c03700 1 -- start start 2024-06-02T03:57:19.934 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.464+0000 7f8409c03700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84041071a0 0x7f8404109590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:19.935 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.464+0000 7f8409c03700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8404079f50 con 0x7f84041071a0 2024-06-02T03:57:19.935 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.464+0000 7f84037fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84041071a0 0x7f8404109590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:19.935 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.464+0000 7f84037fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84041071a0 0x7f8404109590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56650/0 (socket says 172.21.15.123:56650) 2024-06-02T03:57:19.935 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.464+0000 7f84037fe700 1 -- 172.21.15.123:0/446927725 learned_addr learned my addr 172.21.15.123:0/446927725 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:19.935 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.464+0000 7f84037fe700 1 -- 172.21.15.123:0/446927725 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8404109ad0 con 0x7f84041071a0 2024-06-02T03:57:19.935 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.464+0000 7f84037fe700 1 --2- 172.21.15.123:0/446927725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84041071a0 0x7f8404109590 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f83f40098a0 tx=0x7f83f4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e966a543fe415334 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:19.935 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.465+0000 7f84027fc700 1 -- 172.21.15.123:0/446927725 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83f4004160 con 0x7f84041071a0 2024-06-02T03:57:19.935 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.465+0000 7f84027fc700 1 -- 172.21.15.123:0/446927725 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f83f40042c0 con 0x7f84041071a0 2024-06-02T03:57:19.935 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.465+0000 7f84027fc700 1 -- 172.21.15.123:0/446927725 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83f4011a00 con 0x7f84041071a0 2024-06-02T03:57:19.935 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.465+0000 7f8409c03700 1 -- 172.21.15.123:0/446927725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84041071a0 msgr2=0x7f8404109590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:19.935 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.465+0000 7f8409c03700 1 --2- 172.21.15.123:0/446927725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84041071a0 0x7f8404109590 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f83f40098a0 tx=0x7f83f4009bb0 comp rx=0 tx=0).stop 2024-06-02T03:57:19.935 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.465+0000 7f8409c03700 1 -- 172.21.15.123:0/446927725 shutdown_connections 2024-06-02T03:57:19.935 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.465+0000 7f8409c03700 1 --2- 172.21.15.123:0/446927725 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84041071a0 0x7f8404109590 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:19.936 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.465+0000 7f8409c03700 1 -- 172.21.15.123:0/446927725 >> 172.21.15.123:0/446927725 conn(0x7f8404100bf0 msgr2=0x7f8404103010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:19.936 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.465+0000 7f8409c03700 1 -- 172.21.15.123:0/446927725 shutdown_connections 2024-06-02T03:57:19.936 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.465+0000 7f8409c03700 1 -- 172.21.15.123:0/446927725 wait complete. 2024-06-02T03:57:19.936 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.466+0000 7f8409c03700 1 Processor -- start 2024-06-02T03:57:19.936 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.466+0000 7f8409c03700 1 -- start start 2024-06-02T03:57:19.936 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.466+0000 7f8409c03700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84041071a0 0x7f84041069d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:19.936 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.466+0000 7f8409c03700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8404106f10 con 0x7f84041071a0 2024-06-02T03:57:19.936 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.466+0000 7f84037fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84041071a0 0x7f84041069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:19.936 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.466+0000 7f84037fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84041071a0 0x7f84041069d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56654/0 (socket says 172.21.15.123:56654) 2024-06-02T03:57:19.936 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.466+0000 7f84037fe700 1 -- 172.21.15.123:0/4060704501 learned_addr learned my addr 172.21.15.123:0/4060704501 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:19.936 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.467+0000 7f84037fe700 1 -- 172.21.15.123:0/4060704501 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f4009550 con 0x7f84041071a0 2024-06-02T03:57:19.936 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.467+0000 7f84037fe700 1 --2- 172.21.15.123:0/4060704501 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84041071a0 0x7f84041069d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f83f4009130 tx=0x7f83f4011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:19.936 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.467+0000 7f8400ff9700 1 -- 172.21.15.123:0/4060704501 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83f4003b70 con 0x7f84041071a0 2024-06-02T03:57:19.936 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.467+0000 7f8400ff9700 1 -- 172.21.15.123:0/4060704501 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f83f4003cd0 con 0x7f84041071a0 2024-06-02T03:57:19.937 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.467+0000 7f8409c03700 1 -- 172.21.15.123:0/4060704501 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8404105150 con 0x7f84041071a0 2024-06-02T03:57:19.937 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.467+0000 7f8400ff9700 1 -- 172.21.15.123:0/4060704501 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83f40197d0 con 0x7f84041071a0 2024-06-02T03:57:19.937 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.467+0000 7f8409c03700 1 -- 172.21.15.123:0/4060704501 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84041055f0 con 0x7f84041071a0 2024-06-02T03:57:19.937 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.467+0000 7f8400ff9700 1 -- 172.21.15.123:0/4060704501 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f83f4019a10 con 0x7f84041071a0 2024-06-02T03:57:19.937 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.467+0000 7f8400ff9700 1 -- 172.21.15.123:0/4060704501 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f83f400b720 con 0x7f84041071a0 2024-06-02T03:57:19.937 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.468+0000 7f8409c03700 1 -- 172.21.15.123:0/4060704501 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84040625d0 con 0x7f84041071a0 2024-06-02T03:57:19.937 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.470+0000 7f8400ff9700 1 -- 172.21.15.123:0/4060704501 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f83f402a060 con 0x7f84041071a0 2024-06-02T03:57:19.937 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.537+0000 7f8409c03700 1 -- 172.21.15.123:0/4060704501 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f840410ab10 con 0x7f84041071a0 2024-06-02T03:57:19.937 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.538+0000 7f8400ff9700 1 -- 172.21.15.123:0/4060704501 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7f83f4019e50 con 0x7f84041071a0 2024-06-02T03:57:19.937 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.538+0000 7f8409c03700 1 -- 172.21.15.123:0/4060704501 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84041071a0 msgr2=0x7f84041069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:19.937 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.538+0000 7f8409c03700 1 --2- 172.21.15.123:0/4060704501 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84041071a0 0x7f84041069d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f83f4009130 tx=0x7f83f4011ad0 comp rx=0 tx=0).stop 2024-06-02T03:57:19.937 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.538+0000 7f8409c03700 1 -- 172.21.15.123:0/4060704501 shutdown_connections 2024-06-02T03:57:19.938 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.538+0000 7f8409c03700 1 --2- 172.21.15.123:0/4060704501 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84041071a0 0x7f84041069d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:19.938 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.539+0000 7f8409c03700 1 -- 172.21.15.123:0/4060704501 >> 172.21.15.123:0/4060704501 conn(0x7f8404100bf0 msgr2=0x7f8404101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:19.938 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.539+0000 7f8409c03700 1 -- 172.21.15.123:0/4060704501 shutdown_connections 2024-06-02T03:57:19.938 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:19.539+0000 7f8409c03700 1 -- 172.21.15.123:0/4060704501 wait complete. 2024-06-02T03:57:19.938 INFO:teuthology.orchestra.run.smithi123.stdout:Restarting the monitor... 2024-06-02T03:57:20.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:19 smithi123 systemd[1]: Stopping Ceph mon.a for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T03:57:20.142 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mon-a[42378]: 2024-06-02T03:57:20.142+0000 7f48ba683700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T03:57:20.420 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mon-a[42378]: 2024-06-02T03:57:20.142+0000 7f48ba683700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-06-02T03:57:20.420 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 bash[42726]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mon-a 2024-06-02T03:57:20.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 systemd[1]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mon.a.service: Succeeded. 2024-06-02T03:57:20.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 systemd[1]: Stopped Ceph mon.a for 1b432ae0-2094-11ef-bc9b-c7b262605968. 2024-06-02T03:57:20.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 systemd[1]: Starting Ceph mon.a for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T03:57:20.999 INFO:teuthology.orchestra.run.smithi123.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-06-02T03:57:21.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: set uid:gid to 167:167 (ceph:ceph) 2024-06-02T03:57:21.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: ceph version 18.2.2-1381-g3bb45379 (3bb45379356e8aa965152e0b8c663715c5df9bda) reef (stable), process ceph-mon, pid 7 2024-06-02T03:57:21.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: pidfile_write: ignore empty --pid-file 2024-06-02T03:57:21.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: load: jerasure load: lrc 2024-06-02T03:57:21.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 bash[42847]: 33bd4d6c762cf9148cb61b086edf95ba534fb57561ce82a3a4ddb43b1435feb6 2024-06-02T03:57:21.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: RocksDB version: 7.9.2 2024-06-02T03:57:21.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Git sha 0 2024-06-02T03:57:21.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Compile date 2024-05-28 22:38:07 2024-06-02T03:57:21.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: DB SUMMARY 2024-06-02T03:57:21.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: DB Session ID: AMQDP3ISGAI3PJ4JRGQ5 2024-06-02T03:57:21.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: CURRENT file: CURRENT 2024-06-02T03:57:21.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: IDENTITY file: IDENTITY 2024-06-02T03:57:21.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-06-02T03:57:21.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-06-02T03:57:21.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 97626 ; 2024-06-02T03:57:21.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.error_if_exists: 0 2024-06-02T03:57:21.325 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.create_if_missing: 0 2024-06-02T03:57:21.325 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.paranoid_checks: 1 2024-06-02T03:57:21.325 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.flush_verify_memtable_count: 1 2024-06-02T03:57:21.325 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-06-02T03:57:21.325 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-06-02T03:57:21.325 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.env: 0x56330a2f9820 2024-06-02T03:57:21.325 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.fs: PosixFileSystem 2024-06-02T03:57:21.325 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.info_log: 0x56330d7cd520 2024-06-02T03:57:21.325 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.max_file_opening_threads: 16 2024-06-02T03:57:21.325 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.statistics: (nil) 2024-06-02T03:57:21.325 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.use_fsync: 0 2024-06-02T03:57:21.325 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.max_log_file_size: 0 2024-06-02T03:57:21.325 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-06-02T03:57:21.325 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.log_file_time_to_roll: 0 2024-06-02T03:57:21.326 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.keep_log_file_num: 1000 2024-06-02T03:57:21.326 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.recycle_log_file_num: 0 2024-06-02T03:57:21.326 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.allow_fallocate: 1 2024-06-02T03:57:21.326 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.allow_mmap_reads: 0 2024-06-02T03:57:21.326 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.allow_mmap_writes: 0 2024-06-02T03:57:21.326 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.use_direct_reads: 0 2024-06-02T03:57:21.326 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-06-02T03:57:21.326 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.create_missing_column_families: 0 2024-06-02T03:57:21.326 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.db_log_dir: 2024-06-02T03:57:21.326 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.wal_dir: 2024-06-02T03:57:21.326 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.table_cache_numshardbits: 6 2024-06-02T03:57:21.326 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.WAL_ttl_seconds: 0 2024-06-02T03:57:21.327 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.WAL_size_limit_MB: 0 2024-06-02T03:57:21.327 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-06-02T03:57:21.327 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-06-02T03:57:21.327 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.is_fd_close_on_exec: 1 2024-06-02T03:57:21.327 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.advise_random_on_open: 1 2024-06-02T03:57:21.327 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.db_write_buffer_size: 0 2024-06-02T03:57:21.327 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.write_buffer_manager: 0x56330ca62320 2024-06-02T03:57:21.327 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-06-02T03:57:21.327 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-06-02T03:57:21.327 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.use_adaptive_mutex: 0 2024-06-02T03:57:21.327 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.rate_limiter: (nil) 2024-06-02T03:57:21.328 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-06-02T03:57:21.328 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.wal_recovery_mode: 2 2024-06-02T03:57:21.328 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.enable_thread_tracking: 0 2024-06-02T03:57:21.328 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.enable_pipelined_write: 0 2024-06-02T03:57:21.328 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.unordered_write: 0 2024-06-02T03:57:21.328 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-06-02T03:57:21.328 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-06-02T03:57:21.328 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-06-02T03:57:21.328 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-06-02T03:57:21.328 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.row_cache: None 2024-06-02T03:57:21.328 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.wal_filter: None 2024-06-02T03:57:21.328 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-06-02T03:57:21.328 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.allow_ingest_behind: 0 2024-06-02T03:57:21.329 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.two_write_queues: 0 2024-06-02T03:57:21.329 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.manual_wal_flush: 0 2024-06-02T03:57:21.329 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.wal_compression: 0 2024-06-02T03:57:21.329 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.atomic_flush: 0 2024-06-02T03:57:21.329 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-06-02T03:57:21.329 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.persist_stats_to_disk: 0 2024-06-02T03:57:21.329 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.write_dbid_to_manifest: 0 2024-06-02T03:57:21.329 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.log_readahead_size: 0 2024-06-02T03:57:21.329 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-06-02T03:57:21.329 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.best_efforts_recovery: 0 2024-06-02T03:57:21.329 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-06-02T03:57:21.329 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-06-02T03:57:21.329 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.allow_data_in_errors: 0 2024-06-02T03:57:21.329 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.db_host_id: __hostname__ 2024-06-02T03:57:21.330 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.enforce_single_del_contracts: true 2024-06-02T03:57:21.330 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.max_background_jobs: 2 2024-06-02T03:57:21.330 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.max_background_compactions: -1 2024-06-02T03:57:21.330 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.max_subcompactions: 1 2024-06-02T03:57:21.330 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-06-02T03:57:21.330 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-06-02T03:57:21.330 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.delayed_write_rate : 16777216 2024-06-02T03:57:21.330 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.max_total_wal_size: 0 2024-06-02T03:57:21.330 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-06-02T03:57:21.330 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.stats_dump_period_sec: 600 2024-06-02T03:57:21.330 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.stats_persist_period_sec: 600 2024-06-02T03:57:21.330 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-06-02T03:57:21.331 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.max_open_files: -1 2024-06-02T03:57:21.331 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.bytes_per_sync: 0 2024-06-02T03:57:21.331 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.wal_bytes_per_sync: 0 2024-06-02T03:57:21.331 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.strict_bytes_per_sync: 0 2024-06-02T03:57:21.331 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.compaction_readahead_size: 0 2024-06-02T03:57:21.331 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.max_background_flushes: -1 2024-06-02T03:57:21.331 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Compression algorithms supported: 2024-06-02T03:57:21.331 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-06-02T03:57:21.331 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: kZSTD supported: 0 2024-06-02T03:57:21.331 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: kXpressCompression supported: 0 2024-06-02T03:57:21.331 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: kLZ4HCCompression supported: 1 2024-06-02T03:57:21.331 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: kZlibCompression supported: 1 2024-06-02T03:57:21.332 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: kSnappyCompression supported: 1 2024-06-02T03:57:21.332 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: kLZ4Compression supported: 1 2024-06-02T03:57:21.332 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: kBZip2Compression supported: 0 2024-06-02T03:57:21.332 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Fast CRC32 supported: Supported on x86 2024-06-02T03:57:21.332 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: DMutex implementation: pthread_mutex_t 2024-06-02T03:57:21.332 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-06-02T03:57:21.332 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-06-02T03:57:21.332 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-06-02T03:57:21.332 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.merge_operator: 2024-06-02T03:57:21.332 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.compaction_filter: None 2024-06-02T03:57:21.332 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.compaction_filter_factory: None 2024-06-02T03:57:21.332 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.sst_partitioner_factory: None 2024-06-02T03:57:21.332 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.memtable_factory: SkipListFactory 2024-06-02T03:57:21.333 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.table_factory: BlockBasedTable 2024-06-02T03:57:21.333 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56330d7cd620) 2024-06-02T03:57:21.333 INFO:journalctl@ceph.mon.a.smithi123.stdout: cache_index_and_filter_blocks: 1 2024-06-02T03:57:21.333 INFO:journalctl@ceph.mon.a.smithi123.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-06-02T03:57:21.333 INFO:journalctl@ceph.mon.a.smithi123.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-06-02T03:57:21.333 INFO:journalctl@ceph.mon.a.smithi123.stdout: pin_top_level_index_and_filter: 1 2024-06-02T03:57:21.333 INFO:journalctl@ceph.mon.a.smithi123.stdout: index_type: 0 2024-06-02T03:57:21.333 INFO:journalctl@ceph.mon.a.smithi123.stdout: data_block_index_type: 0 2024-06-02T03:57:21.333 INFO:journalctl@ceph.mon.a.smithi123.stdout: index_shortening: 1 2024-06-02T03:57:21.333 INFO:journalctl@ceph.mon.a.smithi123.stdout: data_block_hash_table_util_ratio: 0.750000 2024-06-02T03:57:21.333 INFO:journalctl@ceph.mon.a.smithi123.stdout: checksum: 4 2024-06-02T03:57:21.333 INFO:journalctl@ceph.mon.a.smithi123.stdout: no_block_cache: 0 2024-06-02T03:57:21.333 INFO:journalctl@ceph.mon.a.smithi123.stdout: block_cache: 0x56330cae51f0 2024-06-02T03:57:21.334 INFO:journalctl@ceph.mon.a.smithi123.stdout: block_cache_name: BinnedLRUCache 2024-06-02T03:57:21.334 INFO:journalctl@ceph.mon.a.smithi123.stdout: block_cache_options: 2024-06-02T03:57:21.334 INFO:journalctl@ceph.mon.a.smithi123.stdout: capacity : 536870912 2024-06-02T03:57:21.334 INFO:journalctl@ceph.mon.a.smithi123.stdout: num_shard_bits : 4 2024-06-02T03:57:21.334 INFO:journalctl@ceph.mon.a.smithi123.stdout: strict_capacity_limit : 0 2024-06-02T03:57:21.334 INFO:journalctl@ceph.mon.a.smithi123.stdout: high_pri_pool_ratio: 0.000 2024-06-02T03:57:21.334 INFO:journalctl@ceph.mon.a.smithi123.stdout: block_cache_compressed: (nil) 2024-06-02T03:57:21.334 INFO:journalctl@ceph.mon.a.smithi123.stdout: persistent_cache: (nil) 2024-06-02T03:57:21.334 INFO:journalctl@ceph.mon.a.smithi123.stdout: block_size: 4096 2024-06-02T03:57:21.334 INFO:journalctl@ceph.mon.a.smithi123.stdout: block_size_deviation: 10 2024-06-02T03:57:21.334 INFO:journalctl@ceph.mon.a.smithi123.stdout: block_restart_interval: 16 2024-06-02T03:57:21.334 INFO:journalctl@ceph.mon.a.smithi123.stdout: index_block_restart_interval: 1 2024-06-02T03:57:21.335 INFO:journalctl@ceph.mon.a.smithi123.stdout: metadata_block_size: 4096 2024-06-02T03:57:21.335 INFO:journalctl@ceph.mon.a.smithi123.stdout: partition_filters: 0 2024-06-02T03:57:21.335 INFO:journalctl@ceph.mon.a.smithi123.stdout: use_delta_encoding: 1 2024-06-02T03:57:21.335 INFO:journalctl@ceph.mon.a.smithi123.stdout: filter_policy: bloomfilter 2024-06-02T03:57:21.335 INFO:journalctl@ceph.mon.a.smithi123.stdout: whole_key_filtering: 1 2024-06-02T03:57:21.335 INFO:journalctl@ceph.mon.a.smithi123.stdout: verify_compression: 0 2024-06-02T03:57:21.335 INFO:journalctl@ceph.mon.a.smithi123.stdout: read_amp_bytes_per_bit: 0 2024-06-02T03:57:21.335 INFO:journalctl@ceph.mon.a.smithi123.stdout: format_version: 5 2024-06-02T03:57:21.335 INFO:journalctl@ceph.mon.a.smithi123.stdout: enable_index_compression: 1 2024-06-02T03:57:21.335 INFO:journalctl@ceph.mon.a.smithi123.stdout: block_align: 0 2024-06-02T03:57:21.335 INFO:journalctl@ceph.mon.a.smithi123.stdout: max_auto_readahead_size: 262144 2024-06-02T03:57:21.335 INFO:journalctl@ceph.mon.a.smithi123.stdout: prepopulate_block_cache: 0 2024-06-02T03:57:21.336 INFO:journalctl@ceph.mon.a.smithi123.stdout: initial_auto_readahead_size: 8192 2024-06-02T03:57:21.336 INFO:journalctl@ceph.mon.a.smithi123.stdout: num_file_reads_for_auto_readahead: 2 2024-06-02T03:57:21.336 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.write_buffer_size: 33554432 2024-06-02T03:57:21.336 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.max_write_buffer_number: 2 2024-06-02T03:57:21.336 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.compression: NoCompression 2024-06-02T03:57:21.336 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.bottommost_compression: Disabled 2024-06-02T03:57:21.336 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.prefix_extractor: nullptr 2024-06-02T03:57:21.336 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-06-02T03:57:21.336 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.num_levels: 7 2024-06-02T03:57:21.336 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-06-02T03:57:21.336 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-06-02T03:57:21.336 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-06-02T03:57:21.336 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-06-02T03:57:21.337 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-06-02T03:57:21.337 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-06-02T03:57:21.337 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-06-02T03:57:21.337 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-06-02T03:57:21.337 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-06-02T03:57:21.337 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-06-02T03:57:21.337 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-06-02T03:57:21.337 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-06-02T03:57:21.337 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.compression_opts.window_bits: -14 2024-06-02T03:57:21.337 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.compression_opts.level: 32767 2024-06-02T03:57:21.337 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.compression_opts.strategy: 0 2024-06-02T03:57:21.337 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-06-02T03:57:21.338 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-06-02T03:57:21.338 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-06-02T03:57:21.338 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-06-02T03:57:21.338 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.compression_opts.enabled: false 2024-06-02T03:57:21.338 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-06-02T03:57:21.338 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-06-02T03:57:21.338 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-06-02T03:57:21.338 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-06-02T03:57:21.338 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.target_file_size_base: 67108864 2024-06-02T03:57:21.338 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.target_file_size_multiplier: 1 2024-06-02T03:57:21.338 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-06-02T03:57:21.338 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-06-02T03:57:21.339 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-06-02T03:57:21.339 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-06-02T03:57:21.339 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-06-02T03:57:21.339 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-06-02T03:57:21.339 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-06-02T03:57:21.339 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-06-02T03:57:21.339 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-06-02T03:57:21.339 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-06-02T03:57:21.339 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-06-02T03:57:21.339 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-06-02T03:57:21.339 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-06-02T03:57:21.339 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.arena_block_size: 1048576 2024-06-02T03:57:21.339 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-06-02T03:57:21.339 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-06-02T03:57:21.340 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.disable_auto_compactions: 0 2024-06-02T03:57:21.340 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-06-02T03:57:21.340 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-06-02T03:57:21.340 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-06-02T03:57:21.341 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-06-02T03:57:21.341 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-06-02T03:57:21.341 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-06-02T03:57:21.341 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-06-02T03:57:21.341 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-06-02T03:57:21.341 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-06-02T03:57:21.341 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-06-02T03:57:21.341 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.table_properties_collectors: 2024-06-02T03:57:21.341 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.inplace_update_support: 0 2024-06-02T03:57:21.341 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.inplace_update_num_locks: 10000 2024-06-02T03:57:21.341 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-06-02T03:57:21.341 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-06-02T03:57:21.342 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.memtable_huge_page_size: 0 2024-06-02T03:57:21.342 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.bloom_locality: 0 2024-06-02T03:57:21.342 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.max_successive_merges: 0 2024-06-02T03:57:21.342 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.optimize_filters_for_hits: 0 2024-06-02T03:57:21.342 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.paranoid_file_checks: 0 2024-06-02T03:57:21.342 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.force_consistency_checks: 1 2024-06-02T03:57:21.342 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.report_bg_io_stats: 0 2024-06-02T03:57:21.342 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.ttl: 2592000 2024-06-02T03:57:21.342 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.periodic_compaction_seconds: 0 2024-06-02T03:57:21.342 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 systemd[1]: Started Ceph mon.a for 1b432ae0-2094-11ef-bc9b-c7b262605968. 2024-06-02T03:57:21.342 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-06-02T03:57:21.342 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-06-02T03:57:21.342 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.enable_blob_files: false 2024-06-02T03:57:21.343 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.min_blob_size: 0 2024-06-02T03:57:21.343 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.blob_file_size: 268435456 2024-06-02T03:57:21.343 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.blob_compression_type: NoCompression 2024-06-02T03:57:21.343 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.enable_blob_garbage_collection: false 2024-06-02T03:57:21.343 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-06-02T03:57:21.343 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-06-02T03:57:21.343 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-06-02T03:57:21.343 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.blob_file_starting_level: 0 2024-06-02T03:57:21.343 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-06-02T03:57:21.343 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-06-02T03:57:21.343 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-06-02T03:57:21.343 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e2bce80e-1b7b-4a16-82ec-cb6ea0197a92 2024-06-02T03:57:21.343 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717300640997586, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-06-02T03:57:21.344 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-06-02T03:57:21.344 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717300640998995, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 93034, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 307, "table_properties": {"data_size": 91032, "index_size": 284, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13614, "raw_average_key_size": 50, "raw_value_size": 83610, "raw_average_value_size": 309, "num_data_blocks": 11, "num_entries": 270, "num_filter_entries": 270, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1717300640, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e2bce80e-1b7b-4a16-82ec-cb6ea0197a92", "db_session_id": "AMQDP3ISGAI3PJ4JRGQ5", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-06-02T03:57:21.344 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: EVENT_LOG_v1 {"time_micros": 1717300640999085, "job": 1, "event": "recovery_finished"} 2024-06-02T03:57:21.344 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:20 smithi123 ceph-mon[42885]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-06-02T03:57:21.344 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:21 smithi123 ceph-mon[42885]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-06-02T03:57:21.344 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:21 smithi123 ceph-mon[42885]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56330cb82000 2024-06-02T03:57:21.344 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:21 smithi123 ceph-mon[42885]: rocksdb: DB pointer 0x56330cb70000 2024-06-02T03:57:21.344 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:21 smithi123 ceph-mon[42885]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-06-02T03:57:21.344 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:21 smithi123 ceph-mon[42885]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-06-02T03:57:21.344 INFO:journalctl@ceph.mon.a.smithi123.stdout: ** DB Stats ** 2024-06-02T03:57:21.344 INFO:journalctl@ceph.mon.a.smithi123.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-02T03:57:21.344 INFO:journalctl@ceph.mon.a.smithi123.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-06-02T03:57:21.344 INFO:journalctl@ceph.mon.a.smithi123.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-02T03:57:21.345 INFO:journalctl@ceph.mon.a.smithi123.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-02T03:57:21.345 INFO:journalctl@ceph.mon.a.smithi123.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-06-02T03:57:21.345 INFO:journalctl@ceph.mon.a.smithi123.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-06-02T03:57:21.345 INFO:journalctl@ceph.mon.a.smithi123.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-06-02T03:57:21.345 INFO:journalctl@ceph.mon.a.smithi123.stdout: 2024-06-02T03:57:21.345 INFO:journalctl@ceph.mon.a.smithi123.stdout: ** Compaction Stats [default] ** 2024-06-02T03:57:21.345 INFO:journalctl@ceph.mon.a.smithi123.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-02T03:57:21.345 INFO:journalctl@ceph.mon.a.smithi123.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-06-02T03:57:21.345 INFO:journalctl@ceph.mon.a.smithi123.stdout: L0 2/0 92.69 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 96.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-02T03:57:21.345 INFO:journalctl@ceph.mon.a.smithi123.stdout: Sum 2/0 92.69 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 96.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-02T03:57:21.345 INFO:journalctl@ceph.mon.a.smithi123.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 96.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-02T03:57:21.345 INFO:journalctl@ceph.mon.a.smithi123.stdout: 2024-06-02T03:57:21.345 INFO:journalctl@ceph.mon.a.smithi123.stdout: ** Compaction Stats [default] ** 2024-06-02T03:57:21.346 INFO:journalctl@ceph.mon.a.smithi123.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-06-02T03:57:21.346 INFO:journalctl@ceph.mon.a.smithi123.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-06-02T03:57:21.346 INFO:journalctl@ceph.mon.a.smithi123.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 96.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-06-02T03:57:21.346 INFO:journalctl@ceph.mon.a.smithi123.stdout: 2024-06-02T03:57:21.346 INFO:journalctl@ceph.mon.a.smithi123.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-06-02T03:57:21.346 INFO:journalctl@ceph.mon.a.smithi123.stdout: 2024-06-02T03:57:21.346 INFO:journalctl@ceph.mon.a.smithi123.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-06-02T03:57:21.346 INFO:journalctl@ceph.mon.a.smithi123.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-06-02T03:57:21.346 INFO:journalctl@ceph.mon.a.smithi123.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-06-02T03:57:21.346 INFO:journalctl@ceph.mon.a.smithi123.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-06-02T03:57:21.346 INFO:journalctl@ceph.mon.a.smithi123.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-06-02T03:57:21.346 INFO:journalctl@ceph.mon.a.smithi123.stdout: AddFile(Keys): cumulative 0, interval 0 2024-06-02T03:57:21.346 INFO:journalctl@ceph.mon.a.smithi123.stdout: Cumulative compaction: 0.00 GB write, 21.26 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-02T03:57:21.347 INFO:journalctl@ceph.mon.a.smithi123.stdout: Interval compaction: 0.00 GB write, 21.26 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-06-02T03:57:21.347 INFO:journalctl@ceph.mon.a.smithi123.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-06-02T03:57:21.347 INFO:journalctl@ceph.mon.a.smithi123.stdout: Block cache BinnedLRUCache@0x56330cae51f0#7 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-06-02T03:57:21.347 INFO:journalctl@ceph.mon.a.smithi123.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-06-02T03:57:21.347 INFO:journalctl@ceph.mon.a.smithi123.stdout: 2024-06-02T03:57:21.347 INFO:journalctl@ceph.mon.a.smithi123.stdout: ** File Read Latency Histogram By Level [default] ** 2024-06-02T03:57:21.347 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:21 smithi123 ceph-mon[42885]: starting mon.a rank 0 at public addrs [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] at bind addrs [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 2024-06-02T03:57:21.347 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:21 smithi123 ceph-mon[42885]: mon.a@-1(???) e1 preinit fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 2024-06-02T03:57:21.347 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:21 smithi123 ceph-mon[42885]: mon.a@-1(???).mds e1 new map 2024-06-02T03:57:21.347 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:21 smithi123 ceph-mon[42885]: mon.a@-1(???).mds e1 print_map 2024-06-02T03:57:21.347 INFO:journalctl@ceph.mon.a.smithi123.stdout: e1 2024-06-02T03:57:21.347 INFO:journalctl@ceph.mon.a.smithi123.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T03:57:21.348 INFO:journalctl@ceph.mon.a.smithi123.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T03:57:21.348 INFO:journalctl@ceph.mon.a.smithi123.stdout: legacy client fscid: -1 2024-06-02T03:57:21.348 INFO:journalctl@ceph.mon.a.smithi123.stdout: 2024-06-02T03:57:21.348 INFO:journalctl@ceph.mon.a.smithi123.stdout: No filesystems configured 2024-06-02T03:57:21.348 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:21 smithi123 ceph-mon[42885]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-06-02T03:57:21.348 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:21 smithi123 ceph-mon[42885]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T03:57:21.348 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:21 smithi123 ceph-mon[42885]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T03:57:21.348 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:21 smithi123 ceph-mon[42885]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T03:57:21.348 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:21 smithi123 ceph-mon[42885]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-06-02T03:57:21.348 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:21 smithi123 ceph-mon[42885]: mon.a is new leader, mons a in quorum (ranks 0) 2024-06-02T03:57:21.348 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:21 smithi123 ceph-mon[42885]: monmap e1: 1 mons at {a=[v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-06-02T03:57:21.348 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:21 smithi123 ceph-mon[42885]: fsmap 2024-06-02T03:57:21.348 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:21 smithi123 ceph-mon[42885]: osdmap e1: 0 total, 0 up, 0 in 2024-06-02T03:57:21.348 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:21 smithi123 ceph-mon[42885]: mgrmap e1: no daemons active 2024-06-02T03:57:23.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:22 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/4222022640' entity='client.admin' 2024-06-02T03:57:23.108 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.527+0000 7fc78df8a700 1 Processor -- start 2024-06-02T03:57:23.109 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.527+0000 7fc78df8a700 1 -- start start 2024-06-02T03:57:23.109 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.527+0000 7fc78df8a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7881071b0 0x7fc7881095a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:23.109 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.527+0000 7fc78df8a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc788079e50 con 0x7fc7881071b0 2024-06-02T03:57:23.109 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.527+0000 7fc7877fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7881071b0 0x7fc7881095a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:23.109 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.527+0000 7fc7877fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7881071b0 0x7fc7881095a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56670/0 (socket says 172.21.15.123:56670) 2024-06-02T03:57:23.109 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.528+0000 7fc7877fe700 1 -- 172.21.15.123:0/535420039 learned_addr learned my addr 172.21.15.123:0/535420039 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:23.109 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.528+0000 7fc7877fe700 1 -- 172.21.15.123:0/535420039 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc788109ae0 con 0x7fc7881071b0 2024-06-02T03:57:23.109 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.528+0000 7fc7877fe700 1 --2- 172.21.15.123:0/535420039 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7881071b0 0x7fc7881095a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc7780098a0 tx=0x7fc778009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c94232711069fb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:23.109 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.528+0000 7fc7867fc700 1 -- 172.21.15.123:0/535420039 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc778004160 con 0x7fc7881071b0 2024-06-02T03:57:23.109 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.528+0000 7fc7867fc700 1 -- 172.21.15.123:0/535420039 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc7780042c0 con 0x7fc7881071b0 2024-06-02T03:57:23.110 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.528+0000 7fc7867fc700 1 -- 172.21.15.123:0/535420039 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc778011a00 con 0x7fc7881071b0 2024-06-02T03:57:23.110 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.529+0000 7fc78df8a700 1 -- 172.21.15.123:0/535420039 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7881071b0 msgr2=0x7fc7881095a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:23.110 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.529+0000 7fc78df8a700 1 --2- 172.21.15.123:0/535420039 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7881071b0 0x7fc7881095a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc7780098a0 tx=0x7fc778009bb0 comp rx=0 tx=0).stop 2024-06-02T03:57:23.110 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.529+0000 7fc78df8a700 1 -- 172.21.15.123:0/535420039 shutdown_connections 2024-06-02T03:57:23.110 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.529+0000 7fc78df8a700 1 --2- 172.21.15.123:0/535420039 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7881071b0 0x7fc7881095a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:23.110 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.529+0000 7fc78df8a700 1 -- 172.21.15.123:0/535420039 >> 172.21.15.123:0/535420039 conn(0x7fc788100bc0 msgr2=0x7fc788102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:23.110 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.529+0000 7fc78df8a700 1 -- 172.21.15.123:0/535420039 shutdown_connections 2024-06-02T03:57:23.110 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.529+0000 7fc78df8a700 1 -- 172.21.15.123:0/535420039 wait complete. 2024-06-02T03:57:23.110 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.529+0000 7fc78df8a700 1 Processor -- start 2024-06-02T03:57:23.110 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.529+0000 7fc78df8a700 1 -- start start 2024-06-02T03:57:23.110 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.530+0000 7fc78df8a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7881071b0 0x7fc78819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:23.110 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.530+0000 7fc78df8a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78819a9c0 con 0x7fc7881071b0 2024-06-02T03:57:23.110 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.530+0000 7fc7877fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7881071b0 0x7fc78819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:23.111 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.530+0000 7fc7877fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7881071b0 0x7fc78819a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56674/0 (socket says 172.21.15.123:56674) 2024-06-02T03:57:23.111 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.530+0000 7fc7877fe700 1 -- 172.21.15.123:0/4222022640 learned_addr learned my addr 172.21.15.123:0/4222022640 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:23.111 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.530+0000 7fc7877fe700 1 -- 172.21.15.123:0/4222022640 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc778009550 con 0x7fc7881071b0 2024-06-02T03:57:23.111 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.530+0000 7fc7877fe700 1 --2- 172.21.15.123:0/4222022640 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7881071b0 0x7fc78819a480 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc778009130 tx=0x7fc778011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:23.111 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.530+0000 7fc784ff9700 1 -- 172.21.15.123:0/4222022640 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc7780038b0 con 0x7fc7881071b0 2024-06-02T03:57:23.111 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.530+0000 7fc784ff9700 1 -- 172.21.15.123:0/4222022640 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc778003a10 con 0x7fc7881071b0 2024-06-02T03:57:23.111 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.530+0000 7fc78df8a700 1 -- 172.21.15.123:0/4222022640 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc78819abc0 con 0x7fc7881071b0 2024-06-02T03:57:23.111 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.530+0000 7fc784ff9700 1 -- 172.21.15.123:0/4222022640 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc778019550 con 0x7fc7881071b0 2024-06-02T03:57:23.111 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.530+0000 7fc78df8a700 1 -- 172.21.15.123:0/4222022640 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc78819b060 con 0x7fc7881071b0 2024-06-02T03:57:23.111 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.531+0000 7fc784ff9700 1 -- 172.21.15.123:0/4222022640 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fc778019b30 con 0x7fc7881071b0 2024-06-02T03:57:23.111 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.531+0000 7fc784ff9700 1 -- 172.21.15.123:0/4222022640 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc77802de30 con 0x7fc7881071b0 2024-06-02T03:57:23.111 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.531+0000 7fc78df8a700 1 -- 172.21.15.123:0/4222022640 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc78810a880 con 0x7fc7881071b0 2024-06-02T03:57:23.112 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.534+0000 7fc784ff9700 1 -- 172.21.15.123:0/4222022640 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fc778003b80 con 0x7fc7881071b0 2024-06-02T03:57:23.112 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.600+0000 7fc78df8a700 1 -- 172.21.15.123:0/4222022640 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fc78810aa70 con 0x7fc7881071b0 2024-06-02T03:57:23.112 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.603+0000 7fc784ff9700 1 -- 172.21.15.123:0/4222022640 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc77801a960 con 0x7fc7881071b0 2024-06-02T03:57:23.112 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.604+0000 7fc78df8a700 1 -- 172.21.15.123:0/4222022640 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7881071b0 msgr2=0x7fc78819a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:23.112 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.604+0000 7fc78df8a700 1 --2- 172.21.15.123:0/4222022640 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7881071b0 0x7fc78819a480 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc778009130 tx=0x7fc778011ad0 comp rx=0 tx=0).stop 2024-06-02T03:57:23.112 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.604+0000 7fc78df8a700 1 -- 172.21.15.123:0/4222022640 shutdown_connections 2024-06-02T03:57:23.112 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.604+0000 7fc78df8a700 1 --2- 172.21.15.123:0/4222022640 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc7881071b0 0x7fc78819a480 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:23.112 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.604+0000 7fc78df8a700 1 -- 172.21.15.123:0/4222022640 >> 172.21.15.123:0/4222022640 conn(0x7fc788100bc0 msgr2=0x7fc788101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:23.112 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.604+0000 7fc78df8a700 1 -- 172.21.15.123:0/4222022640 shutdown_connections 2024-06-02T03:57:23.112 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:21.604+0000 7fc78df8a700 1 -- 172.21.15.123:0/4222022640 wait complete. 2024-06-02T03:57:23.113 INFO:teuthology.orchestra.run.smithi123.stdout:Wrote config to /etc/ceph/ceph.conf 2024-06-02T03:57:23.304 INFO:teuthology.orchestra.run.smithi123.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-06-02T03:57:23.304 INFO:teuthology.orchestra.run.smithi123.stdout:Creating mgr... 2024-06-02T03:57:23.305 INFO:teuthology.orchestra.run.smithi123.stdout:Verifying port 0.0.0.0:9283 ... 2024-06-02T03:57:23.305 INFO:teuthology.orchestra.run.smithi123.stdout:Verifying port 0.0.0.0:8765 ... 2024-06-02T03:57:24.006 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mgr.x 2024-06-02T03:57:24.007 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Failed to reset failed state of unit ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mgr.x.service: Unit ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mgr.x.service not loaded. 2024-06-02T03:57:24.096 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-1b432ae0-2094-11ef-bc9b-c7b262605968.target.wants/ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@.service. 2024-06-02T03:57:24.311 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:24 smithi123 systemd[1]: Starting Ceph mgr.x for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T03:57:24.534 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-02T03:57:24.534 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout disabled 2024-06-02T03:57:24.542 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-02T03:57:24.543 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout inactive 2024-06-02T03:57:24.543 INFO:teuthology.orchestra.run.smithi123.stdout:firewalld.service is not enabled 2024-06-02T03:57:24.543 INFO:teuthology.orchestra.run.smithi123.stdout:Not possible to enable service . firewalld.service is not available 2024-06-02T03:57:24.553 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-02T03:57:24.553 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout disabled 2024-06-02T03:57:24.561 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-02T03:57:24.561 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout inactive 2024-06-02T03:57:24.561 INFO:teuthology.orchestra.run.smithi123.stdout:firewalld.service is not enabled 2024-06-02T03:57:24.562 INFO:teuthology.orchestra.run.smithi123.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-06-02T03:57:24.562 INFO:teuthology.orchestra.run.smithi123.stdout:Waiting for mgr to start... 2024-06-02T03:57:24.562 INFO:teuthology.orchestra.run.smithi123.stdout:Waiting for mgr... 2024-06-02T03:57:24.572 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:24 smithi123 bash[43119]: b057390367f3d3a43a681320ab9d4962faf2148ffd11d5de6f83fba233aa055b 2024-06-02T03:57:24.572 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:24 smithi123 systemd[1]: Started Ceph mgr.x for 1b432ae0-2094-11ef-bc9b-c7b262605968. 2024-06-02T03:57:25.222 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:25 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2016384827' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-02T03:57:25.222 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:24 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:24.942+0000 7f4290300200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-02T03:57:25.222 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:25 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:25.044+0000 7f4290300200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-02T03:57:25.222 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:25 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:25.135+0000 7f4290300200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-02T03:57:25.414 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-06-02T03:57:25.414 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout { 2024-06-02T03:57:25.414 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "fsid": "1b432ae0-2094-11ef-bc9b-c7b262605968", 2024-06-02T03:57:25.414 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "health": { 2024-06-02T03:57:25.414 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-02T03:57:25.414 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-02T03:57:25.414 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-02T03:57:25.414 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-06-02T03:57:25.414 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-02T03:57:25.414 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-02T03:57:25.415 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 0 2024-06-02T03:57:25.415 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-06-02T03:57:25.415 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-02T03:57:25.415 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "a" 2024-06-02T03:57:25.415 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-06-02T03:57:25.415 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum_age": 4, 2024-06-02T03:57:25.415 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-02T03:57:25.415 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T03:57:25.415 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-06-02T03:57:25.415 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-02T03:57:25.415 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-06-02T03:57:25.415 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-02T03:57:25.415 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T03:57:25.415 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-02T03:57:25.416 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-02T03:57:25.416 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-02T03:57:25.416 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-02T03:57:25.416 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-02T03:57:25.416 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-02T03:57:25.416 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-06-02T03:57:25.416 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-02T03:57:25.416 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-02T03:57:25.416 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-02T03:57:25.416 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-02T03:57:25.416 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-02T03:57:25.416 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-02T03:57:25.416 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-02T03:57:25.416 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-02T03:57:25.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-02T03:57:25.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-06-02T03:57:25.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-02T03:57:25.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T03:57:25.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-02T03:57:25.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-02T03:57:25.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-06-02T03:57:25.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-02T03:57:25.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "available": false, 2024-06-02T03:57:25.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-02T03:57:25.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-02T03:57:25.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-02T03:57:25.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-02T03:57:25.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "restful" 2024-06-02T03:57:25.418 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-06-02T03:57:25.418 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T03:57:25.418 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-06-02T03:57:25.418 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-02T03:57:25.418 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T03:57:25.418 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "modified": "2024-06-02T03:57:17.384407+0000", 2024-06-02T03:57:25.418 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T03:57:25.418 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-06-02T03:57:25.418 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-02T03:57:25.418 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout } 2024-06-02T03:57:25.418 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.944+0000 7fc5807bc700 1 Processor -- start 2024-06-02T03:57:25.418 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.944+0000 7fc5807bc700 1 -- start start 2024-06-02T03:57:25.418 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.944+0000 7fc5807bc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc578104f30 0x7fc578107360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:25.419 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.944+0000 7fc5807bc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc578079e90 con 0x7fc578104f30 2024-06-02T03:57:25.419 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.945+0000 7fc57e558700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc578104f30 0x7fc578107360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:25.419 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.945+0000 7fc57e558700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc578104f30 0x7fc578107360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56866/0 (socket says 172.21.15.123:56866) 2024-06-02T03:57:25.419 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.945+0000 7fc57e558700 1 -- 172.21.15.123:0/1534372833 learned_addr learned my addr 172.21.15.123:0/1534372833 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:25.419 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.945+0000 7fc57e558700 1 -- 172.21.15.123:0/1534372833 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5781078a0 con 0x7fc578104f30 2024-06-02T03:57:25.419 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.945+0000 7fc57e558700 1 --2- 172.21.15.123:0/1534372833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc578104f30 0x7fc578107360 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc5740098a0 tx=0x7fc574009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b636f7f4ccdddb2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:25.419 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.945+0000 7fc57d556700 1 -- 172.21.15.123:0/1534372833 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc574004160 con 0x7fc578104f30 2024-06-02T03:57:25.419 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.945+0000 7fc57d556700 1 -- 172.21.15.123:0/1534372833 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc5740042c0 con 0x7fc578104f30 2024-06-02T03:57:25.419 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.945+0000 7fc57d556700 1 -- 172.21.15.123:0/1534372833 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc574011a00 con 0x7fc578104f30 2024-06-02T03:57:25.419 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.946+0000 7fc5807bc700 1 -- 172.21.15.123:0/1534372833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc578104f30 msgr2=0x7fc578107360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:25.419 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.946+0000 7fc5807bc700 1 --2- 172.21.15.123:0/1534372833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc578104f30 0x7fc578107360 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc5740098a0 tx=0x7fc574009bb0 comp rx=0 tx=0).stop 2024-06-02T03:57:25.419 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.946+0000 7fc5807bc700 1 -- 172.21.15.123:0/1534372833 shutdown_connections 2024-06-02T03:57:25.419 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.946+0000 7fc5807bc700 1 --2- 172.21.15.123:0/1534372833 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc578104f30 0x7fc578107360 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:25.419 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.946+0000 7fc5807bc700 1 -- 172.21.15.123:0/1534372833 >> 172.21.15.123:0/1534372833 conn(0x7fc578100b90 msgr2=0x7fc578102fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:25.420 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.946+0000 7fc5807bc700 1 -- 172.21.15.123:0/1534372833 shutdown_connections 2024-06-02T03:57:25.420 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.946+0000 7fc5807bc700 1 -- 172.21.15.123:0/1534372833 wait complete. 2024-06-02T03:57:25.420 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.947+0000 7fc5807bc700 1 Processor -- start 2024-06-02T03:57:25.420 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.947+0000 7fc5807bc700 1 -- start start 2024-06-02T03:57:25.420 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.947+0000 7fc5807bc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc578104f30 0x7fc5781a09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:25.420 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.947+0000 7fc5807bc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5781a0f30 con 0x7fc578104f30 2024-06-02T03:57:25.420 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.947+0000 7fc57e558700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc578104f30 0x7fc5781a09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:25.420 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.947+0000 7fc57e558700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc578104f30 0x7fc5781a09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56880/0 (socket says 172.21.15.123:56880) 2024-06-02T03:57:25.420 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.947+0000 7fc57e558700 1 -- 172.21.15.123:0/2016384827 learned_addr learned my addr 172.21.15.123:0/2016384827 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:25.420 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.947+0000 7fc57e558700 1 -- 172.21.15.123:0/2016384827 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc574009550 con 0x7fc578104f30 2024-06-02T03:57:25.420 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.947+0000 7fc57e558700 1 --2- 172.21.15.123:0/2016384827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc578104f30 0x7fc5781a09f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc574009fb0 tx=0x7fc574011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:25.420 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.948+0000 7fc56f7fe700 1 -- 172.21.15.123:0/2016384827 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc574003a40 con 0x7fc578104f30 2024-06-02T03:57:25.420 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.948+0000 7fc5807bc700 1 -- 172.21.15.123:0/2016384827 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5781a1130 con 0x7fc578104f30 2024-06-02T03:57:25.421 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.948+0000 7fc56f7fe700 1 -- 172.21.15.123:0/2016384827 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc574003ba0 con 0x7fc578104f30 2024-06-02T03:57:25.421 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.948+0000 7fc56f7fe700 1 -- 172.21.15.123:0/2016384827 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc57401a750 con 0x7fc578104f30 2024-06-02T03:57:25.421 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.948+0000 7fc5807bc700 1 -- 172.21.15.123:0/2016384827 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5781a15d0 con 0x7fc578104f30 2024-06-02T03:57:25.421 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.948+0000 7fc56f7fe700 1 -- 172.21.15.123:0/2016384827 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fc57401acd0 con 0x7fc578104f30 2024-06-02T03:57:25.421 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.948+0000 7fc56f7fe700 1 -- 172.21.15.123:0/2016384827 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc5740193c0 con 0x7fc578104f30 2024-06-02T03:57:25.421 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.949+0000 7fc5807bc700 1 -- 172.21.15.123:0/2016384827 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc57819a210 con 0x7fc578104f30 2024-06-02T03:57:25.421 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:24.952+0000 7fc56f7fe700 1 -- 172.21.15.123:0/2016384827 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fc574024b60 con 0x7fc578104f30 2024-06-02T03:57:25.421 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:25.024+0000 7fc5807bc700 1 -- 172.21.15.123:0/2016384827 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fc5781089c0 con 0x7fc578104f30 2024-06-02T03:57:25.421 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:25.025+0000 7fc56f7fe700 1 -- 172.21.15.123:0/2016384827 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7fc574024430 con 0x7fc578104f30 2024-06-02T03:57:25.421 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:25.026+0000 7fc5807bc700 1 -- 172.21.15.123:0/2016384827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc578104f30 msgr2=0x7fc5781a09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:25.421 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:25.026+0000 7fc5807bc700 1 --2- 172.21.15.123:0/2016384827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc578104f30 0x7fc5781a09f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc574009fb0 tx=0x7fc574011ad0 comp rx=0 tx=0).stop 2024-06-02T03:57:25.421 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:25.026+0000 7fc5807bc700 1 -- 172.21.15.123:0/2016384827 shutdown_connections 2024-06-02T03:57:25.421 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:25.026+0000 7fc5807bc700 1 --2- 172.21.15.123:0/2016384827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc578104f30 0x7fc5781a09f0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:25.422 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:25.026+0000 7fc5807bc700 1 -- 172.21.15.123:0/2016384827 >> 172.21.15.123:0/2016384827 conn(0x7fc578100b90 msgr2=0x7fc578102f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:25.422 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:25.026+0000 7fc5807bc700 1 -- 172.21.15.123:0/2016384827 shutdown_connections 2024-06-02T03:57:25.422 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:25.026+0000 7fc5807bc700 1 -- 172.21.15.123:0/2016384827 wait complete. 2024-06-02T03:57:25.422 INFO:teuthology.orchestra.run.smithi123.stdout:mgr not available, waiting (1/15)... 2024-06-02T03:57:25.572 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:25 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:25.221+0000 7f4290300200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-02T03:57:26.189 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:25 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:25.859+0000 7f4290300200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-02T03:57:26.189 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:26 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:26.105+0000 7f4290300200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-02T03:57:26.454 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:26 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:26.189+0000 7f4290300200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-02T03:57:26.454 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:26 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:26.298+0000 7f4290300200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-02T03:57:26.822 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:26 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:26.454+0000 7f4290300200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-02T03:57:26.822 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:26 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:26.579+0000 7f4290300200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-02T03:57:26.822 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:26 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:26.663+0000 7f4290300200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-02T03:57:27.322 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:27 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:27.029+0000 7f4290300200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-02T03:57:27.713 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:27 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:27.412+0000 7f4290300200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-02T03:57:27.713 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:27 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:27.618+0000 7f4290300200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-02T03:57:28.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:27 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/685051499' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-02T03:57:28.072 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:27 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:27.713+0000 7f4290300200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-02T03:57:28.297 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-06-02T03:57:28.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout { 2024-06-02T03:57:28.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "fsid": "1b432ae0-2094-11ef-bc9b-c7b262605968", 2024-06-02T03:57:28.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "health": { 2024-06-02T03:57:28.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-02T03:57:28.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-02T03:57:28.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-02T03:57:28.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-06-02T03:57:28.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-02T03:57:28.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-02T03:57:28.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 0 2024-06-02T03:57:28.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-06-02T03:57:28.298 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-02T03:57:28.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "a" 2024-06-02T03:57:28.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-06-02T03:57:28.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-06-02T03:57:28.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-02T03:57:28.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T03:57:28.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-06-02T03:57:28.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-02T03:57:28.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-06-02T03:57:28.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-02T03:57:28.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T03:57:28.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-02T03:57:28.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-02T03:57:28.299 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-02T03:57:28.307 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-02T03:57:28.307 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-02T03:57:28.307 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-02T03:57:28.307 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-06-02T03:57:28.307 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-02T03:57:28.307 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-02T03:57:28.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-02T03:57:28.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-02T03:57:28.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-02T03:57:28.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-02T03:57:28.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-02T03:57:28.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-02T03:57:28.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-02T03:57:28.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-06-02T03:57:28.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-02T03:57:28.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T03:57:28.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-02T03:57:28.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-02T03:57:28.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-06-02T03:57:28.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-02T03:57:28.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "available": false, 2024-06-02T03:57:28.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-02T03:57:28.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-02T03:57:28.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-02T03:57:28.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-02T03:57:28.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "restful" 2024-06-02T03:57:28.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-06-02T03:57:28.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T03:57:28.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-06-02T03:57:28.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-02T03:57:28.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T03:57:28.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "modified": "2024-06-02T03:57:17.384407+0000", 2024-06-02T03:57:28.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T03:57:28.309 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-06-02T03:57:28.310 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-02T03:57:28.310 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout } 2024-06-02T03:57:28.310 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.820+0000 7ff1015e5700 1 Processor -- start 2024-06-02T03:57:28.310 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.820+0000 7ff1015e5700 1 -- start start 2024-06-02T03:57:28.310 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.820+0000 7ff1015e5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0fc107180 0x7ff0fc109570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:28.310 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.820+0000 7ff1015e5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc079e50 con 0x7ff0fc107180 2024-06-02T03:57:28.310 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.820+0000 7ff0faffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0fc107180 0x7ff0fc109570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:28.310 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.820+0000 7ff0faffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0fc107180 0x7ff0fc109570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56896/0 (socket says 172.21.15.123:56896) 2024-06-02T03:57:28.310 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.820+0000 7ff0faffd700 1 -- 172.21.15.123:0/3492592387 learned_addr learned my addr 172.21.15.123:0/3492592387 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:28.310 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.821+0000 7ff0faffd700 1 -- 172.21.15.123:0/3492592387 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0fc109ab0 con 0x7ff0fc107180 2024-06-02T03:57:28.310 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.821+0000 7ff0faffd700 1 --2- 172.21.15.123:0/3492592387 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0fc107180 0x7ff0fc109570 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec0098a0 tx=0x7ff0ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d04a6ff74cd36a30 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:28.310 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.821+0000 7ff0f9ffb700 1 -- 172.21.15.123:0/3492592387 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff0ec004160 con 0x7ff0fc107180 2024-06-02T03:57:28.310 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.821+0000 7ff0f9ffb700 1 -- 172.21.15.123:0/3492592387 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff0ec0042c0 con 0x7ff0fc107180 2024-06-02T03:57:28.311 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.821+0000 7ff0f9ffb700 1 -- 172.21.15.123:0/3492592387 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff0ec011a00 con 0x7ff0fc107180 2024-06-02T03:57:28.311 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.822+0000 7ff1015e5700 1 -- 172.21.15.123:0/3492592387 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0fc107180 msgr2=0x7ff0fc109570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:28.311 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.822+0000 7ff1015e5700 1 --2- 172.21.15.123:0/3492592387 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0fc107180 0x7ff0fc109570 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec0098a0 tx=0x7ff0ec009bb0 comp rx=0 tx=0).stop 2024-06-02T03:57:28.311 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.822+0000 7ff1015e5700 1 -- 172.21.15.123:0/3492592387 shutdown_connections 2024-06-02T03:57:28.311 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.822+0000 7ff1015e5700 1 --2- 172.21.15.123:0/3492592387 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0fc107180 0x7ff0fc109570 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:28.311 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.822+0000 7ff1015e5700 1 -- 172.21.15.123:0/3492592387 >> 172.21.15.123:0/3492592387 conn(0x7ff0fc100bb0 msgr2=0x7ff0fc102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:28.311 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.822+0000 7ff1015e5700 1 -- 172.21.15.123:0/3492592387 shutdown_connections 2024-06-02T03:57:28.311 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.822+0000 7ff1015e5700 1 -- 172.21.15.123:0/3492592387 wait complete. 2024-06-02T03:57:28.311 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.822+0000 7ff1015e5700 1 Processor -- start 2024-06-02T03:57:28.311 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.823+0000 7ff1015e5700 1 -- start start 2024-06-02T03:57:28.311 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.823+0000 7ff1015e5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0fc107180 0x7ff0fc106960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:28.312 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.823+0000 7ff1015e5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc106ea0 con 0x7ff0fc107180 2024-06-02T03:57:28.312 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.823+0000 7ff0faffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0fc107180 0x7ff0fc106960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:28.312 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.823+0000 7ff0faffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0fc107180 0x7ff0fc106960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56906/0 (socket says 172.21.15.123:56906) 2024-06-02T03:57:28.312 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.823+0000 7ff0faffd700 1 -- 172.21.15.123:0/685051499 learned_addr learned my addr 172.21.15.123:0/685051499 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:28.312 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.823+0000 7ff0faffd700 1 -- 172.21.15.123:0/685051499 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ec009550 con 0x7ff0fc107180 2024-06-02T03:57:28.312 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.823+0000 7ff0faffd700 1 --2- 172.21.15.123:0/685051499 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0fc107180 0x7ff0fc106960 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec009fb0 tx=0x7ff0ec011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:28.312 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.823+0000 7ff0e3fff700 1 -- 172.21.15.123:0/685051499 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff0ec003a40 con 0x7ff0fc107180 2024-06-02T03:57:28.312 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.823+0000 7ff0e3fff700 1 -- 172.21.15.123:0/685051499 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff0ec003ba0 con 0x7ff0fc107180 2024-06-02T03:57:28.312 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.823+0000 7ff0e3fff700 1 -- 172.21.15.123:0/685051499 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff0ec01a750 con 0x7ff0fc107180 2024-06-02T03:57:28.312 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.823+0000 7ff1015e5700 1 -- 172.21.15.123:0/685051499 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0fc105130 con 0x7ff0fc107180 2024-06-02T03:57:28.312 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.824+0000 7ff1015e5700 1 -- 172.21.15.123:0/685051499 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0fc1055d0 con 0x7ff0fc107180 2024-06-02T03:57:28.312 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.824+0000 7ff0e3fff700 1 -- 172.21.15.123:0/685051499 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7ff0ec01acd0 con 0x7ff0fc107180 2024-06-02T03:57:28.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.824+0000 7ff0e3fff700 1 -- 172.21.15.123:0/685051499 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff0ec0193c0 con 0x7ff0fc107180 2024-06-02T03:57:28.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.825+0000 7ff1015e5700 1 -- 172.21.15.123:0/685051499 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0fc0625d0 con 0x7ff0fc107180 2024-06-02T03:57:28.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.827+0000 7ff0e3fff700 1 -- 172.21.15.123:0/685051499 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7ff0ec02de40 con 0x7ff0fc107180 2024-06-02T03:57:28.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.899+0000 7ff1015e5700 1 -- 172.21.15.123:0/685051499 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7ff0fc10a950 con 0x7ff0fc107180 2024-06-02T03:57:28.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.900+0000 7ff0e3fff700 1 -- 172.21.15.123:0/685051499 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7ff0ec024c10 con 0x7ff0fc107180 2024-06-02T03:57:28.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.901+0000 7ff1015e5700 1 -- 172.21.15.123:0/685051499 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0fc107180 msgr2=0x7ff0fc106960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:28.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.901+0000 7ff1015e5700 1 --2- 172.21.15.123:0/685051499 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0fc107180 0x7ff0fc106960 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec009fb0 tx=0x7ff0ec011ad0 comp rx=0 tx=0).stop 2024-06-02T03:57:28.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.901+0000 7ff1015e5700 1 -- 172.21.15.123:0/685051499 shutdown_connections 2024-06-02T03:57:28.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.901+0000 7ff1015e5700 1 --2- 172.21.15.123:0/685051499 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0fc107180 0x7ff0fc106960 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:28.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.901+0000 7ff1015e5700 1 -- 172.21.15.123:0/685051499 >> 172.21.15.123:0/685051499 conn(0x7ff0fc100bb0 msgr2=0x7ff0fc101760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:28.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.901+0000 7ff1015e5700 1 -- 172.21.15.123:0/685051499 shutdown_connections 2024-06-02T03:57:28.313 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:27.901+0000 7ff1015e5700 1 -- 172.21.15.123:0/685051499 wait complete. 2024-06-02T03:57:28.313 INFO:teuthology.orchestra.run.smithi123.stdout:mgr not available, waiting (2/15)... 2024-06-02T03:57:28.822 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:28 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:28.496+0000 7f4290300200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-02T03:57:28.822 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:28 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:28.592+0000 7f4290300200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-02T03:57:28.822 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:28 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:28.738+0000 7f4290300200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-02T03:57:29.725 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:29 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:29.356+0000 7f4290300200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-02T03:57:29.725 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:29 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:29.533+0000 7f4290300200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-02T03:57:30.072 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:29 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:29.725+0000 7f4290300200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-02T03:57:30.789 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:30 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:30.664+0000 7f4290300200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-02T03:57:31.047 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:30 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/3025578639' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-02T03:57:31.048 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:30 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:30.958+0000 7f4290300200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-02T03:57:31.150 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-06-02T03:57:31.150 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout { 2024-06-02T03:57:31.151 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "fsid": "1b432ae0-2094-11ef-bc9b-c7b262605968", 2024-06-02T03:57:31.151 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "health": { 2024-06-02T03:57:31.151 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-02T03:57:31.151 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-02T03:57:31.151 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-02T03:57:31.151 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-06-02T03:57:31.151 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-02T03:57:31.151 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-02T03:57:31.151 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 0 2024-06-02T03:57:31.151 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-06-02T03:57:31.151 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-02T03:57:31.151 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "a" 2024-06-02T03:57:31.151 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-06-02T03:57:31.152 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-06-02T03:57:31.152 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-02T03:57:31.152 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T03:57:31.152 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-06-02T03:57:31.152 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-02T03:57:31.152 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-06-02T03:57:31.152 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-02T03:57:31.152 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T03:57:31.152 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-02T03:57:31.152 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-02T03:57:31.153 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-02T03:57:31.153 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-02T03:57:31.153 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-02T03:57:31.153 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-02T03:57:31.153 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-06-02T03:57:31.153 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-02T03:57:31.153 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-02T03:57:31.153 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-02T03:57:31.153 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-02T03:57:31.153 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-02T03:57:31.153 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-02T03:57:31.153 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-02T03:57:31.154 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-02T03:57:31.154 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-02T03:57:31.154 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-06-02T03:57:31.154 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-02T03:57:31.154 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T03:57:31.154 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-02T03:57:31.154 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-02T03:57:31.154 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-06-02T03:57:31.154 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-02T03:57:31.155 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "available": false, 2024-06-02T03:57:31.155 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-02T03:57:31.155 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-02T03:57:31.155 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-02T03:57:31.155 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-02T03:57:31.155 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "restful" 2024-06-02T03:57:31.155 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-06-02T03:57:31.155 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T03:57:31.155 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-06-02T03:57:31.155 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-02T03:57:31.155 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T03:57:31.155 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "modified": "2024-06-02T03:57:17.384407+0000", 2024-06-02T03:57:31.155 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T03:57:31.156 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-06-02T03:57:31.156 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-02T03:57:31.156 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout } 2024-06-02T03:57:31.156 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.676+0000 7f7a8534e700 1 Processor -- start 2024-06-02T03:57:31.156 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.677+0000 7f7a8534e700 1 -- start start 2024-06-02T03:57:31.156 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.677+0000 7f7a8534e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a80107160 0x7f7a80109550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:31.156 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.677+0000 7f7a8534e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a80079e70 con 0x7f7a80107160 2024-06-02T03:57:31.156 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.677+0000 7f7a7effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a80107160 0x7f7a80109550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:31.156 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.677+0000 7f7a7effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a80107160 0x7f7a80109550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56908/0 (socket says 172.21.15.123:56908) 2024-06-02T03:57:31.156 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.677+0000 7f7a7effd700 1 -- 172.21.15.123:0/4208987084 learned_addr learned my addr 172.21.15.123:0/4208987084 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:31.156 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.677+0000 7f7a7effd700 1 -- 172.21.15.123:0/4208987084 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a80109a90 con 0x7f7a80107160 2024-06-02T03:57:31.156 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.677+0000 7f7a7effd700 1 --2- 172.21.15.123:0/4208987084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a80107160 0x7f7a80109550 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7a700098a0 tx=0x7f7a70009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc31aaead0d57dc1 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:31.157 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.677+0000 7f7a7dffb700 1 -- 172.21.15.123:0/4208987084 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a70004160 con 0x7f7a80107160 2024-06-02T03:57:31.157 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.678+0000 7f7a7dffb700 1 -- 172.21.15.123:0/4208987084 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7a700042c0 con 0x7f7a80107160 2024-06-02T03:57:31.157 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.678+0000 7f7a7dffb700 1 -- 172.21.15.123:0/4208987084 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a70011a00 con 0x7f7a80107160 2024-06-02T03:57:31.157 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.678+0000 7f7a8534e700 1 -- 172.21.15.123:0/4208987084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a80107160 msgr2=0x7f7a80109550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:31.157 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.678+0000 7f7a8534e700 1 --2- 172.21.15.123:0/4208987084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a80107160 0x7f7a80109550 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7a700098a0 tx=0x7f7a70009bb0 comp rx=0 tx=0).stop 2024-06-02T03:57:31.157 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.678+0000 7f7a8534e700 1 -- 172.21.15.123:0/4208987084 shutdown_connections 2024-06-02T03:57:31.157 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.678+0000 7f7a8534e700 1 --2- 172.21.15.123:0/4208987084 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a80107160 0x7f7a80109550 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:31.157 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.678+0000 7f7a8534e700 1 -- 172.21.15.123:0/4208987084 >> 172.21.15.123:0/4208987084 conn(0x7f7a80100b90 msgr2=0x7f7a80102fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:31.157 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.678+0000 7f7a8534e700 1 -- 172.21.15.123:0/4208987084 shutdown_connections 2024-06-02T03:57:31.157 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.678+0000 7f7a8534e700 1 -- 172.21.15.123:0/4208987084 wait complete. 2024-06-02T03:57:31.157 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.679+0000 7f7a8534e700 1 Processor -- start 2024-06-02T03:57:31.157 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.679+0000 7f7a8534e700 1 -- start start 2024-06-02T03:57:31.157 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.679+0000 7f7a8534e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a80107160 0x7f7a80106940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:31.157 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.679+0000 7f7a8534e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a80106e80 con 0x7f7a80107160 2024-06-02T03:57:31.158 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.679+0000 7f7a7effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a80107160 0x7f7a80106940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:31.158 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.679+0000 7f7a7effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a80107160 0x7f7a80106940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56922/0 (socket says 172.21.15.123:56922) 2024-06-02T03:57:31.158 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.679+0000 7f7a7effd700 1 -- 172.21.15.123:0/3025578639 learned_addr learned my addr 172.21.15.123:0/3025578639 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:31.158 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.680+0000 7f7a7effd700 1 -- 172.21.15.123:0/3025578639 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a70009550 con 0x7f7a80107160 2024-06-02T03:57:31.158 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.680+0000 7f7a7effd700 1 --2- 172.21.15.123:0/3025578639 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a80107160 0x7f7a80106940 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7a70009130 tx=0x7f7a70011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:31.158 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.680+0000 7f7a67fff700 1 -- 172.21.15.123:0/3025578639 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a70003b70 con 0x7f7a80107160 2024-06-02T03:57:31.158 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.680+0000 7f7a67fff700 1 -- 172.21.15.123:0/3025578639 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7a70003cd0 con 0x7f7a80107160 2024-06-02T03:57:31.158 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.680+0000 7f7a8534e700 1 -- 172.21.15.123:0/3025578639 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a80105110 con 0x7f7a80107160 2024-06-02T03:57:31.159 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.680+0000 7f7a67fff700 1 -- 172.21.15.123:0/3025578639 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a700197d0 con 0x7f7a80107160 2024-06-02T03:57:31.159 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.680+0000 7f7a8534e700 1 -- 172.21.15.123:0/3025578639 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a801055b0 con 0x7f7a80107160 2024-06-02T03:57:31.159 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.680+0000 7f7a67fff700 1 -- 172.21.15.123:0/3025578639 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f7a700199c0 con 0x7f7a80107160 2024-06-02T03:57:31.159 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.680+0000 7f7a67fff700 1 -- 172.21.15.123:0/3025578639 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7a7000b720 con 0x7f7a80107160 2024-06-02T03:57:31.159 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.681+0000 7f7a65ffb700 1 -- 172.21.15.123:0/3025578639 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a600052f0 con 0x7f7a80107160 2024-06-02T03:57:31.159 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.685+0000 7f7a67fff700 1 -- 172.21.15.123:0/3025578639 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f7a7002a060 con 0x7f7a80107160 2024-06-02T03:57:31.159 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.757+0000 7f7a65ffb700 1 -- 172.21.15.123:0/3025578639 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f7a60005870 con 0x7f7a80107160 2024-06-02T03:57:31.159 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.758+0000 7f7a67fff700 1 -- 172.21.15.123:0/3025578639 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f7a70019e00 con 0x7f7a80107160 2024-06-02T03:57:31.159 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.759+0000 7f7a65ffb700 1 -- 172.21.15.123:0/3025578639 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a80107160 msgr2=0x7f7a80106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:31.159 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.759+0000 7f7a65ffb700 1 --2- 172.21.15.123:0/3025578639 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a80107160 0x7f7a80106940 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7a70009130 tx=0x7f7a70011ad0 comp rx=0 tx=0).stop 2024-06-02T03:57:31.159 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.759+0000 7f7a65ffb700 1 -- 172.21.15.123:0/3025578639 shutdown_connections 2024-06-02T03:57:31.159 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.759+0000 7f7a65ffb700 1 --2- 172.21.15.123:0/3025578639 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7a80107160 0x7f7a80106940 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:31.159 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.759+0000 7f7a65ffb700 1 -- 172.21.15.123:0/3025578639 >> 172.21.15.123:0/3025578639 conn(0x7f7a80100b90 msgr2=0x7f7a80101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:31.160 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.759+0000 7f7a65ffb700 1 -- 172.21.15.123:0/3025578639 shutdown_connections 2024-06-02T03:57:31.160 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:30.759+0000 7f7a65ffb700 1 -- 172.21.15.123:0/3025578639 wait complete. 2024-06-02T03:57:31.160 INFO:teuthology.orchestra.run.smithi123.stdout:mgr not available, waiting (3/15)... 2024-06-02T03:57:31.322 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:31 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:31.047+0000 7f4290300200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-02T03:57:31.323 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:31 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:31.241+0000 7f4290300200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-02T03:57:32.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:31 smithi123 ceph-mon[42885]: Activating manager daemon x 2024-06-02T03:57:32.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:31 smithi123 ceph-mon[42885]: mgrmap e2: x(active, starting, since 0.00311205s) 2024-06-02T03:57:32.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:31 smithi123 ceph-mon[42885]: from='mgr.14100 172.21.15.123:0/4234739819' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-02T03:57:32.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:31 smithi123 ceph-mon[42885]: from='mgr.14100 172.21.15.123:0/4234739819' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-02T03:57:32.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:31 smithi123 ceph-mon[42885]: from='mgr.14100 172.21.15.123:0/4234739819' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-02T03:57:32.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:31 smithi123 ceph-mon[42885]: from='mgr.14100 172.21.15.123:0/4234739819' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T03:57:32.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:31 smithi123 ceph-mon[42885]: from='mgr.14100 172.21.15.123:0/4234739819' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-02T03:57:32.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:31 smithi123 ceph-mon[42885]: Manager daemon x is now available 2024-06-02T03:57:32.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:31 smithi123 ceph-mon[42885]: from='mgr.14100 172.21.15.123:0/4234739819' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-02T03:57:32.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:31 smithi123 ceph-mon[42885]: from='mgr.14100 172.21.15.123:0/4234739819' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-02T03:57:32.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:31 smithi123 ceph-mon[42885]: from='mgr.14100 172.21.15.123:0/4234739819' entity='mgr.x' 2024-06-02T03:57:32.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:31 smithi123 ceph-mon[42885]: from='mgr.14100 172.21.15.123:0/4234739819' entity='mgr.x' 2024-06-02T03:57:32.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:31 smithi123 ceph-mon[42885]: from='mgr.14100 172.21.15.123:0/4234739819' entity='mgr.x' 2024-06-02T03:57:33.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:33 smithi123 ceph-mon[42885]: mgrmap e3: x(active, since 1.00685s) 2024-06-02T03:57:34.416 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-06-02T03:57:34.416 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout { 2024-06-02T03:57:34.416 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "fsid": "1b432ae0-2094-11ef-bc9b-c7b262605968", 2024-06-02T03:57:34.416 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "health": { 2024-06-02T03:57:34.416 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-06-02T03:57:34.416 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-06-02T03:57:34.416 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-06-02T03:57:34.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-06-02T03:57:34.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-06-02T03:57:34.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-06-02T03:57:34.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 0 2024-06-02T03:57:34.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-06-02T03:57:34.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-06-02T03:57:34.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "a" 2024-06-02T03:57:34.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-06-02T03:57:34.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-06-02T03:57:34.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "monmap": { 2024-06-02T03:57:34.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T03:57:34.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-06-02T03:57:34.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-06-02T03:57:34.418 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-06-02T03:57:34.418 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-06-02T03:57:34.418 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T03:57:34.418 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-06-02T03:57:34.418 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-06-02T03:57:34.418 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-06-02T03:57:34.418 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-06-02T03:57:34.418 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-06-02T03:57:34.418 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-06-02T03:57:34.418 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-06-02T03:57:34.419 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-06-02T03:57:34.419 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-06-02T03:57:34.419 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-06-02T03:57:34.419 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-06-02T03:57:34.419 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-06-02T03:57:34.419 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-06-02T03:57:34.419 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-06-02T03:57:34.419 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-06-02T03:57:34.419 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-06-02T03:57:34.419 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-06-02T03:57:34.419 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-06-02T03:57:34.419 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T03:57:34.419 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-06-02T03:57:34.420 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-06-02T03:57:34.420 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-06-02T03:57:34.420 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-06-02T03:57:34.420 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "available": true, 2024-06-02T03:57:34.420 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-06-02T03:57:34.420 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "modules": [ 2024-06-02T03:57:34.420 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "iostat", 2024-06-02T03:57:34.420 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "nfs", 2024-06-02T03:57:34.420 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "restful" 2024-06-02T03:57:34.420 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ], 2024-06-02T03:57:34.420 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T03:57:34.420 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-06-02T03:57:34.420 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-06-02T03:57:34.421 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-06-02T03:57:34.421 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "modified": "2024-06-02T03:57:17.384407+0000", 2024-06-02T03:57:34.421 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "services": {} 2024-06-02T03:57:34.421 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout }, 2024-06-02T03:57:34.421 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-06-02T03:57:34.421 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout } 2024-06-02T03:57:34.421 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.491+0000 7f885ef10700 1 Processor -- start 2024-06-02T03:57:34.421 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.491+0000 7f885ef10700 1 -- start start 2024-06-02T03:57:34.421 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.491+0000 7f885ef10700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8858106710 0x7f8858106b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:34.421 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.491+0000 7f885ef10700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8858107100 con 0x7f8858106710 2024-06-02T03:57:34.421 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.491+0000 7f885ccac700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8858106710 0x7f8858106b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:34.421 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.491+0000 7f885ccac700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8858106710 0x7f8858106b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57014/0 (socket says 172.21.15.123:57014) 2024-06-02T03:57:34.421 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.491+0000 7f885ccac700 1 -- 172.21.15.123:0/1005947899 learned_addr learned my addr 172.21.15.123:0/1005947899 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:34.422 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.491+0000 7f885ccac700 1 -- 172.21.15.123:0/1005947899 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88581078c0 con 0x7f8858106710 2024-06-02T03:57:34.422 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.492+0000 7f885ccac700 1 --2- 172.21.15.123:0/1005947899 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8858106710 0x7f8858106b30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f884c0098a0 tx=0x7f884c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b88019eee24f9687 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:34.422 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.492+0000 7f88577fe700 1 -- 172.21.15.123:0/1005947899 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f884c004160 con 0x7f8858106710 2024-06-02T03:57:34.422 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.492+0000 7f88577fe700 1 -- 172.21.15.123:0/1005947899 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f884c0042c0 con 0x7f8858106710 2024-06-02T03:57:34.422 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.492+0000 7f88577fe700 1 -- 172.21.15.123:0/1005947899 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f884c011a00 con 0x7f8858106710 2024-06-02T03:57:34.422 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.492+0000 7f885ef10700 1 -- 172.21.15.123:0/1005947899 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8858106710 msgr2=0x7f8858106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:34.422 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.492+0000 7f885ef10700 1 --2- 172.21.15.123:0/1005947899 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8858106710 0x7f8858106b30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f884c0098a0 tx=0x7f884c009bb0 comp rx=0 tx=0).stop 2024-06-02T03:57:34.422 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.492+0000 7f885ef10700 1 -- 172.21.15.123:0/1005947899 shutdown_connections 2024-06-02T03:57:34.422 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.492+0000 7f885ef10700 1 --2- 172.21.15.123:0/1005947899 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8858106710 0x7f8858106b30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:34.422 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.492+0000 7f885ef10700 1 -- 172.21.15.123:0/1005947899 >> 172.21.15.123:0/1005947899 conn(0x7f8858101cd0 msgr2=0x7f88581040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:34.422 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.492+0000 7f885ef10700 1 -- 172.21.15.123:0/1005947899 shutdown_connections 2024-06-02T03:57:34.422 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.492+0000 7f885ef10700 1 -- 172.21.15.123:0/1005947899 wait complete. 2024-06-02T03:57:34.423 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.493+0000 7f885ef10700 1 Processor -- start 2024-06-02T03:57:34.423 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.493+0000 7f885ef10700 1 -- start start 2024-06-02T03:57:34.423 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.493+0000 7f885ef10700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8858106710 0x7f885819c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:34.423 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.493+0000 7f885ef10700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885819cb60 con 0x7f8858106710 2024-06-02T03:57:34.423 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.493+0000 7f885ccac700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8858106710 0x7f885819c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:34.423 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.493+0000 7f885ccac700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8858106710 0x7f885819c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:57028/0 (socket says 172.21.15.123:57028) 2024-06-02T03:57:34.423 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.493+0000 7f885ccac700 1 -- 172.21.15.123:0/3869077941 learned_addr learned my addr 172.21.15.123:0/3869077941 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:34.423 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.494+0000 7f885ccac700 1 -- 172.21.15.123:0/3869077941 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884c009550 con 0x7f8858106710 2024-06-02T03:57:34.423 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.494+0000 7f885ccac700 1 --2- 172.21.15.123:0/3869077941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8858106710 0x7f885819c620 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f884c009130 tx=0x7f884c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:34.423 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.494+0000 7f8855ffb700 1 -- 172.21.15.123:0/3869077941 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f884c003ab0 con 0x7f8858106710 2024-06-02T03:57:34.423 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.494+0000 7f8855ffb700 1 -- 172.21.15.123:0/3869077941 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f884c003c10 con 0x7f8858106710 2024-06-02T03:57:34.423 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.494+0000 7f8855ffb700 1 -- 172.21.15.123:0/3869077941 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f884c0247d0 con 0x7f8858106710 2024-06-02T03:57:34.424 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.494+0000 7f885ef10700 1 -- 172.21.15.123:0/3869077941 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f885819cd60 con 0x7f8858106710 2024-06-02T03:57:34.424 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.494+0000 7f885ef10700 1 -- 172.21.15.123:0/3869077941 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f885819d200 con 0x7f8858106710 2024-06-02T03:57:34.424 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.495+0000 7f8855ffb700 1 -- 172.21.15.123:0/3869077941 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 3) v1 ==== 45424+0+0 (secure 0 0 0) 0x7f884c01abb0 con 0x7f8858106710 2024-06-02T03:57:34.424 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.495+0000 7f8855ffb700 1 --2- 172.21.15.123:0/3869077941 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7f8848038580 0x7f884803aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:34.424 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.495+0000 7f885ef10700 1 -- 172.21.15.123:0/3869077941 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f885810aaf0 con 0x7f8858106710 2024-06-02T03:57:34.424 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.495+0000 7f8855ffb700 1 -- 172.21.15.123:0/3869077941 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f884c04c230 con 0x7f8858106710 2024-06-02T03:57:34.424 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.495+0000 7f8857fff700 1 --2- 172.21.15.123:0/3869077941 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7f8848038580 0x7f884803aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:34.424 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.496+0000 7f8857fff700 1 --2- 172.21.15.123:0/3869077941 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7f8848038580 0x7f884803aa40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8844006fd0 tx=0x7f8844006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:34.424 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.500+0000 7f8855ffb700 1 -- 172.21.15.123:0/3869077941 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f884c018530 con 0x7f8858106710 2024-06-02T03:57:34.424 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.768+0000 7f885ef10700 1 -- 172.21.15.123:0/3869077941 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f885819fa90 con 0x7f8858106710 2024-06-02T03:57:34.424 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.769+0000 7f8855ffb700 1 -- 172.21.15.123:0/3869077941 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f884c021d60 con 0x7f8858106710 2024-06-02T03:57:34.425 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.771+0000 7f885ef10700 1 -- 172.21.15.123:0/3869077941 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7f8848038580 msgr2=0x7f884803aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:34.425 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.771+0000 7f885ef10700 1 --2- 172.21.15.123:0/3869077941 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7f8848038580 0x7f884803aa40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8844006fd0 tx=0x7f8844006e40 comp rx=0 tx=0).stop 2024-06-02T03:57:34.425 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.771+0000 7f885ef10700 1 -- 172.21.15.123:0/3869077941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8858106710 msgr2=0x7f885819c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:34.425 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.771+0000 7f885ef10700 1 --2- 172.21.15.123:0/3869077941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8858106710 0x7f885819c620 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f884c009130 tx=0x7f884c011ad0 comp rx=0 tx=0).stop 2024-06-02T03:57:34.425 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.771+0000 7f885ef10700 1 -- 172.21.15.123:0/3869077941 shutdown_connections 2024-06-02T03:57:34.425 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.771+0000 7f885ef10700 1 --2- 172.21.15.123:0/3869077941 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7f8848038580 0x7f884803aa40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:34.425 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.771+0000 7f885ef10700 1 --2- 172.21.15.123:0/3869077941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8858106710 0x7f885819c620 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:34.425 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.771+0000 7f885ef10700 1 -- 172.21.15.123:0/3869077941 >> 172.21.15.123:0/3869077941 conn(0x7f8858101cd0 msgr2=0x7f88581027e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:34.425 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.771+0000 7f885ef10700 1 -- 172.21.15.123:0/3869077941 shutdown_connections 2024-06-02T03:57:34.425 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:33.771+0000 7f885ef10700 1 -- 172.21.15.123:0/3869077941 wait complete. 2024-06-02T03:57:34.425 INFO:teuthology.orchestra.run.smithi123.stdout:mgr is available 2024-06-02T03:57:34.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:34 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/3869077941' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-06-02T03:57:35.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:35 smithi123 ceph-mon[42885]: mgrmap e4: x(active, since 3s) 2024-06-02T03:57:36.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:36 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2474250995' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-06-02T03:57:37.094 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-06-02T03:57:37.094 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout [global] 2024-06-02T03:57:37.095 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout fsid = 1b432ae0-2094-11ef-bc9b-c7b262605968 2024-06-02T03:57:37.095 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-06-02T03:57:37.095 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-06-02T03:57:37.095 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-06-02T03:57:37.095 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-06-02T03:57:37.095 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-06-02T03:57:37.095 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout [mgr] 2024-06-02T03:57:37.095 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-06-02T03:57:37.095 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 2024-06-02T03:57:37.095 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout [osd] 2024-06-02T03:57:37.095 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-06-02T03:57:37.095 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-06-02T03:57:37.095 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-06-02T03:57:37.096 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-06-02T03:57:37.096 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-06-02T03:57:37.096 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.647+0000 7efed7e7a700 1 Processor -- start 2024-06-02T03:57:37.096 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.647+0000 7efed7e7a700 1 -- start start 2024-06-02T03:57:37.096 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.647+0000 7efed7e7a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed0106710 0x7efed0106b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:37.096 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.647+0000 7efed7e7a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed0107100 con 0x7efed0106710 2024-06-02T03:57:37.096 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.647+0000 7efed5c16700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed0106710 0x7efed0106b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:37.096 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.647+0000 7efed5c16700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed0106710 0x7efed0106b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39850/0 (socket says 172.21.15.123:39850) 2024-06-02T03:57:37.096 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.647+0000 7efed5c16700 1 -- 172.21.15.123:0/3082015461 learned_addr learned my addr 172.21.15.123:0/3082015461 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:37.096 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.648+0000 7efed5c16700 1 -- 172.21.15.123:0/3082015461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed01078c0 con 0x7efed0106710 2024-06-02T03:57:37.096 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.648+0000 7efed5c16700 1 --2- 172.21.15.123:0/3082015461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed0106710 0x7efed0106b30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efecc0098a0 tx=0x7efecc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d76fdc0e84189da server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:37.097 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.648+0000 7efed4c14700 1 -- 172.21.15.123:0/3082015461 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efecc004160 con 0x7efed0106710 2024-06-02T03:57:37.097 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.648+0000 7efed4c14700 1 -- 172.21.15.123:0/3082015461 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efecc0042c0 con 0x7efed0106710 2024-06-02T03:57:37.097 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.648+0000 7efed4c14700 1 -- 172.21.15.123:0/3082015461 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efecc011a00 con 0x7efed0106710 2024-06-02T03:57:37.099 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.648+0000 7efed7e7a700 1 -- 172.21.15.123:0/3082015461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed0106710 msgr2=0x7efed0106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:37.099 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.648+0000 7efed7e7a700 1 --2- 172.21.15.123:0/3082015461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed0106710 0x7efed0106b30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efecc0098a0 tx=0x7efecc009bb0 comp rx=0 tx=0).stop 2024-06-02T03:57:37.099 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.648+0000 7efed7e7a700 1 -- 172.21.15.123:0/3082015461 shutdown_connections 2024-06-02T03:57:37.099 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.648+0000 7efed7e7a700 1 --2- 172.21.15.123:0/3082015461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed0106710 0x7efed0106b30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:37.099 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.648+0000 7efed7e7a700 1 -- 172.21.15.123:0/3082015461 >> 172.21.15.123:0/3082015461 conn(0x7efed0101cd0 msgr2=0x7efed01040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:37.099 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.648+0000 7efed7e7a700 1 -- 172.21.15.123:0/3082015461 shutdown_connections 2024-06-02T03:57:37.100 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.648+0000 7efed7e7a700 1 -- 172.21.15.123:0/3082015461 wait complete. 2024-06-02T03:57:37.100 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.649+0000 7efed7e7a700 1 Processor -- start 2024-06-02T03:57:37.100 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.649+0000 7efed7e7a700 1 -- start start 2024-06-02T03:57:37.100 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.649+0000 7efed7e7a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed0106710 0x7efed019a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:37.100 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.649+0000 7efed7e7a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed019a970 con 0x7efed0106710 2024-06-02T03:57:37.100 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.649+0000 7efed5c16700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed0106710 0x7efed019a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:37.100 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.649+0000 7efed5c16700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed0106710 0x7efed019a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39856/0 (socket says 172.21.15.123:39856) 2024-06-02T03:57:37.100 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.649+0000 7efed5c16700 1 -- 172.21.15.123:0/2474250995 learned_addr learned my addr 172.21.15.123:0/2474250995 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:37.101 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.650+0000 7efed5c16700 1 -- 172.21.15.123:0/2474250995 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efecc009550 con 0x7efed0106710 2024-06-02T03:57:37.101 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.650+0000 7efed5c16700 1 --2- 172.21.15.123:0/2474250995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed0106710 0x7efed019a430 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efecc009fb0 tx=0x7efecc011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:37.101 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.650+0000 7efec6ffd700 1 -- 172.21.15.123:0/2474250995 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efecc003a40 con 0x7efed0106710 2024-06-02T03:57:37.101 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.650+0000 7efec6ffd700 1 -- 172.21.15.123:0/2474250995 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efecc003ba0 con 0x7efed0106710 2024-06-02T03:57:37.101 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.650+0000 7efed7e7a700 1 -- 172.21.15.123:0/2474250995 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed019ab70 con 0x7efed0106710 2024-06-02T03:57:37.101 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.650+0000 7efec6ffd700 1 -- 172.21.15.123:0/2474250995 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efecc01a750 con 0x7efed0106710 2024-06-02T03:57:37.101 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.650+0000 7efed7e7a700 1 -- 172.21.15.123:0/2474250995 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed019b010 con 0x7efed0106710 2024-06-02T03:57:37.101 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.651+0000 7efed7e7a700 1 -- 172.21.15.123:0/2474250995 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed010aaf0 con 0x7efed0106710 2024-06-02T03:57:37.101 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.651+0000 7efec6ffd700 1 -- 172.21.15.123:0/2474250995 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 4) v1 ==== 45530+0+0 (secure 0 0 0) 0x7efecc024b60 con 0x7efed0106710 2024-06-02T03:57:37.102 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.651+0000 7efec6ffd700 1 --2- 172.21.15.123:0/2474250995 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7efebc0386b0 0x7efebc03ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:37.102 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.651+0000 7efec6ffd700 1 -- 172.21.15.123:0/2474250995 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7efecc04c360 con 0x7efed0106710 2024-06-02T03:57:37.102 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.651+0000 7efed5415700 1 --2- 172.21.15.123:0/2474250995 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7efebc0386b0 0x7efebc03ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:37.102 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.652+0000 7efed5415700 1 --2- 172.21.15.123:0/2474250995 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7efebc0386b0 0x7efebc03ab70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efec0006fd0 tx=0x7efec0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:37.102 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.656+0000 7efec6ffd700 1 -- 172.21.15.123:0/2474250995 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7efecc024430 con 0x7efed0106710 2024-06-02T03:57:37.102 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.847+0000 7efed7e7a700 1 -- 172.21.15.123:0/2474250995 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7efed019d8a0 con 0x7efed0106710 2024-06-02T03:57:37.102 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.848+0000 7efec6ffd700 1 -- 172.21.15.123:0/2474250995 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7efecc0187c0 con 0x7efed0106710 2024-06-02T03:57:37.102 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.850+0000 7efed7e7a700 1 -- 172.21.15.123:0/2474250995 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7efebc0386b0 msgr2=0x7efebc03ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:37.102 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.850+0000 7efed7e7a700 1 --2- 172.21.15.123:0/2474250995 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7efebc0386b0 0x7efebc03ab70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efec0006fd0 tx=0x7efec0006e40 comp rx=0 tx=0).stop 2024-06-02T03:57:37.102 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.850+0000 7efed7e7a700 1 -- 172.21.15.123:0/2474250995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed0106710 msgr2=0x7efed019a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:37.102 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.850+0000 7efed7e7a700 1 --2- 172.21.15.123:0/2474250995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed0106710 0x7efed019a430 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efecc009fb0 tx=0x7efecc011ad0 comp rx=0 tx=0).stop 2024-06-02T03:57:37.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.850+0000 7efed7e7a700 1 -- 172.21.15.123:0/2474250995 shutdown_connections 2024-06-02T03:57:37.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.850+0000 7efed7e7a700 1 --2- 172.21.15.123:0/2474250995 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7efebc0386b0 0x7efebc03ab70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:37.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.850+0000 7efed7e7a700 1 --2- 172.21.15.123:0/2474250995 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7efed0106710 0x7efed019a430 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:37.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.850+0000 7efed7e7a700 1 -- 172.21.15.123:0/2474250995 >> 172.21.15.123:0/2474250995 conn(0x7efed0101cd0 msgr2=0x7efed01028d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:37.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.850+0000 7efed7e7a700 1 -- 172.21.15.123:0/2474250995 shutdown_connections 2024-06-02T03:57:37.103 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:35.850+0000 7efed7e7a700 1 -- 172.21.15.123:0/2474250995 wait complete. 2024-06-02T03:57:37.103 INFO:teuthology.orchestra.run.smithi123.stdout:Enabling cephadm module... 2024-06-02T03:57:39.271 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:38 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1425532144' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-06-02T03:57:39.271 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:38 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: ignoring --setuser ceph since I am not root 2024-06-02T03:57:39.272 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:38 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: ignoring --setgroup ceph since I am not root 2024-06-02T03:57:39.537 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:39 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:39.271+0000 7ff599c8b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-02T03:57:39.537 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:39 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:39.367+0000 7ff599c8b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-02T03:57:39.537 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:39 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:39.452+0000 7ff599c8b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-02T03:57:39.822 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:39 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:39.537+0000 7ff599c8b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-02T03:57:40.161 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:39 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1425532144' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-06-02T03:57:40.161 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:39 smithi123 ceph-mon[42885]: mgrmap e5: x(active, since 7s) 2024-06-02T03:57:40.495 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:40 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:40.161+0000 7ff599c8b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-02T03:57:40.495 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:40 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:40.411+0000 7ff599c8b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-02T03:57:40.758 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:40 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:40.495+0000 7ff599c8b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-02T03:57:40.758 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:40 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:40.603+0000 7ff599c8b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-02T03:57:41.031 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.540+0000 7f5744af0700 1 Processor -- start 2024-06-02T03:57:41.031 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.540+0000 7f5744af0700 1 -- start start 2024-06-02T03:57:41.031 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.541+0000 7f5744af0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5740105b20 0x7f5740105f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:41.031 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.541+0000 7f5744af0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5740106510 con 0x7f5740105b20 2024-06-02T03:57:41.031 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.541+0000 7f573e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5740105b20 0x7f5740105f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:41.031 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.541+0000 7f573e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5740105b20 0x7f5740105f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39864/0 (socket says 172.21.15.123:39864) 2024-06-02T03:57:41.031 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.541+0000 7f573e59c700 1 -- 172.21.15.123:0/725140781 learned_addr learned my addr 172.21.15.123:0/725140781 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:41.031 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.541+0000 7f573e59c700 1 -- 172.21.15.123:0/725140781 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5740106840 con 0x7f5740105b20 2024-06-02T03:57:41.031 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.541+0000 7f573e59c700 1 --2- 172.21.15.123:0/725140781 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5740105b20 0x7f5740105f40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f57280098a0 tx=0x7f5728009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f4091bfb37b107 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:41.031 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.542+0000 7f573d59a700 1 -- 172.21.15.123:0/725140781 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5728004160 con 0x7f5740105b20 2024-06-02T03:57:41.031 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.542+0000 7f573d59a700 1 -- 172.21.15.123:0/725140781 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f57280042c0 con 0x7f5740105b20 2024-06-02T03:57:41.032 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.542+0000 7f573d59a700 1 -- 172.21.15.123:0/725140781 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5728011a00 con 0x7f5740105b20 2024-06-02T03:57:41.032 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.542+0000 7f5744af0700 1 -- 172.21.15.123:0/725140781 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5740105b20 msgr2=0x7f5740105f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:41.032 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.542+0000 7f5744af0700 1 --2- 172.21.15.123:0/725140781 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5740105b20 0x7f5740105f40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f57280098a0 tx=0x7f5728009bb0 comp rx=0 tx=0).stop 2024-06-02T03:57:41.032 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.542+0000 7f5744af0700 1 -- 172.21.15.123:0/725140781 shutdown_connections 2024-06-02T03:57:41.032 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.542+0000 7f5744af0700 1 --2- 172.21.15.123:0/725140781 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5740105b20 0x7f5740105f40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:41.032 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.542+0000 7f5744af0700 1 -- 172.21.15.123:0/725140781 >> 172.21.15.123:0/725140781 conn(0x7f5740100320 msgr2=0x7f5740102780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:41.032 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.542+0000 7f5744af0700 1 -- 172.21.15.123:0/725140781 shutdown_connections 2024-06-02T03:57:41.032 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.542+0000 7f5744af0700 1 -- 172.21.15.123:0/725140781 wait complete. 2024-06-02T03:57:41.032 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.543+0000 7f5744af0700 1 Processor -- start 2024-06-02T03:57:41.032 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.543+0000 7f5744af0700 1 -- start start 2024-06-02T03:57:41.032 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.543+0000 7f5744af0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5740105b20 0x7f574019a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:41.032 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.543+0000 7f5744af0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574019aa60 con 0x7f5740105b20 2024-06-02T03:57:41.033 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.543+0000 7f573e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5740105b20 0x7f574019a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:41.033 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.543+0000 7f573e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5740105b20 0x7f574019a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39870/0 (socket says 172.21.15.123:39870) 2024-06-02T03:57:41.033 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.543+0000 7f573e59c700 1 -- 172.21.15.123:0/1425532144 learned_addr learned my addr 172.21.15.123:0/1425532144 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:41.033 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.544+0000 7f573e59c700 1 -- 172.21.15.123:0/1425532144 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5728009550 con 0x7f5740105b20 2024-06-02T03:57:41.033 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.544+0000 7f573e59c700 1 --2- 172.21.15.123:0/1425532144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5740105b20 0x7f574019a520 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5728011a20 tx=0x7f5728011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:41.033 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.544+0000 7f57377fe700 1 -- 172.21.15.123:0/1425532144 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5728003af0 con 0x7f5740105b20 2024-06-02T03:57:41.033 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.544+0000 7f5744af0700 1 -- 172.21.15.123:0/1425532144 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f574019ac60 con 0x7f5740105b20 2024-06-02T03:57:41.033 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.544+0000 7f57377fe700 1 -- 172.21.15.123:0/1425532144 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5728003c50 con 0x7f5740105b20 2024-06-02T03:57:41.033 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.544+0000 7f57377fe700 1 -- 172.21.15.123:0/1425532144 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5728019760 con 0x7f5740105b20 2024-06-02T03:57:41.033 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.544+0000 7f5744af0700 1 -- 172.21.15.123:0/1425532144 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f574019b100 con 0x7f5740105b20 2024-06-02T03:57:41.033 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.545+0000 7f57377fe700 1 -- 172.21.15.123:0/1425532144 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 4) v1 ==== 45530+0+0 (secure 0 0 0) 0x7f57280199a0 con 0x7f5740105b20 2024-06-02T03:57:41.033 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.545+0000 7f5744af0700 1 -- 172.21.15.123:0/1425532144 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57401945f0 con 0x7f5740105b20 2024-06-02T03:57:41.034 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.545+0000 7f57377fe700 1 --2- 172.21.15.123:0/1425532144 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7f572c0386b0 0x7f572c03ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:41.034 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.545+0000 7f57377fe700 1 -- 172.21.15.123:0/1425532144 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f572804c890 con 0x7f5740105b20 2024-06-02T03:57:41.034 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.545+0000 7f573dd9b700 1 --2- 172.21.15.123:0/1425532144 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7f572c0386b0 0x7f572c03ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:41.034 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.545+0000 7f573dd9b700 1 --2- 172.21.15.123:0/1425532144 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7f572c0386b0 0x7f572c03ab70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5730006fd0 tx=0x7f5730006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:41.034 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.550+0000 7f57377fe700 1 -- 172.21.15.123:0/1425532144 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5728018db0 con 0x7f5740105b20 2024-06-02T03:57:41.034 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.799+0000 7f5744af0700 1 -- 172.21.15.123:0/1425532144 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f5740109a70 con 0x7f5740105b20 2024-06-02T03:57:41.034 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.852+0000 7f57377fe700 1 -- 172.21.15.123:0/1425532144 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f572800b900 con 0x7f5740105b20 2024-06-02T03:57:41.034 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.853+0000 7f57377fe700 1 -- 172.21.15.123:0/1425532144 <== mon.0 v2:172.21.15.123:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f5728023bd0 con 0x7f5740105b20 2024-06-02T03:57:41.034 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.856+0000 7f5744af0700 1 -- 172.21.15.123:0/1425532144 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7f572c0386b0 msgr2=0x7f572c03ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:41.035 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.856+0000 7f5744af0700 1 --2- 172.21.15.123:0/1425532144 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7f572c0386b0 0x7f572c03ab70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5730006fd0 tx=0x7f5730006e40 comp rx=0 tx=0).stop 2024-06-02T03:57:41.035 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.856+0000 7f5744af0700 1 -- 172.21.15.123:0/1425532144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5740105b20 msgr2=0x7f574019a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:41.035 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.856+0000 7f5744af0700 1 --2- 172.21.15.123:0/1425532144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5740105b20 0x7f574019a520 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5728011a20 tx=0x7f5728011b00 comp rx=0 tx=0).stop 2024-06-02T03:57:41.035 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.856+0000 7f5744af0700 1 -- 172.21.15.123:0/1425532144 shutdown_connections 2024-06-02T03:57:41.035 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.856+0000 7f5744af0700 1 --2- 172.21.15.123:0/1425532144 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7f572c0386b0 0x7f572c03ab70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:41.035 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.856+0000 7f5744af0700 1 --2- 172.21.15.123:0/1425532144 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5740105b20 0x7f574019a520 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:41.035 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.856+0000 7f5744af0700 1 -- 172.21.15.123:0/1425532144 >> 172.21.15.123:0/1425532144 conn(0x7f5740100320 msgr2=0x7f57401012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:41.035 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.856+0000 7f5744af0700 1 -- 172.21.15.123:0/1425532144 shutdown_connections 2024-06-02T03:57:41.035 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:38.856+0000 7f5744af0700 1 -- 172.21.15.123:0/1425532144 wait complete. 2024-06-02T03:57:41.035 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:40 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:40.758+0000 7ff599c8b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-02T03:57:41.035 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:40 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:40.885+0000 7ff599c8b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-02T03:57:41.036 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:40 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:40.969+0000 7ff599c8b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-02T03:57:41.725 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:41 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:41.342+0000 7ff599c8b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-02T03:57:42.038 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:41 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:41.730+0000 7ff599c8b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-02T03:57:42.042 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:41 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:41.941+0000 7ff599c8b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-02T03:57:42.322 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:42 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:42.038+0000 7ff599c8b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-02T03:57:42.611 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:42 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/294384682' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-06-02T03:57:42.665 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout { 2024-06-02T03:57:42.666 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-06-02T03:57:42.666 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "available": true, 2024-06-02T03:57:42.666 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-06-02T03:57:42.666 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-06-02T03:57:42.666 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout } 2024-06-02T03:57:42.666 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.041+0000 7fd34d4b6700 1 Processor -- start 2024-06-02T03:57:42.666 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.041+0000 7fd34d4b6700 1 -- start start 2024-06-02T03:57:42.667 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.042+0000 7fd34d4b6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3481071c0 0x7fd3481095b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:42.667 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.042+0000 7fd34d4b6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd348079f30 con 0x7fd3481071c0 2024-06-02T03:57:42.667 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.042+0000 7fd346ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3481071c0 0x7fd3481095b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:42.667 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.042+0000 7fd346ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3481071c0 0x7fd3481095b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39910/0 (socket says 172.21.15.123:39910) 2024-06-02T03:57:42.667 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.042+0000 7fd346ffd700 1 -- 172.21.15.123:0/942971056 learned_addr learned my addr 172.21.15.123:0/942971056 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:42.667 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.042+0000 7fd346ffd700 1 -- 172.21.15.123:0/942971056 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd348109af0 con 0x7fd3481071c0 2024-06-02T03:57:42.667 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.042+0000 7fd346ffd700 1 --2- 172.21.15.123:0/942971056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3481071c0 0x7fd3481095b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd3380098a0 tx=0x7fd338009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=155959416480a8fc server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:42.667 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.042+0000 7fd345ffb700 1 -- 172.21.15.123:0/942971056 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd338004160 con 0x7fd3481071c0 2024-06-02T03:57:42.667 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.042+0000 7fd345ffb700 1 -- 172.21.15.123:0/942971056 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd3380042c0 con 0x7fd3481071c0 2024-06-02T03:57:42.667 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.042+0000 7fd345ffb700 1 -- 172.21.15.123:0/942971056 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd338011a00 con 0x7fd3481071c0 2024-06-02T03:57:42.667 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.043+0000 7fd34d4b6700 1 -- 172.21.15.123:0/942971056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3481071c0 msgr2=0x7fd3481095b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:42.667 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.043+0000 7fd34d4b6700 1 --2- 172.21.15.123:0/942971056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3481071c0 0x7fd3481095b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd3380098a0 tx=0x7fd338009bb0 comp rx=0 tx=0).stop 2024-06-02T03:57:42.667 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.043+0000 7fd34d4b6700 1 -- 172.21.15.123:0/942971056 shutdown_connections 2024-06-02T03:57:42.668 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.043+0000 7fd34d4b6700 1 --2- 172.21.15.123:0/942971056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3481071c0 0x7fd3481095b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:42.668 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.043+0000 7fd34d4b6700 1 -- 172.21.15.123:0/942971056 >> 172.21.15.123:0/942971056 conn(0x7fd348100bf0 msgr2=0x7fd348103010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:42.668 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.043+0000 7fd34d4b6700 1 -- 172.21.15.123:0/942971056 shutdown_connections 2024-06-02T03:57:42.668 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.043+0000 7fd34d4b6700 1 -- 172.21.15.123:0/942971056 wait complete. 2024-06-02T03:57:42.668 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.044+0000 7fd34d4b6700 1 Processor -- start 2024-06-02T03:57:42.668 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.044+0000 7fd34d4b6700 1 -- start start 2024-06-02T03:57:42.668 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.044+0000 7fd34d4b6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3481071c0 0x7fd3481069f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:42.668 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.044+0000 7fd34d4b6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd348106f30 con 0x7fd3481071c0 2024-06-02T03:57:42.668 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.044+0000 7fd346ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3481071c0 0x7fd3481069f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:42.668 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.044+0000 7fd346ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3481071c0 0x7fd3481069f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39912/0 (socket says 172.21.15.123:39912) 2024-06-02T03:57:42.668 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.044+0000 7fd346ffd700 1 -- 172.21.15.123:0/294384682 learned_addr learned my addr 172.21.15.123:0/294384682 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:42.668 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.044+0000 7fd346ffd700 1 -- 172.21.15.123:0/294384682 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd338009550 con 0x7fd3481071c0 2024-06-02T03:57:42.669 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.045+0000 7fd346ffd700 1 --2- 172.21.15.123:0/294384682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3481071c0 0x7fd3481069f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd338009130 tx=0x7fd338011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:42.669 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.045+0000 7fd32ffff700 1 -- 172.21.15.123:0/294384682 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd338003b70 con 0x7fd3481071c0 2024-06-02T03:57:42.669 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.045+0000 7fd32ffff700 1 -- 172.21.15.123:0/294384682 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd338003cd0 con 0x7fd3481071c0 2024-06-02T03:57:42.669 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.045+0000 7fd34d4b6700 1 -- 172.21.15.123:0/294384682 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd348105170 con 0x7fd3481071c0 2024-06-02T03:57:42.669 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.045+0000 7fd32ffff700 1 -- 172.21.15.123:0/294384682 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3380197d0 con 0x7fd3481071c0 2024-06-02T03:57:42.669 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.045+0000 7fd34d4b6700 1 -- 172.21.15.123:0/294384682 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd348105610 con 0x7fd3481071c0 2024-06-02T03:57:42.669 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.045+0000 7fd32ffff700 1 -- 172.21.15.123:0/294384682 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fd3380199c0 con 0x7fd3481071c0 2024-06-02T03:57:42.669 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.046+0000 7fd32ffff700 1 --2- 172.21.15.123:0/294384682 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7fd330038750 0x7fd33003ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:42.669 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.046+0000 7fd32ffff700 1 -- 172.21.15.123:0/294384682 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd33804d8d0 con 0x7fd3481071c0 2024-06-02T03:57:42.669 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.046+0000 7fd3467fc700 1 -- 172.21.15.123:0/294384682 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7fd330038750 msgr2=0x7fd33003ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/3442784869 2024-06-02T03:57:42.669 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.046+0000 7fd3467fc700 1 --2- 172.21.15.123:0/294384682 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7fd330038750 0x7fd33003ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T03:57:42.669 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.046+0000 7fd34d4b6700 1 -- 172.21.15.123:0/294384682 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3480625d0 con 0x7fd3481071c0 2024-06-02T03:57:42.669 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.051+0000 7fd32ffff700 1 -- 172.21.15.123:0/294384682 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd338018db0 con 0x7fd3481071c0 2024-06-02T03:57:42.670 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.247+0000 7fd3467fc700 1 -- 172.21.15.123:0/294384682 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7fd330038750 msgr2=0x7fd33003ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/3442784869 2024-06-02T03:57:42.670 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.247+0000 7fd3467fc700 1 --2- 172.21.15.123:0/294384682 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7fd330038750 0x7fd33003ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-02T03:57:42.670 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.304+0000 7fd34d4b6700 1 -- 172.21.15.123:0/294384682 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fd34810ab50 con 0x7fd3481071c0 2024-06-02T03:57:42.670 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.304+0000 7fd32ffff700 1 -- 172.21.15.123:0/294384682 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7fd338018350 con 0x7fd3481071c0 2024-06-02T03:57:42.670 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.307+0000 7fd34d4b6700 1 -- 172.21.15.123:0/294384682 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7fd330038750 msgr2=0x7fd33003ac10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T03:57:42.670 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.307+0000 7fd34d4b6700 1 --2- 172.21.15.123:0/294384682 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7fd330038750 0x7fd33003ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:42.670 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.307+0000 7fd34d4b6700 1 -- 172.21.15.123:0/294384682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3481071c0 msgr2=0x7fd3481069f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:42.670 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.307+0000 7fd34d4b6700 1 --2- 172.21.15.123:0/294384682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3481071c0 0x7fd3481069f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd338009130 tx=0x7fd338011ad0 comp rx=0 tx=0).stop 2024-06-02T03:57:42.670 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.307+0000 7fd34d4b6700 1 -- 172.21.15.123:0/294384682 shutdown_connections 2024-06-02T03:57:42.670 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.307+0000 7fd34d4b6700 1 --2- 172.21.15.123:0/294384682 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7fd330038750 0x7fd33003ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:42.670 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.307+0000 7fd34d4b6700 1 --2- 172.21.15.123:0/294384682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd3481071c0 0x7fd3481069f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:42.671 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.307+0000 7fd34d4b6700 1 -- 172.21.15.123:0/294384682 >> 172.21.15.123:0/294384682 conn(0x7fd348100bf0 msgr2=0x7fd348101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:42.671 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.307+0000 7fd34d4b6700 1 -- 172.21.15.123:0/294384682 shutdown_connections 2024-06-02T03:57:42.671 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:42.307+0000 7fd34d4b6700 1 -- 172.21.15.123:0/294384682 wait complete. 2024-06-02T03:57:42.671 INFO:teuthology.orchestra.run.smithi123.stdout:Waiting for the mgr to restart... 2024-06-02T03:57:42.671 INFO:teuthology.orchestra.run.smithi123.stdout:Waiting for mgr epoch 5... 2024-06-02T03:57:42.938 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:42 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:42.839+0000 7ff599c8b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-02T03:57:43.322 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:42 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:42.938+0000 7ff599c8b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-02T03:57:43.322 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:43 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:43.095+0000 7ff599c8b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-02T03:57:44.072 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:43 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:43.722+0000 7ff599c8b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-02T03:57:44.073 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:43 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:43.903+0000 7ff599c8b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-02T03:57:44.572 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:44 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:44.098+0000 7ff599c8b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-02T03:57:45.318 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:45 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:45.036+0000 7ff599c8b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-02T03:57:45.572 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:45 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:45.318+0000 7ff599c8b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-02T03:57:45.572 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:45 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:45.406+0000 7ff599c8b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-02T03:57:46.073 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:45 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:57:45.597+0000 7ff599c8b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-02T03:57:46.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:45 smithi123 ceph-mon[42885]: Active manager daemon x restarted 2024-06-02T03:57:46.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:45 smithi123 ceph-mon[42885]: Activating manager daemon x 2024-06-02T03:57:46.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:45 smithi123 ceph-mon[42885]: osdmap e2: 0 total, 0 up, 0 in 2024-06-02T03:57:46.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:45 smithi123 ceph-mon[42885]: mgrmap e6: x(active, starting, since 0.00316044s) 2024-06-02T03:57:46.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:45 smithi123 ceph-mon[42885]: from='mgr.14120 172.21.15.123:0/2131965966' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T03:57:46.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:45 smithi123 ceph-mon[42885]: from='mgr.14120 172.21.15.123:0/2131965966' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-02T03:57:46.075 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:45 smithi123 ceph-mon[42885]: from='mgr.14120 172.21.15.123:0/2131965966' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-02T03:57:46.075 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:45 smithi123 ceph-mon[42885]: from='mgr.14120 172.21.15.123:0/2131965966' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-02T03:57:46.075 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:45 smithi123 ceph-mon[42885]: from='mgr.14120 172.21.15.123:0/2131965966' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-02T03:57:46.075 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:45 smithi123 ceph-mon[42885]: Manager daemon x is now available 2024-06-02T03:57:46.075 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:45 smithi123 ceph-mon[42885]: from='mgr.14120 172.21.15.123:0/2131965966' entity='mgr.x' 2024-06-02T03:57:46.075 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:45 smithi123 ceph-mon[42885]: from='mgr.14120 172.21.15.123:0/2131965966' entity='mgr.x' 2024-06-02T03:57:46.075 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:45 smithi123 ceph-mon[42885]: from='mgr.14120 172.21.15.123:0/2131965966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:57:46.075 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:45 smithi123 ceph-mon[42885]: from='mgr.14120 172.21.15.123:0/2131965966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:57:47.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:46 smithi123 ceph-mon[42885]: Found migration_current of "None". Setting to last migration. 2024-06-02T03:57:47.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:46 smithi123 ceph-mon[42885]: from='mgr.14120 172.21.15.123:0/2131965966' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-02T03:57:47.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:46 smithi123 ceph-mon[42885]: from='mgr.14120 172.21.15.123:0/2131965966' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-02T03:57:47.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:46 smithi123 ceph-mon[42885]: from='mgr.14120 172.21.15.123:0/2131965966' entity='mgr.x' 2024-06-02T03:57:47.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:46 smithi123 ceph-mon[42885]: from='mgr.14120 172.21.15.123:0/2131965966' entity='mgr.x' 2024-06-02T03:57:47.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:46 smithi123 ceph-mon[42885]: mgrmap e7: x(active, since 1.00567s) 2024-06-02T03:57:47.239 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout { 2024-06-02T03:57:47.246 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-06-02T03:57:47.246 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "initialized": true 2024-06-02T03:57:47.246 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout } 2024-06-02T03:57:47.246 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.043+0000 7fa92ba99700 1 Processor -- start 2024-06-02T03:57:47.247 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.043+0000 7fa92ba99700 1 -- start start 2024-06-02T03:57:47.247 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.043+0000 7fa92ba99700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa924104fd0 0x7fa9241053f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:47.247 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.043+0000 7fa92ba99700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa924079df0 con 0x7fa924104fd0 2024-06-02T03:57:47.247 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.043+0000 7fa929835700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa924104fd0 0x7fa9241053f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:47.247 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.043+0000 7fa929835700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa924104fd0 0x7fa9241053f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39922/0 (socket says 172.21.15.123:39922) 2024-06-02T03:57:47.247 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.044+0000 7fa929835700 1 -- 172.21.15.123:0/118456868 learned_addr learned my addr 172.21.15.123:0/118456868 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:47.247 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.044+0000 7fa929835700 1 -- 172.21.15.123:0/118456868 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa924079f30 con 0x7fa924104fd0 2024-06-02T03:57:47.247 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.044+0000 7fa929835700 1 --2- 172.21.15.123:0/118456868 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa924104fd0 0x7fa9241053f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa9200098a0 tx=0x7fa920009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2c41e47e84b2ce server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:47.247 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.044+0000 7fa928833700 1 -- 172.21.15.123:0/118456868 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa920004160 con 0x7fa924104fd0 2024-06-02T03:57:47.247 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.044+0000 7fa928833700 1 -- 172.21.15.123:0/118456868 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa9200042c0 con 0x7fa924104fd0 2024-06-02T03:57:47.247 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.044+0000 7fa928833700 1 -- 172.21.15.123:0/118456868 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa920011a00 con 0x7fa924104fd0 2024-06-02T03:57:47.247 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.045+0000 7fa92ba99700 1 -- 172.21.15.123:0/118456868 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa924104fd0 msgr2=0x7fa9241053f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:47.248 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.045+0000 7fa92ba99700 1 --2- 172.21.15.123:0/118456868 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa924104fd0 0x7fa9241053f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa9200098a0 tx=0x7fa920009bb0 comp rx=0 tx=0).stop 2024-06-02T03:57:47.248 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.045+0000 7fa92ba99700 1 -- 172.21.15.123:0/118456868 shutdown_connections 2024-06-02T03:57:47.248 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.045+0000 7fa92ba99700 1 --2- 172.21.15.123:0/118456868 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa924104fd0 0x7fa9241053f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:47.248 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.045+0000 7fa92ba99700 1 -- 172.21.15.123:0/118456868 >> 172.21.15.123:0/118456868 conn(0x7fa924100b90 msgr2=0x7fa924102fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:47.248 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.045+0000 7fa92ba99700 1 -- 172.21.15.123:0/118456868 shutdown_connections 2024-06-02T03:57:47.248 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.045+0000 7fa92ba99700 1 -- 172.21.15.123:0/118456868 wait complete. 2024-06-02T03:57:47.248 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.046+0000 7fa92ba99700 1 Processor -- start 2024-06-02T03:57:47.248 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.046+0000 7fa92ba99700 1 -- start start 2024-06-02T03:57:47.248 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.046+0000 7fa92ba99700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa924104fd0 0x7fa92419c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:47.248 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.046+0000 7fa92ba99700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92419cb10 con 0x7fa924104fd0 2024-06-02T03:57:47.248 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.046+0000 7fa929835700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa924104fd0 0x7fa92419c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:47.248 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.046+0000 7fa929835700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa924104fd0 0x7fa92419c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39928/0 (socket says 172.21.15.123:39928) 2024-06-02T03:57:47.248 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.046+0000 7fa929835700 1 -- 172.21.15.123:0/190020815 learned_addr learned my addr 172.21.15.123:0/190020815 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:47.248 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.046+0000 7fa929835700 1 -- 172.21.15.123:0/190020815 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa920009550 con 0x7fa924104fd0 2024-06-02T03:57:47.249 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.046+0000 7fa929835700 1 --2- 172.21.15.123:0/190020815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa924104fd0 0x7fa92419c5d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa920009fb0 tx=0x7fa920011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:47.249 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.047+0000 7fa91affd700 1 -- 172.21.15.123:0/190020815 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa920003a40 con 0x7fa924104fd0 2024-06-02T03:57:47.249 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.047+0000 7fa92ba99700 1 -- 172.21.15.123:0/190020815 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa92419cd10 con 0x7fa924104fd0 2024-06-02T03:57:47.249 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.047+0000 7fa91affd700 1 -- 172.21.15.123:0/190020815 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa920003ba0 con 0x7fa924104fd0 2024-06-02T03:57:47.249 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.047+0000 7fa91affd700 1 -- 172.21.15.123:0/190020815 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa92001a750 con 0x7fa924104fd0 2024-06-02T03:57:47.249 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.047+0000 7fa92ba99700 1 -- 172.21.15.123:0/190020815 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa92419d1b0 con 0x7fa924104fd0 2024-06-02T03:57:47.249 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.047+0000 7fa91affd700 1 -- 172.21.15.123:0/190020815 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fa92001a9d0 con 0x7fa924104fd0 2024-06-02T03:57:47.249 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.048+0000 7fa91affd700 1 --2- 172.21.15.123:0/190020815 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7fa9100386b0 0x7fa91003ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:47.249 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.048+0000 7fa92ba99700 1 -- 172.21.15.123:0/190020815 --> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa924106610 con 0x7fa9100386b0 2024-06-02T03:57:47.249 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.048+0000 7fa91affd700 1 -- 172.21.15.123:0/190020815 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa92004c3e0 con 0x7fa924104fd0 2024-06-02T03:57:47.249 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.048+0000 7fa929034700 1 -- 172.21.15.123:0/190020815 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7fa9100386b0 msgr2=0x7fa91003ab70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/3442784869 2024-06-02T03:57:47.249 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.048+0000 7fa929034700 1 --2- 172.21.15.123:0/190020815 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7fa9100386b0 0x7fa91003ab70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T03:57:47.250 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.249+0000 7fa929034700 1 -- 172.21.15.123:0/190020815 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7fa9100386b0 msgr2=0x7fa91003ab70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/3442784869 2024-06-02T03:57:47.250 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.249+0000 7fa929034700 1 --2- 172.21.15.123:0/190020815 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7fa9100386b0 0x7fa91003ab70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-02T03:57:47.250 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.650+0000 7fa929034700 1 -- 172.21.15.123:0/190020815 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7fa9100386b0 msgr2=0x7fa91003ab70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/3442784869 2024-06-02T03:57:47.250 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:43.650+0000 7fa929034700 1 --2- 172.21.15.123:0/190020815 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7fa9100386b0 0x7fa91003ab70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-06-02T03:57:47.250 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:44.451+0000 7fa929034700 1 -- 172.21.15.123:0/190020815 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7fa9100386b0 msgr2=0x7fa91003ab70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/3442784869 2024-06-02T03:57:47.250 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:44.451+0000 7fa929034700 1 --2- 172.21.15.123:0/190020815 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7fa9100386b0 0x7fa91003ab70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-06-02T03:57:47.250 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:45.612+0000 7fa91affd700 1 -- 172.21.15.123:0/190020815 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mgrmap(e 6) v1 ==== 45308+0+0 (secure 0 0 0) 0x7fa92004b560 con 0x7fa924104fd0 2024-06-02T03:57:47.250 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:45.612+0000 7fa91affd700 1 -- 172.21.15.123:0/190020815 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7fa9100386b0 msgr2=0x7fa91003ab70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T03:57:47.250 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:45.612+0000 7fa91affd700 1 --2- 172.21.15.123:0/190020815 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7fa9100386b0 0x7fa91003ab70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:47.250 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:46.613+0000 7fa91affd700 1 -- 172.21.15.123:0/190020815 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mgrmap(e 7) v1 ==== 45435+0+0 (secure 0 0 0) 0x7fa92002d960 con 0x7fa924104fd0 2024-06-02T03:57:47.250 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:46.613+0000 7fa91affd700 1 --2- 172.21.15.123:0/190020815 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fa91003be30 0x7fa91003e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:47.250 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:46.613+0000 7fa91affd700 1 -- 172.21.15.123:0/190020815 --> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa924106610 con 0x7fa91003be30 2024-06-02T03:57:47.250 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:46.613+0000 7fa929034700 1 --2- 172.21.15.123:0/190020815 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fa91003be30 0x7fa91003e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:47.251 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:46.614+0000 7fa929034700 1 --2- 172.21.15.123:0/190020815 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fa91003be30 0x7fa91003e220 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa914003a10 tx=0x7fa914009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:47.251 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:46.615+0000 7fa91affd700 1 -- 172.21.15.123:0/190020815 <== mgr.14120 v2:172.21.15.123:6800/3555101542 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7fa924106610 con 0x7fa91003be30 2024-06-02T03:57:47.251 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:46.621+0000 7fa92ba99700 1 -- 172.21.15.123:0/190020815 --> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fa924106780 con 0x7fa91003be30 2024-06-02T03:57:47.251 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:46.621+0000 7fa91affd700 1 -- 172.21.15.123:0/190020815 <== mgr.14120 v2:172.21.15.123:6800/3555101542 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fa924106780 con 0x7fa91003be30 2024-06-02T03:57:47.251 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:46.622+0000 7fa92ba99700 1 -- 172.21.15.123:0/190020815 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fa91003be30 msgr2=0x7fa91003e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:47.251 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:46.622+0000 7fa92ba99700 1 --2- 172.21.15.123:0/190020815 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fa91003be30 0x7fa91003e220 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fa914003a10 tx=0x7fa914009290 comp rx=0 tx=0).stop 2024-06-02T03:57:47.251 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:46.622+0000 7fa92ba99700 1 -- 172.21.15.123:0/190020815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa924104fd0 msgr2=0x7fa92419c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:47.251 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:46.622+0000 7fa92ba99700 1 --2- 172.21.15.123:0/190020815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa924104fd0 0x7fa92419c5d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa920009fb0 tx=0x7fa920011ad0 comp rx=0 tx=0).stop 2024-06-02T03:57:47.251 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:46.622+0000 7fa92ba99700 1 -- 172.21.15.123:0/190020815 shutdown_connections 2024-06-02T03:57:47.251 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:46.622+0000 7fa92ba99700 1 --2- 172.21.15.123:0/190020815 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa924104fd0 0x7fa92419c5d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:47.251 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:46.622+0000 7fa92ba99700 1 --2- 172.21.15.123:0/190020815 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fa91003be30 0x7fa91003e220 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:47.251 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:46.622+0000 7fa92ba99700 1 --2- 172.21.15.123:0/190020815 >> [v2:172.21.15.123:6800/3442784869,v1:172.21.15.123:6801/3442784869] conn(0x7fa9100386b0 0x7fa91003ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:47.252 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:46.622+0000 7fa92ba99700 1 -- 172.21.15.123:0/190020815 >> 172.21.15.123:0/190020815 conn(0x7fa924100b90 msgr2=0x7fa924193440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:47.252 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:46.622+0000 7fa92ba99700 1 -- 172.21.15.123:0/190020815 shutdown_connections 2024-06-02T03:57:47.252 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:46.622+0000 7fa92ba99700 1 -- 172.21.15.123:0/190020815 wait complete. 2024-06-02T03:57:47.252 INFO:teuthology.orchestra.run.smithi123.stdout:mgr epoch 5 is available 2024-06-02T03:57:47.252 INFO:teuthology.orchestra.run.smithi123.stdout:Setting orchestrator backend to cephadm... 2024-06-02T03:57:48.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:47 smithi123 ceph-mon[42885]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-06-02T03:57:48.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:47 smithi123 ceph-mon[42885]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-06-02T03:57:48.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:47 smithi123 ceph-mon[42885]: from='mgr.14120 172.21.15.123:0/2131965966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:57:48.810 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:48 smithi123 ceph-mon[42885]: [02/Jun/2024:03:57:47] ENGINE Bus STARTING 2024-06-02T03:57:48.811 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:48 smithi123 ceph-mon[42885]: [02/Jun/2024:03:57:47] ENGINE Serving on https://172.21.15.123:7150 2024-06-02T03:57:48.811 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:48 smithi123 ceph-mon[42885]: [02/Jun/2024:03:57:47] ENGINE Serving on http://172.21.15.123:8765 2024-06-02T03:57:48.811 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:48 smithi123 ceph-mon[42885]: [02/Jun/2024:03:57:47] ENGINE Bus STARTED 2024-06-02T03:57:48.811 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:48 smithi123 ceph-mon[42885]: mgrmap e8: x(active, since 2s) 2024-06-02T03:57:48.811 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:48 smithi123 ceph-mon[42885]: from='mgr.14120 172.21.15.123:0/2131965966' entity='mgr.x' 2024-06-02T03:57:48.811 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:48 smithi123 ceph-mon[42885]: from='mgr.14120 172.21.15.123:0/2131965966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:57:48.856 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.240+0000 7fad24dd9700 1 Processor -- start 2024-06-02T03:57:48.856 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.240+0000 7fad24dd9700 1 -- start start 2024-06-02T03:57:48.856 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.240+0000 7fad24dd9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad20105600 0x7fad20105a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:48.856 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.240+0000 7fad24dd9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad20105ff0 con 0x7fad20105600 2024-06-02T03:57:48.856 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.240+0000 7fad1e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad20105600 0x7fad20105a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:48.856 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.240+0000 7fad1e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad20105600 0x7fad20105a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42070/0 (socket says 172.21.15.123:42070) 2024-06-02T03:57:48.856 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.240+0000 7fad1e59c700 1 -- 172.21.15.123:0/1100909276 learned_addr learned my addr 172.21.15.123:0/1100909276 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:48.856 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.241+0000 7fad1e59c700 1 -- 172.21.15.123:0/1100909276 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad20106800 con 0x7fad20105600 2024-06-02T03:57:48.856 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.241+0000 7fad1e59c700 1 --2- 172.21.15.123:0/1100909276 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad20105600 0x7fad20105a20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fad100098a0 tx=0x7fad10009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c29c928e6046efb server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:48.857 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.241+0000 7fad1d59a700 1 -- 172.21.15.123:0/1100909276 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad10004160 con 0x7fad20105600 2024-06-02T03:57:48.862 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.241+0000 7fad1d59a700 1 -- 172.21.15.123:0/1100909276 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fad100042c0 con 0x7fad20105600 2024-06-02T03:57:48.862 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.241+0000 7fad1d59a700 1 -- 172.21.15.123:0/1100909276 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad10011a00 con 0x7fad20105600 2024-06-02T03:57:48.862 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.242+0000 7fad24dd9700 1 -- 172.21.15.123:0/1100909276 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad20105600 msgr2=0x7fad20105a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:48.862 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.242+0000 7fad24dd9700 1 --2- 172.21.15.123:0/1100909276 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad20105600 0x7fad20105a20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fad100098a0 tx=0x7fad10009bb0 comp rx=0 tx=0).stop 2024-06-02T03:57:48.862 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.242+0000 7fad24dd9700 1 -- 172.21.15.123:0/1100909276 shutdown_connections 2024-06-02T03:57:48.862 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.242+0000 7fad24dd9700 1 --2- 172.21.15.123:0/1100909276 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad20105600 0x7fad20105a20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:48.862 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.242+0000 7fad24dd9700 1 -- 172.21.15.123:0/1100909276 >> 172.21.15.123:0/1100909276 conn(0x7fad20100bc0 msgr2=0x7fad20102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:48.862 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.242+0000 7fad24dd9700 1 -- 172.21.15.123:0/1100909276 shutdown_connections 2024-06-02T03:57:48.862 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.242+0000 7fad24dd9700 1 -- 172.21.15.123:0/1100909276 wait complete. 2024-06-02T03:57:48.863 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.243+0000 7fad24dd9700 1 Processor -- start 2024-06-02T03:57:48.863 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.243+0000 7fad24dd9700 1 -- start start 2024-06-02T03:57:48.863 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.243+0000 7fad24dd9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad20105600 0x7fad20079a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:48.863 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.243+0000 7fad24dd9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad20079f80 con 0x7fad20105600 2024-06-02T03:57:48.863 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.243+0000 7fad1e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad20105600 0x7fad20079a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:48.863 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.243+0000 7fad1e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad20105600 0x7fad20079a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42076/0 (socket says 172.21.15.123:42076) 2024-06-02T03:57:48.863 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.243+0000 7fad1e59c700 1 -- 172.21.15.123:0/1954733057 learned_addr learned my addr 172.21.15.123:0/1954733057 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:48.863 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.244+0000 7fad1e59c700 1 -- 172.21.15.123:0/1954733057 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad10009550 con 0x7fad20105600 2024-06-02T03:57:48.863 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.244+0000 7fad1e59c700 1 --2- 172.21.15.123:0/1954733057 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad20105600 0x7fad20079a40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fad10009130 tx=0x7fad10011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:48.863 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.244+0000 7fad0f7fe700 1 -- 172.21.15.123:0/1954733057 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad100038b0 con 0x7fad20105600 2024-06-02T03:57:48.863 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.244+0000 7fad0f7fe700 1 -- 172.21.15.123:0/1954733057 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fad10003a10 con 0x7fad20105600 2024-06-02T03:57:48.863 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.244+0000 7fad0f7fe700 1 -- 172.21.15.123:0/1954733057 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad10019550 con 0x7fad20105600 2024-06-02T03:57:48.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.244+0000 7fad24dd9700 1 -- 172.21.15.123:0/1954733057 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad2019d190 con 0x7fad20105600 2024-06-02T03:57:48.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.244+0000 7fad24dd9700 1 -- 172.21.15.123:0/1954733057 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad2019d630 con 0x7fad20105600 2024-06-02T03:57:48.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.245+0000 7fad0f7fe700 1 -- 172.21.15.123:0/1954733057 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fad100197c0 con 0x7fad20105600 2024-06-02T03:57:48.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.245+0000 7fad0f7fe700 1 --2- 172.21.15.123:0/1954733057 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fad080386e0 0x7fad0803aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:48.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.245+0000 7fad0f7fe700 1 -- 172.21.15.123:0/1954733057 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fad1004ca00 con 0x7fad20105600 2024-06-02T03:57:48.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.245+0000 7fad24dd9700 1 -- 172.21.15.123:0/1954733057 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad20109a30 con 0x7fad20105600 2024-06-02T03:57:48.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.245+0000 7fad1dd9b700 1 --2- 172.21.15.123:0/1954733057 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fad080386e0 0x7fad0803aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:48.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.245+0000 7fad1dd9b700 1 --2- 172.21.15.123:0/1954733057 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fad080386e0 0x7fad0803aba0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fad14006fd0 tx=0x7fad14006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:48.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.250+0000 7fad0f7fe700 1 -- 172.21.15.123:0/1954733057 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fad10018db0 con 0x7fad20105600 2024-06-02T03:57:48.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.458+0000 7fad24dd9700 1 -- 172.21.15.123:0/1954733057 --> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fad20101ea0 con 0x7fad080386e0 2024-06-02T03:57:48.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.467+0000 7fad0f7fe700 1 -- 172.21.15.123:0/1954733057 <== mgr.14120 v2:172.21.15.123:6800/3555101542 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fad20101ea0 con 0x7fad080386e0 2024-06-02T03:57:48.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.469+0000 7fad24dd9700 1 -- 172.21.15.123:0/1954733057 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fad080386e0 msgr2=0x7fad0803aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:48.865 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.469+0000 7fad24dd9700 1 --2- 172.21.15.123:0/1954733057 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fad080386e0 0x7fad0803aba0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fad14006fd0 tx=0x7fad14006e40 comp rx=0 tx=0).stop 2024-06-02T03:57:48.865 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.469+0000 7fad24dd9700 1 -- 172.21.15.123:0/1954733057 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad20105600 msgr2=0x7fad20079a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:48.865 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.469+0000 7fad24dd9700 1 --2- 172.21.15.123:0/1954733057 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad20105600 0x7fad20079a40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fad10009130 tx=0x7fad10011ad0 comp rx=0 tx=0).stop 2024-06-02T03:57:48.865 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.469+0000 7fad24dd9700 1 -- 172.21.15.123:0/1954733057 shutdown_connections 2024-06-02T03:57:48.865 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.469+0000 7fad24dd9700 1 --2- 172.21.15.123:0/1954733057 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fad080386e0 0x7fad0803aba0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:48.865 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.469+0000 7fad24dd9700 1 --2- 172.21.15.123:0/1954733057 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad20105600 0x7fad20079a40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:48.865 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.469+0000 7fad24dd9700 1 -- 172.21.15.123:0/1954733057 >> 172.21.15.123:0/1954733057 conn(0x7fad20100bc0 msgr2=0x7fad20101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:48.865 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.469+0000 7fad24dd9700 1 -- 172.21.15.123:0/1954733057 shutdown_connections 2024-06-02T03:57:48.865 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:48.469+0000 7fad24dd9700 1 -- 172.21.15.123:0/1954733057 wait complete. 2024-06-02T03:57:49.702 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:49 smithi123 ceph-mon[42885]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T03:57:49.763 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout value unchanged 2024-06-02T03:57:49.764 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.214+0000 7f53edaa4700 1 Processor -- start 2024-06-02T03:57:49.764 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.214+0000 7f53edaa4700 1 -- start start 2024-06-02T03:57:49.764 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.214+0000 7f53edaa4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e8106710 0x7f53e8106b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:49.764 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.214+0000 7f53edaa4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e8107100 con 0x7f53e8106710 2024-06-02T03:57:49.764 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.214+0000 7f53e77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e8106710 0x7f53e8106b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:49.764 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.214+0000 7f53e77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e8106710 0x7f53e8106b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42086/0 (socket says 172.21.15.123:42086) 2024-06-02T03:57:49.764 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.214+0000 7f53e77fe700 1 -- 172.21.15.123:0/1717691680 learned_addr learned my addr 172.21.15.123:0/1717691680 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:49.764 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.214+0000 7f53e77fe700 1 -- 172.21.15.123:0/1717691680 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e81078c0 con 0x7f53e8106710 2024-06-02T03:57:49.764 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.215+0000 7f53e77fe700 1 --2- 172.21.15.123:0/1717691680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e8106710 0x7f53e8106b30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f53d80098a0 tx=0x7f53d8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c6c6985b1577823 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:49.764 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.215+0000 7f53e67fc700 1 -- 172.21.15.123:0/1717691680 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53d8004160 con 0x7f53e8106710 2024-06-02T03:57:49.764 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.215+0000 7f53e67fc700 1 -- 172.21.15.123:0/1717691680 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f53d80042c0 con 0x7f53e8106710 2024-06-02T03:57:49.765 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.215+0000 7f53e67fc700 1 -- 172.21.15.123:0/1717691680 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53d8011a00 con 0x7f53e8106710 2024-06-02T03:57:49.765 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.215+0000 7f53edaa4700 1 -- 172.21.15.123:0/1717691680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e8106710 msgr2=0x7f53e8106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:49.765 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.215+0000 7f53edaa4700 1 --2- 172.21.15.123:0/1717691680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e8106710 0x7f53e8106b30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f53d80098a0 tx=0x7f53d8009bb0 comp rx=0 tx=0).stop 2024-06-02T03:57:49.765 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.215+0000 7f53edaa4700 1 -- 172.21.15.123:0/1717691680 shutdown_connections 2024-06-02T03:57:49.765 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.215+0000 7f53edaa4700 1 --2- 172.21.15.123:0/1717691680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e8106710 0x7f53e8106b30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:49.765 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.215+0000 7f53edaa4700 1 -- 172.21.15.123:0/1717691680 >> 172.21.15.123:0/1717691680 conn(0x7f53e8101cd0 msgr2=0x7f53e81040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:49.765 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.215+0000 7f53edaa4700 1 -- 172.21.15.123:0/1717691680 shutdown_connections 2024-06-02T03:57:49.765 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.215+0000 7f53edaa4700 1 -- 172.21.15.123:0/1717691680 wait complete. 2024-06-02T03:57:49.765 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.216+0000 7f53edaa4700 1 Processor -- start 2024-06-02T03:57:49.765 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.216+0000 7f53edaa4700 1 -- start start 2024-06-02T03:57:49.765 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.216+0000 7f53edaa4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e8106710 0x7f53e819a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:49.765 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.216+0000 7f53edaa4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e819a970 con 0x7f53e8106710 2024-06-02T03:57:49.765 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.216+0000 7f53e77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e8106710 0x7f53e819a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:49.765 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.216+0000 7f53e77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e8106710 0x7f53e819a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42090/0 (socket says 172.21.15.123:42090) 2024-06-02T03:57:49.766 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.216+0000 7f53e77fe700 1 -- 172.21.15.123:0/3837375621 learned_addr learned my addr 172.21.15.123:0/3837375621 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:49.766 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.217+0000 7f53e77fe700 1 -- 172.21.15.123:0/3837375621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d8009550 con 0x7f53e8106710 2024-06-02T03:57:49.766 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.217+0000 7f53e77fe700 1 --2- 172.21.15.123:0/3837375621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e8106710 0x7f53e819a430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f53d8009130 tx=0x7f53d8011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:49.766 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.217+0000 7f53e4ff9700 1 -- 172.21.15.123:0/3837375621 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53d8003ab0 con 0x7f53e8106710 2024-06-02T03:57:49.766 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.217+0000 7f53e4ff9700 1 -- 172.21.15.123:0/3837375621 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f53d8003c10 con 0x7f53e8106710 2024-06-02T03:57:49.766 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.217+0000 7f53edaa4700 1 -- 172.21.15.123:0/3837375621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e819ab70 con 0x7f53e8106710 2024-06-02T03:57:49.766 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.217+0000 7f53e4ff9700 1 -- 172.21.15.123:0/3837375621 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f53d80247d0 con 0x7f53e8106710 2024-06-02T03:57:49.766 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.217+0000 7f53edaa4700 1 -- 172.21.15.123:0/3837375621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e819b010 con 0x7f53e8106710 2024-06-02T03:57:49.766 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.218+0000 7f53e4ff9700 1 -- 172.21.15.123:0/3837375621 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f53d802d3f0 con 0x7f53e8106710 2024-06-02T03:57:49.766 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.218+0000 7f53e4ff9700 1 --2- 172.21.15.123:0/3837375621 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f53d0038700 0x7f53d003abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:49.766 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.218+0000 7f53e4ff9700 1 -- 172.21.15.123:0/3837375621 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f53d804c9e0 con 0x7f53e8106710 2024-06-02T03:57:49.766 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.218+0000 7f53e6ffd700 1 --2- 172.21.15.123:0/3837375621 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f53d0038700 0x7f53d003abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:49.766 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.218+0000 7f53edaa4700 1 -- 172.21.15.123:0/3837375621 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e80625d0 con 0x7f53e8106710 2024-06-02T03:57:49.767 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.219+0000 7f53e6ffd700 1 --2- 172.21.15.123:0/3837375621 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f53d0038700 0x7f53d003abc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f53dc006fd0 tx=0x7f53dc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:49.767 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.223+0000 7f53e4ff9700 1 -- 172.21.15.123:0/3837375621 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f53d8010970 con 0x7f53e8106710 2024-06-02T03:57:49.767 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.416+0000 7f53edaa4700 1 -- 172.21.15.123:0/3837375621 --> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f53e8102fe0 con 0x7f53d0038700 2024-06-02T03:57:49.767 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.417+0000 7f53e4ff9700 1 -- 172.21.15.123:0/3837375621 <== mgr.14120 v2:172.21.15.123:6800/3555101542 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f53e8102fe0 con 0x7f53d0038700 2024-06-02T03:57:49.767 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.419+0000 7f53edaa4700 1 -- 172.21.15.123:0/3837375621 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f53d0038700 msgr2=0x7f53d003abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:49.767 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.419+0000 7f53edaa4700 1 --2- 172.21.15.123:0/3837375621 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f53d0038700 0x7f53d003abc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f53dc006fd0 tx=0x7f53dc006e40 comp rx=0 tx=0).stop 2024-06-02T03:57:49.767 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.419+0000 7f53edaa4700 1 -- 172.21.15.123:0/3837375621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e8106710 msgr2=0x7f53e819a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:49.767 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.419+0000 7f53edaa4700 1 --2- 172.21.15.123:0/3837375621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e8106710 0x7f53e819a430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f53d8009130 tx=0x7f53d8011ad0 comp rx=0 tx=0).stop 2024-06-02T03:57:49.767 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.419+0000 7f53edaa4700 1 -- 172.21.15.123:0/3837375621 shutdown_connections 2024-06-02T03:57:49.767 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.419+0000 7f53edaa4700 1 --2- 172.21.15.123:0/3837375621 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f53d0038700 0x7f53d003abc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:49.767 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.419+0000 7f53edaa4700 1 --2- 172.21.15.123:0/3837375621 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f53e8106710 0x7f53e819a430 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:49.767 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.419+0000 7f53edaa4700 1 -- 172.21.15.123:0/3837375621 >> 172.21.15.123:0/3837375621 conn(0x7f53e8101cd0 msgr2=0x7f53e81028d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:49.767 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.419+0000 7f53edaa4700 1 -- 172.21.15.123:0/3837375621 shutdown_connections 2024-06-02T03:57:49.768 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:49.419+0000 7f53edaa4700 1 -- 172.21.15.123:0/3837375621 wait complete. 2024-06-02T03:57:49.768 INFO:teuthology.orchestra.run.smithi123.stdout:Generating ssh key... 2024-06-02T03:57:50.877 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:50 smithi123 ceph-mon[42885]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T03:57:50.877 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:50 smithi123 ceph-mon[42885]: from='mgr.14120 172.21.15.123:0/2131965966' entity='mgr.x' 2024-06-02T03:57:50.877 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:50 smithi123 ceph-mon[42885]: from='mgr.14120 172.21.15.123:0/2131965966' entity='mgr.x' 2024-06-02T03:57:50.878 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:50 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: Generating public/private rsa key pair. 2024-06-02T03:57:50.878 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:50 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: Your identification has been saved in /tmp/tmpmhihvl6n/key. 2024-06-02T03:57:50.878 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:50 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: Your public key has been saved in /tmp/tmpmhihvl6n/key.pub. 2024-06-02T03:57:50.878 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:50 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: The key fingerprint is: 2024-06-02T03:57:50.878 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:50 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: SHA256:zJe0RgtPRmFwO1/tki1VeAcvjnS4ug4XbvBeqt6APNc ceph-1b432ae0-2094-11ef-bc9b-c7b262605968 2024-06-02T03:57:50.878 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:50 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: The key's randomart image is: 2024-06-02T03:57:50.878 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:50 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: +---[RSA 3072]----+ 2024-06-02T03:57:50.878 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:50 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: | ..=. .o.| 2024-06-02T03:57:50.878 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:50 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: | + . ..o+| 2024-06-02T03:57:50.878 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:50 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: | . B o +.=| 2024-06-02T03:57:50.878 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:50 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: | o B B * * | 2024-06-02T03:57:50.878 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:50 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: | S O + = o| 2024-06-02T03:57:50.879 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:50 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: | . . B o o | 2024-06-02T03:57:50.879 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:50 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: | + + E . | 2024-06-02T03:57:50.879 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:50 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: | o B + | 2024-06-02T03:57:50.879 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:50 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: | .oo* | 2024-06-02T03:57:50.879 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:57:50 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: +----[SHA256]-----+ 2024-06-02T03:57:50.938 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.097+0000 7f64cb5c5700 1 Processor -- start 2024-06-02T03:57:50.938 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.097+0000 7f64cb5c5700 1 -- start start 2024-06-02T03:57:50.938 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.097+0000 7f64cb5c5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64c41071a0 0x7f64c4109590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:50.938 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.097+0000 7f64cb5c5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c4079f50 con 0x7f64c41071a0 2024-06-02T03:57:50.938 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.098+0000 7f64c9361700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64c41071a0 0x7f64c4109590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:50.938 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.098+0000 7f64c9361700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64c41071a0 0x7f64c4109590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42100/0 (socket says 172.21.15.123:42100) 2024-06-02T03:57:50.938 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.098+0000 7f64c9361700 1 -- 172.21.15.123:0/2319274226 learned_addr learned my addr 172.21.15.123:0/2319274226 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:50.938 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.098+0000 7f64c9361700 1 -- 172.21.15.123:0/2319274226 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c4109ad0 con 0x7f64c41071a0 2024-06-02T03:57:50.938 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.098+0000 7f64c9361700 1 --2- 172.21.15.123:0/2319274226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64c41071a0 0x7f64c4109590 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f64b40098a0 tx=0x7f64b4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3054704131df5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:50.938 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.098+0000 7f64bbfff700 1 -- 172.21.15.123:0/2319274226 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f64b4004160 con 0x7f64c41071a0 2024-06-02T03:57:50.939 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.098+0000 7f64bbfff700 1 -- 172.21.15.123:0/2319274226 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f64b40042c0 con 0x7f64c41071a0 2024-06-02T03:57:50.939 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.098+0000 7f64bbfff700 1 -- 172.21.15.123:0/2319274226 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f64b4011a00 con 0x7f64c41071a0 2024-06-02T03:57:50.939 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.099+0000 7f64cb5c5700 1 -- 172.21.15.123:0/2319274226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64c41071a0 msgr2=0x7f64c4109590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:50.939 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.099+0000 7f64cb5c5700 1 --2- 172.21.15.123:0/2319274226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64c41071a0 0x7f64c4109590 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f64b40098a0 tx=0x7f64b4009bb0 comp rx=0 tx=0).stop 2024-06-02T03:57:50.939 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.099+0000 7f64cb5c5700 1 -- 172.21.15.123:0/2319274226 shutdown_connections 2024-06-02T03:57:50.939 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.099+0000 7f64cb5c5700 1 --2- 172.21.15.123:0/2319274226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64c41071a0 0x7f64c4109590 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:50.939 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.099+0000 7f64cb5c5700 1 -- 172.21.15.123:0/2319274226 >> 172.21.15.123:0/2319274226 conn(0x7f64c4100bf0 msgr2=0x7f64c4103010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:50.939 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.099+0000 7f64cb5c5700 1 -- 172.21.15.123:0/2319274226 shutdown_connections 2024-06-02T03:57:50.939 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.099+0000 7f64cb5c5700 1 -- 172.21.15.123:0/2319274226 wait complete. 2024-06-02T03:57:50.939 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.099+0000 7f64cb5c5700 1 Processor -- start 2024-06-02T03:57:50.939 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.100+0000 7f64cb5c5700 1 -- start start 2024-06-02T03:57:50.939 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.100+0000 7f64cb5c5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64c41071a0 0x7f64c419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:50.939 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.100+0000 7f64cb5c5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c419aa10 con 0x7f64c41071a0 2024-06-02T03:57:50.940 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.100+0000 7f64c9361700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64c41071a0 0x7f64c419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:50.940 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.100+0000 7f64c9361700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64c41071a0 0x7f64c419a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42114/0 (socket says 172.21.15.123:42114) 2024-06-02T03:57:50.940 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.100+0000 7f64c9361700 1 -- 172.21.15.123:0/1564497012 learned_addr learned my addr 172.21.15.123:0/1564497012 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:50.940 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.100+0000 7f64c9361700 1 -- 172.21.15.123:0/1564497012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b4009550 con 0x7f64c41071a0 2024-06-02T03:57:50.940 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.100+0000 7f64c9361700 1 --2- 172.21.15.123:0/1564497012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64c41071a0 0x7f64c419a4d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f64b4009fb0 tx=0x7f64b4011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:50.940 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.100+0000 7f64ba7fc700 1 -- 172.21.15.123:0/1564497012 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f64b4003a40 con 0x7f64c41071a0 2024-06-02T03:57:50.940 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.100+0000 7f64cb5c5700 1 -- 172.21.15.123:0/1564497012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c419ac10 con 0x7f64c41071a0 2024-06-02T03:57:50.940 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.100+0000 7f64ba7fc700 1 -- 172.21.15.123:0/1564497012 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f64b4003ba0 con 0x7f64c41071a0 2024-06-02T03:57:50.940 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.100+0000 7f64ba7fc700 1 -- 172.21.15.123:0/1564497012 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f64b401a750 con 0x7f64c41071a0 2024-06-02T03:57:50.940 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.100+0000 7f64cb5c5700 1 -- 172.21.15.123:0/1564497012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c419b0b0 con 0x7f64c41071a0 2024-06-02T03:57:50.940 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.101+0000 7f64ba7fc700 1 -- 172.21.15.123:0/1564497012 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f64b401a9d0 con 0x7f64c41071a0 2024-06-02T03:57:50.940 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.101+0000 7f64cb5c5700 1 -- 172.21.15.123:0/1564497012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c410a990 con 0x7f64c41071a0 2024-06-02T03:57:50.940 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.101+0000 7f64ba7fc700 1 --2- 172.21.15.123:0/1564497012 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f64b00386b0 0x7f64b003ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:50.941 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.101+0000 7f64ba7fc700 1 -- 172.21.15.123:0/1564497012 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f64b404c8f0 con 0x7f64c41071a0 2024-06-02T03:57:50.941 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.101+0000 7f64c8b60700 1 --2- 172.21.15.123:0/1564497012 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f64b00386b0 0x7f64b003ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:50.941 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.102+0000 7f64c8b60700 1 --2- 172.21.15.123:0/1564497012 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f64b00386b0 0x7f64b003ab70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f64c0006fd0 tx=0x7f64c0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:50.941 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.106+0000 7f64ba7fc700 1 -- 172.21.15.123:0/1564497012 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f64b402cb40 con 0x7f64c41071a0 2024-06-02T03:57:50.941 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.299+0000 7f64cb5c5700 1 -- 172.21.15.123:0/1564497012 --> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f64c419d940 con 0x7f64b00386b0 2024-06-02T03:57:50.941 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.584+0000 7f64ba7fc700 1 -- 172.21.15.123:0/1564497012 <== mgr.14120 v2:172.21.15.123:6800/3555101542 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f64c419d940 con 0x7f64b00386b0 2024-06-02T03:57:50.941 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.587+0000 7f64cb5c5700 1 -- 172.21.15.123:0/1564497012 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f64b00386b0 msgr2=0x7f64b003ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:50.941 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.587+0000 7f64cb5c5700 1 --2- 172.21.15.123:0/1564497012 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f64b00386b0 0x7f64b003ab70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f64c0006fd0 tx=0x7f64c0006e40 comp rx=0 tx=0).stop 2024-06-02T03:57:50.941 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.587+0000 7f64cb5c5700 1 -- 172.21.15.123:0/1564497012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64c41071a0 msgr2=0x7f64c419a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:50.941 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.587+0000 7f64cb5c5700 1 --2- 172.21.15.123:0/1564497012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64c41071a0 0x7f64c419a4d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f64b4009fb0 tx=0x7f64b4011ad0 comp rx=0 tx=0).stop 2024-06-02T03:57:50.941 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.587+0000 7f64cb5c5700 1 -- 172.21.15.123:0/1564497012 shutdown_connections 2024-06-02T03:57:50.941 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.587+0000 7f64cb5c5700 1 --2- 172.21.15.123:0/1564497012 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f64b00386b0 0x7f64b003ab70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:50.941 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.587+0000 7f64cb5c5700 1 --2- 172.21.15.123:0/1564497012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f64c41071a0 0x7f64c419a4d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:50.942 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.587+0000 7f64cb5c5700 1 -- 172.21.15.123:0/1564497012 >> 172.21.15.123:0/1564497012 conn(0x7f64c4100bf0 msgr2=0x7f64c4101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:50.942 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.587+0000 7f64cb5c5700 1 -- 172.21.15.123:0/1564497012 shutdown_connections 2024-06-02T03:57:50.942 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:50.587+0000 7f64cb5c5700 1 -- 172.21.15.123:0/1564497012 wait complete. 2024-06-02T03:57:51.802 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:51 smithi123 ceph-mon[42885]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T03:57:51.802 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:51 smithi123 ceph-mon[42885]: Generating ssh key... 2024-06-02T03:57:51.863 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsbGeRsgtRYf0RepvwKG40fs6gPp2MmeXCIJ9sY9gMhNECzRrnAqQE+lmQHQV+XDQFnBqBBgr+mbzLkor3j5Z3vxg6ZLSwo8g2hqSAI1AqdHlkqRe8ifvtFTYSTljF3qUvbOz2FO+2u3PXdw8FzRlEWyOFQfc9ZduEkGH86+lgRGHOPwdrUNtADyjTCzRFxxoWHv9tfFIFX6s5X4bTW3WsHD8BZUPuBFB/NJKi3pB94nglFeRAnAcgQHxUgXDh2ms9YMgiy4LC6rS+uOlQWZyQeaBcJ0PyPcmQ1MOwpq7Tnl2EBcXTG7/2t74N0Nr3RzWJgLMnLlt0+KSZb5R7/VmjXnz+yBtxHDaEwSIOohzkewoHC+UFEMw7faRL5ExexCNoYu4jqnxZQjEjXEAE1Eif9sYXTcdRbwJ5auuLlQZjVcNtwVngZDlAOSZLE/HSn2MzS4yKf7bDKDbgzxR3XjUvUYzIketag3I484fbE9QaYyLm73n+bTh/urrUsG6S/k0= ceph-1b432ae0-2094-11ef-bc9b-c7b262605968 2024-06-02T03:57:51.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.296+0000 7effed659700 1 Processor -- start 2024-06-02T03:57:51.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.296+0000 7effed659700 1 -- start start 2024-06-02T03:57:51.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.296+0000 7effed659700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effe81049c0 0x7effe8104de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:51.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.296+0000 7effed659700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe81053b0 con 0x7effe81049c0 2024-06-02T03:57:51.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.297+0000 7effe6ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effe81049c0 0x7effe8104de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:51.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.297+0000 7effe6ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effe81049c0 0x7effe8104de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42128/0 (socket says 172.21.15.123:42128) 2024-06-02T03:57:51.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.297+0000 7effe6ffd700 1 -- 172.21.15.123:0/580735528 learned_addr learned my addr 172.21.15.123:0/580735528 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:51.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.297+0000 7effe6ffd700 1 -- 172.21.15.123:0/580735528 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe8107950 con 0x7effe81049c0 2024-06-02T03:57:51.864 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.297+0000 7effe6ffd700 1 --2- 172.21.15.123:0/580735528 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effe81049c0 0x7effe8104de0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7effd80098a0 tx=0x7effd8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6057b55fbb2bf72c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:51.865 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.297+0000 7effe5ffb700 1 -- 172.21.15.123:0/580735528 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7effd8004160 con 0x7effe81049c0 2024-06-02T03:57:51.865 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.297+0000 7effe5ffb700 1 -- 172.21.15.123:0/580735528 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7effd80042c0 con 0x7effe81049c0 2024-06-02T03:57:51.865 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.297+0000 7effe5ffb700 1 -- 172.21.15.123:0/580735528 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7effd8011a00 con 0x7effe81049c0 2024-06-02T03:57:51.865 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.298+0000 7effed659700 1 -- 172.21.15.123:0/580735528 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effe81049c0 msgr2=0x7effe8104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:51.865 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.298+0000 7effed659700 1 --2- 172.21.15.123:0/580735528 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effe81049c0 0x7effe8104de0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7effd80098a0 tx=0x7effd8009bb0 comp rx=0 tx=0).stop 2024-06-02T03:57:51.865 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.298+0000 7effed659700 1 -- 172.21.15.123:0/580735528 shutdown_connections 2024-06-02T03:57:51.865 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.298+0000 7effed659700 1 --2- 172.21.15.123:0/580735528 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effe81049c0 0x7effe8104de0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:51.866 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.298+0000 7effed659700 1 -- 172.21.15.123:0/580735528 >> 172.21.15.123:0/580735528 conn(0x7effe8100350 msgr2=0x7effe8102770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:51.866 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.298+0000 7effed659700 1 -- 172.21.15.123:0/580735528 shutdown_connections 2024-06-02T03:57:51.866 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.298+0000 7effed659700 1 -- 172.21.15.123:0/580735528 wait complete. 2024-06-02T03:57:51.866 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.298+0000 7effed659700 1 Processor -- start 2024-06-02T03:57:51.866 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.299+0000 7effed659700 1 -- start start 2024-06-02T03:57:51.866 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.299+0000 7effed659700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effe81049c0 0x7effe819a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:51.866 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.299+0000 7effed659700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe819a970 con 0x7effe81049c0 2024-06-02T03:57:51.866 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.299+0000 7effe6ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effe81049c0 0x7effe819a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:51.866 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.299+0000 7effe6ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effe81049c0 0x7effe819a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42140/0 (socket says 172.21.15.123:42140) 2024-06-02T03:57:51.866 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.299+0000 7effe6ffd700 1 -- 172.21.15.123:0/452927515 learned_addr learned my addr 172.21.15.123:0/452927515 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:51.866 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.299+0000 7effe6ffd700 1 -- 172.21.15.123:0/452927515 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd8009550 con 0x7effe81049c0 2024-06-02T03:57:51.866 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.299+0000 7effe6ffd700 1 --2- 172.21.15.123:0/452927515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effe81049c0 0x7effe819a430 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7effd8009fb0 tx=0x7effd8011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:51.866 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.299+0000 7effcffff700 1 -- 172.21.15.123:0/452927515 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7effd8003a40 con 0x7effe81049c0 2024-06-02T03:57:51.867 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.299+0000 7effcffff700 1 -- 172.21.15.123:0/452927515 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7effd8003ba0 con 0x7effe81049c0 2024-06-02T03:57:51.867 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.299+0000 7effed659700 1 -- 172.21.15.123:0/452927515 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effe819ab70 con 0x7effe81049c0 2024-06-02T03:57:51.867 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.299+0000 7effcffff700 1 -- 172.21.15.123:0/452927515 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7effd801a750 con 0x7effe81049c0 2024-06-02T03:57:51.867 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.299+0000 7effed659700 1 -- 172.21.15.123:0/452927515 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effe819b010 con 0x7effe81049c0 2024-06-02T03:57:51.867 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.300+0000 7effcffff700 1 -- 172.21.15.123:0/452927515 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7effd801a9d0 con 0x7effe81049c0 2024-06-02T03:57:51.867 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.300+0000 7effed659700 1 -- 172.21.15.123:0/452927515 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effe810ab60 con 0x7effe81049c0 2024-06-02T03:57:51.867 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.300+0000 7effcffff700 1 --2- 172.21.15.123:0/452927515 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7effd00386b0 0x7effd003ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:51.867 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.300+0000 7effcffff700 1 -- 172.21.15.123:0/452927515 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7effd804c6f0 con 0x7effe81049c0 2024-06-02T03:57:51.867 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.301+0000 7effe67fc700 1 --2- 172.21.15.123:0/452927515 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7effd00386b0 0x7effd003ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:51.867 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.301+0000 7effe67fc700 1 --2- 172.21.15.123:0/452927515 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7effd00386b0 0x7effd003ab70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7effdc006fd0 tx=0x7effdc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:51.867 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.305+0000 7effcffff700 1 -- 172.21.15.123:0/452927515 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7effd8018d20 con 0x7effe81049c0 2024-06-02T03:57:51.867 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.500+0000 7effed659700 1 -- 172.21.15.123:0/452927515 --> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7effe819d8a0 con 0x7effd00386b0 2024-06-02T03:57:51.868 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.501+0000 7effcffff700 1 -- 172.21.15.123:0/452927515 <== mgr.14120 v2:172.21.15.123:6800/3555101542 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7effe819d8a0 con 0x7effd00386b0 2024-06-02T03:57:51.868 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.503+0000 7effed659700 1 -- 172.21.15.123:0/452927515 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7effd00386b0 msgr2=0x7effd003ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:51.868 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.503+0000 7effed659700 1 --2- 172.21.15.123:0/452927515 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7effd00386b0 0x7effd003ab70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7effdc006fd0 tx=0x7effdc006e40 comp rx=0 tx=0).stop 2024-06-02T03:57:51.868 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.503+0000 7effed659700 1 -- 172.21.15.123:0/452927515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effe81049c0 msgr2=0x7effe819a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:51.868 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.503+0000 7effed659700 1 --2- 172.21.15.123:0/452927515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effe81049c0 0x7effe819a430 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7effd8009fb0 tx=0x7effd8011ad0 comp rx=0 tx=0).stop 2024-06-02T03:57:51.868 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.503+0000 7effed659700 1 -- 172.21.15.123:0/452927515 shutdown_connections 2024-06-02T03:57:51.868 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.503+0000 7effed659700 1 --2- 172.21.15.123:0/452927515 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7effd00386b0 0x7effd003ab70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:51.868 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.503+0000 7effed659700 1 --2- 172.21.15.123:0/452927515 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7effe81049c0 0x7effe819a430 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:51.868 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.503+0000 7effed659700 1 -- 172.21.15.123:0/452927515 >> 172.21.15.123:0/452927515 conn(0x7effe8100350 msgr2=0x7effe8100f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:51.868 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.503+0000 7effed659700 1 -- 172.21.15.123:0/452927515 shutdown_connections 2024-06-02T03:57:51.868 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:51.503+0000 7effed659700 1 -- 172.21.15.123:0/452927515 wait complete. 2024-06-02T03:57:51.868 INFO:teuthology.orchestra.run.smithi123.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-06-02T03:57:51.868 INFO:teuthology.orchestra.run.smithi123.stdout:Adding key to root@localhost authorized_keys... 2024-06-02T03:57:51.869 INFO:teuthology.orchestra.run.smithi123.stdout:Adding host smithi123... 2024-06-02T03:57:52.688 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:52 smithi123 ceph-mon[42885]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T03:57:54.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:53 smithi123 ceph-mon[42885]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi123", "addr": "172.21.15.123", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T03:57:54.929 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout Added host 'smithi123' with addr '172.21.15.123' 2024-06-02T03:57:54.930 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.216+0000 7faa05b8c700 1 Processor -- start 2024-06-02T03:57:54.930 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.216+0000 7faa05b8c700 1 -- start start 2024-06-02T03:57:54.930 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.216+0000 7faa05b8c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa00106710 0x7faa00106b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:54.930 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.216+0000 7faa05b8c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa00107100 con 0x7faa00106710 2024-06-02T03:57:54.930 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.216+0000 7fa9ff7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa00106710 0x7faa00106b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:54.930 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.216+0000 7fa9ff7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa00106710 0x7faa00106b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42146/0 (socket says 172.21.15.123:42146) 2024-06-02T03:57:54.930 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.216+0000 7fa9ff7fe700 1 -- 172.21.15.123:0/3771476548 learned_addr learned my addr 172.21.15.123:0/3771476548 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:54.930 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.216+0000 7fa9ff7fe700 1 -- 172.21.15.123:0/3771476548 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa001078c0 con 0x7faa00106710 2024-06-02T03:57:54.930 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.217+0000 7fa9ff7fe700 1 --2- 172.21.15.123:0/3771476548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa00106710 0x7faa00106b30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa9f00098a0 tx=0x7fa9f0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94054f1581034017 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:54.930 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.217+0000 7fa9fe7fc700 1 -- 172.21.15.123:0/3771476548 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9f0004160 con 0x7faa00106710 2024-06-02T03:57:54.930 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.217+0000 7fa9fe7fc700 1 -- 172.21.15.123:0/3771476548 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa9f00042c0 con 0x7faa00106710 2024-06-02T03:57:54.931 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.217+0000 7fa9fe7fc700 1 -- 172.21.15.123:0/3771476548 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9f0011a00 con 0x7faa00106710 2024-06-02T03:57:54.931 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.217+0000 7faa05b8c700 1 -- 172.21.15.123:0/3771476548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa00106710 msgr2=0x7faa00106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:54.931 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.217+0000 7faa05b8c700 1 --2- 172.21.15.123:0/3771476548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa00106710 0x7faa00106b30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa9f00098a0 tx=0x7fa9f0009bb0 comp rx=0 tx=0).stop 2024-06-02T03:57:54.931 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.217+0000 7faa05b8c700 1 -- 172.21.15.123:0/3771476548 shutdown_connections 2024-06-02T03:57:54.931 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.217+0000 7faa05b8c700 1 --2- 172.21.15.123:0/3771476548 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa00106710 0x7faa00106b30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:54.931 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.217+0000 7faa05b8c700 1 -- 172.21.15.123:0/3771476548 >> 172.21.15.123:0/3771476548 conn(0x7faa00101d30 msgr2=0x7faa00104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:54.931 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.217+0000 7faa05b8c700 1 -- 172.21.15.123:0/3771476548 shutdown_connections 2024-06-02T03:57:54.931 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.217+0000 7faa05b8c700 1 -- 172.21.15.123:0/3771476548 wait complete. 2024-06-02T03:57:54.931 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.218+0000 7faa05b8c700 1 Processor -- start 2024-06-02T03:57:54.931 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.218+0000 7faa05b8c700 1 -- start start 2024-06-02T03:57:54.931 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.219+0000 7faa05b8c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa00106710 0x7faa0019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:54.931 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.219+0000 7faa05b8c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0019a9e0 con 0x7faa00106710 2024-06-02T03:57:54.931 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.219+0000 7fa9ff7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa00106710 0x7faa0019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:54.932 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.219+0000 7fa9ff7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa00106710 0x7faa0019a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42160/0 (socket says 172.21.15.123:42160) 2024-06-02T03:57:54.932 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.219+0000 7fa9ff7fe700 1 -- 172.21.15.123:0/242379070 learned_addr learned my addr 172.21.15.123:0/242379070 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:54.932 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.219+0000 7fa9ff7fe700 1 -- 172.21.15.123:0/242379070 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f0009550 con 0x7faa00106710 2024-06-02T03:57:54.932 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.219+0000 7fa9ff7fe700 1 --2- 172.21.15.123:0/242379070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa00106710 0x7faa0019a4a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0009130 tx=0x7fa9f0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:54.932 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.219+0000 7fa9fcff9700 1 -- 172.21.15.123:0/242379070 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9f00038b0 con 0x7faa00106710 2024-06-02T03:57:54.932 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.219+0000 7fa9fcff9700 1 -- 172.21.15.123:0/242379070 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa9f0003a10 con 0x7faa00106710 2024-06-02T03:57:54.932 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.219+0000 7faa05b8c700 1 -- 172.21.15.123:0/242379070 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa0019abe0 con 0x7faa00106710 2024-06-02T03:57:54.932 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.219+0000 7fa9fcff9700 1 -- 172.21.15.123:0/242379070 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9f0019550 con 0x7faa00106710 2024-06-02T03:57:54.932 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.219+0000 7faa05b8c700 1 -- 172.21.15.123:0/242379070 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa0019b080 con 0x7faa00106710 2024-06-02T03:57:54.932 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.220+0000 7fa9fcff9700 1 -- 172.21.15.123:0/242379070 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fa9f001a960 con 0x7faa00106710 2024-06-02T03:57:54.932 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.220+0000 7faa05b8c700 1 -- 172.21.15.123:0/242379070 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa0010aaf0 con 0x7faa00106710 2024-06-02T03:57:54.932 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.220+0000 7fa9fcff9700 1 --2- 172.21.15.123:0/242379070 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fa9e80386e0 0x7fa9e803aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:54.932 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.220+0000 7fa9fcff9700 1 -- 172.21.15.123:0/242379070 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa9f004c770 con 0x7faa00106710 2024-06-02T03:57:54.933 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.221+0000 7fa9feffd700 1 --2- 172.21.15.123:0/242379070 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fa9e80386e0 0x7fa9e803aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:54.933 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.221+0000 7fa9feffd700 1 --2- 172.21.15.123:0/242379070 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fa9e80386e0 0x7fa9e803aba0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4006fd0 tx=0x7fa9f4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:54.933 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.225+0000 7fa9fcff9700 1 -- 172.21.15.123:0/242379070 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa9f0003b80 con 0x7faa00106710 2024-06-02T03:57:54.933 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:52.419+0000 7faa05b8c700 1 -- 172.21.15.123:0/242379070 --> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi123", "addr": "172.21.15.123", "target": ["mon-mgr", ""]}) v1 -- 0x7faa0019d970 con 0x7fa9e80386e0 2024-06-02T03:57:54.933 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:54.584+0000 7fa9fcff9700 1 -- 172.21.15.123:0/242379070 <== mgr.14120 v2:172.21.15.123:6800/3555101542 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7faa0019d970 con 0x7fa9e80386e0 2024-06-02T03:57:54.933 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:54.587+0000 7faa05b8c700 1 -- 172.21.15.123:0/242379070 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fa9e80386e0 msgr2=0x7fa9e803aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:54.933 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:54.587+0000 7faa05b8c700 1 --2- 172.21.15.123:0/242379070 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fa9e80386e0 0x7fa9e803aba0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4006fd0 tx=0x7fa9f4006e40 comp rx=0 tx=0).stop 2024-06-02T03:57:54.933 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:54.587+0000 7faa05b8c700 1 -- 172.21.15.123:0/242379070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa00106710 msgr2=0x7faa0019a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:54.933 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:54.587+0000 7faa05b8c700 1 --2- 172.21.15.123:0/242379070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa00106710 0x7faa0019a4a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0009130 tx=0x7fa9f0011ad0 comp rx=0 tx=0).stop 2024-06-02T03:57:54.933 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:54.587+0000 7faa05b8c700 1 -- 172.21.15.123:0/242379070 shutdown_connections 2024-06-02T03:57:54.933 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:54.587+0000 7faa05b8c700 1 --2- 172.21.15.123:0/242379070 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fa9e80386e0 0x7fa9e803aba0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:54.933 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:54.587+0000 7faa05b8c700 1 --2- 172.21.15.123:0/242379070 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa00106710 0x7faa0019a4a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:54.934 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:54 smithi123 ceph-mon[42885]: Deploying cephadm binary to smithi123 2024-06-02T03:57:54.934 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:54 smithi123 ceph-mon[42885]: from='mgr.14120 172.21.15.123:0/2131965966' entity='mgr.x' 2024-06-02T03:57:54.934 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:54 smithi123 ceph-mon[42885]: from='mgr.14120 172.21.15.123:0/2131965966' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:57:54.935 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:54.587+0000 7faa05b8c700 1 -- 172.21.15.123:0/242379070 >> 172.21.15.123:0/242379070 conn(0x7faa00101d30 msgr2=0x7faa00102920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:54.935 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:54.587+0000 7faa05b8c700 1 -- 172.21.15.123:0/242379070 shutdown_connections 2024-06-02T03:57:54.935 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:54.587+0000 7faa05b8c700 1 -- 172.21.15.123:0/242379070 wait complete. 2024-06-02T03:57:54.935 INFO:teuthology.orchestra.run.smithi123.stdout:Deploying unmanaged mon service... 2024-06-02T03:57:55.773 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:55 smithi123 ceph-mon[42885]: Added host smithi123 2024-06-02T03:57:55.774 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:55 smithi123 ceph-mon[42885]: from='mgr.14120 172.21.15.123:0/2131965966' entity='mgr.x' 2024-06-02T03:57:56.156 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-06-02T03:57:56.156 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.379+0000 7f73ab851700 1 Processor -- start 2024-06-02T03:57:56.156 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.379+0000 7f73ab851700 1 -- start start 2024-06-02T03:57:56.157 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.379+0000 7f73ab851700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73a4105600 0x7f73a4105a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:56.157 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.379+0000 7f73ab851700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a4105ff0 con 0x7f73a4105600 2024-06-02T03:57:56.157 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.379+0000 7f73a95ed700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73a4105600 0x7f73a4105a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:56.157 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.379+0000 7f73a95ed700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73a4105600 0x7f73a4105a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53316/0 (socket says 172.21.15.123:53316) 2024-06-02T03:57:56.157 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.379+0000 7f73a95ed700 1 -- 172.21.15.123:0/3921448636 learned_addr learned my addr 172.21.15.123:0/3921448636 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:56.157 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.379+0000 7f73a95ed700 1 -- 172.21.15.123:0/3921448636 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a4106800 con 0x7f73a4105600 2024-06-02T03:57:56.157 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.379+0000 7f73a95ed700 1 --2- 172.21.15.123:0/3921448636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73a4105600 0x7f73a4105a20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7394009e80 tx=0x7f739400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e9f79f8559f2c6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:56.157 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.380+0000 7f73a3fff700 1 -- 172.21.15.123:0/3921448636 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f739400e070 con 0x7f73a4105600 2024-06-02T03:57:56.157 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.380+0000 7f73a3fff700 1 -- 172.21.15.123:0/3921448636 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f739400b8c0 con 0x7f73a4105600 2024-06-02T03:57:56.157 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.380+0000 7f73a3fff700 1 -- 172.21.15.123:0/3921448636 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f73940044c0 con 0x7f73a4105600 2024-06-02T03:57:56.157 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.380+0000 7f73ab851700 1 -- 172.21.15.123:0/3921448636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73a4105600 msgr2=0x7f73a4105a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:56.157 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.380+0000 7f73ab851700 1 --2- 172.21.15.123:0/3921448636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73a4105600 0x7f73a4105a20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7394009e80 tx=0x7f739400b330 comp rx=0 tx=0).stop 2024-06-02T03:57:56.158 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.380+0000 7f73ab851700 1 -- 172.21.15.123:0/3921448636 shutdown_connections 2024-06-02T03:57:56.158 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.380+0000 7f73ab851700 1 --2- 172.21.15.123:0/3921448636 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73a4105600 0x7f73a4105a20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:56.158 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.380+0000 7f73ab851700 1 -- 172.21.15.123:0/3921448636 >> 172.21.15.123:0/3921448636 conn(0x7f73a4100bc0 msgr2=0x7f73a4102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:56.158 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.380+0000 7f73ab851700 1 -- 172.21.15.123:0/3921448636 shutdown_connections 2024-06-02T03:57:56.158 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.380+0000 7f73ab851700 1 -- 172.21.15.123:0/3921448636 wait complete. 2024-06-02T03:57:56.158 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.381+0000 7f73ab851700 1 Processor -- start 2024-06-02T03:57:56.158 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.381+0000 7f73ab851700 1 -- start start 2024-06-02T03:57:56.158 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.381+0000 7f73ab851700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73a4105600 0x7f73a4079a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:56.158 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.381+0000 7f73ab851700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a4079f40 con 0x7f73a4105600 2024-06-02T03:57:56.158 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.381+0000 7f73a95ed700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73a4105600 0x7f73a4079a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:56.158 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.381+0000 7f73a95ed700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73a4105600 0x7f73a4079a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53318/0 (socket says 172.21.15.123:53318) 2024-06-02T03:57:56.158 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.381+0000 7f73a95ed700 1 -- 172.21.15.123:0/1593376491 learned_addr learned my addr 172.21.15.123:0/1593376491 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:56.159 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.381+0000 7f73a95ed700 1 -- 172.21.15.123:0/1593376491 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7394009b30 con 0x7f73a4105600 2024-06-02T03:57:56.159 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.382+0000 7f73a95ed700 1 --2- 172.21.15.123:0/1593376491 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73a4105600 0x7f73a4079a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7394009e50 tx=0x7f7394004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:56.159 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.382+0000 7f73a27fc700 1 -- 172.21.15.123:0/1593376491 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f739400e040 con 0x7f73a4105600 2024-06-02T03:57:56.159 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.382+0000 7f73a27fc700 1 -- 172.21.15.123:0/1593376491 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f739400bd70 con 0x7f73a4105600 2024-06-02T03:57:56.159 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.382+0000 7f73ab851700 1 -- 172.21.15.123:0/1593376491 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a419d1a0 con 0x7f73a4105600 2024-06-02T03:57:56.159 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.382+0000 7f73a27fc700 1 -- 172.21.15.123:0/1593376491 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f739401c730 con 0x7f73a4105600 2024-06-02T03:57:56.159 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.382+0000 7f73ab851700 1 -- 172.21.15.123:0/1593376491 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a419d6a0 con 0x7f73a4105600 2024-06-02T03:57:56.159 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.382+0000 7f73a27fc700 1 -- 172.21.15.123:0/1593376491 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f739401c970 con 0x7f73a4105600 2024-06-02T03:57:56.159 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.383+0000 7f73a27fc700 1 --2- 172.21.15.123:0/1593376491 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f738c0386b0 0x7f738c03ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:56.159 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.383+0000 7f73a27fc700 1 -- 172.21.15.123:0/1593376491 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f739404c6f0 con 0x7f73a4105600 2024-06-02T03:57:56.159 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.383+0000 7f73ab851700 1 -- 172.21.15.123:0/1593376491 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73a4109a30 con 0x7f73a4105600 2024-06-02T03:57:56.159 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.383+0000 7f73a8dec700 1 --2- 172.21.15.123:0/1593376491 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f738c0386b0 0x7f738c03ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:56.160 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.383+0000 7f73a8dec700 1 --2- 172.21.15.123:0/1593376491 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f738c0386b0 0x7f738c03ab70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7398006fd0 tx=0x7f7398006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:56.160 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.388+0000 7f73a27fc700 1 -- 172.21.15.123:0/1593376491 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7394017070 con 0x7f73a4105600 2024-06-02T03:57:56.160 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.603+0000 7f73ab851700 1 -- 172.21.15.123:0/1593376491 --> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f73a4101eb0 con 0x7f738c0386b0 2024-06-02T03:57:56.160 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.608+0000 7f73a27fc700 1 -- 172.21.15.123:0/1593376491 <== mgr.14120 v2:172.21.15.123:6800/3555101542 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f73a4101eb0 con 0x7f738c0386b0 2024-06-02T03:57:56.160 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.609+0000 7f73ab851700 1 -- 172.21.15.123:0/1593376491 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f738c0386b0 msgr2=0x7f738c03ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:56.160 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.609+0000 7f73ab851700 1 --2- 172.21.15.123:0/1593376491 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f738c0386b0 0x7f738c03ab70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7398006fd0 tx=0x7f7398006e40 comp rx=0 tx=0).stop 2024-06-02T03:57:56.160 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.609+0000 7f73ab851700 1 -- 172.21.15.123:0/1593376491 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73a4105600 msgr2=0x7f73a4079a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:56.160 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.609+0000 7f73ab851700 1 --2- 172.21.15.123:0/1593376491 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73a4105600 0x7f73a4079a00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7394009e50 tx=0x7f7394004610 comp rx=0 tx=0).stop 2024-06-02T03:57:56.160 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.610+0000 7f73ab851700 1 -- 172.21.15.123:0/1593376491 shutdown_connections 2024-06-02T03:57:56.160 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.610+0000 7f73ab851700 1 --2- 172.21.15.123:0/1593376491 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f738c0386b0 0x7f738c03ab70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:56.160 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.610+0000 7f73ab851700 1 --2- 172.21.15.123:0/1593376491 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73a4105600 0x7f73a4079a00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:56.160 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.610+0000 7f73ab851700 1 -- 172.21.15.123:0/1593376491 >> 172.21.15.123:0/1593376491 conn(0x7f73a4100bc0 msgr2=0x7f73a41017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:56.160 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.610+0000 7f73ab851700 1 -- 172.21.15.123:0/1593376491 shutdown_connections 2024-06-02T03:57:56.161 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:55.610+0000 7f73ab851700 1 -- 172.21.15.123:0/1593376491 wait complete. 2024-06-02T03:57:56.161 INFO:teuthology.orchestra.run.smithi123.stdout:Deploying unmanaged mgr service... 2024-06-02T03:57:57.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:56 smithi123 ceph-mon[42885]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T03:57:57.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:56 smithi123 ceph-mon[42885]: Saving service mon spec with placement count:5 2024-06-02T03:57:57.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:56 smithi123 ceph-mon[42885]: from='mgr.14120 172.21.15.123:0/2131965966' entity='mgr.x' 2024-06-02T03:57:57.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:56 smithi123 ceph-mon[42885]: from='mgr.14120 172.21.15.123:0/2131965966' entity='mgr.x' 2024-06-02T03:57:57.262 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-06-02T03:57:57.263 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.521+0000 7f20dae13700 1 Processor -- start 2024-06-02T03:57:57.263 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.521+0000 7f20dae13700 1 -- start start 2024-06-02T03:57:57.263 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.521+0000 7f20dae13700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20d4106bf0 0x7f20d4107010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:57.263 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.521+0000 7f20dae13700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d41075e0 con 0x7f20d4106bf0 2024-06-02T03:57:57.263 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.521+0000 7f20d8baf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20d4106bf0 0x7f20d4107010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:57.263 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.521+0000 7f20d8baf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20d4106bf0 0x7f20d4107010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53332/0 (socket says 172.21.15.123:53332) 2024-06-02T03:57:57.263 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.521+0000 7f20d8baf700 1 -- 172.21.15.123:0/3498585620 learned_addr learned my addr 172.21.15.123:0/3498585620 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:57.263 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.522+0000 7f20d8baf700 1 -- 172.21.15.123:0/3498585620 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d4107720 con 0x7f20d4106bf0 2024-06-02T03:57:57.263 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.522+0000 7f20d8baf700 1 --2- 172.21.15.123:0/3498585620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20d4106bf0 0x7f20d4107010 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f20c80098a0 tx=0x7f20c8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd90f305385ee71 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:57.263 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.522+0000 7f20d37fe700 1 -- 172.21.15.123:0/3498585620 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f20c8004160 con 0x7f20d4106bf0 2024-06-02T03:57:57.263 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.522+0000 7f20d37fe700 1 -- 172.21.15.123:0/3498585620 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f20c80042c0 con 0x7f20d4106bf0 2024-06-02T03:57:57.263 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.522+0000 7f20d37fe700 1 -- 172.21.15.123:0/3498585620 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f20c80119b0 con 0x7f20d4106bf0 2024-06-02T03:57:57.264 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.522+0000 7f20dae13700 1 -- 172.21.15.123:0/3498585620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20d4106bf0 msgr2=0x7f20d4107010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:57.264 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.522+0000 7f20dae13700 1 --2- 172.21.15.123:0/3498585620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20d4106bf0 0x7f20d4107010 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f20c80098a0 tx=0x7f20c8009bb0 comp rx=0 tx=0).stop 2024-06-02T03:57:57.264 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.522+0000 7f20dae13700 1 -- 172.21.15.123:0/3498585620 shutdown_connections 2024-06-02T03:57:57.264 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.522+0000 7f20dae13700 1 --2- 172.21.15.123:0/3498585620 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20d4106bf0 0x7f20d4107010 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:57.264 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.523+0000 7f20dae13700 1 -- 172.21.15.123:0/3498585620 >> 172.21.15.123:0/3498585620 conn(0x7f20d4100320 msgr2=0x7f20d4102780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:57.264 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.523+0000 7f20dae13700 1 -- 172.21.15.123:0/3498585620 shutdown_connections 2024-06-02T03:57:57.264 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.523+0000 7f20dae13700 1 -- 172.21.15.123:0/3498585620 wait complete. 2024-06-02T03:57:57.264 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.523+0000 7f20dae13700 1 Processor -- start 2024-06-02T03:57:57.264 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.523+0000 7f20dae13700 1 -- start start 2024-06-02T03:57:57.264 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.523+0000 7f20dae13700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20d4106bf0 0x7f20d419c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:57.264 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.523+0000 7f20dae13700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d419cc50 con 0x7f20d4106bf0 2024-06-02T03:57:57.264 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.524+0000 7f20d8baf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20d4106bf0 0x7f20d419c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:57.264 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.524+0000 7f20d8baf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20d4106bf0 0x7f20d419c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53334/0 (socket says 172.21.15.123:53334) 2024-06-02T03:57:57.265 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.524+0000 7f20d8baf700 1 -- 172.21.15.123:0/2623977212 learned_addr learned my addr 172.21.15.123:0/2623977212 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:57.265 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.524+0000 7f20d8baf700 1 -- 172.21.15.123:0/2623977212 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c8009550 con 0x7f20d4106bf0 2024-06-02T03:57:57.265 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.524+0000 7f20d8baf700 1 --2- 172.21.15.123:0/2623977212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20d4106bf0 0x7f20d419c710 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f20c8003e60 tx=0x7f20c8011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:57.265 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.524+0000 7f20d1ffb700 1 -- 172.21.15.123:0/2623977212 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f20c80038b0 con 0x7f20d4106bf0 2024-06-02T03:57:57.265 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.524+0000 7f20d1ffb700 1 -- 172.21.15.123:0/2623977212 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f20c8003a10 con 0x7f20d4106bf0 2024-06-02T03:57:57.265 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.524+0000 7f20dae13700 1 -- 172.21.15.123:0/2623977212 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d419ce50 con 0x7f20d4106bf0 2024-06-02T03:57:57.265 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.524+0000 7f20d1ffb700 1 -- 172.21.15.123:0/2623977212 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f20c8019530 con 0x7f20d4106bf0 2024-06-02T03:57:57.265 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.524+0000 7f20dae13700 1 -- 172.21.15.123:0/2623977212 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d419d2f0 con 0x7f20d4106bf0 2024-06-02T03:57:57.265 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.525+0000 7f20d1ffb700 1 -- 172.21.15.123:0/2623977212 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f20c8019810 con 0x7f20d4106bf0 2024-06-02T03:57:57.265 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.525+0000 7f20dae13700 1 -- 172.21.15.123:0/2623977212 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d41962e0 con 0x7f20d4106bf0 2024-06-02T03:57:57.265 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.525+0000 7f20d1ffb700 1 --2- 172.21.15.123:0/2623977212 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f20c40386b0 0x7f20c403ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:57.265 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.526+0000 7f20d1ffb700 1 -- 172.21.15.123:0/2623977212 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f20c804c880 con 0x7f20d4106bf0 2024-06-02T03:57:57.265 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.526+0000 7f20d3fff700 1 --2- 172.21.15.123:0/2623977212 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f20c40386b0 0x7f20c403ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:57.266 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.526+0000 7f20d3fff700 1 --2- 172.21.15.123:0/2623977212 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f20c40386b0 0x7f20c403ab70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f20c0006fd0 tx=0x7f20c0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:57.266 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.531+0000 7f20d1ffb700 1 -- 172.21.15.123:0/2623977212 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f20c802b340 con 0x7f20d4106bf0 2024-06-02T03:57:57.266 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.749+0000 7f20dae13700 1 -- 172.21.15.123:0/2623977212 --> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f20d402cf60 con 0x7f20c40386b0 2024-06-02T03:57:57.266 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.757+0000 7f20d1ffb700 1 -- 172.21.15.123:0/2623977212 <== mgr.14120 v2:172.21.15.123:6800/3555101542 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f20d402cf60 con 0x7f20c40386b0 2024-06-02T03:57:57.266 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.759+0000 7f20dae13700 1 -- 172.21.15.123:0/2623977212 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f20c40386b0 msgr2=0x7f20c403ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:57.266 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.759+0000 7f20dae13700 1 --2- 172.21.15.123:0/2623977212 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f20c40386b0 0x7f20c403ab70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f20c0006fd0 tx=0x7f20c0006e40 comp rx=0 tx=0).stop 2024-06-02T03:57:57.266 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.759+0000 7f20dae13700 1 -- 172.21.15.123:0/2623977212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20d4106bf0 msgr2=0x7f20d419c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:57.266 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.759+0000 7f20dae13700 1 --2- 172.21.15.123:0/2623977212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20d4106bf0 0x7f20d419c710 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f20c8003e60 tx=0x7f20c8011a30 comp rx=0 tx=0).stop 2024-06-02T03:57:57.266 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.759+0000 7f20dae13700 1 -- 172.21.15.123:0/2623977212 shutdown_connections 2024-06-02T03:57:57.266 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.759+0000 7f20dae13700 1 --2- 172.21.15.123:0/2623977212 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f20c40386b0 0x7f20c403ab70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:57.266 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.759+0000 7f20dae13700 1 --2- 172.21.15.123:0/2623977212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f20d4106bf0 0x7f20d419c710 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:57.266 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.759+0000 7f20dae13700 1 -- 172.21.15.123:0/2623977212 >> 172.21.15.123:0/2623977212 conn(0x7f20d4100320 msgr2=0x7f20d4193420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:57.267 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.759+0000 7f20dae13700 1 -- 172.21.15.123:0/2623977212 shutdown_connections 2024-06-02T03:57:57.267 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:56.759+0000 7f20dae13700 1 -- 172.21.15.123:0/2623977212 wait complete. 2024-06-02T03:57:58.056 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:57 smithi123 ceph-mon[42885]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T03:57:58.056 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:57 smithi123 ceph-mon[42885]: Saving service mgr spec with placement count:2 2024-06-02T03:57:58.056 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:57 smithi123 ceph-mon[42885]: from='mgr.14120 172.21.15.123:0/2131965966' entity='mgr.x' 2024-06-02T03:57:58.057 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:57 smithi123 ceph-mon[42885]: from='mgr.14120 172.21.15.123:0/2131965966' entity='mgr.x' 2024-06-02T03:57:58.057 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:57 smithi123 ceph-mon[42885]: from='mgr.14120 172.21.15.123:0/2131965966' entity='mgr.x' 2024-06-02T03:57:58.205 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.622+0000 7fd4054f0700 1 Processor -- start 2024-06-02T03:57:58.205 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.623+0000 7fd4054f0700 1 -- start start 2024-06-02T03:57:58.206 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.623+0000 7fd4054f0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd400107180 0x7fd400109570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:58.206 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.623+0000 7fd4054f0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd400079e50 con 0x7fd400107180 2024-06-02T03:57:58.206 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.623+0000 7fd3feffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd400107180 0x7fd400109570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:58.206 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.623+0000 7fd3feffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd400107180 0x7fd400109570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53336/0 (socket says 172.21.15.123:53336) 2024-06-02T03:57:58.206 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.623+0000 7fd3feffd700 1 -- 172.21.15.123:0/425429448 learned_addr learned my addr 172.21.15.123:0/425429448 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:58.206 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.623+0000 7fd3feffd700 1 -- 172.21.15.123:0/425429448 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd400109ab0 con 0x7fd400107180 2024-06-02T03:57:58.206 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.623+0000 7fd3feffd700 1 --2- 172.21.15.123:0/425429448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd400107180 0x7fd400109570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd3f00098a0 tx=0x7fd3f0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c59df812759e880b server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:58.206 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.624+0000 7fd3fdffb700 1 -- 172.21.15.123:0/425429448 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3f0004160 con 0x7fd400107180 2024-06-02T03:57:58.206 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.624+0000 7fd3fdffb700 1 -- 172.21.15.123:0/425429448 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3f00042c0 con 0x7fd400107180 2024-06-02T03:57:58.206 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.624+0000 7fd3fdffb700 1 -- 172.21.15.123:0/425429448 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3f00119b0 con 0x7fd400107180 2024-06-02T03:57:58.206 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.624+0000 7fd4054f0700 1 -- 172.21.15.123:0/425429448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd400107180 msgr2=0x7fd400109570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:58.207 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.624+0000 7fd4054f0700 1 --2- 172.21.15.123:0/425429448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd400107180 0x7fd400109570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd3f00098a0 tx=0x7fd3f0009bb0 comp rx=0 tx=0).stop 2024-06-02T03:57:58.207 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.624+0000 7fd4054f0700 1 -- 172.21.15.123:0/425429448 shutdown_connections 2024-06-02T03:57:58.207 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.624+0000 7fd4054f0700 1 --2- 172.21.15.123:0/425429448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd400107180 0x7fd400109570 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:58.207 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.624+0000 7fd4054f0700 1 -- 172.21.15.123:0/425429448 >> 172.21.15.123:0/425429448 conn(0x7fd400100b90 msgr2=0x7fd400102fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:58.207 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.624+0000 7fd4054f0700 1 -- 172.21.15.123:0/425429448 shutdown_connections 2024-06-02T03:57:58.207 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.624+0000 7fd4054f0700 1 -- 172.21.15.123:0/425429448 wait complete. 2024-06-02T03:57:58.207 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.625+0000 7fd4054f0700 1 Processor -- start 2024-06-02T03:57:58.207 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.625+0000 7fd4054f0700 1 -- start start 2024-06-02T03:57:58.207 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.625+0000 7fd4054f0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd400107180 0x7fd40019a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:58.207 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.625+0000 7fd4054f0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40019a990 con 0x7fd400107180 2024-06-02T03:57:58.207 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.625+0000 7fd3feffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd400107180 0x7fd40019a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:58.208 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.625+0000 7fd3feffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd400107180 0x7fd40019a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53340/0 (socket says 172.21.15.123:53340) 2024-06-02T03:57:58.208 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.625+0000 7fd3feffd700 1 -- 172.21.15.123:0/2849382746 learned_addr learned my addr 172.21.15.123:0/2849382746 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:58.208 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.626+0000 7fd3feffd700 1 -- 172.21.15.123:0/2849382746 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f0009550 con 0x7fd400107180 2024-06-02T03:57:58.208 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.626+0000 7fd3feffd700 1 --2- 172.21.15.123:0/2849382746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd400107180 0x7fd40019a450 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0011670 tx=0x7fd3f0011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:58.208 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.626+0000 7fd3e7fff700 1 -- 172.21.15.123:0/2849382746 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3f0003b20 con 0x7fd400107180 2024-06-02T03:57:58.208 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.626+0000 7fd3e7fff700 1 -- 172.21.15.123:0/2849382746 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3f0003c80 con 0x7fd400107180 2024-06-02T03:57:58.208 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.626+0000 7fd4054f0700 1 -- 172.21.15.123:0/2849382746 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd40019ab90 con 0x7fd400107180 2024-06-02T03:57:58.208 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.626+0000 7fd3e7fff700 1 -- 172.21.15.123:0/2849382746 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3f0019770 con 0x7fd400107180 2024-06-02T03:57:58.208 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.626+0000 7fd4054f0700 1 -- 172.21.15.123:0/2849382746 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd40019b030 con 0x7fd400107180 2024-06-02T03:57:58.208 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.627+0000 7fd3e7fff700 1 -- 172.21.15.123:0/2849382746 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fd3f0019a30 con 0x7fd400107180 2024-06-02T03:57:58.208 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.627+0000 7fd3e7fff700 1 --2- 172.21.15.123:0/2849382746 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fd3e8038700 0x7fd3e803abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:58.208 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.627+0000 7fd3e7fff700 1 -- 172.21.15.123:0/2849382746 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd3f004d900 con 0x7fd400107180 2024-06-02T03:57:58.209 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.627+0000 7fd4054f0700 1 -- 172.21.15.123:0/2849382746 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4000625d0 con 0x7fd400107180 2024-06-02T03:57:58.209 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.627+0000 7fd3fe7fc700 1 --2- 172.21.15.123:0/2849382746 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fd3e8038700 0x7fd3e803abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:58.209 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.628+0000 7fd3fe7fc700 1 --2- 172.21.15.123:0/2849382746 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fd3e8038700 0x7fd3e803abc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4006fd0 tx=0x7fd3f4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:58.209 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.635+0000 7fd3e7fff700 1 -- 172.21.15.123:0/2849382746 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd3f0018b80 con 0x7fd400107180 2024-06-02T03:57:58.209 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.848+0000 7fd4054f0700 1 -- 172.21.15.123:0/2849382746 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fd40019da00 con 0x7fd400107180 2024-06-02T03:57:58.209 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.853+0000 7fd3e7fff700 1 -- 172.21.15.123:0/2849382746 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fd3f0023e60 con 0x7fd400107180 2024-06-02T03:57:58.209 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.856+0000 7fd4054f0700 1 -- 172.21.15.123:0/2849382746 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fd3e8038700 msgr2=0x7fd3e803abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:58.209 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.856+0000 7fd4054f0700 1 --2- 172.21.15.123:0/2849382746 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fd3e8038700 0x7fd3e803abc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4006fd0 tx=0x7fd3f4006e40 comp rx=0 tx=0).stop 2024-06-02T03:57:58.209 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.856+0000 7fd4054f0700 1 -- 172.21.15.123:0/2849382746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd400107180 msgr2=0x7fd40019a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:58.209 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.856+0000 7fd4054f0700 1 --2- 172.21.15.123:0/2849382746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd400107180 0x7fd40019a450 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0011670 tx=0x7fd3f0011a30 comp rx=0 tx=0).stop 2024-06-02T03:57:58.209 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.856+0000 7fd4054f0700 1 -- 172.21.15.123:0/2849382746 shutdown_connections 2024-06-02T03:57:58.209 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.856+0000 7fd4054f0700 1 --2- 172.21.15.123:0/2849382746 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fd3e8038700 0x7fd3e803abc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:58.210 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.856+0000 7fd4054f0700 1 --2- 172.21.15.123:0/2849382746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd400107180 0x7fd40019a450 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:58.210 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.856+0000 7fd4054f0700 1 -- 172.21.15.123:0/2849382746 >> 172.21.15.123:0/2849382746 conn(0x7fd400100b90 msgr2=0x7fd4001016f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:58.210 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.856+0000 7fd4054f0700 1 -- 172.21.15.123:0/2849382746 shutdown_connections 2024-06-02T03:57:58.210 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:57.856+0000 7fd4054f0700 1 -- 172.21.15.123:0/2849382746 wait complete. 2024-06-02T03:57:58.926 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:58 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2849382746' entity='client.admin' 2024-06-02T03:57:58.926 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:58 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2448938237' entity='client.admin' 2024-06-02T03:57:59.304 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.578+0000 7fa36c323700 1 Processor -- start 2024-06-02T03:57:59.304 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.578+0000 7fa36c323700 1 -- start start 2024-06-02T03:57:59.304 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.578+0000 7fa36c323700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa364104fb0 0x7fa3641053d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:59.304 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.578+0000 7fa36c323700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa364079e10 con 0x7fa364104fb0 2024-06-02T03:57:59.304 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.578+0000 7fa36a0bf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa364104fb0 0x7fa3641053d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:59.304 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.578+0000 7fa36a0bf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa364104fb0 0x7fa3641053d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53342/0 (socket says 172.21.15.123:53342) 2024-06-02T03:57:59.304 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.578+0000 7fa36a0bf700 1 -- 172.21.15.123:0/4002560046 learned_addr learned my addr 172.21.15.123:0/4002560046 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:59.305 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.578+0000 7fa36a0bf700 1 -- 172.21.15.123:0/4002560046 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa364105910 con 0x7fa364104fb0 2024-06-02T03:57:59.305 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.579+0000 7fa36a0bf700 1 --2- 172.21.15.123:0/4002560046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa364104fb0 0x7fa3641053d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa3600098a0 tx=0x7fa360009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d1edfa9d79c51e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:59.305 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.579+0000 7fa3690bd700 1 -- 172.21.15.123:0/4002560046 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa360004160 con 0x7fa364104fb0 2024-06-02T03:57:59.305 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.579+0000 7fa3690bd700 1 -- 172.21.15.123:0/4002560046 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa3600042c0 con 0x7fa364104fb0 2024-06-02T03:57:59.305 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.579+0000 7fa3690bd700 1 -- 172.21.15.123:0/4002560046 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa3600119b0 con 0x7fa364104fb0 2024-06-02T03:57:59.305 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.579+0000 7fa36c323700 1 -- 172.21.15.123:0/4002560046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa364104fb0 msgr2=0x7fa3641053d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:59.305 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.579+0000 7fa36c323700 1 --2- 172.21.15.123:0/4002560046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa364104fb0 0x7fa3641053d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa3600098a0 tx=0x7fa360009bb0 comp rx=0 tx=0).stop 2024-06-02T03:57:59.305 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.579+0000 7fa36c323700 1 -- 172.21.15.123:0/4002560046 shutdown_connections 2024-06-02T03:57:59.305 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.579+0000 7fa36c323700 1 --2- 172.21.15.123:0/4002560046 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa364104fb0 0x7fa3641053d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:59.305 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.579+0000 7fa36c323700 1 -- 172.21.15.123:0/4002560046 >> 172.21.15.123:0/4002560046 conn(0x7fa364100bf0 msgr2=0x7fa364103010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:59.305 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.580+0000 7fa36c323700 1 -- 172.21.15.123:0/4002560046 shutdown_connections 2024-06-02T03:57:59.305 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.580+0000 7fa36c323700 1 -- 172.21.15.123:0/4002560046 wait complete. 2024-06-02T03:57:59.305 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.580+0000 7fa36c323700 1 Processor -- start 2024-06-02T03:57:59.306 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.580+0000 7fa36c323700 1 -- start start 2024-06-02T03:57:59.306 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.580+0000 7fa36c323700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa364104fb0 0x7fa36419c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:59.306 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.580+0000 7fa36c323700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36419cb40 con 0x7fa364104fb0 2024-06-02T03:57:59.306 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.580+0000 7fa36a0bf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa364104fb0 0x7fa36419c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:59.306 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.580+0000 7fa36a0bf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa364104fb0 0x7fa36419c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53350/0 (socket says 172.21.15.123:53350) 2024-06-02T03:57:59.306 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.580+0000 7fa36a0bf700 1 -- 172.21.15.123:0/2448938237 learned_addr learned my addr 172.21.15.123:0/2448938237 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:57:59.306 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.581+0000 7fa36a0bf700 1 -- 172.21.15.123:0/2448938237 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa360009550 con 0x7fa364104fb0 2024-06-02T03:57:59.306 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.581+0000 7fa36a0bf700 1 --2- 172.21.15.123:0/2448938237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa364104fb0 0x7fa36419c600 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa360006af0 tx=0x7fa360011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:59.306 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.581+0000 7fa35b7fe700 1 -- 172.21.15.123:0/2448938237 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa360003a40 con 0x7fa364104fb0 2024-06-02T03:57:59.306 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.581+0000 7fa36c323700 1 -- 172.21.15.123:0/2448938237 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa36419cd40 con 0x7fa364104fb0 2024-06-02T03:57:59.306 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.581+0000 7fa35b7fe700 1 -- 172.21.15.123:0/2448938237 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa360003ba0 con 0x7fa364104fb0 2024-06-02T03:57:59.306 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.581+0000 7fa35b7fe700 1 -- 172.21.15.123:0/2448938237 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa3600196c0 con 0x7fa364104fb0 2024-06-02T03:57:59.307 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.581+0000 7fa36c323700 1 -- 172.21.15.123:0/2448938237 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa36419d1e0 con 0x7fa364104fb0 2024-06-02T03:57:59.307 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.582+0000 7fa35b7fe700 1 -- 172.21.15.123:0/2448938237 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fa360019980 con 0x7fa364104fb0 2024-06-02T03:57:59.307 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.582+0000 7fa36c323700 1 -- 172.21.15.123:0/2448938237 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa364196330 con 0x7fa364104fb0 2024-06-02T03:57:59.307 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.582+0000 7fa35b7fe700 1 --2- 172.21.15.123:0/2448938237 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fa3500386b0 0x7fa35003ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:57:59.307 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.582+0000 7fa35b7fe700 1 -- 172.21.15.123:0/2448938237 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa36004c940 con 0x7fa364104fb0 2024-06-02T03:57:59.307 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.582+0000 7fa3698be700 1 --2- 172.21.15.123:0/2448938237 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fa3500386b0 0x7fa35003ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:57:59.307 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.582+0000 7fa3698be700 1 --2- 172.21.15.123:0/2448938237 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fa3500386b0 0x7fa35003ab70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa354006fd0 tx=0x7fa354006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:57:59.307 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.587+0000 7fa35b7fe700 1 -- 172.21.15.123:0/2448938237 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa36002dcd0 con 0x7fa364104fb0 2024-06-02T03:57:59.307 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.791+0000 7fa36c323700 1 -- 172.21.15.123:0/2448938237 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fa364106990 con 0x7fa364104fb0 2024-06-02T03:57:59.307 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.795+0000 7fa35b7fe700 1 -- 172.21.15.123:0/2448938237 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fa360023390 con 0x7fa364104fb0 2024-06-02T03:57:59.307 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.797+0000 7fa36c323700 1 -- 172.21.15.123:0/2448938237 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fa3500386b0 msgr2=0x7fa35003ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:59.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.797+0000 7fa36c323700 1 --2- 172.21.15.123:0/2448938237 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fa3500386b0 0x7fa35003ab70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa354006fd0 tx=0x7fa354006e40 comp rx=0 tx=0).stop 2024-06-02T03:57:59.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.797+0000 7fa36c323700 1 -- 172.21.15.123:0/2448938237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa364104fb0 msgr2=0x7fa36419c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:57:59.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.797+0000 7fa36c323700 1 --2- 172.21.15.123:0/2448938237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa364104fb0 0x7fa36419c600 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa360006af0 tx=0x7fa360011a10 comp rx=0 tx=0).stop 2024-06-02T03:57:59.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.797+0000 7fa36c323700 1 -- 172.21.15.123:0/2448938237 shutdown_connections 2024-06-02T03:57:59.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.797+0000 7fa36c323700 1 --2- 172.21.15.123:0/2448938237 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fa3500386b0 0x7fa35003ab70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:59.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.797+0000 7fa36c323700 1 --2- 172.21.15.123:0/2448938237 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa364104fb0 0x7fa36419c600 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:57:59.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.797+0000 7fa36c323700 1 -- 172.21.15.123:0/2448938237 >> 172.21.15.123:0/2448938237 conn(0x7fa364100bf0 msgr2=0x7fa364193470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:57:59.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.797+0000 7fa36c323700 1 -- 172.21.15.123:0/2448938237 shutdown_connections 2024-06-02T03:57:59.308 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:58.797+0000 7fa36c323700 1 -- 172.21.15.123:0/2448938237 wait complete. 2024-06-02T03:57:59.308 INFO:teuthology.orchestra.run.smithi123.stdout:Enabling the dashboard module... 2024-06-02T03:58:00.284 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:57:59 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/936649021' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-06-02T03:58:00.285 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:58:00 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: ignoring --setuser ceph since I am not root 2024-06-02T03:58:00.285 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:58:00 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: ignoring --setgroup ceph since I am not root 2024-06-02T03:58:00.354 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.657+0000 7f22eb0b2700 1 Processor -- start 2024-06-02T03:58:00.354 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.657+0000 7f22eb0b2700 1 -- start start 2024-06-02T03:58:00.354 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.657+0000 7f22eb0b2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22e4107170 0x7f22e4109560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:00.354 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.657+0000 7f22eb0b2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e4079e90 con 0x7f22e4107170 2024-06-02T03:58:00.354 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.657+0000 7f22e8e4e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22e4107170 0x7f22e4109560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:00.355 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.658+0000 7f22e8e4e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22e4107170 0x7f22e4109560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53364/0 (socket says 172.21.15.123:53364) 2024-06-02T03:58:00.355 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.658+0000 7f22e8e4e700 1 -- 172.21.15.123:0/1880684871 learned_addr learned my addr 172.21.15.123:0/1880684871 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:58:00.355 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.658+0000 7f22e8e4e700 1 -- 172.21.15.123:0/1880684871 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e4109aa0 con 0x7f22e4107170 2024-06-02T03:58:00.355 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.658+0000 7f22e8e4e700 1 --2- 172.21.15.123:0/1880684871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22e4107170 0x7f22e4109560 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f22d80098a0 tx=0x7f22d8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43492b2c643f4a55 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:00.355 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.658+0000 7f22e37fe700 1 -- 172.21.15.123:0/1880684871 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22d8004160 con 0x7f22e4107170 2024-06-02T03:58:00.355 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.658+0000 7f22e37fe700 1 -- 172.21.15.123:0/1880684871 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f22d80042c0 con 0x7f22e4107170 2024-06-02T03:58:00.355 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.658+0000 7f22e37fe700 1 -- 172.21.15.123:0/1880684871 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22d80119b0 con 0x7f22e4107170 2024-06-02T03:58:00.355 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.659+0000 7f22eb0b2700 1 -- 172.21.15.123:0/1880684871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22e4107170 msgr2=0x7f22e4109560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:00.355 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.659+0000 7f22eb0b2700 1 --2- 172.21.15.123:0/1880684871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22e4107170 0x7f22e4109560 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f22d80098a0 tx=0x7f22d8009bb0 comp rx=0 tx=0).stop 2024-06-02T03:58:00.355 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.659+0000 7f22eb0b2700 1 -- 172.21.15.123:0/1880684871 shutdown_connections 2024-06-02T03:58:00.355 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.659+0000 7f22eb0b2700 1 --2- 172.21.15.123:0/1880684871 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22e4107170 0x7f22e4109560 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:00.355 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.659+0000 7f22eb0b2700 1 -- 172.21.15.123:0/1880684871 >> 172.21.15.123:0/1880684871 conn(0x7f22e4100bc0 msgr2=0x7f22e4102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:00.356 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.659+0000 7f22eb0b2700 1 -- 172.21.15.123:0/1880684871 shutdown_connections 2024-06-02T03:58:00.356 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.659+0000 7f22eb0b2700 1 -- 172.21.15.123:0/1880684871 wait complete. 2024-06-02T03:58:00.356 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.659+0000 7f22eb0b2700 1 Processor -- start 2024-06-02T03:58:00.356 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.659+0000 7f22eb0b2700 1 -- start start 2024-06-02T03:58:00.356 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.659+0000 7f22eb0b2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22e4107170 0x7f22e41069a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:00.356 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.659+0000 7f22eb0b2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e4106ee0 con 0x7f22e4107170 2024-06-02T03:58:00.356 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.660+0000 7f22e8e4e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22e4107170 0x7f22e41069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:00.356 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.660+0000 7f22e8e4e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22e4107170 0x7f22e41069a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53372/0 (socket says 172.21.15.123:53372) 2024-06-02T03:58:00.356 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.660+0000 7f22e8e4e700 1 -- 172.21.15.123:0/936649021 learned_addr learned my addr 172.21.15.123:0/936649021 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:58:00.356 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.660+0000 7f22e8e4e700 1 -- 172.21.15.123:0/936649021 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d8009550 con 0x7f22e4107170 2024-06-02T03:58:00.356 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.660+0000 7f22e8e4e700 1 --2- 172.21.15.123:0/936649021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22e4107170 0x7f22e41069a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f22d8003e60 tx=0x7f22d8011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:00.356 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.660+0000 7f22e1ffb700 1 -- 172.21.15.123:0/936649021 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22d80038b0 con 0x7f22e4107170 2024-06-02T03:58:00.356 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.660+0000 7f22e1ffb700 1 -- 172.21.15.123:0/936649021 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f22d8003a10 con 0x7f22e4107170 2024-06-02T03:58:00.356 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.660+0000 7f22eb0b2700 1 -- 172.21.15.123:0/936649021 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e4105120 con 0x7f22e4107170 2024-06-02T03:58:00.357 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.660+0000 7f22e1ffb700 1 -- 172.21.15.123:0/936649021 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f22d8019530 con 0x7f22e4107170 2024-06-02T03:58:00.357 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.660+0000 7f22eb0b2700 1 -- 172.21.15.123:0/936649021 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e41055c0 con 0x7f22e4107170 2024-06-02T03:58:00.357 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.661+0000 7f22e1ffb700 1 -- 172.21.15.123:0/936649021 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f22d801a430 con 0x7f22e4107170 2024-06-02T03:58:00.357 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.661+0000 7f22eb0b2700 1 -- 172.21.15.123:0/936649021 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22e410a8e0 con 0x7f22e4107170 2024-06-02T03:58:00.357 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.661+0000 7f22e1ffb700 1 --2- 172.21.15.123:0/936649021 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f22d4038750 0x7f22d403ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:00.357 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.662+0000 7f22e1ffb700 1 -- 172.21.15.123:0/936649021 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f22d804c800 con 0x7f22e4107170 2024-06-02T03:58:00.357 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.662+0000 7f22e3fff700 1 --2- 172.21.15.123:0/936649021 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f22d4038750 0x7f22d403ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:00.357 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.662+0000 7f22e3fff700 1 --2- 172.21.15.123:0/936649021 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f22d4038750 0x7f22d403ac10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f22d0006fd0 tx=0x7f22d0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:00.357 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.666+0000 7f22e1ffb700 1 -- 172.21.15.123:0/936649021 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f22d80239e0 con 0x7f22e4107170 2024-06-02T03:58:00.358 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.916+0000 7f22eb0b2700 1 -- 172.21.15.123:0/936649021 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f22e410ab20 con 0x7f22e4107170 2024-06-02T03:58:00.358 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.969+0000 7f22e1ffb700 1 -- 172.21.15.123:0/936649021 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f22d8019930 con 0x7f22e4107170 2024-06-02T03:58:00.358 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.970+0000 7f22e1ffb700 1 -- 172.21.15.123:0/936649021 <== mon.0 v2:172.21.15.123:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f22d804e4a0 con 0x7f22e4107170 2024-06-02T03:58:00.358 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.972+0000 7f22eb0b2700 1 -- 172.21.15.123:0/936649021 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f22d4038750 msgr2=0x7f22d403ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:00.358 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.972+0000 7f22eb0b2700 1 --2- 172.21.15.123:0/936649021 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f22d4038750 0x7f22d403ac10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f22d0006fd0 tx=0x7f22d0006e40 comp rx=0 tx=0).stop 2024-06-02T03:58:00.358 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.972+0000 7f22eb0b2700 1 -- 172.21.15.123:0/936649021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22e4107170 msgr2=0x7f22e41069a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:00.358 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.972+0000 7f22eb0b2700 1 --2- 172.21.15.123:0/936649021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22e4107170 0x7f22e41069a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f22d8003e60 tx=0x7f22d8011a30 comp rx=0 tx=0).stop 2024-06-02T03:58:00.358 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.972+0000 7f22eb0b2700 1 -- 172.21.15.123:0/936649021 shutdown_connections 2024-06-02T03:58:00.358 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.972+0000 7f22eb0b2700 1 --2- 172.21.15.123:0/936649021 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f22d4038750 0x7f22d403ac10 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:00.359 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.972+0000 7f22eb0b2700 1 --2- 172.21.15.123:0/936649021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f22e4107170 0x7f22e41069a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:00.359 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.973+0000 7f22eb0b2700 1 -- 172.21.15.123:0/936649021 >> 172.21.15.123:0/936649021 conn(0x7f22e4100bc0 msgr2=0x7f22e4101770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:00.359 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.973+0000 7f22eb0b2700 1 -- 172.21.15.123:0/936649021 shutdown_connections 2024-06-02T03:58:00.359 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:57:59.973+0000 7f22eb0b2700 1 -- 172.21.15.123:0/936649021 wait complete. 2024-06-02T03:58:00.552 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:58:00 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:58:00.425+0000 7fbb846d0200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-02T03:58:00.552 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:58:00 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:58:00.522+0000 7fbb846d0200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-02T03:58:00.970 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:58:00 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:58:00.613+0000 7fbb846d0200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-02T03:58:00.971 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:58:00 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:58:00.700+0000 7fbb846d0200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-02T03:58:01.230 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:00 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/936649021' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-06-02T03:58:01.230 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:00 smithi123 ceph-mon[42885]: mgrmap e9: x(active, since 14s) 2024-06-02T03:58:01.406 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout { 2024-06-02T03:58:01.412 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-06-02T03:58:01.413 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "available": true, 2024-06-02T03:58:01.413 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-06-02T03:58:01.413 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-06-02T03:58:01.413 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout } 2024-06-02T03:58:01.413 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.769+0000 7fac0b8c3700 1 Processor -- start 2024-06-02T03:58:01.413 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.769+0000 7fac0b8c3700 1 -- start start 2024-06-02T03:58:01.413 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.770+0000 7fac0b8c3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac041055d0 0x7fac041059f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:01.413 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.770+0000 7fac0b8c3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac04105fc0 con 0x7fac041055d0 2024-06-02T03:58:01.413 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.770+0000 7fac0965f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac041055d0 0x7fac041059f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:01.413 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.770+0000 7fac0965f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac041055d0 0x7fac041059f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53410/0 (socket says 172.21.15.123:53410) 2024-06-02T03:58:01.413 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.770+0000 7fac0965f700 1 -- 172.21.15.123:0/984631008 learned_addr learned my addr 172.21.15.123:0/984631008 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:58:01.414 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.770+0000 7fac0965f700 1 -- 172.21.15.123:0/984631008 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac041067d0 con 0x7fac041055d0 2024-06-02T03:58:01.414 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.770+0000 7fac0965f700 1 --2- 172.21.15.123:0/984631008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac041055d0 0x7fac041059f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fac000098a0 tx=0x7fac00009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5dec4f1912f4a0d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:01.414 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.770+0000 7fabfbfff700 1 -- 172.21.15.123:0/984631008 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac00004160 con 0x7fac041055d0 2024-06-02T03:58:01.414 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.770+0000 7fabfbfff700 1 -- 172.21.15.123:0/984631008 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fac000042c0 con 0x7fac041055d0 2024-06-02T03:58:01.414 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.770+0000 7fabfbfff700 1 -- 172.21.15.123:0/984631008 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac000119b0 con 0x7fac041055d0 2024-06-02T03:58:01.414 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.771+0000 7fac0b8c3700 1 -- 172.21.15.123:0/984631008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac041055d0 msgr2=0x7fac041059f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:01.414 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.771+0000 7fac0b8c3700 1 --2- 172.21.15.123:0/984631008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac041055d0 0x7fac041059f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fac000098a0 tx=0x7fac00009bb0 comp rx=0 tx=0).stop 2024-06-02T03:58:01.414 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.771+0000 7fac0b8c3700 1 -- 172.21.15.123:0/984631008 shutdown_connections 2024-06-02T03:58:01.414 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.771+0000 7fac0b8c3700 1 --2- 172.21.15.123:0/984631008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac041055d0 0x7fac041059f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:01.414 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.771+0000 7fac0b8c3700 1 -- 172.21.15.123:0/984631008 >> 172.21.15.123:0/984631008 conn(0x7fac04100b90 msgr2=0x7fac04102fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:01.414 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.771+0000 7fac0b8c3700 1 -- 172.21.15.123:0/984631008 shutdown_connections 2024-06-02T03:58:01.414 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.771+0000 7fac0b8c3700 1 -- 172.21.15.123:0/984631008 wait complete. 2024-06-02T03:58:01.414 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.772+0000 7fac0b8c3700 1 Processor -- start 2024-06-02T03:58:01.415 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.772+0000 7fac0b8c3700 1 -- start start 2024-06-02T03:58:01.415 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.772+0000 7fac0b8c3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac041055d0 0x7fac04079a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:01.415 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.772+0000 7fac0b8c3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac04079f80 con 0x7fac041055d0 2024-06-02T03:58:01.415 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.772+0000 7fac0965f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac041055d0 0x7fac04079a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:01.415 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.772+0000 7fac0965f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac041055d0 0x7fac04079a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53412/0 (socket says 172.21.15.123:53412) 2024-06-02T03:58:01.415 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.772+0000 7fac0965f700 1 -- 172.21.15.123:0/2764788597 learned_addr learned my addr 172.21.15.123:0/2764788597 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:58:01.415 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.772+0000 7fac0965f700 1 -- 172.21.15.123:0/2764788597 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac00009550 con 0x7fac041055d0 2024-06-02T03:58:01.415 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.772+0000 7fac0965f700 1 --2- 172.21.15.123:0/2764788597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac041055d0 0x7fac04079a40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fac00006af0 tx=0x7fac00011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:01.415 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.773+0000 7fabfa7fc700 1 -- 172.21.15.123:0/2764788597 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac00003a40 con 0x7fac041055d0 2024-06-02T03:58:01.415 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.773+0000 7fabfa7fc700 1 -- 172.21.15.123:0/2764788597 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fac00003ba0 con 0x7fac041055d0 2024-06-02T03:58:01.415 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.773+0000 7fabfa7fc700 1 -- 172.21.15.123:0/2764788597 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fac00019690 con 0x7fac041055d0 2024-06-02T03:58:01.415 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.773+0000 7fac0b8c3700 1 -- 172.21.15.123:0/2764788597 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac0419d130 con 0x7fac041055d0 2024-06-02T03:58:01.415 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.773+0000 7fac0b8c3700 1 -- 172.21.15.123:0/2764788597 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac0419d5d0 con 0x7fac041055d0 2024-06-02T03:58:01.416 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.773+0000 7fabfa7fc700 1 -- 172.21.15.123:0/2764788597 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7fac00019900 con 0x7fac041055d0 2024-06-02T03:58:01.416 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.774+0000 7fabfa7fc700 1 --2- 172.21.15.123:0/2764788597 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fabf0038750 0x7fabf003ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:01.416 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.774+0000 7fabfa7fc700 1 -- 172.21.15.123:0/2764788597 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fac0004c670 con 0x7fac041055d0 2024-06-02T03:58:01.416 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.774+0000 7fac08e5e700 1 -- 172.21.15.123:0/2764788597 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fabf0038750 msgr2=0x7fabf003ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/3555101542 2024-06-02T03:58:01.416 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.774+0000 7fac08e5e700 1 --2- 172.21.15.123:0/2764788597 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fabf0038750 0x7fabf003ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T03:58:01.416 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.774+0000 7fac0b8c3700 1 -- 172.21.15.123:0/2764788597 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac04109a00 con 0x7fac041055d0 2024-06-02T03:58:01.416 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.779+0000 7fabfa7fc700 1 -- 172.21.15.123:0/2764788597 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fac000243f0 con 0x7fac041055d0 2024-06-02T03:58:01.416 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.975+0000 7fac08e5e700 1 -- 172.21.15.123:0/2764788597 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fabf0038750 msgr2=0x7fabf003ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/3555101542 2024-06-02T03:58:01.416 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:00.975+0000 7fac08e5e700 1 --2- 172.21.15.123:0/2764788597 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fabf0038750 0x7fabf003ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-02T03:58:01.416 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.033+0000 7fac0b8c3700 1 -- 172.21.15.123:0/2764788597 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fac0419da40 con 0x7fac041055d0 2024-06-02T03:58:01.416 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.033+0000 7fabfa7fc700 1 -- 172.21.15.123:0/2764788597 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7fac00018350 con 0x7fac041055d0 2024-06-02T03:58:01.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.036+0000 7fac0b8c3700 1 -- 172.21.15.123:0/2764788597 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fabf0038750 msgr2=0x7fabf003ac10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T03:58:01.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.036+0000 7fac0b8c3700 1 --2- 172.21.15.123:0/2764788597 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fabf0038750 0x7fabf003ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:01.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.036+0000 7fac0b8c3700 1 -- 172.21.15.123:0/2764788597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac041055d0 msgr2=0x7fac04079a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:01.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.036+0000 7fac0b8c3700 1 --2- 172.21.15.123:0/2764788597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac041055d0 0x7fac04079a40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fac00006af0 tx=0x7fac00011a10 comp rx=0 tx=0).stop 2024-06-02T03:58:01.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.036+0000 7fac0b8c3700 1 -- 172.21.15.123:0/2764788597 shutdown_connections 2024-06-02T03:58:01.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.036+0000 7fac0b8c3700 1 --2- 172.21.15.123:0/2764788597 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7fabf0038750 0x7fabf003ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:01.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.036+0000 7fac0b8c3700 1 --2- 172.21.15.123:0/2764788597 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fac041055d0 0x7fac04079a40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:01.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.036+0000 7fac0b8c3700 1 -- 172.21.15.123:0/2764788597 >> 172.21.15.123:0/2764788597 conn(0x7fac04100b90 msgr2=0x7fac04101710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:01.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.036+0000 7fac0b8c3700 1 -- 172.21.15.123:0/2764788597 shutdown_connections 2024-06-02T03:58:01.417 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.036+0000 7fac0b8c3700 1 -- 172.21.15.123:0/2764788597 wait complete. 2024-06-02T03:58:01.417 INFO:teuthology.orchestra.run.smithi123.stdout:Waiting for the mgr to restart... 2024-06-02T03:58:01.417 INFO:teuthology.orchestra.run.smithi123.stdout:Waiting for mgr epoch 9... 2024-06-02T03:58:01.521 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:58:01 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:58:01.346+0000 7fbb846d0200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-02T03:58:01.813 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:58:01 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:58:01.611+0000 7fbb846d0200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-02T03:58:01.813 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:58:01 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:58:01.699+0000 7fbb846d0200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-02T03:58:02.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:01 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2764788597' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-06-02T03:58:02.072 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:58:01 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:58:01.814+0000 7fbb846d0200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-02T03:58:02.073 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:58:01 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:58:01.970+0000 7fbb846d0200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-02T03:58:02.548 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:58:02 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:58:02.098+0000 7fbb846d0200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-02T03:58:02.548 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:58:02 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:58:02.183+0000 7fbb846d0200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-02T03:58:02.822 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:58:02 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:58:02.549+0000 7fbb846d0200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-02T03:58:03.238 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:58:02 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:58:02.950+0000 7fbb846d0200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-02T03:58:03.238 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:58:03 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:58:03.146+0000 7fbb846d0200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-02T03:58:03.572 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:58:03 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:58:03.239+0000 7fbb846d0200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-02T03:58:04.322 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:58:04 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:58:04.009+0000 7fbb846d0200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-02T03:58:04.322 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:58:04 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:58:04.107+0000 7fbb846d0200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-02T03:58:04.323 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:58:04 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:58:04.256+0000 7fbb846d0200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-02T03:58:05.265 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:58:04 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:58:04.887+0000 7fbb846d0200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-02T03:58:05.265 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:58:05 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:58:05.071+0000 7fbb846d0200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-02T03:58:05.572 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:58:05 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:58:05.266+0000 7fbb846d0200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-02T03:58:06.473 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:58:06 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:58:06.187+0000 7fbb846d0200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-02T03:58:06.751 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:58:06 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:58:06.473+0000 7fbb846d0200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-02T03:58:06.751 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:58:06 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:58:06.560+0000 7fbb846d0200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-02T03:58:07.072 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 03:58:06 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T03:58:06.751+0000 7fbb846d0200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-02T03:58:07.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:06 smithi123 ceph-mon[42885]: Active manager daemon x restarted 2024-06-02T03:58:07.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:06 smithi123 ceph-mon[42885]: Activating manager daemon x 2024-06-02T03:58:07.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:06 smithi123 ceph-mon[42885]: osdmap e3: 0 total, 0 up, 0 in 2024-06-02T03:58:07.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:06 smithi123 ceph-mon[42885]: mgrmap e10: x(active, starting, since 0.00370343s) 2024-06-02T03:58:07.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:06 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T03:58:07.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:06 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-06-02T03:58:07.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:06 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-06-02T03:58:07.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:06 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-06-02T03:58:07.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:06 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-06-02T03:58:07.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:06 smithi123 ceph-mon[42885]: Manager daemon x is now available 2024-06-02T03:58:07.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:06 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:58:08.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:07 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-06-02T03:58:08.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:07 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-06-02T03:58:08.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:07 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:08.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:07 smithi123 ceph-mon[42885]: mgrmap e11: x(active, since 1.00882s) 2024-06-02T03:58:08.146 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout { 2024-06-02T03:58:08.146 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-06-02T03:58:08.146 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout "initialized": true 2024-06-02T03:58:08.146 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout } 2024-06-02T03:58:08.146 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.807+0000 7f71ebdd8700 1 Processor -- start 2024-06-02T03:58:08.146 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.807+0000 7f71ebdd8700 1 -- start start 2024-06-02T03:58:08.147 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.808+0000 7f71ebdd8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71e4107160 0x7f71e4109550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:08.147 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.808+0000 7f71ebdd8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e4109a90 con 0x7f71e4107160 2024-06-02T03:58:08.147 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.808+0000 7f71e9b74700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71e4107160 0x7f71e4109550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:08.147 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.808+0000 7f71e9b74700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71e4107160 0x7f71e4109550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53426/0 (socket says 172.21.15.123:53426) 2024-06-02T03:58:08.147 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.808+0000 7f71e9b74700 1 -- 172.21.15.123:0/1034109538 learned_addr learned my addr 172.21.15.123:0/1034109538 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:58:08.147 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.808+0000 7f71e9b74700 1 -- 172.21.15.123:0/1034109538 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e4109bd0 con 0x7f71e4107160 2024-06-02T03:58:08.147 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.808+0000 7f71e9b74700 1 --2- 172.21.15.123:0/1034109538 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71e4107160 0x7f71e4109550 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f71e00098a0 tx=0x7f71e0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f508043a6e7ef5e3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:08.147 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.809+0000 7f71e8b72700 1 -- 172.21.15.123:0/1034109538 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f71e0004160 con 0x7f71e4107160 2024-06-02T03:58:08.147 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.809+0000 7f71e8b72700 1 -- 172.21.15.123:0/1034109538 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71e00042c0 con 0x7f71e4107160 2024-06-02T03:58:08.147 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.809+0000 7f71e8b72700 1 -- 172.21.15.123:0/1034109538 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f71e00119b0 con 0x7f71e4107160 2024-06-02T03:58:08.147 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.809+0000 7f71ebdd8700 1 -- 172.21.15.123:0/1034109538 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71e4107160 msgr2=0x7f71e4109550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:08.148 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.809+0000 7f71ebdd8700 1 --2- 172.21.15.123:0/1034109538 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71e4107160 0x7f71e4109550 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f71e00098a0 tx=0x7f71e0009bb0 comp rx=0 tx=0).stop 2024-06-02T03:58:08.148 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.809+0000 7f71ebdd8700 1 -- 172.21.15.123:0/1034109538 shutdown_connections 2024-06-02T03:58:08.148 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.809+0000 7f71ebdd8700 1 --2- 172.21.15.123:0/1034109538 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71e4107160 0x7f71e4109550 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:08.148 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.809+0000 7f71ebdd8700 1 -- 172.21.15.123:0/1034109538 >> 172.21.15.123:0/1034109538 conn(0x7f71e4100bf0 msgr2=0x7f71e4103010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:08.148 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.809+0000 7f71ebdd8700 1 -- 172.21.15.123:0/1034109538 shutdown_connections 2024-06-02T03:58:08.148 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.809+0000 7f71ebdd8700 1 -- 172.21.15.123:0/1034109538 wait complete. 2024-06-02T03:58:08.148 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.810+0000 7f71ebdd8700 1 Processor -- start 2024-06-02T03:58:08.148 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.810+0000 7f71ebdd8700 1 -- start start 2024-06-02T03:58:08.148 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.810+0000 7f71ebdd8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71e4107160 0x7f71e419a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:08.148 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.810+0000 7f71ebdd8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e419aa40 con 0x7f71e4107160 2024-06-02T03:58:08.148 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.810+0000 7f71e9b74700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71e4107160 0x7f71e419a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:08.148 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.810+0000 7f71e9b74700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71e4107160 0x7f71e419a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53428/0 (socket says 172.21.15.123:53428) 2024-06-02T03:58:08.148 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.810+0000 7f71e9b74700 1 -- 172.21.15.123:0/4058404020 learned_addr learned my addr 172.21.15.123:0/4058404020 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:58:08.149 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.811+0000 7f71e9b74700 1 -- 172.21.15.123:0/4058404020 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e0009550 con 0x7f71e4107160 2024-06-02T03:58:08.149 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.811+0000 7f71e9b74700 1 --2- 172.21.15.123:0/4058404020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71e4107160 0x7f71e419a500 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f71e0006af0 tx=0x7f71e0011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:08.149 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.811+0000 7f71daffd700 1 -- 172.21.15.123:0/4058404020 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f71e0003a40 con 0x7f71e4107160 2024-06-02T03:58:08.149 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.811+0000 7f71daffd700 1 -- 172.21.15.123:0/4058404020 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71e0003ba0 con 0x7f71e4107160 2024-06-02T03:58:08.149 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.811+0000 7f71ebdd8700 1 -- 172.21.15.123:0/4058404020 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e419ac40 con 0x7f71e4107160 2024-06-02T03:58:08.149 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.811+0000 7f71daffd700 1 -- 172.21.15.123:0/4058404020 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f71e00196c0 con 0x7f71e4107160 2024-06-02T03:58:08.149 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.811+0000 7f71ebdd8700 1 -- 172.21.15.123:0/4058404020 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e419b0e0 con 0x7f71e4107160 2024-06-02T03:58:08.149 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.812+0000 7f71daffd700 1 -- 172.21.15.123:0/4058404020 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f71e0019980 con 0x7f71e4107160 2024-06-02T03:58:08.149 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.812+0000 7f71daffd700 1 --2- 172.21.15.123:0/4058404020 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f71d0038700 0x7f71d003abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:08.149 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.812+0000 7f71daffd700 1 -- 172.21.15.123:0/4058404020 --> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f71d003b2d0 con 0x7f71d0038700 2024-06-02T03:58:08.149 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.812+0000 7f71daffd700 1 -- 172.21.15.123:0/4058404020 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f71e004c770 con 0x7f71e4107160 2024-06-02T03:58:08.149 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.812+0000 7f71e9373700 1 -- 172.21.15.123:0/4058404020 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f71d0038700 msgr2=0x7f71d003abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/3555101542 2024-06-02T03:58:08.149 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:01.812+0000 7f71e9373700 1 --2- 172.21.15.123:0/4058404020 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f71d0038700 0x7f71d003abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T03:58:08.150 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:02.013+0000 7f71e9373700 1 -- 172.21.15.123:0/4058404020 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f71d0038700 msgr2=0x7f71d003abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/3555101542 2024-06-02T03:58:08.150 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:02.013+0000 7f71e9373700 1 --2- 172.21.15.123:0/4058404020 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f71d0038700 0x7f71d003abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-06-02T03:58:08.150 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:02.414+0000 7f71e9373700 1 -- 172.21.15.123:0/4058404020 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f71d0038700 msgr2=0x7f71d003abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/3555101542 2024-06-02T03:58:08.150 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:02.414+0000 7f71e9373700 1 --2- 172.21.15.123:0/4058404020 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f71d0038700 0x7f71d003abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-06-02T03:58:08.150 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:03.215+0000 7f71e9373700 1 -- 172.21.15.123:0/4058404020 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f71d0038700 msgr2=0x7f71d003abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/3555101542 2024-06-02T03:58:08.150 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:03.215+0000 7f71e9373700 1 --2- 172.21.15.123:0/4058404020 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f71d0038700 0x7f71d003abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-06-02T03:58:08.150 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:04.816+0000 7f71e9373700 1 -- 172.21.15.123:0/4058404020 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f71d0038700 msgr2=0x7f71d003abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.123:6800/3555101542 2024-06-02T03:58:08.150 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:04.816+0000 7f71e9373700 1 --2- 172.21.15.123:0/4058404020 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f71d0038700 0x7f71d003abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-06-02T03:58:08.150 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:06.767+0000 7f71daffd700 1 -- 172.21.15.123:0/4058404020 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mgrmap(e 10) v1 ==== 45321+0+0 (secure 0 0 0) 0x7f71e002d430 con 0x7f71e4107160 2024-06-02T03:58:08.150 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:06.767+0000 7f71daffd700 1 -- 172.21.15.123:0/4058404020 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f71d0038700 msgr2=0x7f71d003abc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T03:58:08.150 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:06.767+0000 7f71daffd700 1 --2- 172.21.15.123:0/4058404020 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f71d0038700 0x7f71d003abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:08.150 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:07.771+0000 7f71daffd700 1 -- 172.21.15.123:0/4058404020 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mgrmap(e 11) v1 ==== 45448+0+0 (secure 0 0 0) 0x7f71e004e120 con 0x7f71e4107160 2024-06-02T03:58:08.151 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:07.771+0000 7f71daffd700 1 --2- 172.21.15.123:0/4058404020 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f71d003bff0 0x7f71d003e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:08.151 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:07.771+0000 7f71daffd700 1 -- 172.21.15.123:0/4058404020 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f71d003b2d0 con 0x7f71d003bff0 2024-06-02T03:58:08.151 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:07.771+0000 7f71e9373700 1 --2- 172.21.15.123:0/4058404020 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f71d003bff0 0x7f71d003e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:08.151 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:07.772+0000 7f71e9373700 1 --2- 172.21.15.123:0/4058404020 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f71d003bff0 0x7f71d003e3e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f71d4003a10 tx=0x7f71d40092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:08.151 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:07.773+0000 7f71daffd700 1 -- 172.21.15.123:0/4058404020 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f71d003b2d0 con 0x7f71d003bff0 2024-06-02T03:58:08.151 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:07.779+0000 7f71ebdd8700 1 -- 172.21.15.123:0/4058404020 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f71e40625d0 con 0x7f71d003bff0 2024-06-02T03:58:08.151 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:07.779+0000 7f71daffd700 1 -- 172.21.15.123:0/4058404020 <== mgr.14152 v2:172.21.15.123:6800/526143134 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f71e40625d0 con 0x7f71d003bff0 2024-06-02T03:58:08.151 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:07.780+0000 7f71ebdd8700 1 -- 172.21.15.123:0/4058404020 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f71d003bff0 msgr2=0x7f71d003e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:08.151 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:07.780+0000 7f71ebdd8700 1 --2- 172.21.15.123:0/4058404020 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f71d003bff0 0x7f71d003e3e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f71d4003a10 tx=0x7f71d40092b0 comp rx=0 tx=0).stop 2024-06-02T03:58:08.151 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:07.780+0000 7f71ebdd8700 1 -- 172.21.15.123:0/4058404020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71e4107160 msgr2=0x7f71e419a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:08.151 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:07.780+0000 7f71ebdd8700 1 --2- 172.21.15.123:0/4058404020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71e4107160 0x7f71e419a500 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f71e0006af0 tx=0x7f71e0011a10 comp rx=0 tx=0).stop 2024-06-02T03:58:08.151 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:07.780+0000 7f71ebdd8700 1 -- 172.21.15.123:0/4058404020 shutdown_connections 2024-06-02T03:58:08.151 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:07.780+0000 7f71ebdd8700 1 --2- 172.21.15.123:0/4058404020 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71e4107160 0x7f71e419a500 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:08.151 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:07.780+0000 7f71ebdd8700 1 --2- 172.21.15.123:0/4058404020 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f71d003bff0 0x7f71d003e3e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:08.152 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:07.780+0000 7f71ebdd8700 1 --2- 172.21.15.123:0/4058404020 >> [v2:172.21.15.123:6800/3555101542,v1:172.21.15.123:6801/3555101542] conn(0x7f71d0038700 0x7f71d003abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:08.152 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:07.780+0000 7f71ebdd8700 1 -- 172.21.15.123:0/4058404020 >> 172.21.15.123:0/4058404020 conn(0x7f71e4100bf0 msgr2=0x7f71e41017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:08.152 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:07.780+0000 7f71ebdd8700 1 -- 172.21.15.123:0/4058404020 shutdown_connections 2024-06-02T03:58:08.152 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:07.780+0000 7f71ebdd8700 1 -- 172.21.15.123:0/4058404020 wait complete. 2024-06-02T03:58:08.152 INFO:teuthology.orchestra.run.smithi123.stdout:mgr epoch 9 is available 2024-06-02T03:58:08.152 INFO:teuthology.orchestra.run.smithi123.stdout:Generating a dashboard self-signed certificate... 2024-06-02T03:58:09.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:08 smithi123 ceph-mon[42885]: [02/Jun/2024:03:58:07] ENGINE Bus STARTING 2024-06-02T03:58:09.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:08 smithi123 ceph-mon[42885]: [02/Jun/2024:03:58:07] ENGINE Serving on https://172.21.15.123:7150 2024-06-02T03:58:09.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:08 smithi123 ceph-mon[42885]: [02/Jun/2024:03:58:07] ENGINE Serving on http://172.21.15.123:8765 2024-06-02T03:58:09.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:08 smithi123 ceph-mon[42885]: [02/Jun/2024:03:58:07] ENGINE Bus STARTED 2024-06-02T03:58:09.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:08 smithi123 ceph-mon[42885]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-06-02T03:58:09.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:08 smithi123 ceph-mon[42885]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-06-02T03:58:09.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:08 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:10.258 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:09 smithi123 ceph-mon[42885]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T03:58:10.259 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:09 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:10.259 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:09 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:10.259 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:09 smithi123 ceph-mon[42885]: mgrmap e12: x(active, since 2s) 2024-06-02T03:58:10.467 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-06-02T03:58:10.467 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.646+0000 7fe069113700 1 Processor -- start 2024-06-02T03:58:10.467 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.647+0000 7fe069113700 1 -- start start 2024-06-02T03:58:10.467 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.647+0000 7fe069113700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe064107ce0 0x7fe064108100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:10.467 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.647+0000 7fe069113700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0641086d0 con 0x7fe064107ce0 2024-06-02T03:58:10.467 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.647+0000 7fe062d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe064107ce0 0x7fe064108100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:10.467 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.647+0000 7fe062d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe064107ce0 0x7fe064108100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41162/0 (socket says 172.21.15.123:41162) 2024-06-02T03:58:10.467 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.647+0000 7fe062d9d700 1 -- 172.21.15.123:0/3878880865 learned_addr learned my addr 172.21.15.123:0/3878880865 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:58:10.467 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.647+0000 7fe062d9d700 1 -- 172.21.15.123:0/3878880865 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe064108810 con 0x7fe064107ce0 2024-06-02T03:58:10.467 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.647+0000 7fe062d9d700 1 --2- 172.21.15.123:0/3878880865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe064107ce0 0x7fe064108100 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0098a0 tx=0x7fe04c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df4c982cbe19f6e server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:10.468 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.648+0000 7fe061d9b700 1 -- 172.21.15.123:0/3878880865 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe04c004160 con 0x7fe064107ce0 2024-06-02T03:58:10.468 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.648+0000 7fe061d9b700 1 -- 172.21.15.123:0/3878880865 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe04c0042c0 con 0x7fe064107ce0 2024-06-02T03:58:10.468 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.648+0000 7fe061d9b700 1 -- 172.21.15.123:0/3878880865 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe04c0119b0 con 0x7fe064107ce0 2024-06-02T03:58:10.468 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.648+0000 7fe069113700 1 -- 172.21.15.123:0/3878880865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe064107ce0 msgr2=0x7fe064108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:10.468 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.648+0000 7fe069113700 1 --2- 172.21.15.123:0/3878880865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe064107ce0 0x7fe064108100 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0098a0 tx=0x7fe04c009bb0 comp rx=0 tx=0).stop 2024-06-02T03:58:10.468 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.648+0000 7fe069113700 1 -- 172.21.15.123:0/3878880865 shutdown_connections 2024-06-02T03:58:10.468 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.648+0000 7fe069113700 1 --2- 172.21.15.123:0/3878880865 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe064107ce0 0x7fe064108100 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:10.468 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.648+0000 7fe069113700 1 -- 172.21.15.123:0/3878880865 >> 172.21.15.123:0/3878880865 conn(0x7fe0641002e0 msgr2=0x7fe064102740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:10.468 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.648+0000 7fe069113700 1 -- 172.21.15.123:0/3878880865 shutdown_connections 2024-06-02T03:58:10.468 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.648+0000 7fe069113700 1 -- 172.21.15.123:0/3878880865 wait complete. 2024-06-02T03:58:10.468 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.649+0000 7fe069113700 1 Processor -- start 2024-06-02T03:58:10.468 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.649+0000 7fe069113700 1 -- start start 2024-06-02T03:58:10.469 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.649+0000 7fe069113700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe064107ce0 0x7fe06419c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:10.469 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.649+0000 7fe069113700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe06419cc70 con 0x7fe064107ce0 2024-06-02T03:58:10.469 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.649+0000 7fe062d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe064107ce0 0x7fe06419c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:10.469 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.649+0000 7fe062d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe064107ce0 0x7fe06419c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41172/0 (socket says 172.21.15.123:41172) 2024-06-02T03:58:10.469 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.649+0000 7fe062d9d700 1 -- 172.21.15.123:0/3194721695 learned_addr learned my addr 172.21.15.123:0/3194721695 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:58:10.469 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.650+0000 7fe062d9d700 1 -- 172.21.15.123:0/3194721695 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c009550 con 0x7fe064107ce0 2024-06-02T03:58:10.469 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.650+0000 7fe062d9d700 1 --2- 172.21.15.123:0/3194721695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe064107ce0 0x7fe06419c730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe04c003e60 tx=0x7fe04c011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:10.469 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.650+0000 7fe05bfff700 1 -- 172.21.15.123:0/3194721695 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe04c0039f0 con 0x7fe064107ce0 2024-06-02T03:58:10.469 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.650+0000 7fe05bfff700 1 -- 172.21.15.123:0/3194721695 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe04c003b50 con 0x7fe064107ce0 2024-06-02T03:58:10.469 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.650+0000 7fe069113700 1 -- 172.21.15.123:0/3194721695 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe06419ce70 con 0x7fe064107ce0 2024-06-02T03:58:10.469 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.650+0000 7fe05bfff700 1 -- 172.21.15.123:0/3194721695 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe04c01a580 con 0x7fe064107ce0 2024-06-02T03:58:10.469 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.650+0000 7fe069113700 1 -- 172.21.15.123:0/3194721695 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe06419d310 con 0x7fe064107ce0 2024-06-02T03:58:10.469 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.651+0000 7fe069113700 1 -- 172.21.15.123:0/3194721695 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0641053b0 con 0x7fe064107ce0 2024-06-02T03:58:10.470 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.651+0000 7fe05bfff700 1 -- 172.21.15.123:0/3194721695 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 11) v1 ==== 45448+0+0 (secure 0 0 0) 0x7fe04c024430 con 0x7fe064107ce0 2024-06-02T03:58:10.470 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.651+0000 7fe05bfff700 1 --2- 172.21.15.123:0/3194721695 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe0500385e0 0x7fe05003aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:10.470 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.651+0000 7fe05bfff700 1 -- 172.21.15.123:0/3194721695 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe04c04cc30 con 0x7fe064107ce0 2024-06-02T03:58:10.470 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.652+0000 7fe06259c700 1 --2- 172.21.15.123:0/3194721695 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe0500385e0 0x7fe05003aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:10.470 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.652+0000 7fe06259c700 1 --2- 172.21.15.123:0/3194721695 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe0500385e0 0x7fe05003aaa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe054006fd0 tx=0x7fe054006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:10.470 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.656+0000 7fe05bfff700 1 -- 172.21.15.123:0/3194721695 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe04c018760 con 0x7fe064107ce0 2024-06-02T03:58:10.470 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.861+0000 7fe069113700 1 -- 172.21.15.123:0/3194721695 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fe06419fb50 con 0x7fe0500385e0 2024-06-02T03:58:10.470 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.983+0000 7fe05bfff700 1 -- 172.21.15.123:0/3194721695 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fe06419fb50 con 0x7fe0500385e0 2024-06-02T03:58:10.470 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.985+0000 7fe069113700 1 -- 172.21.15.123:0/3194721695 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe0500385e0 msgr2=0x7fe05003aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:10.470 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.985+0000 7fe069113700 1 --2- 172.21.15.123:0/3194721695 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe0500385e0 0x7fe05003aaa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe054006fd0 tx=0x7fe054006e40 comp rx=0 tx=0).stop 2024-06-02T03:58:10.470 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.985+0000 7fe069113700 1 -- 172.21.15.123:0/3194721695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe064107ce0 msgr2=0x7fe06419c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:10.470 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.985+0000 7fe069113700 1 --2- 172.21.15.123:0/3194721695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe064107ce0 0x7fe06419c730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe04c003e60 tx=0x7fe04c011a30 comp rx=0 tx=0).stop 2024-06-02T03:58:10.471 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.985+0000 7fe069113700 1 -- 172.21.15.123:0/3194721695 shutdown_connections 2024-06-02T03:58:10.471 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.985+0000 7fe069113700 1 --2- 172.21.15.123:0/3194721695 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe0500385e0 0x7fe05003aaa0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:10.471 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.985+0000 7fe069113700 1 --2- 172.21.15.123:0/3194721695 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe064107ce0 0x7fe06419c730 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:10.471 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.985+0000 7fe069113700 1 -- 172.21.15.123:0/3194721695 >> 172.21.15.123:0/3194721695 conn(0x7fe0641002e0 msgr2=0x7fe064100dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:10.471 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.985+0000 7fe069113700 1 -- 172.21.15.123:0/3194721695 shutdown_connections 2024-06-02T03:58:10.471 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:08.985+0000 7fe069113700 1 -- 172.21.15.123:0/3194721695 wait complete. 2024-06-02T03:58:10.471 INFO:teuthology.orchestra.run.smithi123.stdout:Creating initial admin user... 2024-06-02T03:58:11.810 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$X8GJM20P37n2ItdJS8k2NOWR5P8Oyj/W3SopAtRp/Y83eP50smPl.", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1717300691, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-06-02T03:58:11.810 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.007+0000 7fba937df700 1 Processor -- start 2024-06-02T03:58:11.810 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.007+0000 7fba937df700 1 -- start start 2024-06-02T03:58:11.810 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.008+0000 7fba937df700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba8c107140 0x7fba8c109530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:11.810 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.008+0000 7fba937df700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c079e90 con 0x7fba8c107140 2024-06-02T03:58:11.810 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.008+0000 7fba9157b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba8c107140 0x7fba8c109530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:11.810 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.008+0000 7fba9157b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba8c107140 0x7fba8c109530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41188/0 (socket says 172.21.15.123:41188) 2024-06-02T03:58:11.810 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.008+0000 7fba9157b700 1 -- 172.21.15.123:0/2268050684 learned_addr learned my addr 172.21.15.123:0/2268050684 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:58:11.810 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.008+0000 7fba9157b700 1 -- 172.21.15.123:0/2268050684 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8c109a70 con 0x7fba8c107140 2024-06-02T03:58:11.811 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.008+0000 7fba9157b700 1 --2- 172.21.15.123:0/2268050684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba8c107140 0x7fba8c109530 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fba7c009e80 tx=0x7fba7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40ace6cf2c52e8f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:11.811 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.008+0000 7fba8bfff700 1 -- 172.21.15.123:0/2268050684 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba7c00e070 con 0x7fba8c107140 2024-06-02T03:58:11.811 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.008+0000 7fba8bfff700 1 -- 172.21.15.123:0/2268050684 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fba7c00b8c0 con 0x7fba8c107140 2024-06-02T03:58:11.811 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.008+0000 7fba8bfff700 1 -- 172.21.15.123:0/2268050684 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba7c0043e0 con 0x7fba8c107140 2024-06-02T03:58:11.811 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.009+0000 7fba937df700 1 -- 172.21.15.123:0/2268050684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba8c107140 msgr2=0x7fba8c109530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:11.811 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.009+0000 7fba937df700 1 --2- 172.21.15.123:0/2268050684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba8c107140 0x7fba8c109530 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fba7c009e80 tx=0x7fba7c00b330 comp rx=0 tx=0).stop 2024-06-02T03:58:11.811 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.009+0000 7fba937df700 1 -- 172.21.15.123:0/2268050684 shutdown_connections 2024-06-02T03:58:11.811 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.009+0000 7fba937df700 1 --2- 172.21.15.123:0/2268050684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba8c107140 0x7fba8c109530 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:11.811 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.009+0000 7fba937df700 1 -- 172.21.15.123:0/2268050684 >> 172.21.15.123:0/2268050684 conn(0x7fba8c100b90 msgr2=0x7fba8c102fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:11.811 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.009+0000 7fba937df700 1 -- 172.21.15.123:0/2268050684 shutdown_connections 2024-06-02T03:58:11.812 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.009+0000 7fba937df700 1 -- 172.21.15.123:0/2268050684 wait complete. 2024-06-02T03:58:11.812 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.010+0000 7fba937df700 1 Processor -- start 2024-06-02T03:58:11.812 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.010+0000 7fba937df700 1 -- start start 2024-06-02T03:58:11.812 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.010+0000 7fba937df700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba8c107140 0x7fba8c19c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:11.812 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.010+0000 7fba937df700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c19cb00 con 0x7fba8c107140 2024-06-02T03:58:11.812 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.010+0000 7fba9157b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba8c107140 0x7fba8c19c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:11.812 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.010+0000 7fba9157b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba8c107140 0x7fba8c19c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41198/0 (socket says 172.21.15.123:41198) 2024-06-02T03:58:11.812 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.010+0000 7fba9157b700 1 -- 172.21.15.123:0/2850301033 learned_addr learned my addr 172.21.15.123:0/2850301033 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:58:11.812 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.010+0000 7fba9157b700 1 -- 172.21.15.123:0/2850301033 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c009b30 con 0x7fba8c107140 2024-06-02T03:58:11.812 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.010+0000 7fba9157b700 1 --2- 172.21.15.123:0/2850301033 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba8c107140 0x7fba8c19c5c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fba7c009530 tx=0x7fba7c003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:11.812 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.011+0000 7fba8a7fc700 1 -- 172.21.15.123:0/2850301033 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba7c00e040 con 0x7fba8c107140 2024-06-02T03:58:11.812 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.011+0000 7fba8a7fc700 1 -- 172.21.15.123:0/2850301033 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fba7c00bd70 con 0x7fba8c107140 2024-06-02T03:58:11.813 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.011+0000 7fba8a7fc700 1 -- 172.21.15.123:0/2850301033 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba7c01c700 con 0x7fba8c107140 2024-06-02T03:58:11.813 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.011+0000 7fba937df700 1 -- 172.21.15.123:0/2850301033 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba8c19cd00 con 0x7fba8c107140 2024-06-02T03:58:11.813 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.011+0000 7fba937df700 1 -- 172.21.15.123:0/2850301033 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba8c19d200 con 0x7fba8c107140 2024-06-02T03:58:11.813 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.012+0000 7fba8a7fc700 1 -- 172.21.15.123:0/2850301033 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7fba7c012a80 con 0x7fba8c107140 2024-06-02T03:58:11.813 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.012+0000 7fba937df700 1 -- 172.21.15.123:0/2850301033 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba8c10a8b0 con 0x7fba8c107140 2024-06-02T03:58:11.813 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.012+0000 7fba8a7fc700 1 --2- 172.21.15.123:0/2850301033 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fba740387a0 0x7fba7403ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:11.813 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.012+0000 7fba8a7fc700 1 -- 172.21.15.123:0/2850301033 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fba7c04c5e0 con 0x7fba8c107140 2024-06-02T03:58:11.813 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.012+0000 7fba90d7a700 1 --2- 172.21.15.123:0/2850301033 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fba740387a0 0x7fba7403ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:11.813 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.012+0000 7fba90d7a700 1 --2- 172.21.15.123:0/2850301033 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fba740387a0 0x7fba7403ac60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fba80006fd0 tx=0x7fba80006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:11.813 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.017+0000 7fba8a7fc700 1 -- 172.21.15.123:0/2850301033 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fba7c012430 con 0x7fba8c107140 2024-06-02T03:58:11.813 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.222+0000 7fba937df700 1 -- 172.21.15.123:0/2850301033 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fba8c0623f0 con 0x7fba740387a0 2024-06-02T03:58:11.813 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.439+0000 7fba8a7fc700 1 -- 172.21.15.123:0/2850301033 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fba8c0623f0 con 0x7fba740387a0 2024-06-02T03:58:11.814 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.442+0000 7fba937df700 1 -- 172.21.15.123:0/2850301033 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fba740387a0 msgr2=0x7fba7403ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:11.814 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.442+0000 7fba937df700 1 --2- 172.21.15.123:0/2850301033 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fba740387a0 0x7fba7403ac60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fba80006fd0 tx=0x7fba80006e40 comp rx=0 tx=0).stop 2024-06-02T03:58:11.814 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.442+0000 7fba937df700 1 -- 172.21.15.123:0/2850301033 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba8c107140 msgr2=0x7fba8c19c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:11.814 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.442+0000 7fba937df700 1 --2- 172.21.15.123:0/2850301033 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba8c107140 0x7fba8c19c5c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fba7c009530 tx=0x7fba7c003d00 comp rx=0 tx=0).stop 2024-06-02T03:58:11.814 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.442+0000 7fba937df700 1 -- 172.21.15.123:0/2850301033 shutdown_connections 2024-06-02T03:58:11.814 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.442+0000 7fba937df700 1 --2- 172.21.15.123:0/2850301033 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fba740387a0 0x7fba7403ac60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:11.814 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.442+0000 7fba937df700 1 --2- 172.21.15.123:0/2850301033 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba8c107140 0x7fba8c19c5c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:11.814 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.442+0000 7fba937df700 1 -- 172.21.15.123:0/2850301033 >> 172.21.15.123:0/2850301033 conn(0x7fba8c100b90 msgr2=0x7fba8c1015d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:11.814 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.442+0000 7fba937df700 1 -- 172.21.15.123:0/2850301033 shutdown_connections 2024-06-02T03:58:11.814 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:11.442+0000 7fba937df700 1 -- 172.21.15.123:0/2850301033 wait complete. 2024-06-02T03:58:11.814 INFO:teuthology.orchestra.run.smithi123.stdout:Fetching dashboard port number... 2024-06-02T03:58:12.696 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:12 smithi123 ceph-mon[42885]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T03:58:12.696 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:12 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:12.697 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:12 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1088413851' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-06-02T03:58:12.751 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stdout 8443 2024-06-02T03:58:12.751 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.155+0000 7f3e88e29700 1 Processor -- start 2024-06-02T03:58:12.751 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.155+0000 7f3e88e29700 1 -- start start 2024-06-02T03:58:12.751 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.155+0000 7f3e88e29700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e84104fe0 0x7f3e84105400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:12.751 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.155+0000 7f3e88e29700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e84079e10 con 0x7f3e84104fe0 2024-06-02T03:58:12.751 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.155+0000 7f3e8259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e84104fe0 0x7f3e84105400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:12.751 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.155+0000 7f3e8259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e84104fe0 0x7f3e84105400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41202/0 (socket says 172.21.15.123:41202) 2024-06-02T03:58:12.751 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.156+0000 7f3e8259c700 1 -- 172.21.15.123:0/1268200207 learned_addr learned my addr 172.21.15.123:0/1268200207 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:58:12.752 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.156+0000 7f3e8259c700 1 -- 172.21.15.123:0/1268200207 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e84105940 con 0x7f3e84104fe0 2024-06-02T03:58:12.752 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.156+0000 7f3e8259c700 1 --2- 172.21.15.123:0/1268200207 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e84104fe0 0x7f3e84105400 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c009e80 tx=0x7f3e7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b0aab82a6e2e39 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:12.752 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.156+0000 7f3e8159a700 1 -- 172.21.15.123:0/1268200207 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e7c00e070 con 0x7f3e84104fe0 2024-06-02T03:58:12.752 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.156+0000 7f3e8159a700 1 -- 172.21.15.123:0/1268200207 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e7c00b8c0 con 0x7f3e84104fe0 2024-06-02T03:58:12.752 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.156+0000 7f3e8159a700 1 -- 172.21.15.123:0/1268200207 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e7c0043e0 con 0x7f3e84104fe0 2024-06-02T03:58:12.752 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.157+0000 7f3e88e29700 1 -- 172.21.15.123:0/1268200207 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e84104fe0 msgr2=0x7f3e84105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:12.752 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.157+0000 7f3e88e29700 1 --2- 172.21.15.123:0/1268200207 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e84104fe0 0x7f3e84105400 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c009e80 tx=0x7f3e7c00b330 comp rx=0 tx=0).stop 2024-06-02T03:58:12.752 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.157+0000 7f3e88e29700 1 -- 172.21.15.123:0/1268200207 shutdown_connections 2024-06-02T03:58:12.752 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.157+0000 7f3e88e29700 1 --2- 172.21.15.123:0/1268200207 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e84104fe0 0x7f3e84105400 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:12.752 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.157+0000 7f3e88e29700 1 -- 172.21.15.123:0/1268200207 >> 172.21.15.123:0/1268200207 conn(0x7f3e84100bc0 msgr2=0x7f3e84102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:12.752 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.157+0000 7f3e88e29700 1 -- 172.21.15.123:0/1268200207 shutdown_connections 2024-06-02T03:58:12.752 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.157+0000 7f3e88e29700 1 -- 172.21.15.123:0/1268200207 wait complete. 2024-06-02T03:58:12.752 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.157+0000 7f3e88e29700 1 Processor -- start 2024-06-02T03:58:12.753 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.158+0000 7f3e88e29700 1 -- start start 2024-06-02T03:58:12.753 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.158+0000 7f3e88e29700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e84104fe0 0x7f3e8419c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:12.753 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.158+0000 7f3e88e29700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8419cb80 con 0x7f3e84104fe0 2024-06-02T03:58:12.753 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.158+0000 7f3e8259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e84104fe0 0x7f3e8419c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:12.753 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.158+0000 7f3e8259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e84104fe0 0x7f3e8419c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41204/0 (socket says 172.21.15.123:41204) 2024-06-02T03:58:12.753 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.158+0000 7f3e8259c700 1 -- 172.21.15.123:0/1088413851 learned_addr learned my addr 172.21.15.123:0/1088413851 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:58:12.753 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.158+0000 7f3e8259c700 1 -- 172.21.15.123:0/1088413851 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7c009b30 con 0x7f3e84104fe0 2024-06-02T03:58:12.753 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.158+0000 7f3e8259c700 1 --2- 172.21.15.123:0/1088413851 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e84104fe0 0x7f3e8419c640 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c004070 tx=0x7f3e7c003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:12.753 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.158+0000 7f3e7b7fe700 1 -- 172.21.15.123:0/1088413851 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e7c00e040 con 0x7f3e84104fe0 2024-06-02T03:58:12.753 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.158+0000 7f3e88e29700 1 -- 172.21.15.123:0/1088413851 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e8419cd80 con 0x7f3e84104fe0 2024-06-02T03:58:12.753 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.158+0000 7f3e7b7fe700 1 -- 172.21.15.123:0/1088413851 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e7c00bdf0 con 0x7f3e84104fe0 2024-06-02T03:58:12.754 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.158+0000 7f3e7b7fe700 1 -- 172.21.15.123:0/1088413851 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e7c01c750 con 0x7f3e84104fe0 2024-06-02T03:58:12.754 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.158+0000 7f3e88e29700 1 -- 172.21.15.123:0/1088413851 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e8419d280 con 0x7f3e84104fe0 2024-06-02T03:58:12.754 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.159+0000 7f3e88e29700 1 -- 172.21.15.123:0/1088413851 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e84196310 con 0x7f3e84104fe0 2024-06-02T03:58:12.754 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.160+0000 7f3e7b7fe700 1 -- 172.21.15.123:0/1088413851 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f3e7c012b10 con 0x7f3e84104fe0 2024-06-02T03:58:12.754 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.160+0000 7f3e7b7fe700 1 --2- 172.21.15.123:0/1088413851 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3e70038700 0x7f3e7003abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:12.754 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.160+0000 7f3e7b7fe700 1 -- 172.21.15.123:0/1088413851 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f3e7c04cb20 con 0x7f3e84104fe0 2024-06-02T03:58:12.754 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.160+0000 7f3e81d9b700 1 --2- 172.21.15.123:0/1088413851 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3e70038700 0x7f3e7003abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:12.754 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.160+0000 7f3e81d9b700 1 --2- 172.21.15.123:0/1088413851 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3e70038700 0x7f3e7003abc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c006fd0 tx=0x7f3e6c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:12.754 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.164+0000 7f3e7b7fe700 1 -- 172.21.15.123:0/1088413851 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3e7c01c9c0 con 0x7f3e84104fe0 2024-06-02T03:58:12.754 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.356+0000 7f3e88e29700 1 -- 172.21.15.123:0/1088413851 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f3e841067f0 con 0x7f3e84104fe0 2024-06-02T03:58:12.754 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.356+0000 7f3e7b7fe700 1 -- 172.21.15.123:0/1088413851 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f3e7c017020 con 0x7f3e84104fe0 2024-06-02T03:58:12.754 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.358+0000 7f3e88e29700 1 -- 172.21.15.123:0/1088413851 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3e70038700 msgr2=0x7f3e7003abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:12.755 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.358+0000 7f3e88e29700 1 --2- 172.21.15.123:0/1088413851 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3e70038700 0x7f3e7003abc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c006fd0 tx=0x7f3e6c006e40 comp rx=0 tx=0).stop 2024-06-02T03:58:12.755 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.358+0000 7f3e88e29700 1 -- 172.21.15.123:0/1088413851 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e84104fe0 msgr2=0x7f3e8419c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:12.755 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.358+0000 7f3e88e29700 1 --2- 172.21.15.123:0/1088413851 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e84104fe0 0x7f3e8419c640 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c004070 tx=0x7f3e7c003d00 comp rx=0 tx=0).stop 2024-06-02T03:58:12.755 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.358+0000 7f3e88e29700 1 -- 172.21.15.123:0/1088413851 shutdown_connections 2024-06-02T03:58:12.755 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.358+0000 7f3e88e29700 1 --2- 172.21.15.123:0/1088413851 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3e70038700 0x7f3e7003abc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:12.755 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.358+0000 7f3e88e29700 1 --2- 172.21.15.123:0/1088413851 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e84104fe0 0x7f3e8419c640 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:12.755 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.358+0000 7f3e88e29700 1 -- 172.21.15.123:0/1088413851 >> 172.21.15.123:0/1088413851 conn(0x7f3e84100bc0 msgr2=0x7f3e84193450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:12.755 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.358+0000 7f3e88e29700 1 -- 172.21.15.123:0/1088413851 shutdown_connections 2024-06-02T03:58:12.756 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:12.358+0000 7f3e88e29700 1 -- 172.21.15.123:0/1088413851 wait complete. 2024-06-02T03:58:12.757 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-06-02T03:58:12.758 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout disabled 2024-06-02T03:58:12.765 INFO:teuthology.orchestra.run.smithi123.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-06-02T03:58:12.765 INFO:teuthology.orchestra.run.smithi123.stdout:systemctl: stdout inactive 2024-06-02T03:58:12.765 INFO:teuthology.orchestra.run.smithi123.stdout:firewalld.service is not enabled 2024-06-02T03:58:12.765 INFO:teuthology.orchestra.run.smithi123.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-06-02T03:58:12.767 INFO:teuthology.orchestra.run.smithi123.stdout:Ceph Dashboard is now available at: 2024-06-02T03:58:12.767 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T03:58:12.767 INFO:teuthology.orchestra.run.smithi123.stdout: URL: https://smithi123.front.sepia.ceph.com:8443/ 2024-06-02T03:58:12.767 INFO:teuthology.orchestra.run.smithi123.stdout: User: admin 2024-06-02T03:58:12.767 INFO:teuthology.orchestra.run.smithi123.stdout: Password: 1bpud67zpa 2024-06-02T03:58:12.767 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T03:58:12.768 INFO:teuthology.orchestra.run.smithi123.stdout:Saving cluster configuration to /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/config directory 2024-06-02T03:58:12.768 INFO:teuthology.orchestra.run.smithi123.stdout:Enabling autotune for osd_memory_target 2024-06-02T03:58:13.729 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.130+0000 7f8c38d3e700 1 Processor -- start 2024-06-02T03:58:13.729 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.130+0000 7f8c38d3e700 1 -- start start 2024-06-02T03:58:13.729 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.130+0000 7f8c38d3e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c341071b0 0x7f8c341095a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:13.729 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.130+0000 7f8c38d3e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c34079e50 con 0x7f8c341071b0 2024-06-02T03:58:13.730 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.130+0000 7f8c3259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c341071b0 0x7f8c341095a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:13.730 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.130+0000 7f8c3259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c341071b0 0x7f8c341095a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41212/0 (socket says 172.21.15.123:41212) 2024-06-02T03:58:13.730 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.130+0000 7f8c3259c700 1 -- 172.21.15.123:0/4154199782 learned_addr learned my addr 172.21.15.123:0/4154199782 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:58:13.731 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.130+0000 7f8c3259c700 1 -- 172.21.15.123:0/4154199782 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c34109ae0 con 0x7f8c341071b0 2024-06-02T03:58:13.731 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.131+0000 7f8c3259c700 1 --2- 172.21.15.123:0/4154199782 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c341071b0 0x7f8c341095a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8c280098a0 tx=0x7f8c28009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b3db92e959b0298 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:13.731 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.131+0000 7f8c3159a700 1 -- 172.21.15.123:0/4154199782 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c28004160 con 0x7f8c341071b0 2024-06-02T03:58:13.731 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.131+0000 7f8c3159a700 1 -- 172.21.15.123:0/4154199782 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c280042c0 con 0x7f8c341071b0 2024-06-02T03:58:13.731 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.131+0000 7f8c3159a700 1 -- 172.21.15.123:0/4154199782 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c280119b0 con 0x7f8c341071b0 2024-06-02T03:58:13.731 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.131+0000 7f8c38d3e700 1 -- 172.21.15.123:0/4154199782 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c341071b0 msgr2=0x7f8c341095a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:13.732 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.131+0000 7f8c38d3e700 1 --2- 172.21.15.123:0/4154199782 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c341071b0 0x7f8c341095a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8c280098a0 tx=0x7f8c28009bb0 comp rx=0 tx=0).stop 2024-06-02T03:58:13.732 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.131+0000 7f8c38d3e700 1 -- 172.21.15.123:0/4154199782 shutdown_connections 2024-06-02T03:58:13.732 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.131+0000 7f8c38d3e700 1 --2- 172.21.15.123:0/4154199782 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c341071b0 0x7f8c341095a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:13.732 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.131+0000 7f8c38d3e700 1 -- 172.21.15.123:0/4154199782 >> 172.21.15.123:0/4154199782 conn(0x7f8c34100bc0 msgr2=0x7f8c34102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:13.732 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.131+0000 7f8c38d3e700 1 -- 172.21.15.123:0/4154199782 shutdown_connections 2024-06-02T03:58:13.732 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.131+0000 7f8c38d3e700 1 -- 172.21.15.123:0/4154199782 wait complete. 2024-06-02T03:58:13.733 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.132+0000 7f8c38d3e700 1 Processor -- start 2024-06-02T03:58:13.733 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.132+0000 7f8c38d3e700 1 -- start start 2024-06-02T03:58:13.733 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.132+0000 7f8c38d3e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c341071b0 0x7f8c3419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:13.733 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.132+0000 7f8c38d3e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3419a9e0 con 0x7f8c341071b0 2024-06-02T03:58:13.733 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.132+0000 7f8c3259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c341071b0 0x7f8c3419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:13.733 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.132+0000 7f8c3259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c341071b0 0x7f8c3419a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41220/0 (socket says 172.21.15.123:41220) 2024-06-02T03:58:13.733 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.132+0000 7f8c3259c700 1 -- 172.21.15.123:0/3020579562 learned_addr learned my addr 172.21.15.123:0/3020579562 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:58:13.733 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.133+0000 7f8c3259c700 1 -- 172.21.15.123:0/3020579562 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c28009550 con 0x7f8c341071b0 2024-06-02T03:58:13.734 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.133+0000 7f8c3259c700 1 --2- 172.21.15.123:0/3020579562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c341071b0 0x7f8c3419a4a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8c28011980 tx=0x7f8c28011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:13.734 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.133+0000 7f8c237fe700 1 -- 172.21.15.123:0/3020579562 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c28003af0 con 0x7f8c341071b0 2024-06-02T03:58:13.734 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.133+0000 7f8c237fe700 1 -- 172.21.15.123:0/3020579562 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c28003c50 con 0x7f8c341071b0 2024-06-02T03:58:13.734 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.133+0000 7f8c38d3e700 1 -- 172.21.15.123:0/3020579562 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c3419abe0 con 0x7f8c341071b0 2024-06-02T03:58:13.734 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.133+0000 7f8c237fe700 1 -- 172.21.15.123:0/3020579562 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c28019760 con 0x7f8c341071b0 2024-06-02T03:58:13.734 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.133+0000 7f8c38d3e700 1 -- 172.21.15.123:0/3020579562 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c3419b080 con 0x7f8c341071b0 2024-06-02T03:58:13.735 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.134+0000 7f8c237fe700 1 -- 172.21.15.123:0/3020579562 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f8c280199a0 con 0x7f8c341071b0 2024-06-02T03:58:13.735 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.134+0000 7f8c38d3e700 1 -- 172.21.15.123:0/3020579562 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c3410a8c0 con 0x7f8c341071b0 2024-06-02T03:58:13.735 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.134+0000 7f8c237fe700 1 --2- 172.21.15.123:0/3020579562 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f8c1c038750 0x7f8c1c03ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:13.735 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.134+0000 7f8c237fe700 1 -- 172.21.15.123:0/3020579562 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8c2804cd00 con 0x7f8c341071b0 2024-06-02T03:58:13.735 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.134+0000 7f8c31d9b700 1 --2- 172.21.15.123:0/3020579562 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f8c1c038750 0x7f8c1c03ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:13.735 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.135+0000 7f8c31d9b700 1 --2- 172.21.15.123:0/3020579562 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f8c1c038750 0x7f8c1c03ac10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8c24006fd0 tx=0x7f8c24006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:13.736 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.139+0000 7f8c237fe700 1 -- 172.21.15.123:0/3020579562 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8c28018710 con 0x7f8c341071b0 2024-06-02T03:58:13.736 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.332+0000 7f8c38d3e700 1 -- 172.21.15.123:0/3020579562 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f8c3410ab30 con 0x7f8c341071b0 2024-06-02T03:58:13.736 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.333+0000 7f8c237fe700 1 -- 172.21.15.123:0/3020579562 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f8c28018350 con 0x7f8c341071b0 2024-06-02T03:58:13.736 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.335+0000 7f8c38d3e700 1 -- 172.21.15.123:0/3020579562 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f8c1c038750 msgr2=0x7f8c1c03ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:13.736 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.335+0000 7f8c38d3e700 1 --2- 172.21.15.123:0/3020579562 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f8c1c038750 0x7f8c1c03ac10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8c24006fd0 tx=0x7f8c24006e40 comp rx=0 tx=0).stop 2024-06-02T03:58:13.736 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.335+0000 7f8c38d3e700 1 -- 172.21.15.123:0/3020579562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c341071b0 msgr2=0x7f8c3419a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:13.736 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.335+0000 7f8c38d3e700 1 --2- 172.21.15.123:0/3020579562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c341071b0 0x7f8c3419a4a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8c28011980 tx=0x7f8c28011a60 comp rx=0 tx=0).stop 2024-06-02T03:58:13.737 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.335+0000 7f8c38d3e700 1 -- 172.21.15.123:0/3020579562 shutdown_connections 2024-06-02T03:58:13.737 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.335+0000 7f8c38d3e700 1 --2- 172.21.15.123:0/3020579562 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f8c1c038750 0x7f8c1c03ac10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:13.737 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.335+0000 7f8c38d3e700 1 --2- 172.21.15.123:0/3020579562 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c341071b0 0x7f8c3419a4a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:13.737 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.335+0000 7f8c38d3e700 1 -- 172.21.15.123:0/3020579562 >> 172.21.15.123:0/3020579562 conn(0x7f8c34100bc0 msgr2=0x7f8c34101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:13.737 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.335+0000 7f8c38d3e700 1 -- 172.21.15.123:0/3020579562 shutdown_connections 2024-06-02T03:58:13.737 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:13.335+0000 7f8c38d3e700 1 -- 172.21.15.123:0/3020579562 wait complete. 2024-06-02T03:58:14.689 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:14 smithi123 ceph-mon[42885]: mgrmap e13: x(active, since 6s) 2024-06-02T03:58:14.690 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:14 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1951405331' entity='client.admin' 2024-06-02T03:58:14.746 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.063+0000 7f171268a700 1 Processor -- start 2024-06-02T03:58:14.752 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.063+0000 7f171268a700 1 -- start start 2024-06-02T03:58:14.752 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.063+0000 7f171268a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f170c1066f0 0x7f170c106b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:14.752 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.063+0000 7f171268a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170c1070e0 con 0x7f170c1066f0 2024-06-02T03:58:14.752 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.063+0000 7f170bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f170c1066f0 0x7f170c106b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:14.752 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.063+0000 7f170bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f170c1066f0 0x7f170c106b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41236/0 (socket says 172.21.15.123:41236) 2024-06-02T03:58:14.752 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.063+0000 7f170bfff700 1 -- 172.21.15.123:0/2445370353 learned_addr learned my addr 172.21.15.123:0/2445370353 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:58:14.752 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.063+0000 7f170bfff700 1 -- 172.21.15.123:0/2445370353 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170c1078a0 con 0x7f170c1066f0 2024-06-02T03:58:14.752 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.064+0000 7f170bfff700 1 --2- 172.21.15.123:0/2445370353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f170c1066f0 0x7f170c106b10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f16fc0098a0 tx=0x7f16fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a89b1bd21c3c357 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:14.752 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.064+0000 7f170affd700 1 -- 172.21.15.123:0/2445370353 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f16fc004160 con 0x7f170c1066f0 2024-06-02T03:58:14.752 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.064+0000 7f170affd700 1 -- 172.21.15.123:0/2445370353 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16fc0042c0 con 0x7f170c1066f0 2024-06-02T03:58:14.753 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.064+0000 7f170affd700 1 -- 172.21.15.123:0/2445370353 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f16fc0119b0 con 0x7f170c1066f0 2024-06-02T03:58:14.753 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.064+0000 7f171268a700 1 -- 172.21.15.123:0/2445370353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f170c1066f0 msgr2=0x7f170c106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:14.753 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.064+0000 7f171268a700 1 --2- 172.21.15.123:0/2445370353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f170c1066f0 0x7f170c106b10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f16fc0098a0 tx=0x7f16fc009bb0 comp rx=0 tx=0).stop 2024-06-02T03:58:14.753 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.064+0000 7f171268a700 1 -- 172.21.15.123:0/2445370353 shutdown_connections 2024-06-02T03:58:14.753 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.064+0000 7f171268a700 1 --2- 172.21.15.123:0/2445370353 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f170c1066f0 0x7f170c106b10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:14.753 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.064+0000 7f171268a700 1 -- 172.21.15.123:0/2445370353 >> 172.21.15.123:0/2445370353 conn(0x7f170c101d30 msgr2=0x7f170c104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:14.753 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.064+0000 7f171268a700 1 -- 172.21.15.123:0/2445370353 shutdown_connections 2024-06-02T03:58:14.753 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.064+0000 7f171268a700 1 -- 172.21.15.123:0/2445370353 wait complete. 2024-06-02T03:58:14.753 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.065+0000 7f171268a700 1 Processor -- start 2024-06-02T03:58:14.753 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.065+0000 7f171268a700 1 -- start start 2024-06-02T03:58:14.753 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.065+0000 7f171268a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f170c1066f0 0x7f170c19a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:14.753 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.065+0000 7f171268a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170c19a940 con 0x7f170c1066f0 2024-06-02T03:58:14.753 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.065+0000 7f170bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f170c1066f0 0x7f170c19a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:14.754 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.065+0000 7f170bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f170c1066f0 0x7f170c19a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41244/0 (socket says 172.21.15.123:41244) 2024-06-02T03:58:14.754 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.065+0000 7f170bfff700 1 -- 172.21.15.123:0/1951405331 learned_addr learned my addr 172.21.15.123:0/1951405331 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:58:14.754 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.066+0000 7f170bfff700 1 -- 172.21.15.123:0/1951405331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16fc009550 con 0x7f170c1066f0 2024-06-02T03:58:14.754 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.066+0000 7f170bfff700 1 --2- 172.21.15.123:0/1951405331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f170c1066f0 0x7f170c19a400 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f16fc006af0 tx=0x7f16fc011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:14.754 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.066+0000 7f17097fa700 1 -- 172.21.15.123:0/1951405331 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f16fc003a40 con 0x7f170c1066f0 2024-06-02T03:58:14.754 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.066+0000 7f17097fa700 1 -- 172.21.15.123:0/1951405331 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16fc003ba0 con 0x7f170c1066f0 2024-06-02T03:58:14.754 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.066+0000 7f17097fa700 1 -- 172.21.15.123:0/1951405331 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f16fc019690 con 0x7f170c1066f0 2024-06-02T03:58:14.754 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.066+0000 7f171268a700 1 -- 172.21.15.123:0/1951405331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f170c19ab40 con 0x7f170c1066f0 2024-06-02T03:58:14.754 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.066+0000 7f171268a700 1 -- 172.21.15.123:0/1951405331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f170c19afe0 con 0x7f170c1066f0 2024-06-02T03:58:14.754 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.067+0000 7f17097fa700 1 -- 172.21.15.123:0/1951405331 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 45598+0+0 (secure 0 0 0) 0x7f16fc019900 con 0x7f170c1066f0 2024-06-02T03:58:14.754 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.067+0000 7f17097fa700 1 --2- 172.21.15.123:0/1951405331 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f16f40387f0 0x7f16f403acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:14.754 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.067+0000 7f171268a700 1 -- 172.21.15.123:0/1951405331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f170c10aad0 con 0x7f170c1066f0 2024-06-02T03:58:14.755 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.067+0000 7f17097fa700 1 -- 172.21.15.123:0/1951405331 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f16fc04cb80 con 0x7f170c1066f0 2024-06-02T03:58:14.755 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.067+0000 7f170b7fe700 1 --2- 172.21.15.123:0/1951405331 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f16f40387f0 0x7f16f403acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:14.755 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.067+0000 7f170b7fe700 1 --2- 172.21.15.123:0/1951405331 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f16f40387f0 0x7f16f403acb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1700006fd0 tx=0x7f1700006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:14.755 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.072+0000 7f17097fa700 1 -- 172.21.15.123:0/1951405331 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f16fc0243f0 con 0x7f170c1066f0 2024-06-02T03:58:14.755 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.369+0000 7f171268a700 1 -- 172.21.15.123:0/1951405331 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f170c10ad10 con 0x7f170c1066f0 2024-06-02T03:58:14.755 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.371+0000 7f17097fa700 1 -- 172.21.15.123:0/1951405331 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f16fc018350 con 0x7f170c1066f0 2024-06-02T03:58:14.755 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.373+0000 7f171268a700 1 -- 172.21.15.123:0/1951405331 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f16f40387f0 msgr2=0x7f16f403acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:14.755 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.373+0000 7f171268a700 1 --2- 172.21.15.123:0/1951405331 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f16f40387f0 0x7f16f403acb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1700006fd0 tx=0x7f1700006e40 comp rx=0 tx=0).stop 2024-06-02T03:58:14.755 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.374+0000 7f171268a700 1 -- 172.21.15.123:0/1951405331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f170c1066f0 msgr2=0x7f170c19a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:14.755 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.374+0000 7f171268a700 1 --2- 172.21.15.123:0/1951405331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f170c1066f0 0x7f170c19a400 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f16fc006af0 tx=0x7f16fc011a10 comp rx=0 tx=0).stop 2024-06-02T03:58:14.755 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.374+0000 7f171268a700 1 -- 172.21.15.123:0/1951405331 shutdown_connections 2024-06-02T03:58:14.755 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.374+0000 7f171268a700 1 --2- 172.21.15.123:0/1951405331 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f16f40387f0 0x7f16f403acb0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:14.755 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.374+0000 7f171268a700 1 --2- 172.21.15.123:0/1951405331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f170c1066f0 0x7f170c19a400 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:14.756 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.374+0000 7f171268a700 1 -- 172.21.15.123:0/1951405331 >> 172.21.15.123:0/1951405331 conn(0x7f170c101d30 msgr2=0x7f170c1028e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:14.756 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.374+0000 7f171268a700 1 -- 172.21.15.123:0/1951405331 shutdown_connections 2024-06-02T03:58:14.756 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr 2024-06-02T03:58:14.374+0000 7f171268a700 1 -- 172.21.15.123:0/1951405331 wait complete. 2024-06-02T03:58:14.756 INFO:teuthology.orchestra.run.smithi123.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-06-02T03:58:14.756 INFO:teuthology.orchestra.run.smithi123.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-06-02T03:58:14.756 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T03:58:14.756 INFO:teuthology.orchestra.run.smithi123.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-06-02T03:58:14.756 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T03:58:14.756 INFO:teuthology.orchestra.run.smithi123.stdout:Or, if you are only running a single cluster on this host: 2024-06-02T03:58:14.756 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T03:58:14.756 INFO:teuthology.orchestra.run.smithi123.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-06-02T03:58:14.756 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T03:58:14.756 INFO:teuthology.orchestra.run.smithi123.stdout:Please consider enabling telemetry to help improve Ceph: 2024-06-02T03:58:14.756 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T03:58:14.757 INFO:teuthology.orchestra.run.smithi123.stdout: ceph telemetry on 2024-06-02T03:58:14.757 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T03:58:14.757 INFO:teuthology.orchestra.run.smithi123.stdout:For more information see: 2024-06-02T03:58:14.757 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T03:58:14.757 INFO:teuthology.orchestra.run.smithi123.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-06-02T03:58:14.757 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T03:58:14.757 INFO:teuthology.orchestra.run.smithi123.stdout:Bootstrap complete. 2024-06-02T03:58:14.784 INFO:tasks.cephadm:Fetching config... 2024-06-02T03:58:14.785 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-06-02T03:58:14.785 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-06-02T03:58:14.803 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-06-02T03:58:14.803 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-06-02T03:58:14.803 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-06-02T03:58:14.860 INFO:tasks.cephadm:Fetching mon keyring... 2024-06-02T03:58:14.860 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-06-02T03:58:14.860 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/keyring of=/dev/stdout 2024-06-02T03:58:14.927 INFO:tasks.cephadm:Fetching pub ssh key... 2024-06-02T03:58:14.928 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-06-02T03:58:14.928 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-06-02T03:58:14.985 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-06-02T03:58:14.985 DEBUG:teuthology.orchestra.run.smithi123:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsbGeRsgtRYf0RepvwKG40fs6gPp2MmeXCIJ9sY9gMhNECzRrnAqQE+lmQHQV+XDQFnBqBBgr+mbzLkor3j5Z3vxg6ZLSwo8g2hqSAI1AqdHlkqRe8ifvtFTYSTljF3qUvbOz2FO+2u3PXdw8FzRlEWyOFQfc9ZduEkGH86+lgRGHOPwdrUNtADyjTCzRFxxoWHv9tfFIFX6s5X4bTW3WsHD8BZUPuBFB/NJKi3pB94nglFeRAnAcgQHxUgXDh2ms9YMgiy4LC6rS+uOlQWZyQeaBcJ0PyPcmQ1MOwpq7Tnl2EBcXTG7/2t74N0Nr3RzWJgLMnLlt0+KSZb5R7/VmjXnz+yBtxHDaEwSIOohzkewoHC+UFEMw7faRL5ExexCNoYu4jqnxZQjEjXEAE1Eif9sYXTcdRbwJ5auuLlQZjVcNtwVngZDlAOSZLE/HSn2MzS4yKf7bDKDbgzxR3XjUvUYzIketag3I484fbE9QaYyLm73n+bTh/urrUsG6S/k0= ceph-1b432ae0-2094-11ef-bc9b-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-06-02T03:58:15.063 INFO:teuthology.orchestra.run.smithi123.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsbGeRsgtRYf0RepvwKG40fs6gPp2MmeXCIJ9sY9gMhNECzRrnAqQE+lmQHQV+XDQFnBqBBgr+mbzLkor3j5Z3vxg6ZLSwo8g2hqSAI1AqdHlkqRe8ifvtFTYSTljF3qUvbOz2FO+2u3PXdw8FzRlEWyOFQfc9ZduEkGH86+lgRGHOPwdrUNtADyjTCzRFxxoWHv9tfFIFX6s5X4bTW3WsHD8BZUPuBFB/NJKi3pB94nglFeRAnAcgQHxUgXDh2ms9YMgiy4LC6rS+uOlQWZyQeaBcJ0PyPcmQ1MOwpq7Tnl2EBcXTG7/2t74N0Nr3RzWJgLMnLlt0+KSZb5R7/VmjXnz+yBtxHDaEwSIOohzkewoHC+UFEMw7faRL5ExexCNoYu4jqnxZQjEjXEAE1Eif9sYXTcdRbwJ5auuLlQZjVcNtwVngZDlAOSZLE/HSn2MzS4yKf7bDKDbgzxR3XjUvUYzIketag3I484fbE9QaYyLm73n+bTh/urrUsG6S/k0= ceph-1b432ae0-2094-11ef-bc9b-c7b262605968 2024-06-02T03:58:15.075 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsbGeRsgtRYf0RepvwKG40fs6gPp2MmeXCIJ9sY9gMhNECzRrnAqQE+lmQHQV+XDQFnBqBBgr+mbzLkor3j5Z3vxg6ZLSwo8g2hqSAI1AqdHlkqRe8ifvtFTYSTljF3qUvbOz2FO+2u3PXdw8FzRlEWyOFQfc9ZduEkGH86+lgRGHOPwdrUNtADyjTCzRFxxoWHv9tfFIFX6s5X4bTW3WsHD8BZUPuBFB/NJKi3pB94nglFeRAnAcgQHxUgXDh2ms9YMgiy4LC6rS+uOlQWZyQeaBcJ0PyPcmQ1MOwpq7Tnl2EBcXTG7/2t74N0Nr3RzWJgLMnLlt0+KSZb5R7/VmjXnz+yBtxHDaEwSIOohzkewoHC+UFEMw7faRL5ExexCNoYu4jqnxZQjEjXEAE1Eif9sYXTcdRbwJ5auuLlQZjVcNtwVngZDlAOSZLE/HSn2MzS4yKf7bDKDbgzxR3XjUvUYzIketag3I484fbE9QaYyLm73n+bTh/urrUsG6S/k0= ceph-1b432ae0-2094-11ef-bc9b-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-06-02T03:58:15.119 INFO:teuthology.orchestra.run.smithi136.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsbGeRsgtRYf0RepvwKG40fs6gPp2MmeXCIJ9sY9gMhNECzRrnAqQE+lmQHQV+XDQFnBqBBgr+mbzLkor3j5Z3vxg6ZLSwo8g2hqSAI1AqdHlkqRe8ifvtFTYSTljF3qUvbOz2FO+2u3PXdw8FzRlEWyOFQfc9ZduEkGH86+lgRGHOPwdrUNtADyjTCzRFxxoWHv9tfFIFX6s5X4bTW3WsHD8BZUPuBFB/NJKi3pB94nglFeRAnAcgQHxUgXDh2ms9YMgiy4LC6rS+uOlQWZyQeaBcJ0PyPcmQ1MOwpq7Tnl2EBcXTG7/2t74N0Nr3RzWJgLMnLlt0+KSZb5R7/VmjXnz+yBtxHDaEwSIOohzkewoHC+UFEMw7faRL5ExexCNoYu4jqnxZQjEjXEAE1Eif9sYXTcdRbwJ5auuLlQZjVcNtwVngZDlAOSZLE/HSn2MzS4yKf7bDKDbgzxR3XjUvUYzIketag3I484fbE9QaYyLm73n+bTh/urrUsG6S/k0= ceph-1b432ae0-2094-11ef-bc9b-c7b262605968 2024-06-02T03:58:15.133 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsbGeRsgtRYf0RepvwKG40fs6gPp2MmeXCIJ9sY9gMhNECzRrnAqQE+lmQHQV+XDQFnBqBBgr+mbzLkor3j5Z3vxg6ZLSwo8g2hqSAI1AqdHlkqRe8ifvtFTYSTljF3qUvbOz2FO+2u3PXdw8FzRlEWyOFQfc9ZduEkGH86+lgRGHOPwdrUNtADyjTCzRFxxoWHv9tfFIFX6s5X4bTW3WsHD8BZUPuBFB/NJKi3pB94nglFeRAnAcgQHxUgXDh2ms9YMgiy4LC6rS+uOlQWZyQeaBcJ0PyPcmQ1MOwpq7Tnl2EBcXTG7/2t74N0Nr3RzWJgLMnLlt0+KSZb5R7/VmjXnz+yBtxHDaEwSIOohzkewoHC+UFEMw7faRL5ExexCNoYu4jqnxZQjEjXEAE1Eif9sYXTcdRbwJ5auuLlQZjVcNtwVngZDlAOSZLE/HSn2MzS4yKf7bDKDbgzxR3XjUvUYzIketag3I484fbE9QaYyLm73n+bTh/urrUsG6S/k0= ceph-1b432ae0-2094-11ef-bc9b-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-06-02T03:58:15.179 INFO:teuthology.orchestra.run.smithi162.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsbGeRsgtRYf0RepvwKG40fs6gPp2MmeXCIJ9sY9gMhNECzRrnAqQE+lmQHQV+XDQFnBqBBgr+mbzLkor3j5Z3vxg6ZLSwo8g2hqSAI1AqdHlkqRe8ifvtFTYSTljF3qUvbOz2FO+2u3PXdw8FzRlEWyOFQfc9ZduEkGH86+lgRGHOPwdrUNtADyjTCzRFxxoWHv9tfFIFX6s5X4bTW3WsHD8BZUPuBFB/NJKi3pB94nglFeRAnAcgQHxUgXDh2ms9YMgiy4LC6rS+uOlQWZyQeaBcJ0PyPcmQ1MOwpq7Tnl2EBcXTG7/2t74N0Nr3RzWJgLMnLlt0+KSZb5R7/VmjXnz+yBtxHDaEwSIOohzkewoHC+UFEMw7faRL5ExexCNoYu4jqnxZQjEjXEAE1Eif9sYXTcdRbwJ5auuLlQZjVcNtwVngZDlAOSZLE/HSn2MzS4yKf7bDKDbgzxR3XjUvUYzIketag3I484fbE9QaYyLm73n+bTh/urrUsG6S/k0= ceph-1b432ae0-2094-11ef-bc9b-c7b262605968 2024-06-02T03:58:15.192 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-06-02T03:58:15.414 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T03:58:16.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.605+0000 7f1c72f8f700 1 -- 172.21.15.123:0/4265977743 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c6c101410 msgr2=0x7f1c6c103800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:16.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.605+0000 7f1c72f8f700 1 --2- 172.21.15.123:0/4265977743 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c6c101410 0x7f1c6c103800 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1c60009910 tx=0x7f1c60009c20 comp rx=0 tx=0).stop 2024-06-02T03:58:16.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.605+0000 7f1c72f8f700 1 -- 172.21.15.123:0/4265977743 shutdown_connections 2024-06-02T03:58:16.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.605+0000 7f1c72f8f700 1 --2- 172.21.15.123:0/4265977743 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c6c101410 0x7f1c6c103800 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:16.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.605+0000 7f1c72f8f700 1 -- 172.21.15.123:0/4265977743 >> 172.21.15.123:0/4265977743 conn(0x7f1c6c0fada0 msgr2=0x7f1c6c0fd200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:16.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.605+0000 7f1c72f8f700 1 -- 172.21.15.123:0/4265977743 shutdown_connections 2024-06-02T03:58:16.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.605+0000 7f1c72f8f700 1 -- 172.21.15.123:0/4265977743 wait complete. 2024-06-02T03:58:16.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.606+0000 7f1c72f8f700 1 Processor -- start 2024-06-02T03:58:16.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.606+0000 7f1c72f8f700 1 -- start start 2024-06-02T03:58:16.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.606+0000 7f1c72f8f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c6c101410 0x7f1c6c100c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:16.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.606+0000 7f1c72f8f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c101180 con 0x7f1c6c101410 2024-06-02T03:58:16.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.606+0000 7f1c70d2b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c6c101410 0x7f1c6c100c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:16.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.606+0000 7f1c70d2b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c6c101410 0x7f1c6c100c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58670/0 (socket says 172.21.15.123:58670) 2024-06-02T03:58:16.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.606+0000 7f1c70d2b700 1 -- 172.21.15.123:0/4099743399 learned_addr learned my addr 172.21.15.123:0/4099743399 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:58:16.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.606+0000 7f1c70d2b700 1 -- 172.21.15.123:0/4099743399 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c600095f0 con 0x7f1c6c101410 2024-06-02T03:58:16.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.607+0000 7f1c70d2b700 1 --2- 172.21.15.123:0/4099743399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c6c101410 0x7f1c6c100c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1c60005b40 tx=0x7f1c600057e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:16.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.607+0000 7f1c69ffb700 1 -- 172.21.15.123:0/4099743399 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c6001d070 con 0x7f1c6c101410 2024-06-02T03:58:16.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.607+0000 7f1c69ffb700 1 -- 172.21.15.123:0/4099743399 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c6000be20 con 0x7f1c6c101410 2024-06-02T03:58:16.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.607+0000 7f1c72f8f700 1 -- 172.21.15.123:0/4099743399 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c6c0ff3c0 con 0x7f1c6c101410 2024-06-02T03:58:16.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.607+0000 7f1c69ffb700 1 -- 172.21.15.123:0/4099743399 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c60022d80 con 0x7f1c6c101410 2024-06-02T03:58:16.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.607+0000 7f1c72f8f700 1 -- 172.21.15.123:0/4099743399 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c6c0ff860 con 0x7f1c6c101410 2024-06-02T03:58:16.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.608+0000 7f1c72f8f700 1 -- 172.21.15.123:0/4099743399 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c6c106f70 con 0x7f1c6c101410 2024-06-02T03:58:16.610 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.610+0000 7f1c69ffb700 1 -- 172.21.15.123:0/4099743399 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 45598+0+0 (secure 0 0 0) 0x7f1c600225e0 con 0x7f1c6c101410 2024-06-02T03:58:16.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.611+0000 7f1c69ffb700 1 --2- 172.21.15.123:0/4099743399 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f1c5c0387f0 0x7f1c5c03acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:16.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.611+0000 7f1c69ffb700 1 -- 172.21.15.123:0/4099743399 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1c6004cd10 con 0x7f1c6c101410 2024-06-02T03:58:16.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.611+0000 7f1c6bfff700 1 --2- 172.21.15.123:0/4099743399 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f1c5c0387f0 0x7f1c5c03acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:16.611 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.611+0000 7f1c6bfff700 1 --2- 172.21.15.123:0/4099743399 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f1c5c0387f0 0x7f1c5c03acb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1c58006fd0 tx=0x7f1c58006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:16.615 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.615+0000 7f1c69ffb700 1 -- 172.21.15.123:0/4099743399 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1c6002b590 con 0x7f1c6c101410 2024-06-02T03:58:16.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.833+0000 7f1c72f8f700 1 -- 172.21.15.123:0/4099743399 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f1c6c106720 con 0x7f1c6c101410 2024-06-02T03:58:16.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.836+0000 7f1c69ffb700 1 -- 172.21.15.123:0/4099743399 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f1c60027030 con 0x7f1c6c101410 2024-06-02T03:58:16.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.838+0000 7f1c72f8f700 1 -- 172.21.15.123:0/4099743399 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f1c5c0387f0 msgr2=0x7f1c5c03acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:16.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.838+0000 7f1c72f8f700 1 --2- 172.21.15.123:0/4099743399 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f1c5c0387f0 0x7f1c5c03acb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1c58006fd0 tx=0x7f1c58006e40 comp rx=0 tx=0).stop 2024-06-02T03:58:16.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.838+0000 7f1c72f8f700 1 -- 172.21.15.123:0/4099743399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c6c101410 msgr2=0x7f1c6c100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:16.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.838+0000 7f1c72f8f700 1 --2- 172.21.15.123:0/4099743399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c6c101410 0x7f1c6c100c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1c60005b40 tx=0x7f1c600057e0 comp rx=0 tx=0).stop 2024-06-02T03:58:16.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.838+0000 7f1c72f8f700 1 -- 172.21.15.123:0/4099743399 shutdown_connections 2024-06-02T03:58:16.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.838+0000 7f1c72f8f700 1 --2- 172.21.15.123:0/4099743399 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f1c5c0387f0 0x7f1c5c03acb0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:16.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.838+0000 7f1c72f8f700 1 --2- 172.21.15.123:0/4099743399 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1c6c101410 0x7f1c6c100c40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:16.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.838+0000 7f1c72f8f700 1 -- 172.21.15.123:0/4099743399 >> 172.21.15.123:0/4099743399 conn(0x7f1c6c0fada0 msgr2=0x7f1c6c0fb8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:16.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.838+0000 7f1c72f8f700 1 -- 172.21.15.123:0/4099743399 shutdown_connections 2024-06-02T03:58:16.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:16.838+0000 7f1c72f8f700 1 -- 172.21.15.123:0/4099743399 wait complete. 2024-06-02T03:58:17.252 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-06-02T03:58:17.252 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-06-02T03:58:17.528 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T03:58:18.021 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:18.022 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:18.022 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi123", "name": "osd_memory_target"}]: dispatch 2024-06-02T03:58:18.022 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:18.022 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:58:18.022 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:18.022 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:17 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/4099743399' entity='client.admin' 2024-06-02T03:58:18.022 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:58:18.022 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:18.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.644+0000 7f9de2128700 1 -- 172.21.15.123:0/3730344072 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ddc100950 msgr2=0x7f9ddc100d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:18.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.644+0000 7f9de2128700 1 --2- 172.21.15.123:0/3730344072 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ddc100950 0x7f9ddc100d70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009910 tx=0x7f9dd0009c20 comp rx=0 tx=0).stop 2024-06-02T03:58:18.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.644+0000 7f9de2128700 1 -- 172.21.15.123:0/3730344072 shutdown_connections 2024-06-02T03:58:18.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.644+0000 7f9de2128700 1 --2- 172.21.15.123:0/3730344072 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ddc100950 0x7f9ddc100d70 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:18.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.644+0000 7f9de2128700 1 -- 172.21.15.123:0/3730344072 >> 172.21.15.123:0/3730344072 conn(0x7f9ddc0fbf30 msgr2=0x7f9ddc0fe350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:18.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.644+0000 7f9de2128700 1 -- 172.21.15.123:0/3730344072 shutdown_connections 2024-06-02T03:58:18.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.644+0000 7f9de2128700 1 -- 172.21.15.123:0/3730344072 wait complete. 2024-06-02T03:58:18.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.645+0000 7f9de2128700 1 Processor -- start 2024-06-02T03:58:18.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.645+0000 7f9de2128700 1 -- start start 2024-06-02T03:58:18.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.645+0000 7f9de2128700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ddc100950 0x7f9ddc074c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:18.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.645+0000 7f9de2128700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ddc075150 con 0x7f9ddc100950 2024-06-02T03:58:18.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.646+0000 7f9ddb7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ddc100950 0x7f9ddc074c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:18.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.646+0000 7f9ddb7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ddc100950 0x7f9ddc074c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58680/0 (socket says 172.21.15.123:58680) 2024-06-02T03:58:18.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.646+0000 7f9ddb7fe700 1 -- 172.21.15.123:0/2384208680 learned_addr learned my addr 172.21.15.123:0/2384208680 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:58:18.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.646+0000 7f9ddb7fe700 1 -- 172.21.15.123:0/2384208680 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd00095f0 con 0x7f9ddc100950 2024-06-02T03:58:18.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.646+0000 7f9ddb7fe700 1 --2- 172.21.15.123:0/2384208680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ddc100950 0x7f9ddc074c10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0004f70 tx=0x7f9dd0004fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:18.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.646+0000 7f9dd8ff9700 1 -- 172.21.15.123:0/2384208680 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9dd001d070 con 0x7f9ddc100950 2024-06-02T03:58:18.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.646+0000 7f9dd8ff9700 1 -- 172.21.15.123:0/2384208680 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9dd000be20 con 0x7f9ddc100950 2024-06-02T03:58:18.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.646+0000 7f9de2128700 1 -- 172.21.15.123:0/2384208680 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ddc073390 con 0x7f9ddc100950 2024-06-02T03:58:18.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.646+0000 7f9dd8ff9700 1 -- 172.21.15.123:0/2384208680 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9dd0022df0 con 0x7f9ddc100950 2024-06-02T03:58:18.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.646+0000 7f9de2128700 1 -- 172.21.15.123:0/2384208680 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ddc073830 con 0x7f9ddc100950 2024-06-02T03:58:18.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.647+0000 7f9dd8ff9700 1 -- 172.21.15.123:0/2384208680 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 45598+0+0 (secure 0 0 0) 0x7f9dd000f4b0 con 0x7f9ddc100950 2024-06-02T03:58:18.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.647+0000 7f9dd8ff9700 1 --2- 172.21.15.123:0/2384208680 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9dc4038780 0x7f9dc403ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:18.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.647+0000 7f9de2128700 1 -- 172.21.15.123:0/2384208680 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ddc106fa0 con 0x7f9ddc100950 2024-06-02T03:58:18.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.647+0000 7f9dd8ff9700 1 -- 172.21.15.123:0/2384208680 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f9dd004c8a0 con 0x7f9ddc100950 2024-06-02T03:58:18.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.647+0000 7f9ddaffd700 1 --2- 172.21.15.123:0/2384208680 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9dc4038780 0x7f9dc403ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:18.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.648+0000 7f9ddaffd700 1 --2- 172.21.15.123:0/2384208680 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9dc4038780 0x7f9dc403ac40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc006fd0 tx=0x7f9dcc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:18.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.652+0000 7f9dd8ff9700 1 -- 172.21.15.123:0/2384208680 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9dd0020730 con 0x7f9ddc100950 2024-06-02T03:58:18.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.847+0000 7f9de2128700 1 -- 172.21.15.123:0/2384208680 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ddc073a70 con 0x7f9dc4038780 2024-06-02T03:58:18.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.851+0000 7f9dd8ff9700 1 -- 172.21.15.123:0/2384208680 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f9ddc073a70 con 0x7f9dc4038780 2024-06-02T03:58:18.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.853+0000 7f9de2128700 1 -- 172.21.15.123:0/2384208680 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9dc4038780 msgr2=0x7f9dc403ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:18.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.853+0000 7f9de2128700 1 --2- 172.21.15.123:0/2384208680 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9dc4038780 0x7f9dc403ac40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc006fd0 tx=0x7f9dcc006e40 comp rx=0 tx=0).stop 2024-06-02T03:58:18.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.853+0000 7f9de2128700 1 -- 172.21.15.123:0/2384208680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ddc100950 msgr2=0x7f9ddc074c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:18.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.853+0000 7f9de2128700 1 --2- 172.21.15.123:0/2384208680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ddc100950 0x7f9ddc074c10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0004f70 tx=0x7f9dd0004fa0 comp rx=0 tx=0).stop 2024-06-02T03:58:18.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.853+0000 7f9de2128700 1 -- 172.21.15.123:0/2384208680 shutdown_connections 2024-06-02T03:58:18.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.853+0000 7f9de2128700 1 --2- 172.21.15.123:0/2384208680 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9dc4038780 0x7f9dc403ac40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:18.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.853+0000 7f9de2128700 1 --2- 172.21.15.123:0/2384208680 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ddc100950 0x7f9ddc074c10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:18.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.853+0000 7f9de2128700 1 -- 172.21.15.123:0/2384208680 >> 172.21.15.123:0/2384208680 conn(0x7f9ddc0fbf30 msgr2=0x7f9ddc0fca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:18.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.853+0000 7f9de2128700 1 -- 172.21.15.123:0/2384208680 shutdown_connections 2024-06-02T03:58:18.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:18.853+0000 7f9de2128700 1 -- 172.21.15.123:0/2384208680 wait complete. 2024-06-02T03:58:19.235 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi136 2024-06-02T03:58:19.236 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-06-02T03:58:19.236 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/etc/ceph/ceph.conf 2024-06-02T03:58:19.256 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-06-02T03:58:19.256 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-02T03:58:19.316 INFO:tasks.cephadm:Adding host smithi136 to orchestrator... 2024-06-02T03:58:19.316 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph orch host add smithi136 2024-06-02T03:58:19.559 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T03:58:20.052 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:19 smithi123 ceph-mon[42885]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T03:58:20.052 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:19 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:20.052 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:19 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:58:20.053 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:19 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:20.053 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:19 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:58:20.053 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:19 smithi123 ceph-mon[42885]: Updating smithi123:/etc/ceph/ceph.conf 2024-06-02T03:58:20.053 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:19 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:20.053 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:19 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:20.053 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:19 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:20.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:20.596+0000 7fb12a823700 1 -- 172.21.15.123:0/31889734 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1241068d0 msgr2=0x7fb124106cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:20.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:20.596+0000 7fb12a823700 1 --2- 172.21.15.123:0/31889734 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1241068d0 0x7fb124106cb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb10c009910 tx=0x7fb10c009c20 comp rx=0 tx=0).stop 2024-06-02T03:58:20.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:20.596+0000 7fb12a823700 1 -- 172.21.15.123:0/31889734 shutdown_connections 2024-06-02T03:58:20.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:20.596+0000 7fb12a823700 1 --2- 172.21.15.123:0/31889734 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1241068d0 0x7fb124106cb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:20.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:20.596+0000 7fb12a823700 1 -- 172.21.15.123:0/31889734 >> 172.21.15.123:0/31889734 conn(0x7fb1240fc3e0 msgr2=0x7fb1240fe800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:20.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:20.596+0000 7fb12a823700 1 -- 172.21.15.123:0/31889734 shutdown_connections 2024-06-02T03:58:20.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:20.596+0000 7fb12a823700 1 -- 172.21.15.123:0/31889734 wait complete. 2024-06-02T03:58:20.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:20.597+0000 7fb12a823700 1 Processor -- start 2024-06-02T03:58:20.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:20.597+0000 7fb12a823700 1 -- start start 2024-06-02T03:58:20.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:20.597+0000 7fb12a823700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1241068d0 0x7fb1241983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:20.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:20.597+0000 7fb12a823700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb124198930 con 0x7fb1241068d0 2024-06-02T03:58:20.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:20.597+0000 7fb123fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1241068d0 0x7fb1241983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:20.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:20.597+0000 7fb123fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1241068d0 0x7fb1241983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:58702/0 (socket says 172.21.15.123:58702) 2024-06-02T03:58:20.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:20.597+0000 7fb123fff700 1 -- 172.21.15.123:0/333524387 learned_addr learned my addr 172.21.15.123:0/333524387 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:58:20.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:20.597+0000 7fb123fff700 1 -- 172.21.15.123:0/333524387 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10c0095f0 con 0x7fb1241068d0 2024-06-02T03:58:20.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:20.598+0000 7fb123fff700 1 --2- 172.21.15.123:0/333524387 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1241068d0 0x7fb1241983f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb10c004f40 tx=0x7fb10c005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:20.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:20.598+0000 7fb1217fa700 1 -- 172.21.15.123:0/333524387 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb10c01d070 con 0x7fb1241068d0 2024-06-02T03:58:20.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:20.598+0000 7fb1217fa700 1 -- 172.21.15.123:0/333524387 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb10c00bbb0 con 0x7fb1241068d0 2024-06-02T03:58:20.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:20.598+0000 7fb12a823700 1 -- 172.21.15.123:0/333524387 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb124198b90 con 0x7fb1241068d0 2024-06-02T03:58:20.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:20.598+0000 7fb1217fa700 1 -- 172.21.15.123:0/333524387 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb10c003810 con 0x7fb1241068d0 2024-06-02T03:58:20.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:20.598+0000 7fb12a823700 1 -- 172.21.15.123:0/333524387 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb124199010 con 0x7fb1241068d0 2024-06-02T03:58:20.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:20.599+0000 7fb1217fa700 1 -- 172.21.15.123:0/333524387 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 45598+0+0 (secure 0 0 0) 0x7fb10c003a90 con 0x7fb1241068d0 2024-06-02T03:58:20.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:20.599+0000 7fb12a823700 1 -- 172.21.15.123:0/333524387 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb124102010 con 0x7fb1241068d0 2024-06-02T03:58:20.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:20.599+0000 7fb1217fa700 1 --2- 172.21.15.123:0/333524387 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb1100387a0 0x7fb11003ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:20.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:20.599+0000 7fb1217fa700 1 -- 172.21.15.123:0/333524387 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb10c04c670 con 0x7fb1241068d0 2024-06-02T03:58:20.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:20.599+0000 7fb1237fe700 1 --2- 172.21.15.123:0/333524387 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb1100387a0 0x7fb11003ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:20.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:20.599+0000 7fb1237fe700 1 --2- 172.21.15.123:0/333524387 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb1100387a0 0x7fb11003ac60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb114006fd0 tx=0x7fb114006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:20.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:20.604+0000 7fb1217fa700 1 -- 172.21.15.123:0/333524387 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb10c029770 con 0x7fb1241068d0 2024-06-02T03:58:20.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:20.798+0000 7fb12a823700 1 -- 172.21.15.123:0/333524387 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi136", "target": ["mon-mgr", ""]}) v1 -- 0x7fb12410abd0 con 0x7fb1100387a0 2024-06-02T03:58:21.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:20 smithi123 ceph-mon[42885]: Updating smithi123:/var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T03:58:21.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:20 smithi123 ceph-mon[42885]: Updating smithi123:/etc/ceph/ceph.client.admin.keyring 2024-06-02T03:58:21.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:20 smithi123 ceph-mon[42885]: Updating smithi123:/var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T03:58:22.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:21 smithi123 ceph-mon[42885]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi136", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T03:58:22.905 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:22.905+0000 7fb1217fa700 1 -- 172.21.15.123:0/333524387 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fb12410abd0 con 0x7fb1100387a0 2024-06-02T03:58:22.905 INFO:teuthology.orchestra.run.smithi123.stdout:Added host 'smithi136' with addr '172.21.15.136' 2024-06-02T03:58:22.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:22.907+0000 7fb12a823700 1 -- 172.21.15.123:0/333524387 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb1100387a0 msgr2=0x7fb11003ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:22.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:22.907+0000 7fb12a823700 1 --2- 172.21.15.123:0/333524387 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb1100387a0 0x7fb11003ac60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb114006fd0 tx=0x7fb114006e40 comp rx=0 tx=0).stop 2024-06-02T03:58:22.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:22.907+0000 7fb12a823700 1 -- 172.21.15.123:0/333524387 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1241068d0 msgr2=0x7fb1241983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:22.907 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:22.907+0000 7fb12a823700 1 --2- 172.21.15.123:0/333524387 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1241068d0 0x7fb1241983f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb10c004f40 tx=0x7fb10c005020 comp rx=0 tx=0).stop 2024-06-02T03:58:22.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:22.907+0000 7fb12a823700 1 -- 172.21.15.123:0/333524387 shutdown_connections 2024-06-02T03:58:22.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:22.907+0000 7fb12a823700 1 --2- 172.21.15.123:0/333524387 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb1100387a0 0x7fb11003ac60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:22.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:22.907+0000 7fb12a823700 1 --2- 172.21.15.123:0/333524387 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb1241068d0 0x7fb1241983f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:22.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:22.907+0000 7fb12a823700 1 -- 172.21.15.123:0/333524387 >> 172.21.15.123:0/333524387 conn(0x7fb1240fc3e0 msgr2=0x7fb124108480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:22.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:22.907+0000 7fb12a823700 1 -- 172.21.15.123:0/333524387 shutdown_connections 2024-06-02T03:58:22.908 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:22.907+0000 7fb12a823700 1 -- 172.21.15.123:0/333524387 wait complete. 2024-06-02T03:58:23.127 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:22 smithi123 ceph-mon[42885]: Deploying cephadm binary to smithi136 2024-06-02T03:58:23.324 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph orch host ls --format=json 2024-06-02T03:58:23.540 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T03:58:24.269 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:23 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:24.269 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:23 smithi123 ceph-mon[42885]: Added host smithi136 2024-06-02T03:58:24.269 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:23 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:58:24.270 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:23 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:24.270 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:23 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:24.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.446+0000 7f0b2156d700 1 -- 172.21.15.123:0/2332887081 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b1c1068c0 msgr2=0x7f0b1c106ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:24.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.446+0000 7f0b2156d700 1 --2- 172.21.15.123:0/2332887081 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b1c1068c0 0x7f0b1c106ca0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c009910 tx=0x7f0b0c009c20 comp rx=0 tx=0).stop 2024-06-02T03:58:24.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.446+0000 7f0b2156d700 1 -- 172.21.15.123:0/2332887081 shutdown_connections 2024-06-02T03:58:24.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.446+0000 7f0b2156d700 1 --2- 172.21.15.123:0/2332887081 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b1c1068c0 0x7f0b1c106ca0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:24.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.446+0000 7f0b2156d700 1 -- 172.21.15.123:0/2332887081 >> 172.21.15.123:0/2332887081 conn(0x7f0b1c0fc3b0 msgr2=0x7f0b1c0fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:24.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.446+0000 7f0b2156d700 1 -- 172.21.15.123:0/2332887081 shutdown_connections 2024-06-02T03:58:24.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.446+0000 7f0b2156d700 1 -- 172.21.15.123:0/2332887081 wait complete. 2024-06-02T03:58:24.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.446+0000 7f0b2156d700 1 Processor -- start 2024-06-02T03:58:24.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.447+0000 7f0b2156d700 1 -- start start 2024-06-02T03:58:24.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.447+0000 7f0b2156d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b1c1068c0 0x7f0b1c196190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:24.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.447+0000 7f0b2156d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c1966d0 con 0x7f0b1c1068c0 2024-06-02T03:58:24.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.447+0000 7f0b1affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b1c1068c0 0x7f0b1c196190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:24.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.447+0000 7f0b1affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b1c1068c0 0x7f0b1c196190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47272/0 (socket says 172.21.15.123:47272) 2024-06-02T03:58:24.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.447+0000 7f0b1affd700 1 -- 172.21.15.123:0/894151448 learned_addr learned my addr 172.21.15.123:0/894151448 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:58:24.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.447+0000 7f0b1affd700 1 -- 172.21.15.123:0/894151448 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b0c0095f0 con 0x7f0b1c1068c0 2024-06-02T03:58:24.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.447+0000 7f0b1affd700 1 --2- 172.21.15.123:0/894151448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b1c1068c0 0x7f0b1c196190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c004f40 tx=0x7f0b0c005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:24.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.447+0000 7f0b13fff700 1 -- 172.21.15.123:0/894151448 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b0c01d070 con 0x7f0b1c1068c0 2024-06-02T03:58:24.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.447+0000 7f0b13fff700 1 -- 172.21.15.123:0/894151448 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b0c00bbb0 con 0x7f0b1c1068c0 2024-06-02T03:58:24.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.447+0000 7f0b2156d700 1 -- 172.21.15.123:0/894151448 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b1c196930 con 0x7f0b1c1068c0 2024-06-02T03:58:24.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.447+0000 7f0b13fff700 1 -- 172.21.15.123:0/894151448 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b0c003810 con 0x7f0b1c1068c0 2024-06-02T03:58:24.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.447+0000 7f0b2156d700 1 -- 172.21.15.123:0/894151448 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b1c196db0 con 0x7f0b1c1068c0 2024-06-02T03:58:24.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.448+0000 7f0b13fff700 1 -- 172.21.15.123:0/894151448 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 45598+0+0 (secure 0 0 0) 0x7f0b0c003a90 con 0x7f0b1c1068c0 2024-06-02T03:58:24.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.448+0000 7f0b13fff700 1 --2- 172.21.15.123:0/894151448 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0b080387a0 0x7f0b0803ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:24.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.448+0000 7f0b2156d700 1 -- 172.21.15.123:0/894151448 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b1c102000 con 0x7f0b1c1068c0 2024-06-02T03:58:24.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.448+0000 7f0b13fff700 1 -- 172.21.15.123:0/894151448 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0b0c04c4f0 con 0x7f0b1c1068c0 2024-06-02T03:58:24.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.448+0000 7f0b1a7fc700 1 --2- 172.21.15.123:0/894151448 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0b080387a0 0x7f0b0803ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:24.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.449+0000 7f0b1a7fc700 1 --2- 172.21.15.123:0/894151448 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0b080387a0 0x7f0b0803ac60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0b04006fd0 tx=0x7f0b04006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:24.453 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.453+0000 7f0b13fff700 1 -- 172.21.15.123:0/894151448 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0b0c029770 con 0x7f0b1c1068c0 2024-06-02T03:58:24.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.652+0000 7f0b2156d700 1 -- 172.21.15.123:0/894151448 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0b1c10abc0 con 0x7f0b080387a0 2024-06-02T03:58:24.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.653+0000 7f0b13fff700 1 -- 172.21.15.123:0/894151448 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7f0b1c10abc0 con 0x7f0b080387a0 2024-06-02T03:58:24.653 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T03:58:24.653 INFO:teuthology.orchestra.run.smithi123.stdout:[{"addr": "172.21.15.123", "hostname": "smithi123", "labels": [], "status": ""}, {"addr": "172.21.15.136", "hostname": "smithi136", "labels": [], "status": ""}] 2024-06-02T03:58:24.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.655+0000 7f0b2156d700 1 -- 172.21.15.123:0/894151448 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0b080387a0 msgr2=0x7f0b0803ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:24.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.655+0000 7f0b2156d700 1 --2- 172.21.15.123:0/894151448 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0b080387a0 0x7f0b0803ac60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0b04006fd0 tx=0x7f0b04006e40 comp rx=0 tx=0).stop 2024-06-02T03:58:24.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.655+0000 7f0b2156d700 1 -- 172.21.15.123:0/894151448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b1c1068c0 msgr2=0x7f0b1c196190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:24.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.655+0000 7f0b2156d700 1 --2- 172.21.15.123:0/894151448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b1c1068c0 0x7f0b1c196190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c004f40 tx=0x7f0b0c005020 comp rx=0 tx=0).stop 2024-06-02T03:58:24.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.655+0000 7f0b2156d700 1 -- 172.21.15.123:0/894151448 shutdown_connections 2024-06-02T03:58:24.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.655+0000 7f0b2156d700 1 --2- 172.21.15.123:0/894151448 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0b080387a0 0x7f0b0803ac60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:24.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.655+0000 7f0b2156d700 1 --2- 172.21.15.123:0/894151448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b1c1068c0 0x7f0b1c196190 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:24.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.655+0000 7f0b2156d700 1 -- 172.21.15.123:0/894151448 >> 172.21.15.123:0/894151448 conn(0x7f0b1c0fc3b0 msgr2=0x7f0b1c1084e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:24.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.655+0000 7f0b2156d700 1 -- 172.21.15.123:0/894151448 shutdown_connections 2024-06-02T03:58:24.655 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:24.655+0000 7f0b2156d700 1 -- 172.21.15.123:0/894151448 wait complete. 2024-06-02T03:58:25.064 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi162 2024-06-02T03:58:25.065 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T03:58:25.065 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/etc/ceph/ceph.conf 2024-06-02T03:58:25.086 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T03:58:25.086 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-02T03:58:25.146 INFO:tasks.cephadm:Adding host smithi162 to orchestrator... 2024-06-02T03:58:25.147 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph orch host add smithi162 2024-06-02T03:58:25.361 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T03:58:25.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:25 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:25.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:25 smithi123 ceph-mon[42885]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T03:58:26.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:26.447+0000 7febcedc2700 1 -- 172.21.15.123:0/1863308377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febc81057c0 msgr2=0x7febc8105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:26.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:26.447+0000 7febcedc2700 1 --2- 172.21.15.123:0/1863308377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febc81057c0 0x7febc8105ba0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7febbc009910 tx=0x7febbc009c20 comp rx=0 tx=0).stop 2024-06-02T03:58:26.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:26.447+0000 7febcedc2700 1 -- 172.21.15.123:0/1863308377 shutdown_connections 2024-06-02T03:58:26.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:26.447+0000 7febcedc2700 1 --2- 172.21.15.123:0/1863308377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febc81057c0 0x7febc8105ba0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:26.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:26.447+0000 7febcedc2700 1 -- 172.21.15.123:0/1863308377 >> 172.21.15.123:0/1863308377 conn(0x7febc8076450 msgr2=0x7febc80fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:26.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:26.447+0000 7febcedc2700 1 -- 172.21.15.123:0/1863308377 shutdown_connections 2024-06-02T03:58:26.448 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:26.447+0000 7febcedc2700 1 -- 172.21.15.123:0/1863308377 wait complete. 2024-06-02T03:58:26.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:26.448+0000 7febcedc2700 1 Processor -- start 2024-06-02T03:58:26.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:26.448+0000 7febcedc2700 1 -- start start 2024-06-02T03:58:26.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:26.448+0000 7febcedc2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febc81057c0 0x7febc8195020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:26.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:26.448+0000 7febcedc2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc8195560 con 0x7febc81057c0 2024-06-02T03:58:26.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:26.448+0000 7febccb5e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febc81057c0 0x7febc8195020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:26.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:26.448+0000 7febccb5e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febc81057c0 0x7febc8195020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47288/0 (socket says 172.21.15.123:47288) 2024-06-02T03:58:26.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:26.448+0000 7febccb5e700 1 -- 172.21.15.123:0/5371692 learned_addr learned my addr 172.21.15.123:0/5371692 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:58:26.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:26.448+0000 7febccb5e700 1 -- 172.21.15.123:0/5371692 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febbc0095f0 con 0x7febc81057c0 2024-06-02T03:58:26.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:26.448+0000 7febccb5e700 1 --2- 172.21.15.123:0/5371692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febc81057c0 0x7febc8195020 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7febbc004f40 tx=0x7febbc005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:26.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:26.449+0000 7febc5ffb700 1 -- 172.21.15.123:0/5371692 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febbc01d070 con 0x7febc81057c0 2024-06-02T03:58:26.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:26.449+0000 7febc5ffb700 1 -- 172.21.15.123:0/5371692 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7febbc00bbb0 con 0x7febc81057c0 2024-06-02T03:58:26.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:26.449+0000 7febcedc2700 1 -- 172.21.15.123:0/5371692 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc81957c0 con 0x7febc81057c0 2024-06-02T03:58:26.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:26.449+0000 7febc5ffb700 1 -- 172.21.15.123:0/5371692 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febbc003810 con 0x7febc81057c0 2024-06-02T03:58:26.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:26.449+0000 7febcedc2700 1 -- 172.21.15.123:0/5371692 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc8195c40 con 0x7febc81057c0 2024-06-02T03:58:26.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:26.450+0000 7febc5ffb700 1 -- 172.21.15.123:0/5371692 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 45598+0+0 (secure 0 0 0) 0x7febbc003a40 con 0x7febc81057c0 2024-06-02T03:58:26.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:26.450+0000 7febcedc2700 1 -- 172.21.15.123:0/5371692 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc8100f00 con 0x7febc81057c0 2024-06-02T03:58:26.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:26.450+0000 7febc5ffb700 1 --2- 172.21.15.123:0/5371692 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7febb80387f0 0x7febb803acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:26.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:26.450+0000 7febc5ffb700 1 -- 172.21.15.123:0/5371692 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7febbc04c3c0 con 0x7febc81057c0 2024-06-02T03:58:26.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:26.450+0000 7febc7fff700 1 --2- 172.21.15.123:0/5371692 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7febb80387f0 0x7febb803acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:26.451 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:26.450+0000 7febc7fff700 1 --2- 172.21.15.123:0/5371692 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7febb80387f0 0x7febb803acb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7febb4006fd0 tx=0x7febb4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:26.454 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:26.455+0000 7febc5ffb700 1 -- 172.21.15.123:0/5371692 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7febbc029360 con 0x7febc81057c0 2024-06-02T03:58:26.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:26.649+0000 7febcedc2700 1 -- 172.21.15.123:0/5371692 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi162", "target": ["mon-mgr", ""]}) v1 -- 0x7febc8109b30 con 0x7febb80387f0 2024-06-02T03:58:28.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:27 smithi123 ceph-mon[42885]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi162", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T03:58:28.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:27 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:28.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:27 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:28.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:27 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:28.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:27 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:28.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:27 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-06-02T03:58:28.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:27 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:28.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:27 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:58:28.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:27 smithi123 ceph-mon[42885]: Updating smithi136:/etc/ceph/ceph.conf 2024-06-02T03:58:28.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:27 smithi123 ceph-mon[42885]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:28.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:27 smithi123 ceph-mon[42885]: Updating smithi136:/var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T03:58:28.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:27 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:28.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:27 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:28.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:27 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:28.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:28.810+0000 7febc5ffb700 1 -- 172.21.15.123:0/5371692 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7febc8109b30 con 0x7febb80387f0 2024-06-02T03:58:28.810 INFO:teuthology.orchestra.run.smithi123.stdout:Added host 'smithi162' with addr '172.21.15.162' 2024-06-02T03:58:28.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:28.812+0000 7febcedc2700 1 -- 172.21.15.123:0/5371692 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7febb80387f0 msgr2=0x7febb803acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:28.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:28.812+0000 7febcedc2700 1 --2- 172.21.15.123:0/5371692 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7febb80387f0 0x7febb803acb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7febb4006fd0 tx=0x7febb4006e40 comp rx=0 tx=0).stop 2024-06-02T03:58:28.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:28.812+0000 7febcedc2700 1 -- 172.21.15.123:0/5371692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febc81057c0 msgr2=0x7febc8195020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:28.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:28.812+0000 7febcedc2700 1 --2- 172.21.15.123:0/5371692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febc81057c0 0x7febc8195020 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7febbc004f40 tx=0x7febbc005020 comp rx=0 tx=0).stop 2024-06-02T03:58:28.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:28.812+0000 7febcedc2700 1 -- 172.21.15.123:0/5371692 shutdown_connections 2024-06-02T03:58:28.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:28.812+0000 7febcedc2700 1 --2- 172.21.15.123:0/5371692 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7febb80387f0 0x7febb803acb0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:28.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:28.812+0000 7febcedc2700 1 --2- 172.21.15.123:0/5371692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7febc81057c0 0x7febc8195020 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:28.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:28.812+0000 7febcedc2700 1 -- 172.21.15.123:0/5371692 >> 172.21.15.123:0/5371692 conn(0x7febc8076450 msgr2=0x7febc8107440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:28.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:28.812+0000 7febcedc2700 1 -- 172.21.15.123:0/5371692 shutdown_connections 2024-06-02T03:58:28.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:28.812+0000 7febcedc2700 1 -- 172.21.15.123:0/5371692 wait complete. 2024-06-02T03:58:28.976 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:28 smithi123 ceph-mon[42885]: Deploying cephadm binary to smithi162 2024-06-02T03:58:28.976 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:28 smithi123 ceph-mon[42885]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-06-02T03:58:28.976 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:28 smithi123 ceph-mon[42885]: Updating smithi136:/var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T03:58:29.197 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph orch host ls --format=json 2024-06-02T03:58:29.414 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T03:58:30.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:29 smithi123 ceph-mon[42885]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:30.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:29 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:30.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:29 smithi123 ceph-mon[42885]: Added host smithi162 2024-06-02T03:58:30.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:29 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:58:30.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:29 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:30.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:29 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:30.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.419+0000 7fb4de832700 1 -- 172.21.15.123:0/923739197 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4d81057c0 msgr2=0x7fb4d8105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:30.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.419+0000 7fb4de832700 1 --2- 172.21.15.123:0/923739197 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4d81057c0 0x7fb4d8105ba0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8009910 tx=0x7fb4c8009c20 comp rx=0 tx=0).stop 2024-06-02T03:58:30.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.419+0000 7fb4de832700 1 -- 172.21.15.123:0/923739197 shutdown_connections 2024-06-02T03:58:30.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.419+0000 7fb4de832700 1 --2- 172.21.15.123:0/923739197 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4d81057c0 0x7fb4d8105ba0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:30.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.419+0000 7fb4de832700 1 -- 172.21.15.123:0/923739197 >> 172.21.15.123:0/923739197 conn(0x7fb4d8076450 msgr2=0x7fb4d80fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:30.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.419+0000 7fb4de832700 1 -- 172.21.15.123:0/923739197 shutdown_connections 2024-06-02T03:58:30.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.419+0000 7fb4de832700 1 -- 172.21.15.123:0/923739197 wait complete. 2024-06-02T03:58:30.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.420+0000 7fb4de832700 1 Processor -- start 2024-06-02T03:58:30.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.420+0000 7fb4de832700 1 -- start start 2024-06-02T03:58:30.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.420+0000 7fb4de832700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4d81057c0 0x7fb4d80fb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:30.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.420+0000 7fb4de832700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d80fd6f0 con 0x7fb4d81057c0 2024-06-02T03:58:30.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.420+0000 7fb4d7fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4d81057c0 0x7fb4d80fb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:30.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.420+0000 7fb4d7fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4d81057c0 0x7fb4d80fb7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47302/0 (socket says 172.21.15.123:47302) 2024-06-02T03:58:30.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.420+0000 7fb4d7fff700 1 -- 172.21.15.123:0/3903611918 learned_addr learned my addr 172.21.15.123:0/3903611918 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:58:30.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.421+0000 7fb4d7fff700 1 -- 172.21.15.123:0/3903611918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c80095f0 con 0x7fb4d81057c0 2024-06-02T03:58:30.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.421+0000 7fb4d7fff700 1 --2- 172.21.15.123:0/3903611918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4d81057c0 0x7fb4d80fb7e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8004f40 tx=0x7fb4c8005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:30.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.421+0000 7fb4d57fa700 1 -- 172.21.15.123:0/3903611918 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4c801d070 con 0x7fb4d81057c0 2024-06-02T03:58:30.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.421+0000 7fb4de832700 1 -- 172.21.15.123:0/3903611918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4d80fbd20 con 0x7fb4d81057c0 2024-06-02T03:58:30.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.421+0000 7fb4d57fa700 1 -- 172.21.15.123:0/3903611918 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb4c800bbb0 con 0x7fb4d81057c0 2024-06-02T03:58:30.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.421+0000 7fb4d57fa700 1 -- 172.21.15.123:0/3903611918 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4c8003810 con 0x7fb4d81057c0 2024-06-02T03:58:30.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.421+0000 7fb4de832700 1 -- 172.21.15.123:0/3903611918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d80fc1a0 con 0x7fb4d81057c0 2024-06-02T03:58:30.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.422+0000 7fb4d57fa700 1 -- 172.21.15.123:0/3903611918 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 45598+0+0 (secure 0 0 0) 0x7fb4c8003a90 con 0x7fb4d81057c0 2024-06-02T03:58:30.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.422+0000 7fb4d57fa700 1 --2- 172.21.15.123:0/3903611918 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb4c00387a0 0x7fb4c003ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:30.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.422+0000 7fb4de832700 1 -- 172.21.15.123:0/3903611918 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4d8100f00 con 0x7fb4d81057c0 2024-06-02T03:58:30.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.422+0000 7fb4d57fa700 1 -- 172.21.15.123:0/3903611918 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb4c804c440 con 0x7fb4d81057c0 2024-06-02T03:58:30.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.422+0000 7fb4d77fe700 1 --2- 172.21.15.123:0/3903611918 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb4c00387a0 0x7fb4c003ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:30.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.422+0000 7fb4d77fe700 1 --2- 172.21.15.123:0/3903611918 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb4c00387a0 0x7fb4c003ac60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc006fd0 tx=0x7fb4cc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:30.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.427+0000 7fb4d57fa700 1 -- 172.21.15.123:0/3903611918 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb4c807cd60 con 0x7fb4d81057c0 2024-06-02T03:58:30.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.623+0000 7fb4de832700 1 -- 172.21.15.123:0/3903611918 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb4d80fc390 con 0x7fb4c00387a0 2024-06-02T03:58:30.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.624+0000 7fb4d57fa700 1 -- 172.21.15.123:0/3903611918 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+241 (secure 0 0 0) 0x7fb4d80fc390 con 0x7fb4c00387a0 2024-06-02T03:58:30.624 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T03:58:30.624 INFO:teuthology.orchestra.run.smithi123.stdout:[{"addr": "172.21.15.123", "hostname": "smithi123", "labels": [], "status": ""}, {"addr": "172.21.15.136", "hostname": "smithi136", "labels": [], "status": ""}, {"addr": "172.21.15.162", "hostname": "smithi162", "labels": [], "status": ""}] 2024-06-02T03:58:30.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.626+0000 7fb4de832700 1 -- 172.21.15.123:0/3903611918 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb4c00387a0 msgr2=0x7fb4c003ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:30.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.626+0000 7fb4de832700 1 --2- 172.21.15.123:0/3903611918 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb4c00387a0 0x7fb4c003ac60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc006fd0 tx=0x7fb4cc006e40 comp rx=0 tx=0).stop 2024-06-02T03:58:30.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.626+0000 7fb4de832700 1 -- 172.21.15.123:0/3903611918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4d81057c0 msgr2=0x7fb4d80fb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:30.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.626+0000 7fb4de832700 1 --2- 172.21.15.123:0/3903611918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4d81057c0 0x7fb4d80fb7e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8004f40 tx=0x7fb4c8005020 comp rx=0 tx=0).stop 2024-06-02T03:58:30.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.626+0000 7fb4de832700 1 -- 172.21.15.123:0/3903611918 shutdown_connections 2024-06-02T03:58:30.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.626+0000 7fb4de832700 1 --2- 172.21.15.123:0/3903611918 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb4c00387a0 0x7fb4c003ac60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:30.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.626+0000 7fb4de832700 1 --2- 172.21.15.123:0/3903611918 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4d81057c0 0x7fb4d80fb7e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:30.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.626+0000 7fb4de832700 1 -- 172.21.15.123:0/3903611918 >> 172.21.15.123:0/3903611918 conn(0x7fb4d8076450 msgr2=0x7fb4d818f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:30.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.626+0000 7fb4de832700 1 -- 172.21.15.123:0/3903611918 shutdown_connections 2024-06-02T03:58:30.627 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:30.626+0000 7fb4de832700 1 -- 172.21.15.123:0/3903611918 wait complete. 2024-06-02T03:58:30.997 INFO:tasks.cephadm:Setting crush tunables to default 2024-06-02T03:58:30.997 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph osd crush tunables default 2024-06-02T03:58:31.211 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T03:58:31.316 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:31 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:31.316 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:31 smithi123 ceph-mon[42885]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T03:58:31.316 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:31 smithi123 ceph-mon[42885]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:32.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.203+0000 7f10a2f3f700 1 -- 172.21.15.123:0/2661340843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f109c101ac0 msgr2=0x7f109c101ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:32.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.203+0000 7f10a2f3f700 1 --2- 172.21.15.123:0/2661340843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f109c101ac0 0x7f109c101ea0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1090009910 tx=0x7f1090009c20 comp rx=0 tx=0).stop 2024-06-02T03:58:32.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.203+0000 7f10a2f3f700 1 -- 172.21.15.123:0/2661340843 shutdown_connections 2024-06-02T03:58:32.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.203+0000 7f10a2f3f700 1 --2- 172.21.15.123:0/2661340843 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f109c101ac0 0x7f109c101ea0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:32.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.203+0000 7f10a2f3f700 1 -- 172.21.15.123:0/2661340843 >> 172.21.15.123:0/2661340843 conn(0x7f109c0fb330 msgr2=0x7f109c0fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:32.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.204+0000 7f10a2f3f700 1 -- 172.21.15.123:0/2661340843 shutdown_connections 2024-06-02T03:58:32.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.204+0000 7f10a2f3f700 1 -- 172.21.15.123:0/2661340843 wait complete. 2024-06-02T03:58:32.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.204+0000 7f10a2f3f700 1 Processor -- start 2024-06-02T03:58:32.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.204+0000 7f10a2f3f700 1 -- start start 2024-06-02T03:58:32.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.204+0000 7f10a2f3f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f109c101ac0 0x7f109c1961d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:32.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.204+0000 7f10a2f3f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109c196710 con 0x7f109c101ac0 2024-06-02T03:58:32.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.204+0000 7f10a0cdb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f109c101ac0 0x7f109c1961d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:32.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.205+0000 7f10a0cdb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f109c101ac0 0x7f109c1961d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47320/0 (socket says 172.21.15.123:47320) 2024-06-02T03:58:32.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.205+0000 7f10a0cdb700 1 -- 172.21.15.123:0/1887638932 learned_addr learned my addr 172.21.15.123:0/1887638932 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:58:32.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.205+0000 7f10a0cdb700 1 -- 172.21.15.123:0/1887638932 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10900095f0 con 0x7f109c101ac0 2024-06-02T03:58:32.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.205+0000 7f10a0cdb700 1 --2- 172.21.15.123:0/1887638932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f109c101ac0 0x7f109c1961d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1090006010 tx=0x7f1090004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:32.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.205+0000 7f1099ffb700 1 -- 172.21.15.123:0/1887638932 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f109001d070 con 0x7f109c101ac0 2024-06-02T03:58:32.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.205+0000 7f1099ffb700 1 -- 172.21.15.123:0/1887638932 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f109000bc10 con 0x7f109c101ac0 2024-06-02T03:58:32.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.205+0000 7f10a2f3f700 1 -- 172.21.15.123:0/1887638932 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f109c196910 con 0x7f109c101ac0 2024-06-02T03:58:32.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.205+0000 7f1099ffb700 1 -- 172.21.15.123:0/1887638932 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10900038f0 con 0x7f109c101ac0 2024-06-02T03:58:32.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.205+0000 7f10a2f3f700 1 -- 172.21.15.123:0/1887638932 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f109c196d30 con 0x7f109c101ac0 2024-06-02T03:58:32.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.206+0000 7f1099ffb700 1 -- 172.21.15.123:0/1887638932 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 45598+0+0 (secure 0 0 0) 0x7f1090003b60 con 0x7f109c101ac0 2024-06-02T03:58:32.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.206+0000 7f10a2f3f700 1 -- 172.21.15.123:0/1887638932 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f109c0695b0 con 0x7f109c101ac0 2024-06-02T03:58:32.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.206+0000 7f1099ffb700 1 --2- 172.21.15.123:0/1887638932 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f108c0387a0 0x7f108c03ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:32.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.206+0000 7f1099ffb700 1 -- 172.21.15.123:0/1887638932 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f109004c6f0 con 0x7f109c101ac0 2024-06-02T03:58:32.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.206+0000 7f109bfff700 1 --2- 172.21.15.123:0/1887638932 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f108c0387a0 0x7f108c03ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:32.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.207+0000 7f109bfff700 1 --2- 172.21.15.123:0/1887638932 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f108c0387a0 0x7f108c03ac60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1088006fd0 tx=0x7f1088006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:32.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.211+0000 7f1099ffb700 1 -- 172.21.15.123:0/1887638932 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1090029770 con 0x7f109c101ac0 2024-06-02T03:58:32.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.411+0000 7f10a2f3f700 1 -- 172.21.15.123:0/1887638932 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f109c1975c0 con 0x7f109c101ac0 2024-06-02T03:58:32.464 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.464+0000 7f1099ffb700 1 -- 172.21.15.123:0/1887638932 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f1090026070 con 0x7f109c101ac0 2024-06-02T03:58:32.466 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.467+0000 7f10a2f3f700 1 -- 172.21.15.123:0/1887638932 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f108c0387a0 msgr2=0x7f108c03ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:32.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.467+0000 7f10a2f3f700 1 --2- 172.21.15.123:0/1887638932 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f108c0387a0 0x7f108c03ac60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1088006fd0 tx=0x7f1088006e40 comp rx=0 tx=0).stop 2024-06-02T03:58:32.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.467+0000 7f10a2f3f700 1 -- 172.21.15.123:0/1887638932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f109c101ac0 msgr2=0x7f109c1961d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:32.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.467+0000 7f10a2f3f700 1 --2- 172.21.15.123:0/1887638932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f109c101ac0 0x7f109c1961d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1090006010 tx=0x7f1090004ff0 comp rx=0 tx=0).stop 2024-06-02T03:58:32.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.467+0000 7f10a2f3f700 1 -- 172.21.15.123:0/1887638932 shutdown_connections 2024-06-02T03:58:32.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.467+0000 7f10a2f3f700 1 --2- 172.21.15.123:0/1887638932 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f108c0387a0 0x7f108c03ac60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:32.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.467+0000 7f10a2f3f700 1 --2- 172.21.15.123:0/1887638932 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f109c101ac0 0x7f109c1961d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:32.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.467+0000 7f10a2f3f700 1 -- 172.21.15.123:0/1887638932 >> 172.21.15.123:0/1887638932 conn(0x7f109c0fb330 msgr2=0x7f109c104880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:32.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.467+0000 7f10a2f3f700 1 -- 172.21.15.123:0/1887638932 shutdown_connections 2024-06-02T03:58:32.467 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:32.467+0000 7f10a2f3f700 1 -- 172.21.15.123:0/1887638932 wait complete. 2024-06-02T03:58:32.468 INFO:teuthology.orchestra.run.smithi123.stderr:adjusted tunables profile to default 2024-06-02T03:58:32.746 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:32 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1887638932' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-06-02T03:58:32.746 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:32 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:32.746 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:32 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:32.746 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:32 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:32.746 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:32 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:32.746 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:32 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi162", "name": "osd_memory_target"}]: dispatch 2024-06-02T03:58:32.746 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:32 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:32.746 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:32 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:58:32.790 INFO:tasks.cephadm:Adding mon.a on smithi123 2024-06-02T03:58:32.791 INFO:tasks.cephadm:Adding mon.b on smithi136 2024-06-02T03:58:32.791 INFO:tasks.cephadm:Adding mon.c on smithi162 2024-06-02T03:58:32.791 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph orch apply mon '3;smithi123:172.21.15.123=a;smithi136:172.21.15.136=b;smithi162:172.21.15.162=c' 2024-06-02T03:58:33.030 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T03:58:33.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:33 smithi123 ceph-mon[42885]: Updating smithi162:/etc/ceph/ceph.conf 2024-06-02T03:58:33.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:33 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1887638932' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-06-02T03:58:33.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:33 smithi123 ceph-mon[42885]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T03:58:33.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:33 smithi123 ceph-mon[42885]: Updating smithi162:/var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T03:58:33.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:33 smithi123 ceph-mon[42885]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:33.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:33 smithi123 ceph-mon[42885]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-06-02T03:58:33.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:33 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:33.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:33 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:33.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:33 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:33.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:33.978+0000 7fd84de82700 1 -- 172.21.15.162:0/627971222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8481057c0 msgr2=0x7fd848105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:33.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:33.978+0000 7fd84de82700 1 --2- 172.21.15.162:0/627971222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8481057c0 0x7fd848105ba0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd83c009910 tx=0x7fd83c009c20 comp rx=0 tx=0).stop 2024-06-02T03:58:33.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:33.978+0000 7fd84de82700 1 -- 172.21.15.162:0/627971222 shutdown_connections 2024-06-02T03:58:33.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:33.978+0000 7fd84de82700 1 --2- 172.21.15.162:0/627971222 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8481057c0 0x7fd848105ba0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:33.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:33.978+0000 7fd84de82700 1 -- 172.21.15.162:0/627971222 >> 172.21.15.162:0/627971222 conn(0x7fd848076450 msgr2=0x7fd8480fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:33.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:33.978+0000 7fd84de82700 1 -- 172.21.15.162:0/627971222 shutdown_connections 2024-06-02T03:58:33.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:33.979+0000 7fd84de82700 1 -- 172.21.15.162:0/627971222 wait complete. 2024-06-02T03:58:33.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:33.979+0000 7fd84de82700 1 Processor -- start 2024-06-02T03:58:33.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:33.979+0000 7fd84de82700 1 -- start start 2024-06-02T03:58:33.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:33.979+0000 7fd84de82700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8481057c0 0x7fd848196f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:33.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:33.980+0000 7fd84de82700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8481974b0 con 0x7fd8481057c0 2024-06-02T03:58:33.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:33.980+0000 7fd8477fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8481057c0 0x7fd848196f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:33.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:33.980+0000 7fd8477fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8481057c0 0x7fd848196f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.162:35476/0 (socket says 172.21.15.162:35476) 2024-06-02T03:58:33.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:33.980+0000 7fd8477fe700 1 -- 172.21.15.162:0/837332572 learned_addr learned my addr 172.21.15.162:0/837332572 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-06-02T03:58:33.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:33.980+0000 7fd8477fe700 1 -- 172.21.15.162:0/837332572 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83c0095f0 con 0x7fd8481057c0 2024-06-02T03:58:33.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:33.980+0000 7fd8477fe700 1 --2- 172.21.15.162:0/837332572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8481057c0 0x7fd848196f70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd83c004f40 tx=0x7fd83c005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:33.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:33.980+0000 7fd844ff9700 1 -- 172.21.15.162:0/837332572 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd83c01d070 con 0x7fd8481057c0 2024-06-02T03:58:33.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:33.980+0000 7fd84de82700 1 -- 172.21.15.162:0/837332572 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd848197710 con 0x7fd8481057c0 2024-06-02T03:58:33.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:33.980+0000 7fd844ff9700 1 -- 172.21.15.162:0/837332572 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd83c00bbb0 con 0x7fd8481057c0 2024-06-02T03:58:33.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:33.980+0000 7fd844ff9700 1 -- 172.21.15.162:0/837332572 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd83c003810 con 0x7fd8481057c0 2024-06-02T03:58:33.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:33.980+0000 7fd84de82700 1 -- 172.21.15.162:0/837332572 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd848197b90 con 0x7fd8481057c0 2024-06-02T03:58:33.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:33.981+0000 7fd844ff9700 1 -- 172.21.15.162:0/837332572 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 45598+0+0 (secure 0 0 0) 0x7fd83c00b6f0 con 0x7fd8481057c0 2024-06-02T03:58:33.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:33.981+0000 7fd84de82700 1 -- 172.21.15.162:0/837332572 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd848197d80 con 0x7fd8481057c0 2024-06-02T03:58:33.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:33.981+0000 7fd844ff9700 1 --2- 172.21.15.162:0/837332572 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd8300387a0 0x7fd83003ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:33.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:33.982+0000 7fd844ff9700 1 -- 172.21.15.162:0/837332572 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd83c04c4a0 con 0x7fd8481057c0 2024-06-02T03:58:33.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:33.982+0000 7fd846ffd700 1 --2- 172.21.15.162:0/837332572 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd8300387a0 0x7fd83003ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:33.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:33.982+0000 7fd846ffd700 1 --2- 172.21.15.162:0/837332572 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd8300387a0 0x7fd83003ac60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd838006fd0 tx=0x7fd838006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:33.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:33.987+0000 7fd844ff9700 1 -- 172.21.15.162:0/837332572 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd83c029540 con 0x7fd8481057c0 2024-06-02T03:58:34.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:34.188+0000 7fd84de82700 1 -- 172.21.15.162:0/837332572 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi123:172.21.15.123=a;smithi136:172.21.15.136=b;smithi162:172.21.15.162=c", "target": ["mon-mgr", ""]}) v1 -- 0x7fd848068660 con 0x7fd8300387a0 2024-06-02T03:58:34.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:34.195+0000 7fd844ff9700 1 -- 172.21.15.162:0/837332572 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fd848068660 con 0x7fd8300387a0 2024-06-02T03:58:34.194 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled mon update... 2024-06-02T03:58:34.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:34.196+0000 7fd84de82700 1 -- 172.21.15.162:0/837332572 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd8300387a0 msgr2=0x7fd83003ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:34.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:34.196+0000 7fd84de82700 1 --2- 172.21.15.162:0/837332572 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd8300387a0 0x7fd83003ac60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd838006fd0 tx=0x7fd838006e40 comp rx=0 tx=0).stop 2024-06-02T03:58:34.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:34.196+0000 7fd84de82700 1 -- 172.21.15.162:0/837332572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8481057c0 msgr2=0x7fd848196f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:34.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:34.196+0000 7fd84de82700 1 --2- 172.21.15.162:0/837332572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8481057c0 0x7fd848196f70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd83c004f40 tx=0x7fd83c005020 comp rx=0 tx=0).stop 2024-06-02T03:58:34.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:34.196+0000 7fd84de82700 1 -- 172.21.15.162:0/837332572 shutdown_connections 2024-06-02T03:58:34.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:34.196+0000 7fd84de82700 1 --2- 172.21.15.162:0/837332572 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd8300387a0 0x7fd83003ac60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:34.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:34.196+0000 7fd84de82700 1 --2- 172.21.15.162:0/837332572 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd8481057c0 0x7fd848196f70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:34.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:34.196+0000 7fd84de82700 1 -- 172.21.15.162:0/837332572 >> 172.21.15.162:0/837332572 conn(0x7fd848076450 msgr2=0x7fd848107440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:34.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:34.196+0000 7fd84de82700 1 -- 172.21.15.162:0/837332572 shutdown_connections 2024-06-02T03:58:34.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:34.196+0000 7fd84de82700 1 -- 172.21.15.162:0/837332572 wait complete. 2024-06-02T03:58:34.573 DEBUG:teuthology.orchestra.run.smithi136:mon.b> sudo journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mon.b.service 2024-06-02T03:58:34.576 DEBUG:teuthology.orchestra.run.smithi162:mon.c> sudo journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mon.c.service 2024-06-02T03:58:34.578 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-06-02T03:58:34.578 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-02T03:58:34.609 INFO:journalctl@ceph.mon.c.smithi162.stdout:-- Logs begin at Sun 2024-06-02 03:41:09 UTC. -- 2024-06-02T03:58:34.611 INFO:journalctl@ceph.mon.b.smithi136.stdout:-- Logs begin at Sun 2024-06-02 03:40:52 UTC. -- 2024-06-02T03:58:34.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:34 smithi123 ceph-mon[42885]: Updating smithi162:/var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T03:58:34.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:34 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:34.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:34 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:58:34.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:34 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:34.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:34 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:58:34.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:34 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:34.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:34 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T03:58:34.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:34 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:34.912 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T03:58:35.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:35 smithi123 ceph-mon[42885]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi123:172.21.15.123=a;smithi136:172.21.15.136=b;smithi162:172.21.15.162=c", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T03:58:35.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:35 smithi123 ceph-mon[42885]: Saving service mon spec with placement smithi123:172.21.15.123=a;smithi136:172.21.15.136=b;smithi162:172.21.15.162=c;count:3 2024-06-02T03:58:35.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:35 smithi123 ceph-mon[42885]: Deploying daemon mon.c on smithi162 2024-06-02T03:58:35.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:35 smithi123 ceph-mon[42885]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:36.401 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.401+0000 7f1b97eb8700 1 -- 172.21.15.162:0/1216043439 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b901068c0 msgr2=0x7f1b90106ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:36.401 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.401+0000 7f1b97eb8700 1 --2- 172.21.15.162:0/1216043439 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b901068c0 0x7f1b90106ca0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1b80009910 tx=0x7f1b80009c20 comp rx=0 tx=0).stop 2024-06-02T03:58:36.401 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.401+0000 7f1b97eb8700 1 -- 172.21.15.162:0/1216043439 shutdown_connections 2024-06-02T03:58:36.401 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.401+0000 7f1b97eb8700 1 --2- 172.21.15.162:0/1216043439 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b901068c0 0x7f1b90106ca0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:36.401 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.401+0000 7f1b97eb8700 1 -- 172.21.15.162:0/1216043439 >> 172.21.15.162:0/1216043439 conn(0x7f1b900fc3b0 msgr2=0x7f1b900fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:36.401 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.401+0000 7f1b97eb8700 1 -- 172.21.15.162:0/1216043439 shutdown_connections 2024-06-02T03:58:36.401 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.401+0000 7f1b97eb8700 1 -- 172.21.15.162:0/1216043439 wait complete. 2024-06-02T03:58:36.403 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.401+0000 7f1b97eb8700 1 Processor -- start 2024-06-02T03:58:36.403 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.401+0000 7f1b97eb8700 1 -- start start 2024-06-02T03:58:36.403 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.402+0000 7f1b97eb8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b901068c0 0x7f1b90196190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:36.403 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.402+0000 7f1b97eb8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b901966d0 con 0x7f1b901068c0 2024-06-02T03:58:36.403 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.402+0000 7f1b95c54700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b901068c0 0x7f1b90196190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:36.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.402+0000 7f1b95c54700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b901068c0 0x7f1b90196190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.162:35494/0 (socket says 172.21.15.162:35494) 2024-06-02T03:58:36.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.402+0000 7f1b95c54700 1 -- 172.21.15.162:0/2565537313 learned_addr learned my addr 172.21.15.162:0/2565537313 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-06-02T03:58:36.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.402+0000 7f1b95c54700 1 -- 172.21.15.162:0/2565537313 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b800095f0 con 0x7f1b901068c0 2024-06-02T03:58:36.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.402+0000 7f1b95c54700 1 --2- 172.21.15.162:0/2565537313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b901068c0 0x7f1b90196190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1b80004f40 tx=0x7f1b80005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:36.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.403+0000 7f1b86ffd700 1 -- 172.21.15.162:0/2565537313 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b8001d070 con 0x7f1b901068c0 2024-06-02T03:58:36.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.403+0000 7f1b97eb8700 1 -- 172.21.15.162:0/2565537313 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b90196930 con 0x7f1b901068c0 2024-06-02T03:58:36.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.403+0000 7f1b86ffd700 1 -- 172.21.15.162:0/2565537313 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b8000bbb0 con 0x7f1b901068c0 2024-06-02T03:58:36.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.403+0000 7f1b86ffd700 1 -- 172.21.15.162:0/2565537313 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b80003810 con 0x7f1b901068c0 2024-06-02T03:58:36.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.403+0000 7f1b97eb8700 1 -- 172.21.15.162:0/2565537313 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b90196db0 con 0x7f1b901068c0 2024-06-02T03:58:36.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.403+0000 7f1b97eb8700 1 -- 172.21.15.162:0/2565537313 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b90102000 con 0x7f1b901068c0 2024-06-02T03:58:36.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.403+0000 7f1b86ffd700 1 -- 172.21.15.162:0/2565537313 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 45598+0+0 (secure 0 0 0) 0x7f1b8000bd20 con 0x7f1b901068c0 2024-06-02T03:58:36.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.404+0000 7f1b86ffd700 1 --2- 172.21.15.162:0/2565537313 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f1b7c0387a0 0x7f1b7c03ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:36.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.404+0000 7f1b86ffd700 1 -- 172.21.15.162:0/2565537313 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1b8004c480 con 0x7f1b901068c0 2024-06-02T03:58:36.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.404+0000 7f1b95453700 1 --2- 172.21.15.162:0/2565537313 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f1b7c0387a0 0x7f1b7c03ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:36.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.404+0000 7f1b95453700 1 --2- 172.21.15.162:0/2565537313 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f1b7c0387a0 0x7f1b7c03ac60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c006fd0 tx=0x7f1b8c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:36.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.410+0000 7f1b86ffd700 1 -- 172.21.15.162:0/2565537313 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1b8002ab60 con 0x7f1b901068c0 2024-06-02T03:58:36.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.707+0000 7f1b97eb8700 1 -- 172.21.15.162:0/2565537313 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1b9010abc0 con 0x7f1b901068c0 2024-06-02T03:58:36.709 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.708+0000 7f1b86ffd700 1 -- 172.21.15.162:0/2565537313 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+740 (secure 0 0 0) 0x7f1b80026070 con 0x7f1b901068c0 2024-06-02T03:58:36.709 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T03:58:36.709 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":1,"fsid":"1b432ae0-2094-11ef-bc9b-c7b262605968","modified":"2024-06-02T03:57:15.171312Z","created":"2024-06-02T03:57:15.171312Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-06-02T03:58:36.710 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.711+0000 7f1b97eb8700 1 -- 172.21.15.162:0/2565537313 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f1b7c0387a0 msgr2=0x7f1b7c03ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:36.710 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.711+0000 7f1b97eb8700 1 --2- 172.21.15.162:0/2565537313 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f1b7c0387a0 0x7f1b7c03ac60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c006fd0 tx=0x7f1b8c006e40 comp rx=0 tx=0).stop 2024-06-02T03:58:36.711 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.711+0000 7f1b97eb8700 1 -- 172.21.15.162:0/2565537313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b901068c0 msgr2=0x7f1b90196190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:36.711 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.711+0000 7f1b97eb8700 1 --2- 172.21.15.162:0/2565537313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b901068c0 0x7f1b90196190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1b80004f40 tx=0x7f1b80005020 comp rx=0 tx=0).stop 2024-06-02T03:58:36.711 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.711+0000 7f1b97eb8700 1 -- 172.21.15.162:0/2565537313 shutdown_connections 2024-06-02T03:58:36.711 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.711+0000 7f1b97eb8700 1 --2- 172.21.15.162:0/2565537313 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f1b7c0387a0 0x7f1b7c03ac60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:36.711 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.711+0000 7f1b97eb8700 1 --2- 172.21.15.162:0/2565537313 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1b901068c0 0x7f1b90196190 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:36.711 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.711+0000 7f1b97eb8700 1 -- 172.21.15.162:0/2565537313 >> 172.21.15.162:0/2565537313 conn(0x7f1b900fc3b0 msgr2=0x7f1b901084e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:36.711 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.711+0000 7f1b97eb8700 1 -- 172.21.15.162:0/2565537313 shutdown_connections 2024-06-02T03:58:36.711 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:36.711+0000 7f1b97eb8700 1 -- 172.21.15.162:0/2565537313 wait complete. 2024-06-02T03:58:36.711 INFO:teuthology.orchestra.run.smithi162.stderr:dumped monmap epoch 1 2024-06-02T03:58:37.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:36 smithi123 ceph-mon[42885]: from='client.? 172.21.15.162:0/2565537313' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T03:58:37.565 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:37 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/1887638932' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-06-02T03:58:37.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:37 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:37.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:37 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:37.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:37 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:37.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:37 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:37.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:37 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi162", "name": "osd_memory_target"}]: dispatch 2024-06-02T03:58:37.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:37 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:37.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:37 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:58:37.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:37 smithi162 ceph-mon[47009]: Updating smithi162:/etc/ceph/ceph.conf 2024-06-02T03:58:37.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:37 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/1887638932' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-06-02T03:58:37.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:37 smithi162 ceph-mon[47009]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T03:58:37.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:37 smithi162 ceph-mon[47009]: Updating smithi162:/var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T03:58:37.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:37 smithi162 ceph-mon[47009]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:37.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:37 smithi162 ceph-mon[47009]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-06-02T03:58:37.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:37 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:37.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:37 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:37.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:37 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:37.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:37 smithi162 ceph-mon[47009]: Updating smithi162:/var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T03:58:37.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:37 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:37.800 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:37 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:58:37.800 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:37 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:37.800 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:37 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:58:37.800 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:37 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:37.800 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:37 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T03:58:37.800 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:37 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:37.800 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:37 smithi162 ceph-mon[47009]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi123:172.21.15.123=a;smithi136:172.21.15.136=b;smithi162:172.21.15.162=c", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T03:58:37.800 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:37 smithi162 ceph-mon[47009]: Saving service mon spec with placement smithi123:172.21.15.123=a;smithi136:172.21.15.136=b;smithi162:172.21.15.162=c;count:3 2024-06-02T03:58:37.800 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:37 smithi162 ceph-mon[47009]: Deploying daemon mon.c on smithi162 2024-06-02T03:58:37.800 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:37 smithi162 ceph-mon[47009]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:37.800 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:37 smithi162 ceph-mon[47009]: from='client.? 172.21.15.162:0/2565537313' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T03:58:37.800 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:37 smithi162 ceph-mon[47009]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-06-02T03:58:37.800 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:37 smithi162 systemd[1]: Started Ceph mon.c for 1b432ae0-2094-11ef-bc9b-c7b262605968. 2024-06-02T03:58:38.065 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-06-02T03:58:38.066 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-02T03:58:38.286 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T03:58:42.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.878+0000 7fa06c995700 1 -- 172.21.15.162:0/2334081368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0540057d0 msgr2=0x7fa054007c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:42.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.878+0000 7fa06c995700 1 --2- 172.21.15.162:0/2334081368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0540057d0 0x7fa054007c60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa0680ff800 tx=0x7fa050014ec0 comp rx=0 tx=0).stop 2024-06-02T03:58:42.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.878+0000 7fa06c995700 1 -- 172.21.15.162:0/2334081368 shutdown_connections 2024-06-02T03:58:42.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.878+0000 7fa06c995700 1 --2- 172.21.15.162:0/2334081368 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0540057d0 0x7fa054007c60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:42.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.878+0000 7fa06c995700 1 -- 172.21.15.162:0/2334081368 >> 172.21.15.162:0/2334081368 conn(0x7fa0680fb400 msgr2=0x7fa0680fd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:42.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.878+0000 7fa06c995700 1 -- 172.21.15.162:0/2334081368 shutdown_connections 2024-06-02T03:58:42.879 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.878+0000 7fa06c995700 1 -- 172.21.15.162:0/2334081368 wait complete. 2024-06-02T03:58:42.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.879+0000 7fa06c995700 1 Processor -- start 2024-06-02T03:58:42.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.879+0000 7fa06c995700 1 -- start start 2024-06-02T03:58:42.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.880+0000 7fa06c995700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0540057d0 0x7fa068194040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:42.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.880+0000 7fa06c995700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa068194580 0x7fa068198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:42.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.880+0000 7fa06c995700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa068194b10 con 0x7fa068194580 2024-06-02T03:58:42.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.880+0000 7fa06c995700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa068194c80 con 0x7fa0540057d0 2024-06-02T03:58:42.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.880+0000 7fa06659c700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0540057d0 0x7fa068194040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:42.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.880+0000 7fa06659c700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0540057d0 0x7fa068194040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:47016/0 (socket says 172.21.15.162:47016) 2024-06-02T03:58:42.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.880+0000 7fa06659c700 1 -- 172.21.15.162:0/1278195270 learned_addr learned my addr 172.21.15.162:0/1278195270 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-06-02T03:58:42.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.880+0000 7fa065d9b700 1 --2- 172.21.15.162:0/1278195270 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa068194580 0x7fa068198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:42.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.880+0000 7fa06659c700 1 -- 172.21.15.162:0/1278195270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0540057d0 msgr2=0x7fa068194040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-06-02T03:58:42.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.880+0000 7fa06659c700 1 -- 172.21.15.162:0/1278195270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0540057d0 msgr2=0x7fa068194040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-06-02T03:58:42.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.880+0000 7fa06659c700 1 --2- 172.21.15.162:0/1278195270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0540057d0 0x7fa068194040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-02T03:58:42.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.880+0000 7fa06659c700 1 --2- 172.21.15.162:0/1278195270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0540057d0 0x7fa068194040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T03:58:42.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.880+0000 7fa065d9b700 1 -- 172.21.15.162:0/1278195270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0540057d0 msgr2=0x7fa068194040 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T03:58:42.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.880+0000 7fa065d9b700 1 --2- 172.21.15.162:0/1278195270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0540057d0 0x7fa068194040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:42.881 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.880+0000 7fa065d9b700 1 -- 172.21.15.162:0/1278195270 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa050014910 con 0x7fa068194580 2024-06-02T03:58:42.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.881+0000 7fa065d9b700 1 --2- 172.21.15.162:0/1278195270 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa068194580 0x7fa068198930 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa05800b4d0 tx=0x7fa05800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:42.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.881+0000 7fa05f7fe700 1 -- 172.21.15.162:0/1278195270 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fa058011630 con 0x7fa068194580 2024-06-02T03:58:42.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.881+0000 7fa05f7fe700 1 -- 172.21.15.162:0/1278195270 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa058011c50 con 0x7fa068194580 2024-06-02T03:58:42.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.881+0000 7fa06c995700 1 -- 172.21.15.162:0/1278195270 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa068198ed0 con 0x7fa068194580 2024-06-02T03:58:42.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.881+0000 7fa05f7fe700 1 -- 172.21.15.162:0/1278195270 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fa058010d90 con 0x7fa068194580 2024-06-02T03:58:42.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.881+0000 7fa06c995700 1 -- 172.21.15.162:0/1278195270 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa068199420 con 0x7fa068194580 2024-06-02T03:58:42.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.882+0000 7fa05f7fe700 1 -- 172.21.15.162:0/1278195270 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 45598+0+0 (secure 0 0 0) 0x7fa05801a400 con 0x7fa068194580 2024-06-02T03:58:42.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.882+0000 7fa05f7fe700 1 --2- 172.21.15.162:0/1278195270 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa0480385d0 0x7fa04803aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:42.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.882+0000 7fa06c995700 1 -- 172.21.15.162:0/1278195270 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa06818deb0 con 0x7fa068194580 2024-06-02T03:58:42.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.882+0000 7fa05f7fe700 1 -- 172.21.15.162:0/1278195270 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa05804ad80 con 0x7fa068194580 2024-06-02T03:58:42.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.883+0000 7fa06659c700 1 --2- 172.21.15.162:0/1278195270 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa0480385d0 0x7fa04803aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:42.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.883+0000 7fa06659c700 1 --2- 172.21.15.162:0/1278195270 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa0480385d0 0x7fa04803aa90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa050005b40 tx=0x7fa050005a90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:42.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:42.888+0000 7fa05f7fe700 1 -- 172.21.15.162:0/1278195270 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa0580193b0 con 0x7fa068194580 2024-06-02T03:58:43.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:42 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T03:58:43.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:42 smithi162 ceph-mon[47009]: mon.a calling monitor election 2024-06-02T03:58:43.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:42 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T03:58:43.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:42 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T03:58:43.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:42 smithi162 ceph-mon[47009]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:43.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:42 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T03:58:43.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:42 smithi162 ceph-mon[47009]: mon.c calling monitor election 2024-06-02T03:58:43.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:42 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T03:58:43.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:42 smithi162 ceph-mon[47009]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:43.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:42 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T03:58:43.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:42 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T03:58:43.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:42 smithi162 ceph-mon[47009]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-02T03:58:43.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:42 smithi162 ceph-mon[47009]: monmap e2: 2 mons at {a=[v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0],c=[v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-06-02T03:58:43.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:42 smithi162 ceph-mon[47009]: fsmap 2024-06-02T03:58:43.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:42 smithi162 ceph-mon[47009]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T03:58:43.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:42 smithi162 ceph-mon[47009]: mgrmap e13: x(active, since 35s) 2024-06-02T03:58:43.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:42 smithi162 ceph-mon[47009]: overall HEALTH_OK 2024-06-02T03:58:43.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:42 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:43.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:42 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:43.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:42 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:43.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:42 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T03:58:43.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:42 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:43.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:42 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T03:58:43.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:42 smithi123 ceph-mon[42885]: mon.a calling monitor election 2024-06-02T03:58:43.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:42 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T03:58:43.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:42 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T03:58:43.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:42 smithi123 ceph-mon[42885]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:43.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:42 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T03:58:43.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:42 smithi123 ceph-mon[42885]: mon.c calling monitor election 2024-06-02T03:58:43.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:42 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T03:58:43.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:42 smithi123 ceph-mon[42885]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:43.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:42 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T03:58:43.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:42 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T03:58:43.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:42 smithi123 ceph-mon[42885]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-02T03:58:43.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:42 smithi123 ceph-mon[42885]: monmap e2: 2 mons at {a=[v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0],c=[v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-06-02T03:58:43.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:42 smithi123 ceph-mon[42885]: fsmap 2024-06-02T03:58:43.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:42 smithi123 ceph-mon[42885]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T03:58:43.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:42 smithi123 ceph-mon[42885]: mgrmap e13: x(active, since 35s) 2024-06-02T03:58:43.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:42 smithi123 ceph-mon[42885]: overall HEALTH_OK 2024-06-02T03:58:43.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:42 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:43.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:42 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:43.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:42 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:43.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:42 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T03:58:43.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:42 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:43.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:43.164+0000 7fa06c995700 1 -- 172.21.15.162:0/1278195270 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa0680625d0 con 0x7fa068194580 2024-06-02T03:58:43.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:43.165+0000 7fa05f7fe700 1 -- 172.21.15.162:0/1278195270 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1010 (secure 0 0 0) 0x7fa0580172c0 con 0x7fa068194580 2024-06-02T03:58:43.167 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T03:58:43.167 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":2,"fsid":"1b432ae0-2094-11ef-bc9b-c7b262605968","modified":"2024-06-02T03:58:37.573168Z","created":"2024-06-02T03:57:15.171312Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:3300","nonce":0},{"type":"v1","addr":"172.21.15.162:6789","nonce":0}]},"addr":"172.21.15.162:6789/0","public_addr":"172.21.15.162:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-06-02T03:58:43.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:43.167+0000 7fa06c995700 1 -- 172.21.15.162:0/1278195270 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa0480385d0 msgr2=0x7fa04803aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:43.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:43.167+0000 7fa06c995700 1 --2- 172.21.15.162:0/1278195270 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa0480385d0 0x7fa04803aa90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa050005b40 tx=0x7fa050005a90 comp rx=0 tx=0).stop 2024-06-02T03:58:43.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:43.167+0000 7fa06c995700 1 -- 172.21.15.162:0/1278195270 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa068194580 msgr2=0x7fa068198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:43.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:43.167+0000 7fa06c995700 1 --2- 172.21.15.162:0/1278195270 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa068194580 0x7fa068198930 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa05800b4d0 tx=0x7fa05800b890 comp rx=0 tx=0).stop 2024-06-02T03:58:43.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:43.167+0000 7fa06c995700 1 -- 172.21.15.162:0/1278195270 shutdown_connections 2024-06-02T03:58:43.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:43.167+0000 7fa06c995700 1 --2- 172.21.15.162:0/1278195270 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa0480385d0 0x7fa04803aa90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:43.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:43.167+0000 7fa06c995700 1 --2- 172.21.15.162:0/1278195270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0540057d0 0x7fa068194040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:43.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:43.167+0000 7fa06c995700 1 --2- 172.21.15.162:0/1278195270 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa068194580 0x7fa068198930 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:43.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:43.167+0000 7fa06c995700 1 -- 172.21.15.162:0/1278195270 >> 172.21.15.162:0/1278195270 conn(0x7fa0680fb400 msgr2=0x7fa0680fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:43.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:43.167+0000 7fa06c995700 1 -- 172.21.15.162:0/1278195270 shutdown_connections 2024-06-02T03:58:43.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:43.167+0000 7fa06c995700 1 -- 172.21.15.162:0/1278195270 wait complete. 2024-06-02T03:58:43.168 INFO:teuthology.orchestra.run.smithi162.stderr:dumped monmap epoch 2 2024-06-02T03:58:43.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:43 smithi162 ceph-mon[47009]: Deploying daemon mon.b on smithi136 2024-06-02T03:58:43.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:43 smithi162 ceph-mon[47009]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:43.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:43 smithi162 ceph-mon[47009]: from='client.? 172.21.15.162:0/1278195270' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T03:58:43.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:43 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T03:58:44.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:43 smithi123 ceph-mon[42885]: Deploying daemon mon.b on smithi136 2024-06-02T03:58:44.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:43 smithi123 ceph-mon[42885]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:44.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:43 smithi123 ceph-mon[42885]: from='client.? 172.21.15.162:0/1278195270' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T03:58:44.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:43 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T03:58:44.544 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-06-02T03:58:44.544 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-06-02T03:58:44.774 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T03:58:45.168 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 systemd[1]: Started Ceph mon.b for 1b432ae0-2094-11ef-bc9b-c7b262605968. 2024-06-02T03:58:45.168 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: mon.b@-1(synchronizing).mds e1 new map 2024-06-02T03:58:45.168 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: mon.b@-1(synchronizing).mds e1 print_map 2024-06-02T03:58:45.168 INFO:journalctl@ceph.mon.b.smithi136.stdout: e1 2024-06-02T03:58:45.168 INFO:journalctl@ceph.mon.b.smithi136.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T03:58:45.168 INFO:journalctl@ceph.mon.b.smithi136.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T03:58:45.168 INFO:journalctl@ceph.mon.b.smithi136.stdout: legacy client fscid: -1 2024-06-02T03:58:45.168 INFO:journalctl@ceph.mon.b.smithi136.stdout: 2024-06-02T03:58:45.168 INFO:journalctl@ceph.mon.b.smithi136.stdout: No filesystems configured 2024-06-02T03:58:45.169 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-06-02T03:58:45.169 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-06-02T03:58:45.169 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-06-02T03:58:45.169 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-06-02T03:58:45.169 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-06-02T03:58:45.169 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-06-02T03:58:45.169 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-06-02T03:58:45.169 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T03:58:45.169 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T03:58:45.169 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-06-02T03:58:45.169 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/1887638932' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-06-02T03:58:45.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:45.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:45.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:45.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:45.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi162", "name": "osd_memory_target"}]: dispatch 2024-06-02T03:58:45.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:45.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:58:45.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: Updating smithi162:/etc/ceph/ceph.conf 2024-06-02T03:58:45.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/1887638932' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-06-02T03:58:45.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T03:58:45.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: Updating smithi162:/var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/config/ceph.conf 2024-06-02T03:58:45.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:45.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: Updating smithi162:/etc/ceph/ceph.client.admin.keyring 2024-06-02T03:58:45.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:45.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:45.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:45.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: Updating smithi162:/var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-06-02T03:58:45.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:45.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:58:45.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:45.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:58:45.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:45.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T03:58:45.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:45.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi123:172.21.15.123=a;smithi136:172.21.15.136=b;smithi162:172.21.15.162=c", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T03:58:45.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: Saving service mon spec with placement smithi123:172.21.15.123=a;smithi136:172.21.15.136=b;smithi162:172.21.15.162=c;count:3 2024-06-02T03:58:45.591 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: Deploying daemon mon.c on smithi162 2024-06-02T03:58:45.591 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:45.591 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='client.? 172.21.15.162:0/2565537313' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T03:58:45.591 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T03:58:45.591 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: mon.a calling monitor election 2024-06-02T03:58:45.591 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T03:58:45.591 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T03:58:45.591 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:45.591 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T03:58:45.591 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: mon.c calling monitor election 2024-06-02T03:58:45.591 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T03:58:45.591 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:45.591 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T03:58:45.591 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T03:58:45.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-02T03:58:45.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: monmap e2: 2 mons at {a=[v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0],c=[v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-06-02T03:58:45.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: fsmap 2024-06-02T03:58:45.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T03:58:45.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: mgrmap e13: x(active, since 35s) 2024-06-02T03:58:45.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: overall HEALTH_OK 2024-06-02T03:58:45.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:45.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:45.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:45.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T03:58:45.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:45.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: Deploying daemon mon.b on smithi136 2024-06-02T03:58:45.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:45.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='client.? 172.21.15.162:0/1278195270' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-06-02T03:58:45.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T03:58:45.593 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:45 smithi136 ceph-mon[47443]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-06-02T03:58:50.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:50 smithi162 ceph-mon[47009]: mon.c calling monitor election 2024-06-02T03:58:50.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:50 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T03:58:50.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:50 smithi162 ceph-mon[47009]: mon.a calling monitor election 2024-06-02T03:58:50.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:50 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T03:58:50.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:50 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T03:58:50.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:50 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T03:58:50.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:50 smithi162 ceph-mon[47009]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:50.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:50 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T03:58:50.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:50 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T03:58:50.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:50 smithi162 ceph-mon[47009]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:50.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:50 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T03:58:50.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:50 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T03:58:50.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:50 smithi162 ceph-mon[47009]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-02T03:58:50.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:50 smithi162 ceph-mon[47009]: monmap e3: 3 mons at {a=[v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0],b=[v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0],c=[v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-06-02T03:58:50.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:50 smithi162 ceph-mon[47009]: fsmap 2024-06-02T03:58:50.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:50 smithi162 ceph-mon[47009]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T03:58:50.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:50 smithi162 ceph-mon[47009]: mgrmap e13: x(active, since 43s) 2024-06-02T03:58:50.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:50 smithi162 ceph-mon[47009]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-06-02T03:58:50.550 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:50 smithi162 ceph-mon[47009]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-06-02T03:58:50.550 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:50 smithi162 ceph-mon[47009]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-06-02T03:58:50.550 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:50 smithi162 ceph-mon[47009]: mon.b (rank 2) addr [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] is down (out of quorum) 2024-06-02T03:58:50.550 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:50 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:50.550 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:50 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:50.550 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:50 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:50.550 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:50 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:50.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:50 smithi123 ceph-mon[42885]: mon.c calling monitor election 2024-06-02T03:58:50.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:50 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T03:58:50.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:50 smithi123 ceph-mon[42885]: mon.a calling monitor election 2024-06-02T03:58:50.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:50 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T03:58:50.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:50 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T03:58:50.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:50 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T03:58:50.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:50 smithi123 ceph-mon[42885]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:50.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:50 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T03:58:50.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:50 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T03:58:50.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:50 smithi123 ceph-mon[42885]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:50.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:50 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T03:58:50.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:50 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T03:58:50.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:50 smithi123 ceph-mon[42885]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-02T03:58:50.575 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:50 smithi123 ceph-mon[42885]: monmap e3: 3 mons at {a=[v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0],b=[v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0],c=[v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-06-02T03:58:50.575 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:50 smithi123 ceph-mon[42885]: fsmap 2024-06-02T03:58:50.575 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:50 smithi123 ceph-mon[42885]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T03:58:50.575 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:50 smithi123 ceph-mon[42885]: mgrmap e13: x(active, since 43s) 2024-06-02T03:58:50.575 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:50 smithi123 ceph-mon[42885]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-06-02T03:58:50.575 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:50 smithi123 ceph-mon[42885]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-06-02T03:58:50.575 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:50 smithi123 ceph-mon[42885]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-06-02T03:58:50.575 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:50 smithi123 ceph-mon[42885]: mon.b (rank 2) addr [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] is down (out of quorum) 2024-06-02T03:58:50.575 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:50 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:50.575 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:50 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:50.575 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:50 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:50.575 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:50 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:51.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:51 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:58:51.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:51 smithi162 ceph-mon[47009]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:51.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:51 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:51.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:51 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:51.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:51 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:51.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:51 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:51.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:51 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:51.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:51 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:58:51.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:51 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T03:58:51.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:51 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:58:51.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:51 smithi123 ceph-mon[42885]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:51.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:51 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:51.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:51 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:51.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:51 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:51.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:51 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:51.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:51 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:51.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:51 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:58:51.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:51 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T03:58:51.716 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.716+0000 7f3c3e9ba700 1 -- 172.21.15.162:0/4266305831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c200062a0 msgr2=0x7f3c20008710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:51.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.716+0000 7f3c3e9ba700 1 --2- 172.21.15.162:0/4266305831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c200062a0 0x7f3c20008710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3c38101aa0 tx=0x7f3c2800fe90 comp rx=0 tx=0).stop 2024-06-02T03:58:51.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.716+0000 7f3c3e9ba700 1 -- 172.21.15.162:0/4266305831 shutdown_connections 2024-06-02T03:58:51.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.716+0000 7f3c3e9ba700 1 --2- 172.21.15.162:0/4266305831 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c200062a0 0x7f3c20008710 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:51.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.716+0000 7f3c3e9ba700 1 -- 172.21.15.162:0/4266305831 >> 172.21.15.162:0/4266305831 conn(0x7f3c380fc4d0 msgr2=0x7f3c380fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:51.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.716+0000 7f3c3e9ba700 1 -- 172.21.15.162:0/4266305831 shutdown_connections 2024-06-02T03:58:51.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.716+0000 7f3c3e9ba700 1 -- 172.21.15.162:0/4266305831 wait complete. 2024-06-02T03:58:51.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.717+0000 7f3c3e9ba700 1 Processor -- start 2024-06-02T03:58:51.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.717+0000 7f3c3e9ba700 1 -- start start 2024-06-02T03:58:51.720 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.717+0000 7f3c3e9ba700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c200062a0 0x7f3c381964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:51.720 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.717+0000 7f3c3e9ba700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c381969f0 0x7f3c3819ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:51.720 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.717+0000 7f3c3e9ba700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c3819b290 0x7f3c3819b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:51.720 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.717+0000 7f3c3e9ba700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c381970e0 con 0x7f3c200062a0 2024-06-02T03:58:51.720 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.717+0000 7f3c3e9ba700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c381a3000 con 0x7f3c3819b290 2024-06-02T03:58:51.720 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.717+0000 7f3c3e9ba700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c381a3140 con 0x7f3c381969f0 2024-06-02T03:58:51.720 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.718+0000 7f3c377fe700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c381969f0 0x7f3c3819ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:51.720 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.718+0000 7f3c377fe700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c381969f0 0x7f3c3819ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60404/0 (socket says 172.21.15.162:60404) 2024-06-02T03:58:51.720 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.718+0000 7f3c377fe700 1 -- 172.21.15.162:0/4231533635 learned_addr learned my addr 172.21.15.162:0/4231533635 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-06-02T03:58:51.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.718+0000 7f3c37fff700 1 --2- 172.21.15.162:0/4231533635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c200062a0 0x7f3c381964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:51.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.718+0000 7f3c377fe700 1 -- 172.21.15.162:0/4231533635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c381969f0 msgr2=0x7f3c3819ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-06-02T03:58:51.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.718+0000 7f3c377fe700 1 -- 172.21.15.162:0/4231533635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c381969f0 msgr2=0x7f3c3819ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-06-02T03:58:51.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.718+0000 7f3c377fe700 1 --2- 172.21.15.162:0/4231533635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c381969f0 0x7f3c3819ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-06-02T03:58:51.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.718+0000 7f3c377fe700 1 --2- 172.21.15.162:0/4231533635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c381969f0 0x7f3c3819ad50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-06-02T03:58:51.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.718+0000 7f3c3cf57700 1 --2- 172.21.15.162:0/4231533635 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c3819b290 0x7f3c3819b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:51.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.718+0000 7f3c37fff700 1 -- 172.21.15.162:0/4231533635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c381969f0 msgr2=0x7f3c3819ad50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-06-02T03:58:51.722 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.718+0000 7f3c37fff700 1 --2- 172.21.15.162:0/4231533635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c381969f0 0x7f3c3819ad50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:51.722 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.718+0000 7f3c37fff700 1 -- 172.21.15.162:0/4231533635 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c3819b290 msgr2=0x7f3c3819b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:51.722 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.718+0000 7f3c37fff700 1 --2- 172.21.15.162:0/4231533635 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c3819b290 0x7f3c3819b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:51.722 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.718+0000 7f3c37fff700 1 -- 172.21.15.162:0/4231533635 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2800f8e0 con 0x7f3c200062a0 2024-06-02T03:58:51.722 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.718+0000 7f3c3cf57700 1 --2- 172.21.15.162:0/4231533635 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c3819b290 0x7f3c3819b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T03:58:51.722 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.718+0000 7f3c37fff700 1 --2- 172.21.15.162:0/4231533635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c200062a0 0x7f3c381964b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3c28010010 tx=0x7f3c28005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:51.722 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.718+0000 7f3c357fa700 1 -- 172.21.15.162:0/4231533635 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c28011d60 con 0x7f3c200062a0 2024-06-02T03:58:51.722 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.718+0000 7f3c357fa700 1 -- 172.21.15.162:0/4231533635 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3c28011ec0 con 0x7f3c200062a0 2024-06-02T03:58:51.722 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.718+0000 7f3c3e9ba700 1 -- 172.21.15.162:0/4231533635 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c381a33c0 con 0x7f3c200062a0 2024-06-02T03:58:51.722 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.718+0000 7f3c357fa700 1 -- 172.21.15.162:0/4231533635 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c280038e0 con 0x7f3c200062a0 2024-06-02T03:58:51.722 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.718+0000 7f3c3e9ba700 1 -- 172.21.15.162:0/4231533635 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c381a38b0 con 0x7f3c200062a0 2024-06-02T03:58:51.722 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.719+0000 7f3c357fa700 1 -- 172.21.15.162:0/4231533635 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 45598+0+0 (secure 0 0 0) 0x7f3c28003a40 con 0x7f3c200062a0 2024-06-02T03:58:51.723 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.719+0000 7f3c357fa700 1 --2- 172.21.15.162:0/4231533635 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3c24038c20 0x7f3c2403b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:51.723 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.719+0000 7f3c3e9ba700 1 -- 172.21.15.162:0/4231533635 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c380625d0 con 0x7f3c200062a0 2024-06-02T03:58:51.723 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.720+0000 7f3c357fa700 1 -- 172.21.15.162:0/4231533635 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f3c2804e720 con 0x7f3c200062a0 2024-06-02T03:58:51.723 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.720+0000 7f3c377fe700 1 --2- 172.21.15.162:0/4231533635 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3c24038c20 0x7f3c2403b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:51.723 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.720+0000 7f3c377fe700 1 --2- 172.21.15.162:0/4231533635 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3c24038c20 0x7f3c2403b0e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c009180 tx=0x7f3c2c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:51.724 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:51.725+0000 7f3c357fa700 1 -- 172.21.15.162:0/4231533635 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3c28039350 con 0x7f3c200062a0 2024-06-02T03:58:52.002 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:52.002+0000 7f3c3e9ba700 1 -- 172.21.15.162:0/4231533635 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3c381086f0 con 0x7f3c200062a0 2024-06-02T03:58:52.003 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:52.003+0000 7f3c357fa700 1 -- 172.21.15.162:0/4231533635 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1278 (secure 0 0 0) 0x7f3c28033b10 con 0x7f3c200062a0 2024-06-02T03:58:52.003 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-06-02T03:58:52.003 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":3,"fsid":"1b432ae0-2094-11ef-bc9b-c7b262605968","modified":"2024-06-02T03:58:45.176150Z","created":"2024-06-02T03:57:15.171312Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:3300","nonce":0},{"type":"v1","addr":"172.21.15.123:6789","nonce":0}]},"addr":"172.21.15.123:6789/0","public_addr":"172.21.15.123:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:3300","nonce":0},{"type":"v1","addr":"172.21.15.162:6789","nonce":0}]},"addr":"172.21.15.162:6789/0","public_addr":"172.21.15.162:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:3300","nonce":0},{"type":"v1","addr":"172.21.15.136:6789","nonce":0}]},"addr":"172.21.15.136:6789/0","public_addr":"172.21.15.136:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-06-02T03:58:52.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:52.005+0000 7f3c3e9ba700 1 -- 172.21.15.162:0/4231533635 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3c24038c20 msgr2=0x7f3c2403b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:52.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:52.005+0000 7f3c3e9ba700 1 --2- 172.21.15.162:0/4231533635 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3c24038c20 0x7f3c2403b0e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c009180 tx=0x7f3c2c008040 comp rx=0 tx=0).stop 2024-06-02T03:58:52.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:52.005+0000 7f3c3e9ba700 1 -- 172.21.15.162:0/4231533635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c200062a0 msgr2=0x7f3c381964b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:52.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:52.005+0000 7f3c3e9ba700 1 --2- 172.21.15.162:0/4231533635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c200062a0 0x7f3c381964b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3c28010010 tx=0x7f3c28005e50 comp rx=0 tx=0).stop 2024-06-02T03:58:52.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:52.005+0000 7f3c3e9ba700 1 -- 172.21.15.162:0/4231533635 shutdown_connections 2024-06-02T03:58:52.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:52.005+0000 7f3c3e9ba700 1 --2- 172.21.15.162:0/4231533635 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3c24038c20 0x7f3c2403b0e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:52.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:52.005+0000 7f3c3e9ba700 1 --2- 172.21.15.162:0/4231533635 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c3819b290 0x7f3c3819b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:52.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:52.005+0000 7f3c3e9ba700 1 --2- 172.21.15.162:0/4231533635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c200062a0 0x7f3c381964b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:52.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:52.005+0000 7f3c3e9ba700 1 --2- 172.21.15.162:0/4231533635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c381969f0 0x7f3c3819ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:52.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:52.005+0000 7f3c3e9ba700 1 -- 172.21.15.162:0/4231533635 >> 172.21.15.162:0/4231533635 conn(0x7f3c380fc4d0 msgr2=0x7f3c381024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:52.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:52.005+0000 7f3c3e9ba700 1 -- 172.21.15.162:0/4231533635 shutdown_connections 2024-06-02T03:58:52.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:52.005+0000 7f3c3e9ba700 1 -- 172.21.15.162:0/4231533635 wait complete. 2024-06-02T03:58:52.007 INFO:teuthology.orchestra.run.smithi162.stderr:dumped monmap epoch 3 2024-06-02T03:58:52.392 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-06-02T03:58:52.392 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph config generate-minimal-conf 2024-06-02T03:58:52.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: mon.c calling monitor election 2024-06-02T03:58:52.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T03:58:52.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: mon.a calling monitor election 2024-06-02T03:58:52.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T03:58:52.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T03:58:52.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T03:58:52.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:52.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T03:58:52.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T03:58:52.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:52.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T03:58:52.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T03:58:52.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-06-02T03:58:52.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: monmap e3: 3 mons at {a=[v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0],b=[v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0],c=[v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-06-02T03:58:52.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: fsmap 2024-06-02T03:58:52.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T03:58:52.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: mgrmap e13: x(active, since 43s) 2024-06-02T03:58:52.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-06-02T03:58:52.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-06-02T03:58:52.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-06-02T03:58:52.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: mon.b (rank 2) addr [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] is down (out of quorum) 2024-06-02T03:58:52.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:52.591 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:52.591 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:52.591 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:52.591 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:58:52.591 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:52.591 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:52.591 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:52.591 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:52.591 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:52.591 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:52.591 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:58:52.591 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T03:58:52.821 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T03:58:53.238 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: mon.b calling monitor election 2024-06-02T03:58:53.239 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: mon.b calling monitor election 2024-06-02T03:58:53.239 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: mon.c calling monitor election 2024-06-02T03:58:53.239 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: mon.a calling monitor election 2024-06-02T03:58:53.239 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-02T03:58:53.239 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: monmap e3: 3 mons at {a=[v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0],b=[v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0],c=[v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-06-02T03:58:53.239 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: fsmap 2024-06-02T03:58:53.239 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T03:58:53.239 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: mgrmap e13: x(active, since 45s) 2024-06-02T03:58:53.239 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-06-02T03:58:53.239 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: Cluster is now healthy 2024-06-02T03:58:53.239 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: overall HEALTH_OK 2024-06-02T03:58:53.239 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:53.240 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:52 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:53.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:52 smithi162 ceph-mon[47009]: mon.b calling monitor election 2024-06-02T03:58:53.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:52 smithi162 ceph-mon[47009]: mon.b calling monitor election 2024-06-02T03:58:53.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:52 smithi162 ceph-mon[47009]: mon.c calling monitor election 2024-06-02T03:58:53.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:52 smithi162 ceph-mon[47009]: mon.a calling monitor election 2024-06-02T03:58:53.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:52 smithi162 ceph-mon[47009]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-02T03:58:53.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:52 smithi162 ceph-mon[47009]: monmap e3: 3 mons at {a=[v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0],b=[v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0],c=[v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-06-02T03:58:53.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:52 smithi162 ceph-mon[47009]: fsmap 2024-06-02T03:58:53.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:52 smithi162 ceph-mon[47009]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T03:58:53.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:52 smithi162 ceph-mon[47009]: mgrmap e13: x(active, since 45s) 2024-06-02T03:58:53.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:52 smithi162 ceph-mon[47009]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-06-02T03:58:53.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:52 smithi162 ceph-mon[47009]: Cluster is now healthy 2024-06-02T03:58:53.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:52 smithi162 ceph-mon[47009]: overall HEALTH_OK 2024-06-02T03:58:53.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:52 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:53.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:52 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:53.305 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:52 smithi123 ceph-mon[42885]: mon.b calling monitor election 2024-06-02T03:58:53.305 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:52 smithi123 ceph-mon[42885]: mon.b calling monitor election 2024-06-02T03:58:53.305 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:52 smithi123 ceph-mon[42885]: mon.c calling monitor election 2024-06-02T03:58:53.305 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:52 smithi123 ceph-mon[42885]: mon.a calling monitor election 2024-06-02T03:58:53.305 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:52 smithi123 ceph-mon[42885]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-06-02T03:58:53.306 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:52 smithi123 ceph-mon[42885]: monmap e3: 3 mons at {a=[v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0],b=[v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0],c=[v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-06-02T03:58:53.306 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:52 smithi123 ceph-mon[42885]: fsmap 2024-06-02T03:58:53.306 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:52 smithi123 ceph-mon[42885]: osdmap e4: 0 total, 0 up, 0 in 2024-06-02T03:58:53.306 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:52 smithi123 ceph-mon[42885]: mgrmap e13: x(active, since 45s) 2024-06-02T03:58:53.306 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:52 smithi123 ceph-mon[42885]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-06-02T03:58:53.306 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:52 smithi123 ceph-mon[42885]: Cluster is now healthy 2024-06-02T03:58:53.306 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:52 smithi123 ceph-mon[42885]: overall HEALTH_OK 2024-06-02T03:58:53.306 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:52 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:53.306 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:52 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:53.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.831+0000 7f9ada39e700 1 -- 172.21.15.123:0/457584331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ad4100890 msgr2=0x7f9ad410cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:53.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.831+0000 7f9ada39e700 1 --2- 172.21.15.123:0/457584331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ad4100890 0x7f9ad410cd40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9acc00b0a0 tx=0x7f9acc00b3b0 comp rx=0 tx=0).stop 2024-06-02T03:58:53.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.831+0000 7f9ada39e700 1 -- 172.21.15.123:0/457584331 shutdown_connections 2024-06-02T03:58:53.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.831+0000 7f9ada39e700 1 --2- 172.21.15.123:0/457584331 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ad4100890 0x7f9ad410cd40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:53.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.831+0000 7f9ada39e700 1 --2- 172.21.15.123:0/457584331 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad4105f00 0x7f9ad41062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:53.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.831+0000 7f9ada39e700 1 --2- 172.21.15.123:0/457584331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ad40ffed0 0x7f9ad4100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:53.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.831+0000 7f9ada39e700 1 -- 172.21.15.123:0/457584331 >> 172.21.15.123:0/457584331 conn(0x7f9ad4075f80 msgr2=0x7f9ad4076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:53.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.831+0000 7f9ada39e700 1 -- 172.21.15.123:0/457584331 shutdown_connections 2024-06-02T03:58:53.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.831+0000 7f9ada39e700 1 -- 172.21.15.123:0/457584331 wait complete. 2024-06-02T03:58:53.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.832+0000 7f9ada39e700 1 Processor -- start 2024-06-02T03:58:53.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.832+0000 7f9ada39e700 1 -- start start 2024-06-02T03:58:53.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.832+0000 7f9ada39e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ad40ffed0 0x7f9ad4198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:53.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.832+0000 7f9ada39e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad4100890 0x7f9ad41988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:53.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.832+0000 7f9ada39e700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ad4105f00 0x7f9ad41a3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:53.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.832+0000 7f9ada39e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad4199110 con 0x7f9ad40ffed0 2024-06-02T03:58:53.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.832+0000 7f9ada39e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad41a3940 con 0x7f9ad4100890 2024-06-02T03:58:53.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.832+0000 7f9ada39e700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad41a3a80 con 0x7f9ad4105f00 2024-06-02T03:58:53.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.833+0000 7f9ad3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ad40ffed0 0x7f9ad4198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:53.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.833+0000 7f9ad3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ad40ffed0 0x7f9ad4198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:51308/0 (socket says 172.21.15.123:51308) 2024-06-02T03:58:53.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.833+0000 7f9ad3fff700 1 -- 172.21.15.123:0/2841167689 learned_addr learned my addr 172.21.15.123:0/2841167689 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:58:53.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.833+0000 7f9ad37fe700 1 --2- 172.21.15.123:0/2841167689 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad4100890 0x7f9ad41988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:53.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.833+0000 7f9ad893b700 1 --2- 172.21.15.123:0/2841167689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ad4105f00 0x7f9ad41a3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:53.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.833+0000 7f9ad3fff700 1 -- 172.21.15.123:0/2841167689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ad4105f00 msgr2=0x7f9ad41a3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:53.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.833+0000 7f9ad3fff700 1 --2- 172.21.15.123:0/2841167689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ad4105f00 0x7f9ad41a3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:53.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.833+0000 7f9ad3fff700 1 -- 172.21.15.123:0/2841167689 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad4100890 msgr2=0x7f9ad41988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:53.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.833+0000 7f9ad3fff700 1 --2- 172.21.15.123:0/2841167689 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad4100890 0x7f9ad41988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:53.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.833+0000 7f9ad3fff700 1 -- 172.21.15.123:0/2841167689 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9acc009d00 con 0x7f9ad40ffed0 2024-06-02T03:58:53.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.833+0000 7f9ad3fff700 1 --2- 172.21.15.123:0/2841167689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ad40ffed0 0x7f9ad4198380 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9ac400d980 tx=0x7f9ac400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:53.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.833+0000 7f9ad17fa700 1 -- 172.21.15.123:0/2841167689 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac40098d0 con 0x7f9ad40ffed0 2024-06-02T03:58:53.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.833+0000 7f9ada39e700 1 -- 172.21.15.123:0/2841167689 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad41961d0 con 0x7f9ad40ffed0 2024-06-02T03:58:53.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.833+0000 7f9ad17fa700 1 -- 172.21.15.123:0/2841167689 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ac4010460 con 0x7f9ad40ffed0 2024-06-02T03:58:53.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.833+0000 7f9ad17fa700 1 -- 172.21.15.123:0/2841167689 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac400f620 con 0x7f9ad40ffed0 2024-06-02T03:58:53.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.833+0000 7f9ada39e700 1 -- 172.21.15.123:0/2841167689 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad41966d0 con 0x7f9ad40ffed0 2024-06-02T03:58:53.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.834+0000 7f9ad17fa700 1 -- 172.21.15.123:0/2841167689 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 45598+0+0 (secure 0 0 0) 0x7f9ac400f780 con 0x7f9ad40ffed0 2024-06-02T03:58:53.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.834+0000 7f9ad17fa700 1 --2- 172.21.15.123:0/2841167689 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9abc0389d0 0x7f9abc03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:53.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.834+0000 7f9ad17fa700 1 -- 172.21.15.123:0/2841167689 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f9ac404b050 con 0x7f9ad40ffed0 2024-06-02T03:58:53.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.834+0000 7f9ada39e700 1 -- 172.21.15.123:0/2841167689 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad4108420 con 0x7f9ad40ffed0 2024-06-02T03:58:53.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.834+0000 7f9ad37fe700 1 --2- 172.21.15.123:0/2841167689 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9abc0389d0 0x7f9abc03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:53.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.835+0000 7f9ad37fe700 1 --2- 172.21.15.123:0/2841167689 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9abc0389d0 0x7f9abc03ae90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4069140 tx=0x7f9ac800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:53.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:53.839+0000 7f9ad17fa700 1 -- 172.21.15.123:0/2841167689 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9ac40228f0 con 0x7f9ad40ffed0 2024-06-02T03:58:54.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:54.030+0000 7f9ada39e700 1 -- 172.21.15.123:0/2841167689 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f9ad4068ef0 con 0x7f9ad40ffed0 2024-06-02T03:58:54.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:54.030+0000 7f9ad17fa700 1 -- 172.21.15.123:0/2841167689 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+277 (secure 0 0 0) 0x7f9ac4022300 con 0x7f9ad40ffed0 2024-06-02T03:58:54.030 INFO:teuthology.orchestra.run.smithi123.stdout:# minimal ceph.conf for 1b432ae0-2094-11ef-bc9b-c7b262605968 2024-06-02T03:58:54.031 INFO:teuthology.orchestra.run.smithi123.stdout:[global] 2024-06-02T03:58:54.031 INFO:teuthology.orchestra.run.smithi123.stdout: fsid = 1b432ae0-2094-11ef-bc9b-c7b262605968 2024-06-02T03:58:54.031 INFO:teuthology.orchestra.run.smithi123.stdout: mon_host = [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2024-06-02T03:58:54.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:54.032+0000 7f9ada39e700 1 -- 172.21.15.123:0/2841167689 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9abc0389d0 msgr2=0x7f9abc03ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:54.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:54.032+0000 7f9ada39e700 1 --2- 172.21.15.123:0/2841167689 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9abc0389d0 0x7f9abc03ae90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4069140 tx=0x7f9ac800b410 comp rx=0 tx=0).stop 2024-06-02T03:58:54.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:54.032+0000 7f9ada39e700 1 -- 172.21.15.123:0/2841167689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ad40ffed0 msgr2=0x7f9ad4198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:54.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:54.032+0000 7f9ada39e700 1 --2- 172.21.15.123:0/2841167689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ad40ffed0 0x7f9ad4198380 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9ac400d980 tx=0x7f9ac400dc90 comp rx=0 tx=0).stop 2024-06-02T03:58:54.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:54.032+0000 7f9ada39e700 1 -- 172.21.15.123:0/2841167689 shutdown_connections 2024-06-02T03:58:54.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:54.032+0000 7f9ada39e700 1 --2- 172.21.15.123:0/2841167689 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ad4105f00 0x7f9ad41a3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:54.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:54.032+0000 7f9ada39e700 1 --2- 172.21.15.123:0/2841167689 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ad40ffed0 0x7f9ad4198380 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:54.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:54.032+0000 7f9ada39e700 1 --2- 172.21.15.123:0/2841167689 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9abc0389d0 0x7f9abc03ae90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:54.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:54.032+0000 7f9ada39e700 1 --2- 172.21.15.123:0/2841167689 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad4100890 0x7f9ad41988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:54.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:54.032+0000 7f9ada39e700 1 -- 172.21.15.123:0/2841167689 >> 172.21.15.123:0/2841167689 conn(0x7f9ad4075f80 msgr2=0x7f9ad40fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:54.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:54.032+0000 7f9ada39e700 1 -- 172.21.15.123:0/2841167689 shutdown_connections 2024-06-02T03:58:54.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:58:54.032+0000 7f9ada39e700 1 -- 172.21.15.123:0/2841167689 wait complete. 2024-06-02T03:58:54.056 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:53 smithi123 ceph-mon[42885]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:54.057 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:53 smithi123 ceph-mon[42885]: Reconfiguring mon.b (monmap changed)... 2024-06-02T03:58:54.057 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:53 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T03:58:54.057 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:53 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T03:58:54.057 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:53 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:54.057 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:53 smithi123 ceph-mon[42885]: Reconfiguring daemon mon.b on smithi136 2024-06-02T03:58:54.057 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:53 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T03:58:54.057 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:53 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:54.057 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:53 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:54.057 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:53 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T03:58:54.057 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:53 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T03:58:54.057 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:53 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:54.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:53 smithi162 ceph-mon[47009]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:54.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:53 smithi162 ceph-mon[47009]: Reconfiguring mon.b (monmap changed)... 2024-06-02T03:58:54.127 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:53 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T03:58:54.128 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:53 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T03:58:54.128 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:53 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:54.128 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:53 smithi162 ceph-mon[47009]: Reconfiguring daemon mon.b on smithi136 2024-06-02T03:58:54.128 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:53 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T03:58:54.128 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:53 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:54.128 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:53 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:54.128 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:53 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T03:58:54.128 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:53 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T03:58:54.128 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:53 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:54.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:53 smithi136 ceph-mon[47443]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:54.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:53 smithi136 ceph-mon[47443]: Reconfiguring mon.b (monmap changed)... 2024-06-02T03:58:54.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:53 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T03:58:54.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:53 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T03:58:54.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:53 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:54.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:53 smithi136 ceph-mon[47443]: Reconfiguring daemon mon.b on smithi136 2024-06-02T03:58:54.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:53 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T03:58:54.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:53 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:54.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:53 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:54.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:53 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-06-02T03:58:54.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:53 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-06-02T03:58:54.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:53 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:54.400 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-06-02T03:58:54.401 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-06-02T03:58:54.401 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/ceph/ceph.conf 2024-06-02T03:58:54.431 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-06-02T03:58:54.432 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-02T03:58:54.498 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-06-02T03:58:54.499 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.conf 2024-06-02T03:58:54.532 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-06-02T03:58:54.532 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-02T03:58:54.601 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T03:58:54.601 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.conf 2024-06-02T03:58:54.634 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T03:58:54.634 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-06-02T03:58:54.702 INFO:tasks.cephadm:Adding mgr.x on smithi123 2024-06-02T03:58:54.702 INFO:tasks.cephadm:Adding mgr.y on smithi136 2024-06-02T03:58:54.703 INFO:tasks.cephadm:Adding mgr.z on smithi162 2024-06-02T03:58:54.703 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph orch apply mgr '3;smithi123=x;smithi136=y;smithi162=z' 2024-06-02T03:58:54.957 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T03:58:55.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:54 smithi162 ceph-mon[47009]: Reconfiguring mon.c (monmap changed)... 2024-06-02T03:58:55.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:54 smithi162 ceph-mon[47009]: Reconfiguring daemon mon.c on smithi162 2024-06-02T03:58:55.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:54 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/2841167689' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:55.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:54 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:55.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:54 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:55.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:54 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:58:55.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:54 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:55.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:54 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:58:55.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:54 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:55.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:54 smithi123 ceph-mon[42885]: Reconfiguring mon.c (monmap changed)... 2024-06-02T03:58:55.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:54 smithi123 ceph-mon[42885]: Reconfiguring daemon mon.c on smithi162 2024-06-02T03:58:55.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:54 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2841167689' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:55.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:54 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:55.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:54 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:55.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:54 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:58:55.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:54 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:55.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:54 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:58:55.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:54 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:55.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:54 smithi136 ceph-mon[47443]: Reconfiguring mon.c (monmap changed)... 2024-06-02T03:58:55.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:54 smithi136 ceph-mon[47443]: Reconfiguring daemon mon.c on smithi162 2024-06-02T03:58:55.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:54 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/2841167689' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:55.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:54 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:55.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:54 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:55.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:54 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:58:55.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:54 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:55.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:54 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:58:55.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:54 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:55.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.954+0000 7fb41cdae700 1 -- 172.21.15.162:0/3370024985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4180fff00 msgr2=0x7fb418100320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:55.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.954+0000 7fb41cdae700 1 --2- 172.21.15.162:0/3370024985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4180fff00 0x7fb418100320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb408009990 tx=0x7fb408009ca0 comp rx=0 tx=0).stop 2024-06-02T03:58:55.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.955+0000 7fb41cdae700 1 -- 172.21.15.162:0/3370024985 shutdown_connections 2024-06-02T03:58:55.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.955+0000 7fb41cdae700 1 --2- 172.21.15.162:0/3370024985 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb418101a20 0x7fb418108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:55.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.955+0000 7fb41cdae700 1 --2- 172.21.15.162:0/3370024985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4180fff00 0x7fb418100320 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:55.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.955+0000 7fb41cdae700 1 --2- 172.21.15.162:0/3370024985 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb418101060 0x7fb4181014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:55.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.955+0000 7fb41cdae700 1 -- 172.21.15.162:0/3370024985 >> 172.21.15.162:0/3370024985 conn(0x7fb4180fb4a0 msgr2=0x7fb4180fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:55.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.955+0000 7fb41cdae700 1 -- 172.21.15.162:0/3370024985 shutdown_connections 2024-06-02T03:58:55.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.955+0000 7fb41cdae700 1 -- 172.21.15.162:0/3370024985 wait complete. 2024-06-02T03:58:55.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.955+0000 7fb41cdae700 1 Processor -- start 2024-06-02T03:58:55.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.955+0000 7fb41cdae700 1 -- start start 2024-06-02T03:58:55.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.955+0000 7fb41cdae700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4180fff00 0x7fb418196e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:55.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.955+0000 7fb41cdae700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb418101060 0x7fb4181973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:55.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.956+0000 7fb41cdae700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb418101a20 0x7fb41819e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:55.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.956+0000 7fb41cdae700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41819e9d0 con 0x7fb418101060 2024-06-02T03:58:55.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.956+0000 7fb41cdae700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41819eb10 con 0x7fb4180fff00 2024-06-02T03:58:55.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.956+0000 7fb41cdae700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41819eca0 con 0x7fb418101a20 2024-06-02T03:58:55.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.956+0000 7fb416d9d700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb418101a20 0x7fb41819e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:55.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.956+0000 7fb416d9d700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb418101a20 0x7fb41819e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:60424/0 (socket says 172.21.15.162:60424) 2024-06-02T03:58:55.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.956+0000 7fb416d9d700 1 -- 172.21.15.162:0/2758611274 learned_addr learned my addr 172.21.15.162:0/2758611274 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-06-02T03:58:55.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.956+0000 7fb41659c700 1 --2- 172.21.15.162:0/2758611274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4180fff00 0x7fb418196e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:55.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.956+0000 7fb415d9b700 1 --2- 172.21.15.162:0/2758611274 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb418101060 0x7fb4181973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:55.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.956+0000 7fb416d9d700 1 -- 172.21.15.162:0/2758611274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4180fff00 msgr2=0x7fb418196e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:55.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.956+0000 7fb416d9d700 1 --2- 172.21.15.162:0/2758611274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4180fff00 0x7fb418196e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:55.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.956+0000 7fb416d9d700 1 -- 172.21.15.162:0/2758611274 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb418101060 msgr2=0x7fb4181973d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:55.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.956+0000 7fb416d9d700 1 --2- 172.21.15.162:0/2758611274 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb418101060 0x7fb4181973d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:55.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.956+0000 7fb416d9d700 1 -- 172.21.15.162:0/2758611274 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4080095f0 con 0x7fb418101a20 2024-06-02T03:58:55.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.956+0000 7fb415d9b700 1 --2- 172.21.15.162:0/2758611274 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb418101060 0x7fb4181973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T03:58:55.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.956+0000 7fb416d9d700 1 --2- 172.21.15.162:0/2758611274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb418101a20 0x7fb41819e400 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb41000b9a0 tx=0x7fb41000bcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:55.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.956+0000 7fb4077fe700 1 -- 172.21.15.162:0/2758611274 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41000c930 con 0x7fb418101a20 2024-06-02T03:58:55.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.956+0000 7fb4077fe700 1 -- 172.21.15.162:0/2758611274 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb410014440 con 0x7fb418101a20 2024-06-02T03:58:55.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.956+0000 7fb41cdae700 1 -- 172.21.15.162:0/2758611274 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb41819ef80 con 0x7fb418101a20 2024-06-02T03:58:55.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.956+0000 7fb4077fe700 1 -- 172.21.15.162:0/2758611274 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4100075d0 con 0x7fb418101a20 2024-06-02T03:58:55.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.956+0000 7fb41cdae700 1 -- 172.21.15.162:0/2758611274 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb41819f3f0 con 0x7fb418101a20 2024-06-02T03:58:55.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.957+0000 7fb4077fe700 1 -- 172.21.15.162:0/2758611274 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 13) v1 ==== 45598+0+0 (secure 0 0 0) 0x7fb410007730 con 0x7fb418101a20 2024-06-02T03:58:55.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.957+0000 7fb4077fe700 1 --2- 172.21.15.162:0/2758611274 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb4000389d0 0x7fb40003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:58:55.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.957+0000 7fb4077fe700 1 -- 172.21.15.162:0/2758611274 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb410006e40 con 0x7fb418101a20 2024-06-02T03:58:55.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.957+0000 7fb41cdae700 1 -- 172.21.15.162:0/2758611274 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb41804ec60 con 0x7fb418101a20 2024-06-02T03:58:55.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.958+0000 7fb41659c700 1 --2- 172.21.15.162:0/2758611274 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb4000389d0 0x7fb40003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:58:55.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.958+0000 7fb41659c700 1 --2- 172.21.15.162:0/2758611274 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb4000389d0 0x7fb40003ae90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb40800b5c0 tx=0x7fb408003790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:58:55.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:55.963+0000 7fb4077fe700 1 -- 172.21.15.162:0/2758611274 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb41001b8b0 con 0x7fb418101a20 2024-06-02T03:58:56.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:55 smithi162 ceph-mon[47009]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:56.164 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:56.164+0000 7fb41cdae700 1 -- 172.21.15.162:0/2758611274 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi123=x;smithi136=y;smithi162=z", "target": ["mon-mgr", ""]}) v1 -- 0x7fb418069060 con 0x7fb4000389d0 2024-06-02T03:58:56.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:56.170+0000 7fb4077fe700 1 -- 172.21.15.162:0/2758611274 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fb418069060 con 0x7fb4000389d0 2024-06-02T03:58:56.170 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled mgr update... 2024-06-02T03:58:56.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:56.172+0000 7fb41cdae700 1 -- 172.21.15.162:0/2758611274 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb4000389d0 msgr2=0x7fb40003ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:56.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:56.172+0000 7fb41cdae700 1 --2- 172.21.15.162:0/2758611274 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb4000389d0 0x7fb40003ae90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb40800b5c0 tx=0x7fb408003790 comp rx=0 tx=0).stop 2024-06-02T03:58:56.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:56.172+0000 7fb41cdae700 1 -- 172.21.15.162:0/2758611274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb418101a20 msgr2=0x7fb41819e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:58:56.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:56.172+0000 7fb41cdae700 1 --2- 172.21.15.162:0/2758611274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb418101a20 0x7fb41819e400 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb41000b9a0 tx=0x7fb41000bcb0 comp rx=0 tx=0).stop 2024-06-02T03:58:56.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:56.172+0000 7fb41cdae700 1 -- 172.21.15.162:0/2758611274 shutdown_connections 2024-06-02T03:58:56.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:56.172+0000 7fb41cdae700 1 --2- 172.21.15.162:0/2758611274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb418101a20 0x7fb41819e400 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:56.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:56.172+0000 7fb41cdae700 1 --2- 172.21.15.162:0/2758611274 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb4000389d0 0x7fb40003ae90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:56.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:56.172+0000 7fb41cdae700 1 --2- 172.21.15.162:0/2758611274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4180fff00 0x7fb418196e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:56.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:56.172+0000 7fb41cdae700 1 --2- 172.21.15.162:0/2758611274 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb418101060 0x7fb4181973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:58:56.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:56.172+0000 7fb41cdae700 1 -- 172.21.15.162:0/2758611274 >> 172.21.15.162:0/2758611274 conn(0x7fb4180fb4a0 msgr2=0x7fb418068950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:58:56.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:56.172+0000 7fb41cdae700 1 -- 172.21.15.162:0/2758611274 shutdown_connections 2024-06-02T03:58:56.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:58:56.173+0000 7fb41cdae700 1 -- 172.21.15.162:0/2758611274 wait complete. 2024-06-02T03:58:56.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:55 smithi123 ceph-mon[42885]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:56.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:55 smithi136 ceph-mon[47443]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:56.563 DEBUG:teuthology.orchestra.run.smithi136:mgr.y> sudo journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mgr.y.service 2024-06-02T03:58:56.566 DEBUG:teuthology.orchestra.run.smithi162:mgr.z> sudo journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mgr.z.service 2024-06-02T03:58:56.569 INFO:tasks.cephadm:Deploying OSDs... 2024-06-02T03:58:56.569 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-06-02T03:58:56.569 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/scratch_devs of=/dev/stdout 2024-06-02T03:58:56.590 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-02T03:58:56.591 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_1 2024-06-02T03:58:56.597 INFO:journalctl@ceph.mgr.z.smithi162.stdout:-- Logs begin at Sun 2024-06-02 03:41:09 UTC. -- 2024-06-02T03:58:56.599 INFO:journalctl@ceph.mgr.y.smithi136.stdout:-- Logs begin at Sun 2024-06-02 03:40:52 UTC. -- 2024-06-02T03:58:56.653 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-02T03:58:56.653 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T03:58:56.653 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 185786 Links: 1 2024-06-02T03:58:56.653 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T03:58:56.653 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T03:58:56.654 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-06-02 03:58:17.316726003 +0000 2024-06-02T03:58:56.654 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-06-02 03:51:46.030813102 +0000 2024-06-02T03:58:56.654 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-06-02 03:51:46.030813102 +0000 2024-06-02T03:58:56.654 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2024-06-02T03:58:56.654 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-02T03:58:56.724 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-06-02T03:58:56.724 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-06-02T03:58:56.725 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000262883 s, 1.9 MB/s 2024-06-02T03:58:56.726 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-02T03:58:56.787 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_2 2024-06-02T03:58:56.849 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-02T03:58:56.849 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T03:58:56.849 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 180194 Links: 1 2024-06-02T03:58:56.849 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T03:58:56.849 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T03:58:56.849 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-06-02 03:58:17.374724655 +0000 2024-06-02T03:58:56.849 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-06-02 03:51:46.405804359 +0000 2024-06-02T03:58:56.849 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-06-02 03:51:46.405804359 +0000 2024-06-02T03:58:56.849 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2024-06-02T03:58:56.850 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-02T03:58:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-06-02T03:58:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-06-02T03:58:56.920 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000224135 s, 2.3 MB/s 2024-06-02T03:58:56.921 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-02T03:58:56.984 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_3 2024-06-02T03:58:57.045 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-02T03:58:57.045 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T03:58:57.045 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 181952 Links: 1 2024-06-02T03:58:57.045 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T03:58:57.045 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T03:58:57.045 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-06-02 03:58:17.424723493 +0000 2024-06-02T03:58:57.045 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-06-02 03:51:46.762796039 +0000 2024-06-02T03:58:57.045 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-06-02 03:51:46.762796039 +0000 2024-06-02T03:58:57.045 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2024-06-02T03:58:57.046 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-02T03:58:57.114 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-06-02T03:58:57.114 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-06-02T03:58:57.114 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000200766 s, 2.6 MB/s 2024-06-02T03:58:57.116 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-02T03:58:57.175 DEBUG:teuthology.orchestra.run.smithi123:> stat /dev/vg_nvme/lv_4 2024-06-02T03:58:57.234 INFO:teuthology.orchestra.run.smithi123.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-02T03:58:57.234 INFO:teuthology.orchestra.run.smithi123.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T03:58:57.235 INFO:teuthology.orchestra.run.smithi123.stdout:Device: 6h/6d Inode: 181991 Links: 1 2024-06-02T03:58:57.235 INFO:teuthology.orchestra.run.smithi123.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T03:58:57.235 INFO:teuthology.orchestra.run.smithi123.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T03:58:57.235 INFO:teuthology.orchestra.run.smithi123.stdout:Access: 2024-06-02 03:58:17.475722308 +0000 2024-06-02T03:58:57.235 INFO:teuthology.orchestra.run.smithi123.stdout:Modify: 2024-06-02 03:51:47.100788161 +0000 2024-06-02T03:58:57.235 INFO:teuthology.orchestra.run.smithi123.stdout:Change: 2024-06-02 03:51:47.100788161 +0000 2024-06-02T03:58:57.235 INFO:teuthology.orchestra.run.smithi123.stdout: Birth: - 2024-06-02T03:58:57.235 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-02T03:58:57.302 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records in 2024-06-02T03:58:57.302 INFO:teuthology.orchestra.run.smithi123.stderr:1+0 records out 2024-06-02T03:58:57.302 INFO:teuthology.orchestra.run.smithi123.stderr:512 bytes copied, 0.000233821 s, 2.2 MB/s 2024-06-02T03:58:57.303 DEBUG:teuthology.orchestra.run.smithi123:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-02T03:58:57.363 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-06-02T03:58:57.363 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/scratch_devs of=/dev/stdout 2024-06-02T03:58:57.385 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-02T03:58:57.385 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_1 2024-06-02T03:58:57.399 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:57 smithi162 ceph-mon[47009]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi123=x;smithi136=y;smithi162=z", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T03:58:57.400 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:57 smithi162 ceph-mon[47009]: Saving service mgr spec with placement smithi123=x;smithi136=y;smithi162=z;count:3 2024-06-02T03:58:57.400 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:57 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:57.400 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:57 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:58:57.400 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:57 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:57.400 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:57 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:58:57.400 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:57 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:57.400 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:57 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T03:58:57.400 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:57 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-02T03:58:57.400 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:57 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T03:58:57.400 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:57 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:57.400 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:57 smithi162 ceph-mon[47009]: Deploying daemon mgr.z on smithi162 2024-06-02T03:58:57.400 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:57 smithi162 ceph-mon[47009]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:57.445 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-02T03:58:57.445 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T03:58:57.445 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 6h/6d Inode: 188715 Links: 1 2024-06-02T03:58:57.445 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T03:58:57.446 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T03:58:57.446 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-06-02 03:58:44.718930504 +0000 2024-06-02T03:58:57.446 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-06-02 03:51:55.764619304 +0000 2024-06-02T03:58:57.446 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-06-02 03:51:55.764619304 +0000 2024-06-02T03:58:57.446 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2024-06-02T03:58:57.446 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-02T03:58:57.512 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:57 smithi136 ceph-mon[47443]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi123=x;smithi136=y;smithi162=z", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T03:58:57.512 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:57 smithi136 ceph-mon[47443]: Saving service mgr spec with placement smithi123=x;smithi136=y;smithi162=z;count:3 2024-06-02T03:58:57.512 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:57 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:57.512 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:57 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:58:57.512 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:57 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:57.513 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:57 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:58:57.513 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:57 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:57.513 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:57 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T03:58:57.513 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:57 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-02T03:58:57.513 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:57 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T03:58:57.513 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:57 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:57.513 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:57 smithi136 ceph-mon[47443]: Deploying daemon mgr.z on smithi162 2024-06-02T03:58:57.513 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:57 smithi136 ceph-mon[47443]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:57.514 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-06-02T03:58:57.515 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-06-02T03:58:57.515 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000243353 s, 2.1 MB/s 2024-06-02T03:58:57.516 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-02T03:58:57.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:57 smithi123 ceph-mon[42885]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi123=x;smithi136=y;smithi162=z", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T03:58:57.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:57 smithi123 ceph-mon[42885]: Saving service mgr spec with placement smithi123=x;smithi136=y;smithi162=z;count:3 2024-06-02T03:58:57.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:57 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:57.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:57 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:58:57.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:57 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:57.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:57 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:58:57.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:57 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:57.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:57 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T03:58:57.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:57 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-02T03:58:57.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:57 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T03:58:57.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:57 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:57.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:57 smithi123 ceph-mon[42885]: Deploying daemon mgr.z on smithi162 2024-06-02T03:58:57.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:57 smithi123 ceph-mon[42885]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:58:57.576 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_2 2024-06-02T03:58:57.635 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-02T03:58:57.635 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T03:58:57.635 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 6h/6d Inode: 189778 Links: 1 2024-06-02T03:58:57.635 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T03:58:57.635 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T03:58:57.635 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-06-02 03:58:44.718930504 +0000 2024-06-02T03:58:57.635 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-06-02 03:51:56.113611514 +0000 2024-06-02T03:58:57.635 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-06-02 03:51:56.113611514 +0000 2024-06-02T03:58:57.635 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2024-06-02T03:58:57.636 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-02T03:58:57.702 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-06-02T03:58:57.702 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-06-02T03:58:57.703 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000315783 s, 1.6 MB/s 2024-06-02T03:58:57.704 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-02T03:58:57.750 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Jun 02 03:58:57 smithi162 systemd[1]: Starting Ceph mgr.z for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T03:58:57.763 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_3 2024-06-02T03:58:57.821 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-02T03:58:57.821 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T03:58:57.821 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 6h/6d Inode: 183063 Links: 1 2024-06-02T03:58:57.821 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T03:58:57.821 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T03:58:57.821 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-06-02 03:58:44.718930504 +0000 2024-06-02T03:58:57.821 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-06-02 03:51:56.457603834 +0000 2024-06-02T03:58:57.822 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-06-02 03:51:56.457603834 +0000 2024-06-02T03:58:57.822 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2024-06-02T03:58:57.822 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-02T03:58:57.889 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-06-02T03:58:57.890 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-06-02T03:58:57.890 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000255456 s, 2.0 MB/s 2024-06-02T03:58:57.892 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-02T03:58:57.960 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_4 2024-06-02T03:58:58.031 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-02T03:58:58.031 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T03:58:58.031 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 6h/6d Inode: 189942 Links: 1 2024-06-02T03:58:58.031 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T03:58:58.031 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T03:58:58.031 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-06-02 03:58:44.718930504 +0000 2024-06-02T03:58:58.031 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-06-02 03:51:56.814595865 +0000 2024-06-02T03:58:58.032 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-06-02 03:51:56.814595865 +0000 2024-06-02T03:58:58.032 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: - 2024-06-02T03:58:58.032 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-02T03:58:58.098 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-06-02T03:58:58.098 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-06-02T03:58:58.099 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000245234 s, 2.1 MB/s 2024-06-02T03:58:58.099 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-02T03:58:58.159 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-06-02T03:58:58.159 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/scratch_devs of=/dev/stdout 2024-06-02T03:58:58.176 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-06-02T03:58:58.176 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_1 2024-06-02T03:58:58.234 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-06-02T03:58:58.234 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T03:58:58.234 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 6h/6d Inode: 183179 Links: 1 2024-06-02T03:58:58.234 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T03:58:58.234 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T03:58:58.235 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-06-02 03:58:57.450669783 +0000 2024-06-02T03:58:58.235 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-06-02 03:51:58.054773775 +0000 2024-06-02T03:58:58.235 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-06-02 03:51:58.054773775 +0000 2024-06-02T03:58:58.235 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: - 2024-06-02T03:58:58.235 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-06-02T03:58:58.273 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Jun 02 03:58:57 smithi162 ceph-mgr[48891]: -- 172.21.15.162:0/2083103940 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a75fbee1a0 con 0x55a75fbc4800 2024-06-02T03:58:58.273 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Jun 02 03:58:57 smithi162 bash[48853]: 5a0de22bba6b2dfdb15f6dbe148b4301373fb4758999336dc566a59c9eb2b87d 2024-06-02T03:58:58.273 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Jun 02 03:58:57 smithi162 systemd[1]: Started Ceph mgr.z for 1b432ae0-2094-11ef-bc9b-c7b262605968. 2024-06-02T03:58:58.303 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-06-02T03:58:58.303 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-06-02T03:58:58.303 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000229362 s, 2.2 MB/s 2024-06-02T03:58:58.303 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-06-02T03:58:58.364 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_2 2024-06-02T03:58:58.421 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-06-02T03:58:58.421 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T03:58:58.421 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 6h/6d Inode: 181970 Links: 1 2024-06-02T03:58:58.421 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T03:58:58.421 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T03:58:58.421 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-06-02 03:58:57.450669783 +0000 2024-06-02T03:58:58.421 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-06-02 03:51:58.439766062 +0000 2024-06-02T03:58:58.421 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-06-02 03:51:58.439766062 +0000 2024-06-02T03:58:58.421 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: - 2024-06-02T03:58:58.422 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-06-02T03:58:58.487 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-06-02T03:58:58.488 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-06-02T03:58:58.488 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000215735 s, 2.4 MB/s 2024-06-02T03:58:58.489 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-06-02T03:58:58.548 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Jun 02 03:58:58 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-z[48868]: 2024-06-02T03:58:58.273+0000 7f7c35023200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-02T03:58:58.548 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Jun 02 03:58:58 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-z[48868]: 2024-06-02T03:58:58.374+0000 7f7c35023200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-02T03:58:58.548 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Jun 02 03:58:58 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-z[48868]: 2024-06-02T03:58:58.464+0000 7f7c35023200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-02T03:58:58.549 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_3 2024-06-02T03:58:58.608 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-06-02T03:58:58.608 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T03:58:58.608 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 6h/6d Inode: 186271 Links: 1 2024-06-02T03:58:58.609 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T03:58:58.609 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T03:58:58.609 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-06-02 03:58:57.451669763 +0000 2024-06-02T03:58:58.609 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-06-02 03:51:58.781759210 +0000 2024-06-02T03:58:58.609 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-06-02 03:51:58.781759210 +0000 2024-06-02T03:58:58.609 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: - 2024-06-02T03:58:58.609 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-06-02T03:58:58.678 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-06-02T03:58:58.678 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-06-02T03:58:58.678 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000194702 s, 2.6 MB/s 2024-06-02T03:58:58.679 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-06-02T03:58:58.739 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_4 2024-06-02T03:58:58.796 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-06-02T03:58:58.796 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-06-02T03:58:58.796 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 6h/6d Inode: 188464 Links: 1 2024-06-02T03:58:58.797 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-06-02T03:58:58.797 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-06-02T03:58:58.797 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-06-02 03:58:57.451669763 +0000 2024-06-02T03:58:58.797 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-06-02 03:51:59.133752158 +0000 2024-06-02T03:58:58.797 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-06-02 03:51:59.133752158 +0000 2024-06-02T03:58:58.797 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: - 2024-06-02T03:58:58.797 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-06-02T03:58:58.860 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Jun 02 03:58:58 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-z[48868]: 2024-06-02T03:58:58.555+0000 7f7c35023200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-02T03:58:58.863 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-06-02T03:58:58.863 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-06-02T03:58:58.863 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000238897 s, 2.1 MB/s 2024-06-02T03:58:58.864 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-06-02T03:58:58.922 INFO:tasks.cephadm:Deploying osd.0 on smithi123 with /dev/vg_nvme/lv_4... 2024-06-02T03:58:58.923 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-06-02T03:58:59.021 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:58 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:59.021 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:58 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:59.021 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:58 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:59.021 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:58 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T03:58:59.021 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:58 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-02T03:58:59.022 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:58 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T03:58:59.022 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:58 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:59.022 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:58:58 smithi136 ceph-mon[47443]: Deploying daemon mgr.y on smithi136 2024-06-02T03:58:59.152 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T03:58:59.221 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:58 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:59.221 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:58 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:59.221 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:58 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:59.221 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:58 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T03:58:59.221 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:58 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-02T03:58:59.221 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:58 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T03:58:59.221 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:58 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:59.221 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:58:58 smithi162 ceph-mon[47009]: Deploying daemon mgr.y on smithi136 2024-06-02T03:58:59.296 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:58 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:59.296 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:58 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:59.296 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:58 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:58:59.296 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:58 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T03:58:59.296 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:58 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-06-02T03:58:59.296 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:58 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T03:58:59.296 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:58 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:58:59.296 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:58:58 smithi123 ceph-mon[42885]: Deploying daemon mgr.y on smithi136 2024-06-02T03:58:59.338 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Jun 02 03:58:59 smithi136 systemd[1]: Starting Ceph mgr.y for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T03:58:59.472 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Jun 02 03:58:59 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-z[48868]: 2024-06-02T03:58:59.220+0000 7f7c35023200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-02T03:58:59.798 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Jun 02 03:58:59 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-z[48868]: 2024-06-02T03:58:59.472+0000 7f7c35023200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-02T03:58:59.798 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Jun 02 03:58:59 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-z[48868]: 2024-06-02T03:58:59.558+0000 7f7c35023200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-02T03:58:59.798 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Jun 02 03:58:59 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-z[48868]: 2024-06-02T03:58:59.666+0000 7f7c35023200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-02T03:59:00.002 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Jun 02 03:58:59 smithi136 ceph-mgr[48948]: -- 172.21.15.136:0/4104762342 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55bc2308e1a0 con 0x55bc23065000 2024-06-02T03:59:00.002 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Jun 02 03:58:59 smithi136 bash[48910]: 5bdf53e14c247fe5d0b114b1afaa152002e608d39bbbef87dfa0980050c0100a 2024-06-02T03:59:00.002 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Jun 02 03:58:59 smithi136 systemd[1]: Started Ceph mgr.y for 1b432ae0-2094-11ef-bc9b-c7b262605968. 2024-06-02T03:59:00.297 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:00 smithi136 ceph-mon[47443]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:00.297 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:00 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:00.297 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:00 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:00.298 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:00 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:00.298 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:00 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:00.298 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:00 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:59:00.298 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Jun 02 03:59:00 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-y[48925]: 2024-06-02T03:59:00.095+0000 7fa9600c6200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-06-02T03:59:00.298 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Jun 02 03:59:00 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-y[48925]: 2024-06-02T03:59:00.202+0000 7fa9600c6200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-06-02T03:59:00.298 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Jun 02 03:59:00 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-y[48925]: 2024-06-02T03:59:00.297+0000 7fa9600c6200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-06-02T03:59:00.299 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Jun 02 03:58:59 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-z[48868]: 2024-06-02T03:58:59.828+0000 7f7c35023200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-02T03:59:00.299 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Jun 02 03:58:59 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-z[48868]: 2024-06-02T03:58:59.971+0000 7f7c35023200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-02T03:59:00.299 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Jun 02 03:59:00 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-z[48868]: 2024-06-02T03:59:00.061+0000 7f7c35023200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-02T03:59:00.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:00 smithi162 ceph-mon[47009]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:00.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:00 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:00.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:00 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:00.300 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:00 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:00.300 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:00 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:00.300 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:00 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:59:00.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:00 smithi123 ceph-mon[42885]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:00.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:00 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:00.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:00 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:00.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:00 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:00.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:00 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:00.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:00 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:59:00.547 INFO:teuthology.orchestra.run.smithi123.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-06-02T03:59:00.548 INFO:teuthology.orchestra.run.smithi123.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-06-02T03:59:00.548 INFO:teuthology.orchestra.run.smithi123.stderr: stderr: 10+0 records in 2024-06-02T03:59:00.548 INFO:teuthology.orchestra.run.smithi123.stderr:10+0 records out 2024-06-02T03:59:00.548 INFO:teuthology.orchestra.run.smithi123.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112106 s, 935 MB/s 2024-06-02T03:59:00.548 INFO:teuthology.orchestra.run.smithi123.stderr:--> Zapping successful for: 2024-06-02T03:59:00.588 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Jun 02 03:59:00 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-y[48925]: 2024-06-02T03:59:00.390+0000 7fa9600c6200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-06-02T03:59:00.798 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Jun 02 03:59:00 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-z[48868]: 2024-06-02T03:59:00.477+0000 7f7c35023200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-02T03:59:00.920 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi123:vg_nvme/lv_4 2024-06-02T03:59:01.170 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Jun 02 03:59:00 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-z[48868]: 2024-06-02T03:59:00.885+0000 7f7c35023200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-02T03:59:01.170 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Jun 02 03:59:01 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-z[48868]: 2024-06-02T03:59:01.078+0000 7f7c35023200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-02T03:59:01.170 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Jun 02 03:59:01 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-z[48868]: 2024-06-02T03:59:01.170+0000 7f7c35023200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-02T03:59:01.338 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Jun 02 03:59:01 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-y[48925]: 2024-06-02T03:59:01.061+0000 7fa9600c6200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-06-02T03:59:01.338 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Jun 02 03:59:01 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-y[48925]: 2024-06-02T03:59:01.311+0000 7fa9600c6200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-06-02T03:59:01.432 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T03:59:01.662 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Jun 02 03:59:01 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-y[48925]: 2024-06-02T03:59:01.396+0000 7fa9600c6200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-06-02T03:59:01.662 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Jun 02 03:59:01 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-y[48925]: 2024-06-02T03:59:01.505+0000 7fa9600c6200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-06-02T03:59:01.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:01.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:01.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:01.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:01.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:01.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:59:01.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:01.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:01 smithi123 ceph-mon[42885]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:01.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:01 smithi123 ceph-mon[42885]: Reconfiguring mgr.x (unknown last config time)... 2024-06-02T03:59:01.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T03:59:01.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T03:59:01.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:01.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:01 smithi123 ceph-mon[42885]: Reconfiguring daemon mgr.x on smithi123 2024-06-02T03:59:02.043 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Jun 02 03:59:01 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-z[48868]: 2024-06-02T03:59:01.940+0000 7f7c35023200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-02T03:59:02.043 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:02.044 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:02.044 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:02.044 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:02.044 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:02.044 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:59:02.044 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:02.044 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:01 smithi162 ceph-mon[47009]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:02.044 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:01 smithi162 ceph-mon[47009]: Reconfiguring mgr.x (unknown last config time)... 2024-06-02T03:59:02.044 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T03:59:02.044 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T03:59:02.044 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:02.045 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:01 smithi162 ceph-mon[47009]: Reconfiguring daemon mgr.x on smithi123 2024-06-02T03:59:02.088 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Jun 02 03:59:01 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-y[48925]: 2024-06-02T03:59:01.662+0000 7fa9600c6200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-06-02T03:59:02.088 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Jun 02 03:59:01 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-y[48925]: 2024-06-02T03:59:01.791+0000 7fa9600c6200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-06-02T03:59:02.088 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Jun 02 03:59:01 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-y[48925]: 2024-06-02T03:59:01.878+0000 7fa9600c6200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-06-02T03:59:02.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:02.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:02.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:02.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:02.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:02.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:59:02.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:02.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:01 smithi136 ceph-mon[47443]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:02.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:01 smithi136 ceph-mon[47443]: Reconfiguring mgr.x (unknown last config time)... 2024-06-02T03:59:02.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-06-02T03:59:02.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-06-02T03:59:02.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:02.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:01 smithi136 ceph-mon[47443]: Reconfiguring daemon mgr.x on smithi123 2024-06-02T03:59:02.298 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Jun 02 03:59:02 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-z[48868]: 2024-06-02T03:59:02.043+0000 7f7c35023200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-02T03:59:02.298 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Jun 02 03:59:02 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-z[48868]: 2024-06-02T03:59:02.190+0000 7f7c35023200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-02T03:59:02.588 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Jun 02 03:59:02 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-y[48925]: 2024-06-02T03:59:02.253+0000 7fa9600c6200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-06-02T03:59:02.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.667+0000 7fb932ca4700 1 -- 172.21.15.123:0/2000949274 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb92c106cf0 msgr2=0x7fb92c109160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:59:02.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.667+0000 7fb932ca4700 1 --2- 172.21.15.123:0/2000949274 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb92c106cf0 0x7fb92c109160 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb92400b0a0 tx=0x7fb92400b3b0 comp rx=0 tx=0).stop 2024-06-02T03:59:02.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.668+0000 7fb932ca4700 1 -- 172.21.15.123:0/2000949274 shutdown_connections 2024-06-02T03:59:02.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.668+0000 7fb932ca4700 1 --2- 172.21.15.123:0/2000949274 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb92c106cf0 0x7fb92c109160 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:59:02.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.668+0000 7fb932ca4700 1 --2- 172.21.15.123:0/2000949274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb92c101a90 0x7fb92c103e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:59:02.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.668+0000 7fb932ca4700 1 --2- 172.21.15.123:0/2000949274 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb92c1043c0 0x7fb92c1067b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:59:02.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.668+0000 7fb932ca4700 1 -- 172.21.15.123:0/2000949274 >> 172.21.15.123:0/2000949274 conn(0x7fb92c0fb4c0 msgr2=0x7fb92c0fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:59:02.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.668+0000 7fb932ca4700 1 -- 172.21.15.123:0/2000949274 shutdown_connections 2024-06-02T03:59:02.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.668+0000 7fb932ca4700 1 -- 172.21.15.123:0/2000949274 wait complete. 2024-06-02T03:59:02.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.668+0000 7fb932ca4700 1 Processor -- start 2024-06-02T03:59:02.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.668+0000 7fb932ca4700 1 -- start start 2024-06-02T03:59:02.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.668+0000 7fb932ca4700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb92c101a90 0x7fb92c196fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:59:02.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.668+0000 7fb932ca4700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb92c1043c0 0x7fb92c1974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:59:02.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.668+0000 7fb932ca4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb92c106cf0 0x7fb92c19e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:59:02.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.669+0000 7fb932ca4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c19eae0 con 0x7fb92c106cf0 2024-06-02T03:59:02.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.669+0000 7fb932ca4700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c19ec20 con 0x7fb92c1043c0 2024-06-02T03:59:02.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.669+0000 7fb932ca4700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c19edb0 con 0x7fb92c101a90 2024-06-02T03:59:02.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.669+0000 7fb931241700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb92c106cf0 0x7fb92c19e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:59:02.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.669+0000 7fb930a40700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb92c101a90 0x7fb92c196fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:59:02.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.669+0000 7fb931241700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb92c106cf0 0x7fb92c19e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:35920/0 (socket says 172.21.15.123:35920) 2024-06-02T03:59:02.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.669+0000 7fb931241700 1 -- 172.21.15.123:0/640408216 learned_addr learned my addr 172.21.15.123:0/640408216 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:59:02.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.669+0000 7fb930a40700 1 --2- 172.21.15.123:0/640408216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb92c101a90 0x7fb92c196fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.123:60470/0 (socket says 172.21.15.123:60470) 2024-06-02T03:59:02.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.669+0000 7fb92bfff700 1 --2- 172.21.15.123:0/640408216 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb92c1043c0 0x7fb92c1974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:59:02.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.669+0000 7fb931241700 1 -- 172.21.15.123:0/640408216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb92c101a90 msgr2=0x7fb92c196fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:59:02.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.669+0000 7fb931241700 1 --2- 172.21.15.123:0/640408216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb92c101a90 0x7fb92c196fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:59:02.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.669+0000 7fb931241700 1 -- 172.21.15.123:0/640408216 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb92c1043c0 msgr2=0x7fb92c1974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:59:02.671 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.669+0000 7fb931241700 1 --2- 172.21.15.123:0/640408216 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb92c1043c0 0x7fb92c1974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:59:02.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.669+0000 7fb931241700 1 -- 172.21.15.123:0/640408216 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb924009d00 con 0x7fb92c106cf0 2024-06-02T03:59:02.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.669+0000 7fb931241700 1 --2- 172.21.15.123:0/640408216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb92c106cf0 0x7fb92c19e510 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb9240094c0 tx=0x7fb9240094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:59:02.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.669+0000 7fb929ffb700 1 -- 172.21.15.123:0/640408216 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92400e040 con 0x7fb92c106cf0 2024-06-02T03:59:02.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.669+0000 7fb929ffb700 1 -- 172.21.15.123:0/640408216 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb92401d940 con 0x7fb92c106cf0 2024-06-02T03:59:02.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.669+0000 7fb932ca4700 1 -- 172.21.15.123:0/640408216 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb92c19f030 con 0x7fb92c106cf0 2024-06-02T03:59:02.672 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.669+0000 7fb929ffb700 1 -- 172.21.15.123:0/640408216 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92401b9d0 con 0x7fb92c106cf0 2024-06-02T03:59:02.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.670+0000 7fb932ca4700 1 -- 172.21.15.123:0/640408216 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb92c19f450 con 0x7fb92c106cf0 2024-06-02T03:59:02.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.670+0000 7fb929ffb700 1 -- 172.21.15.123:0/640408216 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 13) v1 ==== 45598+0+0 (secure 0 0 0) 0x7fb92401bb30 con 0x7fb92c106cf0 2024-06-02T03:59:02.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.670+0000 7fb932ca4700 1 -- 172.21.15.123:0/640408216 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb92c0fd040 con 0x7fb92c106cf0 2024-06-02T03:59:02.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.670+0000 7fb929ffb700 1 --2- 172.21.15.123:0/640408216 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb91c0389d0 0x7fb91c03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:59:02.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.671+0000 7fb929ffb700 1 -- 172.21.15.123:0/640408216 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb92404d100 con 0x7fb92c106cf0 2024-06-02T03:59:02.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.671+0000 7fb930a40700 1 --2- 172.21.15.123:0/640408216 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb91c0389d0 0x7fb91c03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:59:02.673 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.671+0000 7fb930a40700 1 --2- 172.21.15.123:0/640408216 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb91c0389d0 0x7fb91c03ae90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb920005950 tx=0x7fb92000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:59:02.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.675+0000 7fb929ffb700 1 -- 172.21.15.123:0/640408216 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb9240257a0 con 0x7fb92c106cf0 2024-06-02T03:59:02.878 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:02.878+0000 7fb932ca4700 1 -- 172.21.15.123:0/640408216 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb92c0613e0 con 0x7fb91c0389d0 2024-06-02T03:59:02.931 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Jun 02 03:59:02 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-y[48925]: 2024-06-02T03:59:02.640+0000 7fa9600c6200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-06-02T03:59:02.931 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Jun 02 03:59:02 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-y[48925]: 2024-06-02T03:59:02.837+0000 7fa9600c6200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-06-02T03:59:02.931 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Jun 02 03:59:02 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-y[48925]: 2024-06-02T03:59:02.931+0000 7fa9600c6200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-06-02T03:59:02.931 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:02 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:02.931 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:02 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:02.931 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:02 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:02.931 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:02 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:59:02.931 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:02 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:02.931 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:02 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:59:02.931 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:02 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:03.195 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Jun 02 03:59:02 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-z[48868]: 2024-06-02T03:59:02.820+0000 7f7c35023200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-02T03:59:03.195 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Jun 02 03:59:03 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-z[48868]: 2024-06-02T03:59:03.002+0000 7f7c35023200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-02T03:59:03.196 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:02 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:03.196 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:02 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:03.196 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:02 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:03.196 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:02 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:59:03.196 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:02 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:03.196 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:02 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:59:03.196 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:02 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:03.235 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:02 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:03.235 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:02 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:03.235 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:02 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:03.235 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:02 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:59:03.235 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:02 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:03.236 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:02 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:59:03.236 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:02 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:04.088 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Jun 02 03:59:03 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-y[48925]: 2024-06-02T03:59:03.692+0000 7fa9600c6200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-06-02T03:59:04.088 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Jun 02 03:59:03 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-y[48925]: 2024-06-02T03:59:03.790+0000 7fa9600c6200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-06-02T03:59:04.088 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Jun 02 03:59:03 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-y[48925]: 2024-06-02T03:59:03.939+0000 7fa9600c6200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-06-02T03:59:04.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:03 smithi136 ceph-mon[47443]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:04.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:03 smithi136 ceph-mon[47443]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T03:59:04.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:03 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T03:59:04.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:03 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T03:59:04.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:03 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:04.131 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Jun 02 03:59:03 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-z[48868]: 2024-06-02T03:59:03.195+0000 7f7c35023200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-02T03:59:04.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:03 smithi162 ceph-mon[47009]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:04.131 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:03 smithi162 ceph-mon[47009]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T03:59:04.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:03 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T03:59:04.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:03 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T03:59:04.132 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:03 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:04.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:03 smithi123 ceph-mon[42885]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:04.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:03 smithi123 ceph-mon[42885]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T03:59:04.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:03 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T03:59:04.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:03 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T03:59:04.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:03 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:04.413 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Jun 02 03:59:04 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-z[48868]: 2024-06-02T03:59:04.131+0000 7f7c35023200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-02T03:59:04.413 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Jun 02 03:59:04 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-z[48868]: 2024-06-02T03:59:04.413+0000 7f7c35023200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-02T03:59:04.692 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Jun 02 03:59:04 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-z[48868]: 2024-06-02T03:59:04.502+0000 7f7c35023200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-02T03:59:04.838 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Jun 02 03:59:04 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-y[48925]: 2024-06-02T03:59:04.568+0000 7fa9600c6200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-06-02T03:59:04.838 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Jun 02 03:59:04 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-y[48925]: 2024-06-02T03:59:04.750+0000 7fa9600c6200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-06-02T03:59:05.048 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Jun 02 03:59:04 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-z[48868]: 2024-06-02T03:59:04.692+0000 7f7c35023200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-02T03:59:05.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:04 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/3567913666' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9d8fb5a-dac5-4b14-98e5-665bdbc696ff"}]: dispatch 2024-06-02T03:59:05.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:04 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/3567913666' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9d8fb5a-dac5-4b14-98e5-665bdbc696ff"}]': finished 2024-06-02T03:59:05.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:04 smithi162 ceph-mon[47009]: osdmap e5: 1 total, 0 up, 1 in 2024-06-02T03:59:05.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:04 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T03:59:05.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:04 smithi162 ceph-mon[47009]: Standby manager daemon z started 2024-06-02T03:59:05.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:04 smithi162 ceph-mon[47009]: from='mgr.? 172.21.15.162:0/783179878' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-02T03:59:05.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:04 smithi162 ceph-mon[47009]: from='mgr.? 172.21.15.162:0/783179878' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T03:59:05.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:04 smithi162 ceph-mon[47009]: from='mgr.? 172.21.15.162:0/783179878' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-02T03:59:05.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:04 smithi162 ceph-mon[47009]: from='mgr.? 172.21.15.162:0/783179878' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T03:59:05.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:04 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/3567913666' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9d8fb5a-dac5-4b14-98e5-665bdbc696ff"}]: dispatch 2024-06-02T03:59:05.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:04 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/3567913666' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9d8fb5a-dac5-4b14-98e5-665bdbc696ff"}]': finished 2024-06-02T03:59:05.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:04 smithi123 ceph-mon[42885]: osdmap e5: 1 total, 0 up, 1 in 2024-06-02T03:59:05.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:04 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T03:59:05.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:04 smithi123 ceph-mon[42885]: Standby manager daemon z started 2024-06-02T03:59:05.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:04 smithi123 ceph-mon[42885]: from='mgr.? 172.21.15.162:0/783179878' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-02T03:59:05.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:04 smithi123 ceph-mon[42885]: from='mgr.? 172.21.15.162:0/783179878' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T03:59:05.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:04 smithi123 ceph-mon[42885]: from='mgr.? 172.21.15.162:0/783179878' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-02T03:59:05.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:04 smithi123 ceph-mon[42885]: from='mgr.? 172.21.15.162:0/783179878' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T03:59:05.338 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Jun 02 03:59:04 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-y[48925]: 2024-06-02T03:59:04.946+0000 7fa9600c6200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-06-02T03:59:05.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:04 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/3567913666' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d9d8fb5a-dac5-4b14-98e5-665bdbc696ff"}]: dispatch 2024-06-02T03:59:05.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:04 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/3567913666' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d9d8fb5a-dac5-4b14-98e5-665bdbc696ff"}]': finished 2024-06-02T03:59:05.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:04 smithi136 ceph-mon[47443]: osdmap e5: 1 total, 0 up, 1 in 2024-06-02T03:59:05.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:04 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T03:59:05.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:04 smithi136 ceph-mon[47443]: Standby manager daemon z started 2024-06-02T03:59:05.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:04 smithi136 ceph-mon[47443]: from='mgr.? 172.21.15.162:0/783179878' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-06-02T03:59:05.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:04 smithi136 ceph-mon[47443]: from='mgr.? 172.21.15.162:0/783179878' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T03:59:05.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:04 smithi136 ceph-mon[47443]: from='mgr.? 172.21.15.162:0/783179878' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-06-02T03:59:05.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:04 smithi136 ceph-mon[47443]: from='mgr.? 172.21.15.162:0/783179878' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T03:59:05.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:05.703+0000 7fb929ffb700 1 -- 172.21.15.123:0/640408216 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mgrmap(e 14) v1 ==== 90708+0+0 (secure 0 0 0) 0x7fb9240058e0 con 0x7fb92c106cf0 2024-06-02T03:59:06.166 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Jun 02 03:59:05 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-y[48925]: 2024-06-02T03:59:05.881+0000 7fa9600c6200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-06-02T03:59:06.166 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:05 smithi136 ceph-mon[47443]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:06.166 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:05 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/3480616553' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T03:59:06.166 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:05 smithi136 ceph-mon[47443]: mgrmap e14: x(active, since 58s), standbys: z 2024-06-02T03:59:06.167 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:05 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-02T03:59:06.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:05 smithi162 ceph-mon[47009]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:06.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:05 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/3480616553' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T03:59:06.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:05 smithi162 ceph-mon[47009]: mgrmap e14: x(active, since 58s), standbys: z 2024-06-02T03:59:06.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:05 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-02T03:59:06.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:05 smithi123 ceph-mon[42885]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:06.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:05 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/3480616553' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T03:59:06.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:05 smithi123 ceph-mon[42885]: mgrmap e14: x(active, since 58s), standbys: z 2024-06-02T03:59:06.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:05 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-06-02T03:59:06.444 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Jun 02 03:59:06 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-y[48925]: 2024-06-02T03:59:06.166+0000 7fa9600c6200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-06-02T03:59:06.444 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Jun 02 03:59:06 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-y[48925]: 2024-06-02T03:59:06.254+0000 7fa9600c6200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-06-02T03:59:06.838 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Jun 02 03:59:06 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-y[48925]: 2024-06-02T03:59:06.445+0000 7fa9600c6200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-06-02T03:59:06.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:06.885+0000 7fb929ffb700 1 -- 172.21.15.123:0/640408216 <== mon.0 v2:172.21.15.123:3300/0 8 ==== mgrmap(e 15) v1 ==== 135818+0+0 (secure 0 0 0) 0x7fb92401c3e0 con 0x7fb92c106cf0 2024-06-02T03:59:07.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:06 smithi162 ceph-mon[47009]: Standby manager daemon y started 2024-06-02T03:59:07.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:06 smithi162 ceph-mon[47009]: from='mgr.? 172.21.15.136:0/1871025235' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-02T03:59:07.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:06 smithi162 ceph-mon[47009]: from='mgr.? 172.21.15.136:0/1871025235' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T03:59:07.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:06 smithi162 ceph-mon[47009]: from='mgr.? 172.21.15.136:0/1871025235' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-02T03:59:07.302 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:06 smithi162 ceph-mon[47009]: from='mgr.? 172.21.15.136:0/1871025235' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T03:59:07.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:06 smithi123 ceph-mon[42885]: Standby manager daemon y started 2024-06-02T03:59:07.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:06 smithi123 ceph-mon[42885]: from='mgr.? 172.21.15.136:0/1871025235' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-02T03:59:07.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:06 smithi123 ceph-mon[42885]: from='mgr.? 172.21.15.136:0/1871025235' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T03:59:07.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:06 smithi123 ceph-mon[42885]: from='mgr.? 172.21.15.136:0/1871025235' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-02T03:59:07.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:06 smithi123 ceph-mon[42885]: from='mgr.? 172.21.15.136:0/1871025235' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T03:59:07.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:06 smithi136 ceph-mon[47443]: Standby manager daemon y started 2024-06-02T03:59:07.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:06 smithi136 ceph-mon[47443]: from='mgr.? 172.21.15.136:0/1871025235' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-06-02T03:59:07.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:06 smithi136 ceph-mon[47443]: from='mgr.? 172.21.15.136:0/1871025235' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-06-02T03:59:07.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:06 smithi136 ceph-mon[47443]: from='mgr.? 172.21.15.136:0/1871025235' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-06-02T03:59:07.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:06 smithi136 ceph-mon[47443]: from='mgr.? 172.21.15.136:0/1871025235' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-06-02T03:59:08.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:07 smithi162 ceph-mon[47009]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:08.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:07 smithi162 ceph-mon[47009]: mgrmap e15: x(active, since 60s), standbys: z, y 2024-06-02T03:59:08.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:07 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-02T03:59:08.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:07 smithi123 ceph-mon[42885]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:08.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:07 smithi123 ceph-mon[42885]: mgrmap e15: x(active, since 60s), standbys: z, y 2024-06-02T03:59:08.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:07 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-02T03:59:08.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:07 smithi136 ceph-mon[47443]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:08.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:07 smithi136 ceph-mon[47443]: mgrmap e15: x(active, since 60s), standbys: z, y 2024-06-02T03:59:08.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:07 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-06-02T03:59:10.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:09 smithi123 ceph-mon[42885]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:10.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:09 smithi162 ceph-mon[47009]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:10.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:09 smithi136 ceph-mon[47443]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:11.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:10 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-02T03:59:11.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:10 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:11.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:10 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-02T03:59:11.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:10 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:11.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:10 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-06-02T03:59:11.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:10 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:12.164 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:11 smithi123 ceph-mon[42885]: Deploying daemon osd.0 on smithi123 2024-06-02T03:59:12.164 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:11 smithi123 ceph-mon[42885]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:12.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:11 smithi162 ceph-mon[47009]: Deploying daemon osd.0 on smithi123 2024-06-02T03:59:12.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:11 smithi162 ceph-mon[47009]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:12.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:11 smithi136 ceph-mon[47443]: Deploying daemon osd.0 on smithi123 2024-06-02T03:59:12.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:11 smithi136 ceph-mon[47443]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:14.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:13 smithi162 ceph-mon[47009]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:14.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:13 smithi123 ceph-mon[42885]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:14.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:13 smithi136 ceph-mon[47443]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:15.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:15 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:15.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:15 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:15.511 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:15 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:59:15.512 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:15 smithi123 ceph-mon[42885]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:15.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:15 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:15.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:15 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:15.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:15 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:59:15.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:15 smithi162 ceph-mon[47009]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:15.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:15 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:15.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:15 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:15.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:15 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:59:15.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:15 smithi136 ceph-mon[47443]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:16.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:16.375+0000 7fb929ffb700 1 -- 172.21.15.123:0/640408216 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb92c0613e0 con 0x7fb91c0389d0 2024-06-02T03:59:16.375 INFO:teuthology.orchestra.run.smithi123.stdout:Created osd(s) 0 on host 'smithi123' 2024-06-02T03:59:16.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:16.377+0000 7fb932ca4700 1 -- 172.21.15.123:0/640408216 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb91c0389d0 msgr2=0x7fb91c03ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:59:16.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:16.377+0000 7fb932ca4700 1 --2- 172.21.15.123:0/640408216 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb91c0389d0 0x7fb91c03ae90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb920005950 tx=0x7fb92000b410 comp rx=0 tx=0).stop 2024-06-02T03:59:16.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:16.377+0000 7fb932ca4700 1 -- 172.21.15.123:0/640408216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb92c106cf0 msgr2=0x7fb92c19e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:59:16.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:16.377+0000 7fb932ca4700 1 --2- 172.21.15.123:0/640408216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb92c106cf0 0x7fb92c19e510 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb9240094c0 tx=0x7fb9240094f0 comp rx=0 tx=0).stop 2024-06-02T03:59:16.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:16.377+0000 7fb932ca4700 1 -- 172.21.15.123:0/640408216 shutdown_connections 2024-06-02T03:59:16.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:16.377+0000 7fb932ca4700 1 --2- 172.21.15.123:0/640408216 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb92c106cf0 0x7fb92c19e510 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:59:16.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:16.377+0000 7fb932ca4700 1 --2- 172.21.15.123:0/640408216 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb92c101a90 0x7fb92c196fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:59:16.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:16.377+0000 7fb932ca4700 1 --2- 172.21.15.123:0/640408216 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb91c0389d0 0x7fb91c03ae90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:59:16.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:16.377+0000 7fb932ca4700 1 --2- 172.21.15.123:0/640408216 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb92c1043c0 0x7fb92c1974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:59:16.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:16.377+0000 7fb932ca4700 1 -- 172.21.15.123:0/640408216 >> 172.21.15.123:0/640408216 conn(0x7fb92c0fb4c0 msgr2=0x7fb92c1023d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:59:16.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:16.378+0000 7fb932ca4700 1 -- 172.21.15.123:0/640408216 shutdown_connections 2024-06-02T03:59:16.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:16.378+0000 7fb932ca4700 1 -- 172.21.15.123:0/640408216 wait complete. 2024-06-02T03:59:16.773 DEBUG:teuthology.orchestra.run.smithi123:osd.0> sudo journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.0.service 2024-06-02T03:59:16.775 INFO:tasks.cephadm:Deploying osd.1 on smithi136 with /dev/vg_nvme/lv_4... 2024-06-02T03:59:16.775 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-06-02T03:59:16.807 INFO:journalctl@ceph.osd.0.smithi123.stdout:-- Logs begin at Sun 2024-06-02 03:41:15 UTC. -- 2024-06-02T03:59:16.933 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:16 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:16.933 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:16 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:16.933 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:16 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:16.933 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:16 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:59:16.933 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:16 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:16.933 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:16 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:16.933 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:16 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:16.933 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:16 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:59:17.005 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T03:59:17.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:16 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:17.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:16 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:17.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:16 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:17.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:16 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:59:17.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:16 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:17.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:16 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:17.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:16 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:17.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:16 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:59:17.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:16 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:17.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:16 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:17.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:16 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:17.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:16 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:59:17.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:16 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:17.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:16 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:17.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:16 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:17.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:16 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:59:17.719 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:17 smithi136 ceph-mon[47443]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:18.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:17 smithi162 ceph-mon[47009]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:18.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:17 smithi123 ceph-mon[42885]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:18.227 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-06-02T03:59:18.227 INFO:teuthology.orchestra.run.smithi136.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-06-02T03:59:18.227 INFO:teuthology.orchestra.run.smithi136.stderr: stderr: 10+0 records in 2024-06-02T03:59:18.227 INFO:teuthology.orchestra.run.smithi136.stderr:10+0 records out 2024-06-02T03:59:18.227 INFO:teuthology.orchestra.run.smithi136.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00942352 s, 1.1 GB/s 2024-06-02T03:59:18.227 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping successful for: 2024-06-02T03:59:18.557 INFO:journalctl@ceph.osd.0.smithi123.stdout:Jun 02 03:59:18 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-0[61352]: 2024-06-02T03:59:18.141+0000 7fb0684ed7c0 -1 osd.0 0 log_to_monitors true 2024-06-02T03:59:18.588 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi136:vg_nvme/lv_4 2024-06-02T03:59:18.807 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T03:59:18.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:18 smithi123 ceph-mon[42885]: from='osd.0 [v2:172.21.15.123:6802/2763421276,v1:172.21.15.123:6803/2763421276]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-02T03:59:18.837 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:18 smithi136 ceph-mon[47443]: from='osd.0 [v2:172.21.15.123:6802/2763421276,v1:172.21.15.123:6803/2763421276]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-02T03:59:19.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:18 smithi162 ceph-mon[47009]: from='osd.0 [v2:172.21.15.123:6802/2763421276,v1:172.21.15.123:6803/2763421276]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-06-02T03:59:19.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.803+0000 7fa037b1f700 1 -- 172.21.15.136:0/2476665509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa030102b80 msgr2=0x7fa030109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:59:19.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.803+0000 7fa037b1f700 1 --2- 172.21.15.136:0/2476665509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa030102b80 0x7fa030109430 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa02800b0d0 tx=0x7fa02800b3e0 comp rx=0 tx=0).stop 2024-06-02T03:59:19.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.804+0000 7fa037b1f700 1 -- 172.21.15.136:0/2476665509 shutdown_connections 2024-06-02T03:59:19.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.804+0000 7fa037b1f700 1 --2- 172.21.15.136:0/2476665509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa030102b80 0x7fa030109430 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:59:19.805 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.804+0000 7fa037b1f700 1 --2- 172.21.15.136:0/2476665509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa030100fe0 0x7fa030101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:59:19.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.804+0000 7fa037b1f700 1 --2- 172.21.15.136:0/2476665509 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0301021e0 0x7fa030102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:59:19.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.804+0000 7fa037b1f700 1 -- 172.21.15.136:0/2476665509 >> 172.21.15.136:0/2476665509 conn(0x7fa0300fc580 msgr2=0x7fa0300fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:59:19.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.804+0000 7fa037b1f700 1 -- 172.21.15.136:0/2476665509 shutdown_connections 2024-06-02T03:59:19.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.804+0000 7fa037b1f700 1 -- 172.21.15.136:0/2476665509 wait complete. 2024-06-02T03:59:19.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.804+0000 7fa037b1f700 1 Processor -- start 2024-06-02T03:59:19.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.804+0000 7fa037b1f700 1 -- start start 2024-06-02T03:59:19.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.804+0000 7fa037b1f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa030100fe0 0x7fa030196fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:59:19.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.804+0000 7fa037b1f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0301021e0 0x7fa030197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:59:19.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.804+0000 7fa037b1f700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa030102b80 0x7fa03019e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:59:19.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.804+0000 7fa037b1f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03019ead0 con 0x7fa030100fe0 2024-06-02T03:59:19.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.804+0000 7fa037b1f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03019ec10 con 0x7fa0301021e0 2024-06-02T03:59:19.806 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.804+0000 7fa037b1f700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03019eda0 con 0x7fa030102b80 2024-06-02T03:59:19.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.805+0000 7fa0350ba700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0301021e0 0x7fa030197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:59:19.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.805+0000 7fa0350ba700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0301021e0 0x7fa030197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:59228/0 (socket says 172.21.15.136:59228) 2024-06-02T03:59:19.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.805+0000 7fa0350ba700 1 -- 172.21.15.136:0/1305742457 learned_addr learned my addr 172.21.15.136:0/1305742457 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-06-02T03:59:19.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.805+0000 7fa0358bb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa030100fe0 0x7fa030196fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:59:19.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.805+0000 7fa0360bc700 1 --2- 172.21.15.136:0/1305742457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa030102b80 0x7fa03019e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:59:19.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.805+0000 7fa0350ba700 1 -- 172.21.15.136:0/1305742457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa030102b80 msgr2=0x7fa03019e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:59:19.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.805+0000 7fa0350ba700 1 --2- 172.21.15.136:0/1305742457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa030102b80 0x7fa03019e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:59:19.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.805+0000 7fa0350ba700 1 -- 172.21.15.136:0/1305742457 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa030100fe0 msgr2=0x7fa030196fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:59:19.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.805+0000 7fa0350ba700 1 --2- 172.21.15.136:0/1305742457 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa030100fe0 0x7fa030196fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:59:19.807 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.805+0000 7fa0350ba700 1 -- 172.21.15.136:0/1305742457 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa028009d00 con 0x7fa0301021e0 2024-06-02T03:59:19.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.805+0000 7fa0350ba700 1 --2- 172.21.15.136:0/1305742457 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0301021e0 0x7fa030197520 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa02c00c9b0 tx=0x7fa02c00ccc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:59:19.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.805+0000 7fa026ffd700 1 -- 172.21.15.136:0/1305742457 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c007b00 con 0x7fa0301021e0 2024-06-02T03:59:19.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.805+0000 7fa026ffd700 1 -- 172.21.15.136:0/1305742457 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa02c00ce50 con 0x7fa0301021e0 2024-06-02T03:59:19.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.805+0000 7fa026ffd700 1 -- 172.21.15.136:0/1305742457 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c018660 con 0x7fa0301021e0 2024-06-02T03:59:19.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.805+0000 7fa037b1f700 1 -- 172.21.15.136:0/1305742457 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa03019f080 con 0x7fa0301021e0 2024-06-02T03:59:19.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.805+0000 7fa037b1f700 1 -- 172.21.15.136:0/1305742457 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa03019f530 con 0x7fa0301021e0 2024-06-02T03:59:19.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.806+0000 7fa037b1f700 1 -- 172.21.15.136:0/1305742457 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0301083a0 con 0x7fa0301021e0 2024-06-02T03:59:19.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.807+0000 7fa026ffd700 1 -- 172.21.15.136:0/1305742457 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 15) v1 ==== 135818+0+0 (secure 0 0 0) 0x7fa02c00f450 con 0x7fa0301021e0 2024-06-02T03:59:19.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.808+0000 7fa026ffd700 1 --2- 172.21.15.136:0/1305742457 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa01c0a1110 0x7fa01c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:59:19.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.808+0000 7fa026ffd700 1 -- 172.21.15.136:0/1305742457 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1487+0+0 (secure 0 0 0) 0x7fa02c0cabf0 con 0x7fa0301021e0 2024-06-02T03:59:19.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.808+0000 7fa0358bb700 1 --2- 172.21.15.136:0/1305742457 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa01c0a1110 0x7fa01c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:59:19.809 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.808+0000 7fa0358bb700 1 --2- 172.21.15.136:0/1305742457 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa01c0a1110 0x7fa01c0a35d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa030102040 tx=0x7fa02000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:59:19.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:19.812+0000 7fa026ffd700 1 -- 172.21.15.136:0/1305742457 <== mon.2 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa02c095f10 con 0x7fa0301021e0 2024-06-02T03:59:20.012 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:20.013+0000 7fa037b1f700 1 -- 172.21.15.136:0/1305742457 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fa03002ceb0 con 0x7fa01c0a1110 2024-06-02T03:59:20.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:19 smithi162 ceph-mon[47009]: from='osd.0 [v2:172.21.15.123:6802/2763421276,v1:172.21.15.123:6803/2763421276]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-02T03:59:20.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:19 smithi162 ceph-mon[47009]: osdmap e6: 1 total, 0 up, 1 in 2024-06-02T03:59:20.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:19 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T03:59:20.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:19 smithi162 ceph-mon[47009]: from='osd.0 [v2:172.21.15.123:6802/2763421276,v1:172.21.15.123:6803/2763421276]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-06-02T03:59:20.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:19 smithi162 ceph-mon[47009]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:20.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:19 smithi162 ceph-mon[47009]: Detected new or changed devices on smithi123 2024-06-02T03:59:20.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:19 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:20.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:19 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:20.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:19 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T03:59:20.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:19 smithi162 ceph-mon[47009]: Adjusting osd_memory_target on smithi123 to 17114M 2024-06-02T03:59:20.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:19 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:20.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:19 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:20.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:19 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:59:20.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:19 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:20.072 INFO:journalctl@ceph.osd.0.smithi123.stdout:Jun 02 03:59:19 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-0[61352]: 2024-06-02T03:59:19.647+0000 7fb05db51700 -1 osd.0 0 waiting for initial osdmap 2024-06-02T03:59:20.072 INFO:journalctl@ceph.osd.0.smithi123.stdout:Jun 02 03:59:19 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-0[61352]: 2024-06-02T03:59:19.650+0000 7fb059946700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T03:59:20.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:19 smithi123 ceph-mon[42885]: from='osd.0 [v2:172.21.15.123:6802/2763421276,v1:172.21.15.123:6803/2763421276]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-02T03:59:20.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:19 smithi123 ceph-mon[42885]: osdmap e6: 1 total, 0 up, 1 in 2024-06-02T03:59:20.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:19 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T03:59:20.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:19 smithi123 ceph-mon[42885]: from='osd.0 [v2:172.21.15.123:6802/2763421276,v1:172.21.15.123:6803/2763421276]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-06-02T03:59:20.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:19 smithi123 ceph-mon[42885]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:20.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:19 smithi123 ceph-mon[42885]: Detected new or changed devices on smithi123 2024-06-02T03:59:20.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:19 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:20.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:19 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:20.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:19 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T03:59:20.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:19 smithi123 ceph-mon[42885]: Adjusting osd_memory_target on smithi123 to 17114M 2024-06-02T03:59:20.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:19 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:20.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:19 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:20.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:19 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:59:20.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:19 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:20.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:19 smithi136 ceph-mon[47443]: from='osd.0 [v2:172.21.15.123:6802/2763421276,v1:172.21.15.123:6803/2763421276]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-06-02T03:59:20.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:19 smithi136 ceph-mon[47443]: osdmap e6: 1 total, 0 up, 1 in 2024-06-02T03:59:20.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:19 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T03:59:20.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:19 smithi136 ceph-mon[47443]: from='osd.0 [v2:172.21.15.123:6802/2763421276,v1:172.21.15.123:6803/2763421276]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-06-02T03:59:20.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:19 smithi136 ceph-mon[47443]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:20.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:19 smithi136 ceph-mon[47443]: Detected new or changed devices on smithi123 2024-06-02T03:59:20.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:19 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:20.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:19 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:20.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:19 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T03:59:20.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:19 smithi136 ceph-mon[47443]: Adjusting osd_memory_target on smithi123 to 17114M 2024-06-02T03:59:20.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:19 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:20.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:19 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:20.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:19 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:59:20.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:19 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:20.775 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:20 smithi136 ceph-mon[47443]: from='osd.0 [v2:172.21.15.123:6802/2763421276,v1:172.21.15.123:6803/2763421276]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-06-02T03:59:20.775 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:20 smithi136 ceph-mon[47443]: osdmap e7: 1 total, 0 up, 1 in 2024-06-02T03:59:20.775 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:20 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T03:59:20.775 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:20 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T03:59:20.775 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:20 smithi136 ceph-mon[47443]: from='client.24152 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T03:59:20.775 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:20 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T03:59:20.775 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:20 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T03:59:20.776 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:20 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:21.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:20 smithi162 ceph-mon[47009]: from='osd.0 [v2:172.21.15.123:6802/2763421276,v1:172.21.15.123:6803/2763421276]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-06-02T03:59:21.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:20 smithi162 ceph-mon[47009]: osdmap e7: 1 total, 0 up, 1 in 2024-06-02T03:59:21.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:20 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T03:59:21.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:20 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T03:59:21.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:20 smithi162 ceph-mon[47009]: from='client.24152 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T03:59:21.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:20 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T03:59:21.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:20 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T03:59:21.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:20 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:21.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:20 smithi123 ceph-mon[42885]: from='osd.0 [v2:172.21.15.123:6802/2763421276,v1:172.21.15.123:6803/2763421276]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-06-02T03:59:21.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:20 smithi123 ceph-mon[42885]: osdmap e7: 1 total, 0 up, 1 in 2024-06-02T03:59:21.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:20 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T03:59:21.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:20 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T03:59:21.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:20 smithi123 ceph-mon[42885]: from='client.24152 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T03:59:21.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:20 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T03:59:21.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:20 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T03:59:21.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:20 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:22.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:21 smithi162 ceph-mon[47009]: purged_snaps scrub starts 2024-06-02T03:59:22.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:21 smithi162 ceph-mon[47009]: purged_snaps scrub ok 2024-06-02T03:59:22.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:21 smithi162 ceph-mon[47009]: osd.0 [v2:172.21.15.123:6802/2763421276,v1:172.21.15.123:6803/2763421276] boot 2024-06-02T03:59:22.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:21 smithi162 ceph-mon[47009]: osdmap e8: 1 total, 1 up, 1 in 2024-06-02T03:59:22.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:21 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T03:59:22.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:21 smithi162 ceph-mon[47009]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:22.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:21 smithi123 ceph-mon[42885]: purged_snaps scrub starts 2024-06-02T03:59:22.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:21 smithi123 ceph-mon[42885]: purged_snaps scrub ok 2024-06-02T03:59:22.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:21 smithi123 ceph-mon[42885]: osd.0 [v2:172.21.15.123:6802/2763421276,v1:172.21.15.123:6803/2763421276] boot 2024-06-02T03:59:22.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:21 smithi123 ceph-mon[42885]: osdmap e8: 1 total, 1 up, 1 in 2024-06-02T03:59:22.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:21 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T03:59:22.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:21 smithi123 ceph-mon[42885]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:22.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:21 smithi136 ceph-mon[47443]: purged_snaps scrub starts 2024-06-02T03:59:22.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:21 smithi136 ceph-mon[47443]: purged_snaps scrub ok 2024-06-02T03:59:22.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:21 smithi136 ceph-mon[47443]: osd.0 [v2:172.21.15.123:6802/2763421276,v1:172.21.15.123:6803/2763421276] boot 2024-06-02T03:59:22.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:21 smithi136 ceph-mon[47443]: osdmap e8: 1 total, 1 up, 1 in 2024-06-02T03:59:22.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:21 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-06-02T03:59:22.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:21 smithi136 ceph-mon[47443]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-06-02T03:59:23.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:22 smithi162 ceph-mon[47009]: osdmap e9: 1 total, 1 up, 1 in 2024-06-02T03:59:23.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:22 smithi162 ceph-mon[47009]: from='client.? 172.21.15.136:0/3970714293' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "121bbe3c-bb76-4ec4-9596-37db68fbf1ea"}]: dispatch 2024-06-02T03:59:23.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:22 smithi162 ceph-mon[47009]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "121bbe3c-bb76-4ec4-9596-37db68fbf1ea"}]: dispatch 2024-06-02T03:59:23.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:22 smithi162 ceph-mon[47009]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "121bbe3c-bb76-4ec4-9596-37db68fbf1ea"}]': finished 2024-06-02T03:59:23.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:22 smithi162 ceph-mon[47009]: osdmap e10: 2 total, 1 up, 2 in 2024-06-02T03:59:23.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:22 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T03:59:23.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:22 smithi162 ceph-mon[47009]: from='client.? 172.21.15.136:0/3049150906' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T03:59:23.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:22 smithi123 ceph-mon[42885]: osdmap e9: 1 total, 1 up, 1 in 2024-06-02T03:59:23.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:22 smithi123 ceph-mon[42885]: from='client.? 172.21.15.136:0/3970714293' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "121bbe3c-bb76-4ec4-9596-37db68fbf1ea"}]: dispatch 2024-06-02T03:59:23.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:22 smithi123 ceph-mon[42885]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "121bbe3c-bb76-4ec4-9596-37db68fbf1ea"}]: dispatch 2024-06-02T03:59:23.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:22 smithi123 ceph-mon[42885]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "121bbe3c-bb76-4ec4-9596-37db68fbf1ea"}]': finished 2024-06-02T03:59:23.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:22 smithi123 ceph-mon[42885]: osdmap e10: 2 total, 1 up, 2 in 2024-06-02T03:59:23.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:22 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T03:59:23.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:22 smithi123 ceph-mon[42885]: from='client.? 172.21.15.136:0/3049150906' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T03:59:23.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:22 smithi136 ceph-mon[47443]: osdmap e9: 1 total, 1 up, 1 in 2024-06-02T03:59:23.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:22 smithi136 ceph-mon[47443]: from='client.? 172.21.15.136:0/3970714293' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "121bbe3c-bb76-4ec4-9596-37db68fbf1ea"}]: dispatch 2024-06-02T03:59:23.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:22 smithi136 ceph-mon[47443]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "121bbe3c-bb76-4ec4-9596-37db68fbf1ea"}]: dispatch 2024-06-02T03:59:23.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:22 smithi136 ceph-mon[47443]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "121bbe3c-bb76-4ec4-9596-37db68fbf1ea"}]': finished 2024-06-02T03:59:23.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:22 smithi136 ceph-mon[47443]: osdmap e10: 2 total, 1 up, 2 in 2024-06-02T03:59:23.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:22 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T03:59:23.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:22 smithi136 ceph-mon[47443]: from='client.? 172.21.15.136:0/3049150906' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T03:59:24.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:23 smithi162 ceph-mon[47009]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T03:59:24.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:23 smithi123 ceph-mon[42885]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T03:59:24.087 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:23 smithi136 ceph-mon[47443]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T03:59:25.927 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:25 smithi136 ceph-mon[47443]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T03:59:26.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:25 smithi162 ceph-mon[47009]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T03:59:26.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:25 smithi123 ceph-mon[42885]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T03:59:28.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:27 smithi136 ceph-mon[47443]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T03:59:28.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:27 smithi162 ceph-mon[47009]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T03:59:28.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:27 smithi123 ceph-mon[42885]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T03:59:28.956 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:28 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-02T03:59:28.957 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:28 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:28.957 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:28 smithi136 ceph-mon[47443]: Deploying daemon osd.1 on smithi136 2024-06-02T03:59:29.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:28 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-02T03:59:29.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:28 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:29.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:28 smithi162 ceph-mon[47009]: Deploying daemon osd.1 on smithi136 2024-06-02T03:59:29.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:28 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-06-02T03:59:29.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:28 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:29.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:28 smithi123 ceph-mon[42885]: Deploying daemon osd.1 on smithi136 2024-06-02T03:59:29.958 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:29 smithi136 ceph-mon[47443]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T03:59:30.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:29 smithi162 ceph-mon[47009]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T03:59:30.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:29 smithi123 ceph-mon[42885]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T03:59:32.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:31 smithi162 ceph-mon[47009]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T03:59:32.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:31 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:32.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:31 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:32.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:31 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:59:32.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:31 smithi123 ceph-mon[42885]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T03:59:32.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:31 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:32.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:31 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:32.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:31 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:59:32.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:31 smithi136 ceph-mon[47443]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T03:59:32.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:31 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:32.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:31 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:32.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:31 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:59:33.920 INFO:teuthology.orchestra.run.smithi136.stdout:Created osd(s) 1 on host 'smithi136' 2024-06-02T03:59:33.921 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:33.919+0000 7fa026ffd700 1 -- 172.21.15.136:0/1305742457 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa03002ceb0 con 0x7fa01c0a1110 2024-06-02T03:59:33.922 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:33.922+0000 7fa037b1f700 1 -- 172.21.15.136:0/1305742457 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa01c0a1110 msgr2=0x7fa01c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:59:33.922 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:33.922+0000 7fa037b1f700 1 --2- 172.21.15.136:0/1305742457 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa01c0a1110 0x7fa01c0a35d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa030102040 tx=0x7fa02000b410 comp rx=0 tx=0).stop 2024-06-02T03:59:33.923 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:33.922+0000 7fa037b1f700 1 -- 172.21.15.136:0/1305742457 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0301021e0 msgr2=0x7fa030197520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:59:33.923 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:33.922+0000 7fa037b1f700 1 --2- 172.21.15.136:0/1305742457 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0301021e0 0x7fa030197520 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa02c00c9b0 tx=0x7fa02c00ccc0 comp rx=0 tx=0).stop 2024-06-02T03:59:33.923 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:33.922+0000 7fa037b1f700 1 -- 172.21.15.136:0/1305742457 shutdown_connections 2024-06-02T03:59:33.923 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:33.922+0000 7fa037b1f700 1 --2- 172.21.15.136:0/1305742457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa030102b80 0x7fa03019e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:59:33.923 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:33.922+0000 7fa037b1f700 1 --2- 172.21.15.136:0/1305742457 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa030100fe0 0x7fa030196fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:59:33.923 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:33.922+0000 7fa037b1f700 1 --2- 172.21.15.136:0/1305742457 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa01c0a1110 0x7fa01c0a35d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:59:33.923 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:33.922+0000 7fa037b1f700 1 --2- 172.21.15.136:0/1305742457 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa0301021e0 0x7fa030197520 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:59:33.923 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:33.922+0000 7fa037b1f700 1 -- 172.21.15.136:0/1305742457 >> 172.21.15.136:0/1305742457 conn(0x7fa0300fc580 msgr2=0x7fa0301054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:59:33.923 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:33.922+0000 7fa037b1f700 1 -- 172.21.15.136:0/1305742457 shutdown_connections 2024-06-02T03:59:33.923 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T03:59:33.922+0000 7fa037b1f700 1 -- 172.21.15.136:0/1305742457 wait complete. 2024-06-02T03:59:34.222 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:33 smithi136 ceph-mon[47443]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T03:59:34.223 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:33 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:34.223 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:33 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:34.223 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:33 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:34.223 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:33 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:59:34.223 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:33 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:34.223 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:33 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:34.223 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:33 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:59:34.223 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:33 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:34.289 DEBUG:teuthology.orchestra.run.smithi136:osd.1> sudo journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.1.service 2024-06-02T03:59:34.292 INFO:tasks.cephadm:Deploying osd.2 on smithi162 with /dev/vg_nvme/lv_4... 2024-06-02T03:59:34.292 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-06-02T03:59:34.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:33 smithi162 ceph-mon[47009]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T03:59:34.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:33 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:34.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:33 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:34.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:33 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:34.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:33 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:59:34.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:33 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:34.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:33 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:34.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:33 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:59:34.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:33 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:34.322 INFO:journalctl@ceph.osd.1.smithi136.stdout:-- Logs begin at Sun 2024-06-02 03:40:52 UTC. -- 2024-06-02T03:59:34.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:33 smithi123 ceph-mon[42885]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T03:59:34.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:33 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:34.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:33 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:34.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:33 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:34.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:33 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:59:34.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:33 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:34.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:33 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:34.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:33 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:59:34.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:33 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:34.523 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T03:59:35.838 INFO:journalctl@ceph.osd.1.smithi136.stdout:Jun 02 03:59:35 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-1[52466]: 2024-06-02T03:59:35.485+0000 7feb054ce7c0 -1 osd.1 0 log_to_monitors true 2024-06-02T03:59:35.898 INFO:teuthology.orchestra.run.smithi162.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-06-02T03:59:35.898 INFO:teuthology.orchestra.run.smithi162.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-06-02T03:59:35.898 INFO:teuthology.orchestra.run.smithi162.stderr: stderr: 10+0 records in 2024-06-02T03:59:35.898 INFO:teuthology.orchestra.run.smithi162.stderr:10+0 records out 2024-06-02T03:59:35.898 INFO:teuthology.orchestra.run.smithi162.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.015648 s, 670 MB/s 2024-06-02T03:59:35.898 INFO:teuthology.orchestra.run.smithi162.stderr:--> Zapping successful for: 2024-06-02T03:59:36.214 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:35 smithi162 ceph-mon[47009]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T03:59:36.215 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:35 smithi162 ceph-mon[47009]: from='osd.1 [v2:172.21.15.136:6800/956325510,v1:172.21.15.136:6801/956325510]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-02T03:59:36.215 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:35 smithi162 ceph-mon[47009]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-02T03:59:36.235 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi162:vg_nvme/lv_4 2024-06-02T03:59:36.283 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:35 smithi136 ceph-mon[47443]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T03:59:36.283 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:35 smithi136 ceph-mon[47443]: from='osd.1 [v2:172.21.15.136:6800/956325510,v1:172.21.15.136:6801/956325510]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-02T03:59:36.283 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:35 smithi136 ceph-mon[47443]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-02T03:59:36.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:35 smithi123 ceph-mon[42885]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T03:59:36.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:35 smithi123 ceph-mon[42885]: from='osd.1 [v2:172.21.15.136:6800/956325510,v1:172.21.15.136:6801/956325510]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-02T03:59:36.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:35 smithi123 ceph-mon[42885]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-06-02T03:59:36.496 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T03:59:37.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:36 smithi162 ceph-mon[47009]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-02T03:59:37.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:36 smithi162 ceph-mon[47009]: osdmap e11: 2 total, 1 up, 2 in 2024-06-02T03:59:37.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:36 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T03:59:37.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:36 smithi162 ceph-mon[47009]: from='osd.1 [v2:172.21.15.136:6800/956325510,v1:172.21.15.136:6801/956325510]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-06-02T03:59:37.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:36 smithi162 ceph-mon[47009]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-06-02T03:59:37.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:36 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:37.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:36 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:37.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:36 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T03:59:37.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:36 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:37.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:36 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:37.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:36 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:59:37.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:36 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:37.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:36 smithi123 ceph-mon[42885]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-02T03:59:37.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:36 smithi123 ceph-mon[42885]: osdmap e11: 2 total, 1 up, 2 in 2024-06-02T03:59:37.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:36 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T03:59:37.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:36 smithi123 ceph-mon[42885]: from='osd.1 [v2:172.21.15.136:6800/956325510,v1:172.21.15.136:6801/956325510]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-06-02T03:59:37.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:36 smithi123 ceph-mon[42885]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-06-02T03:59:37.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:36 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:37.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:36 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:37.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:36 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T03:59:37.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:36 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:37.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:36 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:37.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:36 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:59:37.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:36 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:37.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:36 smithi136 ceph-mon[47443]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-06-02T03:59:37.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:36 smithi136 ceph-mon[47443]: osdmap e11: 2 total, 1 up, 2 in 2024-06-02T03:59:37.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:36 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T03:59:37.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:36 smithi136 ceph-mon[47443]: from='osd.1 [v2:172.21.15.136:6800/956325510,v1:172.21.15.136:6801/956325510]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-06-02T03:59:37.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:36 smithi136 ceph-mon[47443]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-06-02T03:59:37.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:36 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:37.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:36 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:37.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:36 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T03:59:37.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:36 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:37.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:36 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:37.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:36 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:59:37.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:36 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:37.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.524+0000 7f0a71e94700 1 -- 172.21.15.162:0/3342376840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a6c101060 msgr2=0x7f0a6c1014e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:59:37.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.524+0000 7f0a71e94700 1 --2- 172.21.15.162:0/3342376840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a6c101060 0x7f0a6c1014e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c009990 tx=0x7f0a5c009ca0 comp rx=0 tx=0).stop 2024-06-02T03:59:37.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.524+0000 7f0a71e94700 1 -- 172.21.15.162:0/3342376840 shutdown_connections 2024-06-02T03:59:37.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.524+0000 7f0a71e94700 1 --2- 172.21.15.162:0/3342376840 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a6c101a20 0x7f0a6c108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:59:37.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.524+0000 7f0a71e94700 1 --2- 172.21.15.162:0/3342376840 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a6c0fff00 0x7f0a6c100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:59:37.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.524+0000 7f0a71e94700 1 --2- 172.21.15.162:0/3342376840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a6c101060 0x7f0a6c1014e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:59:37.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.524+0000 7f0a71e94700 1 -- 172.21.15.162:0/3342376840 >> 172.21.15.162:0/3342376840 conn(0x7f0a6c0fb4c0 msgr2=0x7f0a6c0fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:59:37.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.524+0000 7f0a71e94700 1 -- 172.21.15.162:0/3342376840 shutdown_connections 2024-06-02T03:59:37.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.524+0000 7f0a71e94700 1 -- 172.21.15.162:0/3342376840 wait complete. 2024-06-02T03:59:37.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.525+0000 7f0a71e94700 1 Processor -- start 2024-06-02T03:59:37.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.525+0000 7f0a71e94700 1 -- start start 2024-06-02T03:59:37.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.525+0000 7f0a71e94700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a6c0fff00 0x7f0a6c069ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:59:37.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.525+0000 7f0a71e94700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a6c101060 0x7f0a6c19bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:59:37.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.525+0000 7f0a71e94700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a6c101a20 0x7f0a6c19e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:59:37.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.525+0000 7f0a71e94700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c19e920 con 0x7f0a6c101a20 2024-06-02T03:59:37.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.525+0000 7f0a71e94700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c19ea90 con 0x7f0a6c101060 2024-06-02T03:59:37.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.525+0000 7f0a71e94700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c19ec50 con 0x7f0a6c0fff00 2024-06-02T03:59:37.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.525+0000 7f0a6b7fe700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a6c0fff00 0x7f0a6c069ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:59:37.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.525+0000 7f0a6b7fe700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a6c0fff00 0x7f0a6c069ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:36758/0 (socket says 172.21.15.162:36758) 2024-06-02T03:59:37.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.525+0000 7f0a6b7fe700 1 -- 172.21.15.162:0/3284283753 learned_addr learned my addr 172.21.15.162:0/3284283753 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-06-02T03:59:37.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.525+0000 7f0a6affd700 1 --2- 172.21.15.162:0/3284283753 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a6c101060 0x7f0a6c19bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:59:37.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.525+0000 7f0a6bfff700 1 --2- 172.21.15.162:0/3284283753 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a6c101a20 0x7f0a6c19e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:59:37.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.525+0000 7f0a6b7fe700 1 -- 172.21.15.162:0/3284283753 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a6c101060 msgr2=0x7f0a6c19bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:59:37.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.525+0000 7f0a6b7fe700 1 --2- 172.21.15.162:0/3284283753 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a6c101060 0x7f0a6c19bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:59:37.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.525+0000 7f0a6b7fe700 1 -- 172.21.15.162:0/3284283753 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a6c101a20 msgr2=0x7f0a6c19e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:59:37.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.525+0000 7f0a6b7fe700 1 --2- 172.21.15.162:0/3284283753 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a6c101a20 0x7f0a6c19e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:59:37.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.525+0000 7f0a6b7fe700 1 -- 172.21.15.162:0/3284283753 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5c0095f0 con 0x7f0a6c0fff00 2024-06-02T03:59:37.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.526+0000 7f0a6b7fe700 1 --2- 172.21.15.162:0/3284283753 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a6c0fff00 0x7f0a6c069ca0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0a6000e9a0 tx=0x7f0a6000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:59:37.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.526+0000 7f0a68ff9700 1 -- 172.21.15.162:0/3284283753 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a60009790 con 0x7f0a6c0fff00 2024-06-02T03:59:37.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.526+0000 7f0a68ff9700 1 -- 172.21.15.162:0/3284283753 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a6000cbd0 con 0x7f0a6c0fff00 2024-06-02T03:59:37.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.526+0000 7f0a71e94700 1 -- 172.21.15.162:0/3284283753 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a6c19ef30 con 0x7f0a6c0fff00 2024-06-02T03:59:37.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.526+0000 7f0a68ff9700 1 -- 172.21.15.162:0/3284283753 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a60018680 con 0x7f0a6c0fff00 2024-06-02T03:59:37.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.526+0000 7f0a71e94700 1 -- 172.21.15.162:0/3284283753 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a6c19f3a0 con 0x7f0a6c0fff00 2024-06-02T03:59:37.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.527+0000 7f0a71e94700 1 -- 172.21.15.162:0/3284283753 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a6c1073d0 con 0x7f0a6c0fff00 2024-06-02T03:59:37.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.528+0000 7f0a68ff9700 1 -- 172.21.15.162:0/3284283753 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 15) v1 ==== 135818+0+0 (secure 0 0 0) 0x7f0a6000cd40 con 0x7f0a6c0fff00 2024-06-02T03:59:37.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.528+0000 7f0a68ff9700 1 --2- 172.21.15.162:0/3284283753 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0a540a1090 0x7f0a540a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:59:37.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.529+0000 7f0a68ff9700 1 -- 172.21.15.162:0/3284283753 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2029+0+0 (secure 0 0 0) 0x7f0a60014070 con 0x7f0a6c0fff00 2024-06-02T03:59:37.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.529+0000 7f0a6affd700 1 --2- 172.21.15.162:0/3284283753 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0a540a1090 0x7f0a540a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:59:37.534 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.529+0000 7f0a6affd700 1 --2- 172.21.15.162:0/3284283753 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0a540a1090 0x7f0a540a3550 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c00b2e0 tx=0x7f0a5c00b750 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:59:37.534 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.533+0000 7f0a68ff9700 1 -- 172.21.15.162:0/3284283753 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0a60052d60 con 0x7f0a6c0fff00 2024-06-02T03:59:37.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:37.735+0000 7f0a71e94700 1 -- 172.21.15.162:0/3284283753 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a6c02ce90 con 0x7f0a540a1090 2024-06-02T03:59:37.838 INFO:journalctl@ceph.osd.1.smithi136.stdout:Jun 02 03:59:37 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-1[52466]: 2024-06-02T03:59:37.437+0000 7feafab32700 -1 osd.1 0 waiting for initial osdmap 2024-06-02T03:59:37.838 INFO:journalctl@ceph.osd.1.smithi136.stdout:Jun 02 03:59:37 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-1[52466]: 2024-06-02T03:59:37.440+0000 7feaf291f700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T03:59:38.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:37 smithi162 ceph-mon[47009]: Detected new or changed devices on smithi136 2024-06-02T03:59:38.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:37 smithi162 ceph-mon[47009]: Adjusting osd_memory_target on smithi136 to 17113M 2024-06-02T03:59:38.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:37 smithi162 ceph-mon[47009]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T03:59:38.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:37 smithi162 ceph-mon[47009]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-06-02T03:59:38.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:37 smithi162 ceph-mon[47009]: osdmap e12: 2 total, 1 up, 2 in 2024-06-02T03:59:38.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:37 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T03:59:38.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:37 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T03:59:38.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:37 smithi162 ceph-mon[47009]: from='osd.1 ' entity='osd.1' 2024-06-02T03:59:38.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:37 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T03:59:38.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:37 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T03:59:38.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:37 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:38.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:37 smithi123 ceph-mon[42885]: Detected new or changed devices on smithi136 2024-06-02T03:59:38.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:37 smithi123 ceph-mon[42885]: Adjusting osd_memory_target on smithi136 to 17113M 2024-06-02T03:59:38.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:37 smithi123 ceph-mon[42885]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T03:59:38.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:37 smithi123 ceph-mon[42885]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-06-02T03:59:38.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:37 smithi123 ceph-mon[42885]: osdmap e12: 2 total, 1 up, 2 in 2024-06-02T03:59:38.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:37 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T03:59:38.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:37 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T03:59:38.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:37 smithi123 ceph-mon[42885]: from='osd.1 ' entity='osd.1' 2024-06-02T03:59:38.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:37 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T03:59:38.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:37 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T03:59:38.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:37 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:38.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:37 smithi136 ceph-mon[47443]: Detected new or changed devices on smithi136 2024-06-02T03:59:38.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:37 smithi136 ceph-mon[47443]: Adjusting osd_memory_target on smithi136 to 17113M 2024-06-02T03:59:38.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:37 smithi136 ceph-mon[47443]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T03:59:38.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:37 smithi136 ceph-mon[47443]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-06-02T03:59:38.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:37 smithi136 ceph-mon[47443]: osdmap e12: 2 total, 1 up, 2 in 2024-06-02T03:59:38.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:37 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T03:59:38.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:37 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T03:59:38.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:37 smithi136 ceph-mon[47443]: from='osd.1 ' entity='osd.1' 2024-06-02T03:59:38.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:37 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T03:59:38.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:37 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T03:59:38.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:37 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:39.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:38 smithi162 ceph-mon[47009]: purged_snaps scrub starts 2024-06-02T03:59:39.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:38 smithi162 ceph-mon[47009]: purged_snaps scrub ok 2024-06-02T03:59:39.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:38 smithi162 ceph-mon[47009]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T03:59:39.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:38 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T03:59:39.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:38 smithi162 ceph-mon[47009]: osd.1 [v2:172.21.15.136:6800/956325510,v1:172.21.15.136:6801/956325510] boot 2024-06-02T03:59:39.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:38 smithi162 ceph-mon[47009]: osdmap e13: 2 total, 2 up, 2 in 2024-06-02T03:59:39.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:38 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T03:59:39.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:38 smithi123 ceph-mon[42885]: purged_snaps scrub starts 2024-06-02T03:59:39.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:38 smithi123 ceph-mon[42885]: purged_snaps scrub ok 2024-06-02T03:59:39.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:38 smithi123 ceph-mon[42885]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T03:59:39.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:38 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T03:59:39.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:38 smithi123 ceph-mon[42885]: osd.1 [v2:172.21.15.136:6800/956325510,v1:172.21.15.136:6801/956325510] boot 2024-06-02T03:59:39.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:38 smithi123 ceph-mon[42885]: osdmap e13: 2 total, 2 up, 2 in 2024-06-02T03:59:39.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:38 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T03:59:39.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:38 smithi136 ceph-mon[47443]: purged_snaps scrub starts 2024-06-02T03:59:39.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:38 smithi136 ceph-mon[47443]: purged_snaps scrub ok 2024-06-02T03:59:39.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:38 smithi136 ceph-mon[47443]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T03:59:39.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:38 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T03:59:39.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:38 smithi136 ceph-mon[47443]: osd.1 [v2:172.21.15.136:6800/956325510,v1:172.21.15.136:6801/956325510] boot 2024-06-02T03:59:39.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:38 smithi136 ceph-mon[47443]: osdmap e13: 2 total, 2 up, 2 in 2024-06-02T03:59:39.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:38 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-06-02T03:59:40.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:39 smithi162 ceph-mon[47009]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T03:59:40.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:39 smithi162 ceph-mon[47009]: osdmap e14: 2 total, 2 up, 2 in 2024-06-02T03:59:40.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:39 smithi162 ceph-mon[47009]: from='client.? 172.21.15.162:0/2539623692' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df9edf0d-f9f0-4699-a6ed-bbcf2dfb1b76"}]: dispatch 2024-06-02T03:59:40.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:39 smithi162 ceph-mon[47009]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df9edf0d-f9f0-4699-a6ed-bbcf2dfb1b76"}]: dispatch 2024-06-02T03:59:40.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:39 smithi162 ceph-mon[47009]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df9edf0d-f9f0-4699-a6ed-bbcf2dfb1b76"}]': finished 2024-06-02T03:59:40.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:39 smithi162 ceph-mon[47009]: osdmap e15: 3 total, 2 up, 3 in 2024-06-02T03:59:40.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:39 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T03:59:40.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:39 smithi123 ceph-mon[42885]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T03:59:40.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:39 smithi123 ceph-mon[42885]: osdmap e14: 2 total, 2 up, 2 in 2024-06-02T03:59:40.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:39 smithi123 ceph-mon[42885]: from='client.? 172.21.15.162:0/2539623692' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df9edf0d-f9f0-4699-a6ed-bbcf2dfb1b76"}]: dispatch 2024-06-02T03:59:40.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:39 smithi123 ceph-mon[42885]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df9edf0d-f9f0-4699-a6ed-bbcf2dfb1b76"}]: dispatch 2024-06-02T03:59:40.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:39 smithi123 ceph-mon[42885]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df9edf0d-f9f0-4699-a6ed-bbcf2dfb1b76"}]': finished 2024-06-02T03:59:40.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:39 smithi123 ceph-mon[42885]: osdmap e15: 3 total, 2 up, 3 in 2024-06-02T03:59:40.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:39 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T03:59:40.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:39 smithi136 ceph-mon[47443]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-06-02T03:59:40.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:39 smithi136 ceph-mon[47443]: osdmap e14: 2 total, 2 up, 2 in 2024-06-02T03:59:40.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:39 smithi136 ceph-mon[47443]: from='client.? 172.21.15.162:0/2539623692' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df9edf0d-f9f0-4699-a6ed-bbcf2dfb1b76"}]: dispatch 2024-06-02T03:59:40.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:39 smithi136 ceph-mon[47443]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "df9edf0d-f9f0-4699-a6ed-bbcf2dfb1b76"}]: dispatch 2024-06-02T03:59:40.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:39 smithi136 ceph-mon[47443]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "df9edf0d-f9f0-4699-a6ed-bbcf2dfb1b76"}]': finished 2024-06-02T03:59:40.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:39 smithi136 ceph-mon[47443]: osdmap e15: 3 total, 2 up, 3 in 2024-06-02T03:59:40.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:39 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T03:59:41.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:40 smithi162 ceph-mon[47009]: from='client.? 172.21.15.162:0/1731507736' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T03:59:41.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:40 smithi123 ceph-mon[42885]: from='client.? 172.21.15.162:0/1731507736' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T03:59:41.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:40 smithi136 ceph-mon[47443]: from='client.? 172.21.15.162:0/1731507736' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T03:59:42.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:41 smithi162 ceph-mon[47009]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T03:59:42.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:41 smithi123 ceph-mon[42885]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T03:59:42.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:41 smithi136 ceph-mon[47443]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T03:59:44.244 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:43 smithi162 ceph-mon[47009]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T03:59:44.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:43 smithi123 ceph-mon[42885]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T03:59:44.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:43 smithi136 ceph-mon[47443]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T03:59:46.275 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:45 smithi162 ceph-mon[47009]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T03:59:46.275 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:45 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-02T03:59:46.275 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:45 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:46.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:45 smithi123 ceph-mon[42885]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T03:59:46.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:45 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-02T03:59:46.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:45 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:46.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:45 smithi136 ceph-mon[47443]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T03:59:46.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-06-02T03:59:46.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:47.279 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:46 smithi162 ceph-mon[47009]: Deploying daemon osd.2 on smithi162 2024-06-02T03:59:47.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:46 smithi123 ceph-mon[42885]: Deploying daemon osd.2 on smithi162 2024-06-02T03:59:47.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:46 smithi136 ceph-mon[47443]: Deploying daemon osd.2 on smithi162 2024-06-02T03:59:48.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:47 smithi162 ceph-mon[47009]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T03:59:48.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:47 smithi123 ceph-mon[42885]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T03:59:48.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:47 smithi136 ceph-mon[47443]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T03:59:50.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:49 smithi162 ceph-mon[47009]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T03:59:50.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:49 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:50.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:49 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:59:50.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:49 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:50.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:49 smithi123 ceph-mon[42885]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T03:59:50.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:49 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:50.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:49 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:59:50.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:49 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:50.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:49 smithi136 ceph-mon[47443]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T03:59:50.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:49 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:50.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:49 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:59:50.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:49 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:51.428 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:51 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:51.428 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:51 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:51.428 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:51 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:51.428 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:51 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:59:51.428 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:51 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:51.428 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:51 smithi162 ceph-mon[47009]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T03:59:51.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:51.488+0000 7f0a68ff9700 1 -- 172.21.15.162:0/3284283753 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0a6c02ce90 con 0x7f0a540a1090 2024-06-02T03:59:51.488 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 2 on host 'smithi162' 2024-06-02T03:59:51.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:51.491+0000 7f0a71e94700 1 -- 172.21.15.162:0/3284283753 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0a540a1090 msgr2=0x7f0a540a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:59:51.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:51.491+0000 7f0a71e94700 1 --2- 172.21.15.162:0/3284283753 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0a540a1090 0x7f0a540a3550 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c00b2e0 tx=0x7f0a5c00b750 comp rx=0 tx=0).stop 2024-06-02T03:59:51.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:51.491+0000 7f0a71e94700 1 -- 172.21.15.162:0/3284283753 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a6c0fff00 msgr2=0x7f0a6c069ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:59:51.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:51.491+0000 7f0a71e94700 1 --2- 172.21.15.162:0/3284283753 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a6c0fff00 0x7f0a6c069ca0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0a6000e9a0 tx=0x7f0a6000ecb0 comp rx=0 tx=0).stop 2024-06-02T03:59:51.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:51.491+0000 7f0a71e94700 1 -- 172.21.15.162:0/3284283753 shutdown_connections 2024-06-02T03:59:51.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:51.491+0000 7f0a71e94700 1 --2- 172.21.15.162:0/3284283753 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0a6c101a20 0x7f0a6c19e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:59:51.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:51.491+0000 7f0a71e94700 1 --2- 172.21.15.162:0/3284283753 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a6c0fff00 0x7f0a6c069ca0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:59:51.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:51.491+0000 7f0a71e94700 1 --2- 172.21.15.162:0/3284283753 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0a540a1090 0x7f0a540a3550 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:59:51.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:51.491+0000 7f0a71e94700 1 --2- 172.21.15.162:0/3284283753 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a6c101060 0x7f0a6c19bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:59:51.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:51.491+0000 7f0a71e94700 1 -- 172.21.15.162:0/3284283753 >> 172.21.15.162:0/3284283753 conn(0x7f0a6c0fb4c0 msgr2=0x7f0a6c104510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:59:51.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:51.491+0000 7f0a71e94700 1 -- 172.21.15.162:0/3284283753 shutdown_connections 2024-06-02T03:59:51.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T03:59:51.491+0000 7f0a71e94700 1 -- 172.21.15.162:0/3284283753 wait complete. 2024-06-02T03:59:51.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:51 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:51.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:51 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:51.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:51 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:51.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:51 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:59:51.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:51 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:51.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:51 smithi123 ceph-mon[42885]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T03:59:51.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:51 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:51.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:51 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:51.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:51 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:51.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:51 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:59:51.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:51 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:51.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:51 smithi136 ceph-mon[47443]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T03:59:51.936 DEBUG:teuthology.orchestra.run.smithi162:osd.2> sudo journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.2.service 2024-06-02T03:59:51.938 INFO:tasks.cephadm:Deploying osd.3 on smithi123 with /dev/vg_nvme/lv_3... 2024-06-02T03:59:51.938 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-06-02T03:59:51.970 INFO:journalctl@ceph.osd.2.smithi162.stdout:-- Logs begin at Sun 2024-06-02 03:41:09 UTC. -- 2024-06-02T03:59:52.172 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T03:59:52.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:52 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:52.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:52 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:52.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:52 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:59:52.700 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:52 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:52.700 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:52 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:52.700 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:52 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:59:52.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:52 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:52.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:52 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:52.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:52 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T03:59:53.516 INFO:teuthology.orchestra.run.smithi123.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-06-02T03:59:53.516 INFO:teuthology.orchestra.run.smithi123.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-06-02T03:59:53.516 INFO:teuthology.orchestra.run.smithi123.stderr: stderr: 10+0 records in 2024-06-02T03:59:53.516 INFO:teuthology.orchestra.run.smithi123.stderr:10+0 records out 2024-06-02T03:59:53.516 INFO:teuthology.orchestra.run.smithi123.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110784 s, 947 MB/s 2024-06-02T03:59:53.516 INFO:teuthology.orchestra.run.smithi123.stderr:--> Zapping successful for: 2024-06-02T03:59:53.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:53 smithi162 ceph-mon[47009]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T03:59:53.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:53 smithi162 ceph-mon[47009]: from='osd.2 [v2:172.21.15.162:6800/2915749676,v1:172.21.15.162:6801/2915749676]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-02T03:59:53.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:53 smithi162 ceph-mon[47009]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-02T03:59:53.549 INFO:journalctl@ceph.osd.2.smithi162.stdout:Jun 02 03:59:53 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-2[52825]: 2024-06-02T03:59:53.243+0000 7f73babed7c0 -1 osd.2 0 log_to_monitors true 2024-06-02T03:59:53.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:53 smithi123 ceph-mon[42885]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T03:59:53.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:53 smithi123 ceph-mon[42885]: from='osd.2 [v2:172.21.15.162:6800/2915749676,v1:172.21.15.162:6801/2915749676]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-02T03:59:53.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:53 smithi123 ceph-mon[42885]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-02T03:59:53.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:53 smithi136 ceph-mon[47443]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T03:59:53.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:53 smithi136 ceph-mon[47443]: from='osd.2 [v2:172.21.15.162:6800/2915749676,v1:172.21.15.162:6801/2915749676]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-02T03:59:53.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:53 smithi136 ceph-mon[47443]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-06-02T03:59:53.876 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi123:vg_nvme/lv_3 2024-06-02T03:59:54.098 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T03:59:54.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:54 smithi162 ceph-mon[47009]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-02T03:59:54.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:54 smithi162 ceph-mon[47009]: osdmap e16: 3 total, 2 up, 3 in 2024-06-02T03:59:54.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:54 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T03:59:54.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:54 smithi162 ceph-mon[47009]: from='osd.2 [v2:172.21.15.162:6800/2915749676,v1:172.21.15.162:6801/2915749676]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-06-02T03:59:54.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:54 smithi162 ceph-mon[47009]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-06-02T03:59:54.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:54 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:54.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:54 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:54.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:54 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T03:59:54.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:54 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:54.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:54 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:54.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:54 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:59:54.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:54 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:54.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:54 smithi123 ceph-mon[42885]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-02T03:59:54.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:54 smithi123 ceph-mon[42885]: osdmap e16: 3 total, 2 up, 3 in 2024-06-02T03:59:54.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:54 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T03:59:54.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:54 smithi123 ceph-mon[42885]: from='osd.2 [v2:172.21.15.162:6800/2915749676,v1:172.21.15.162:6801/2915749676]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-06-02T03:59:54.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:54 smithi123 ceph-mon[42885]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-06-02T03:59:54.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:54 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:54.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:54 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:54.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:54 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T03:59:54.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:54 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:54.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:54 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:54.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:54 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:59:54.824 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:54 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:54.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:54 smithi136 ceph-mon[47443]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-06-02T03:59:54.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:54 smithi136 ceph-mon[47443]: osdmap e16: 3 total, 2 up, 3 in 2024-06-02T03:59:54.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:54 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T03:59:54.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:54 smithi136 ceph-mon[47443]: from='osd.2 [v2:172.21.15.162:6800/2915749676,v1:172.21.15.162:6801/2915749676]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-06-02T03:59:54.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:54 smithi136 ceph-mon[47443]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-06-02T03:59:54.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:54 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:54.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:54 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:54.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:54 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T03:59:54.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:54 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:54.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:54 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:54.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:54 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T03:59:54.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:54 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:55.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.049+0000 7fe57ba03700 1 -- 172.21.15.123:0/4245144752 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5740fff00 msgr2=0x7fe574100320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:59:55.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.049+0000 7fe57ba03700 1 --2- 172.21.15.123:0/4245144752 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5740fff00 0x7fe574100320 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe56c00b0a0 tx=0x7fe56c00b3b0 comp rx=0 tx=0).stop 2024-06-02T03:59:55.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.049+0000 7fe57ba03700 1 -- 172.21.15.123:0/4245144752 shutdown_connections 2024-06-02T03:59:55.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.049+0000 7fe57ba03700 1 --2- 172.21.15.123:0/4245144752 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe574101a20 0x7fe574108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:59:55.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.049+0000 7fe57ba03700 1 --2- 172.21.15.123:0/4245144752 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe5740fff00 0x7fe574100320 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:59:55.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.049+0000 7fe57ba03700 1 --2- 172.21.15.123:0/4245144752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe574101060 0x7fe5741014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:59:55.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.049+0000 7fe57ba03700 1 -- 172.21.15.123:0/4245144752 >> 172.21.15.123:0/4245144752 conn(0x7fe5740fb4c0 msgr2=0x7fe5740fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T03:59:55.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.049+0000 7fe57ba03700 1 -- 172.21.15.123:0/4245144752 shutdown_connections 2024-06-02T03:59:55.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.049+0000 7fe57ba03700 1 -- 172.21.15.123:0/4245144752 wait complete. 2024-06-02T03:59:55.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.050+0000 7fe57ba03700 1 Processor -- start 2024-06-02T03:59:55.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.050+0000 7fe57ba03700 1 -- start start 2024-06-02T03:59:55.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.050+0000 7fe57ba03700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe5740fff00 0x7fe574199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:59:55.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.050+0000 7fe57ba03700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe574101060 0x7fe574199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:59:55.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.050+0000 7fe57ba03700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe574101a20 0x7fe5741a0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:59:55.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.050+0000 7fe57ba03700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5741a0e60 con 0x7fe574101060 2024-06-02T03:59:55.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.050+0000 7fe57ba03700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5741a0fa0 con 0x7fe5740fff00 2024-06-02T03:59:55.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.050+0000 7fe57ba03700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5741a1130 con 0x7fe574101a20 2024-06-02T03:59:55.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.050+0000 7fe578f9e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe574101060 0x7fe574199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:59:55.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.050+0000 7fe578f9e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe574101060 0x7fe574199860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:36216/0 (socket says 172.21.15.123:36216) 2024-06-02T03:59:55.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.050+0000 7fe578f9e700 1 -- 172.21.15.123:0/2168591853 learned_addr learned my addr 172.21.15.123:0/2168591853 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T03:59:55.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.050+0000 7fe579fa0700 1 --2- 172.21.15.123:0/2168591853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe574101a20 0x7fe5741a0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:59:55.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.050+0000 7fe57979f700 1 --2- 172.21.15.123:0/2168591853 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe5740fff00 0x7fe574199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:59:55.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.050+0000 7fe578f9e700 1 -- 172.21.15.123:0/2168591853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe574101a20 msgr2=0x7fe5741a0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:59:55.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.050+0000 7fe578f9e700 1 --2- 172.21.15.123:0/2168591853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe574101a20 0x7fe5741a0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:59:55.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.050+0000 7fe578f9e700 1 -- 172.21.15.123:0/2168591853 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe5740fff00 msgr2=0x7fe574199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T03:59:55.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.050+0000 7fe578f9e700 1 --2- 172.21.15.123:0/2168591853 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe5740fff00 0x7fe574199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T03:59:55.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.050+0000 7fe578f9e700 1 -- 172.21.15.123:0/2168591853 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56c009d00 con 0x7fe574101060 2024-06-02T03:59:55.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.051+0000 7fe578f9e700 1 --2- 172.21.15.123:0/2168591853 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe574101060 0x7fe574199860 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe56800d980 tx=0x7fe56800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:59:55.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.051+0000 7fe5727fc700 1 -- 172.21.15.123:0/2168591853 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe568009b40 con 0x7fe574101060 2024-06-02T03:59:55.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.051+0000 7fe5727fc700 1 -- 172.21.15.123:0/2168591853 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe56800b6e0 con 0x7fe574101060 2024-06-02T03:59:55.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.051+0000 7fe57ba03700 1 -- 172.21.15.123:0/2168591853 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5741a1410 con 0x7fe574101060 2024-06-02T03:59:55.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.051+0000 7fe5727fc700 1 -- 172.21.15.123:0/2168591853 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56800f620 con 0x7fe574101060 2024-06-02T03:59:55.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.051+0000 7fe57ba03700 1 -- 172.21.15.123:0/2168591853 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5741a1960 con 0x7fe574101060 2024-06-02T03:59:55.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.052+0000 7fe57ba03700 1 -- 172.21.15.123:0/2168591853 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe57404ec60 con 0x7fe574101060 2024-06-02T03:59:55.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.053+0000 7fe5727fc700 1 -- 172.21.15.123:0/2168591853 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 15) v1 ==== 135818+0+0 (secure 0 0 0) 0x7fe568010460 con 0x7fe574101060 2024-06-02T03:59:55.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.053+0000 7fe5727fc700 1 --2- 172.21.15.123:0/2168591853 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe55c0a1110 0x7fe55c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T03:59:55.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.053+0000 7fe57979f700 1 --2- 172.21.15.123:0/2168591853 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe55c0a1110 0x7fe55c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T03:59:55.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.053+0000 7fe5727fc700 1 -- 172.21.15.123:0/2168591853 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 2571+0+0 (secure 0 0 0) 0x7fe5680cb180 con 0x7fe574101060 2024-06-02T03:59:55.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.054+0000 7fe57979f700 1 --2- 172.21.15.123:0/2168591853 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe55c0a1110 0x7fe55c0a35d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe56c007a60 tx=0x7fe56c006230 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T03:59:55.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.057+0000 7fe5727fc700 1 -- 172.21.15.123:0/2168591853 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe568096060 con 0x7fe574101060 2024-06-02T03:59:55.258 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T03:59:55.258+0000 7fe57ba03700 1 -- 172.21.15.123:0/2168591853 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fe574069960 con 0x7fe55c0a1110 2024-06-02T03:59:55.298 INFO:journalctl@ceph.osd.2.smithi162.stdout:Jun 02 03:59:54 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-2[52825]: 2024-06-02T03:59:54.911+0000 7f73b0251700 -1 osd.2 0 waiting for initial osdmap 2024-06-02T03:59:55.298 INFO:journalctl@ceph.osd.2.smithi162.stdout:Jun 02 03:59:54 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-2[52825]: 2024-06-02T03:59:54.915+0000 7f73a803e700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T03:59:55.772 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:55 smithi123 ceph-mon[42885]: Detected new or changed devices on smithi162 2024-06-02T03:59:55.772 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:55 smithi123 ceph-mon[42885]: Adjusting osd_memory_target on smithi162 to 17114M 2024-06-02T03:59:55.772 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:55 smithi123 ceph-mon[42885]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-06-02T03:59:55.772 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:55 smithi123 ceph-mon[42885]: osdmap e17: 3 total, 2 up, 3 in 2024-06-02T03:59:55.772 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:55 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T03:59:55.772 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:55 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T03:59:55.773 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:55 smithi123 ceph-mon[42885]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T03:59:55.773 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:55 smithi123 ceph-mon[42885]: from='osd.2 ' entity='osd.2' 2024-06-02T03:59:55.773 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:55 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T03:59:55.773 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:55 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T03:59:55.773 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:55 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:55.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:55 smithi162 ceph-mon[47009]: Detected new or changed devices on smithi162 2024-06-02T03:59:55.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:55 smithi162 ceph-mon[47009]: Adjusting osd_memory_target on smithi162 to 17114M 2024-06-02T03:59:55.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:55 smithi162 ceph-mon[47009]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-06-02T03:59:55.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:55 smithi162 ceph-mon[47009]: osdmap e17: 3 total, 2 up, 3 in 2024-06-02T03:59:55.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:55 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T03:59:55.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:55 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T03:59:55.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:55 smithi162 ceph-mon[47009]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T03:59:55.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:55 smithi162 ceph-mon[47009]: from='osd.2 ' entity='osd.2' 2024-06-02T03:59:55.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:55 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T03:59:55.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:55 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T03:59:55.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:55 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:55.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:55 smithi136 ceph-mon[47443]: Detected new or changed devices on smithi162 2024-06-02T03:59:55.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:55 smithi136 ceph-mon[47443]: Adjusting osd_memory_target on smithi162 to 17114M 2024-06-02T03:59:55.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:55 smithi136 ceph-mon[47443]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-06-02T03:59:55.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:55 smithi136 ceph-mon[47443]: osdmap e17: 3 total, 2 up, 3 in 2024-06-02T03:59:55.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:55 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T03:59:55.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:55 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T03:59:55.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:55 smithi136 ceph-mon[47443]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-06-02T03:59:55.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:55 smithi136 ceph-mon[47443]: from='osd.2 ' entity='osd.2' 2024-06-02T03:59:55.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:55 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T03:59:55.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:55 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T03:59:55.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:55 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T03:59:56.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:56 smithi162 ceph-mon[47009]: purged_snaps scrub starts 2024-06-02T03:59:56.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:56 smithi162 ceph-mon[47009]: purged_snaps scrub ok 2024-06-02T03:59:56.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:56 smithi162 ceph-mon[47009]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T03:59:56.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:56 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T03:59:56.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:56 smithi162 ceph-mon[47009]: osd.2 [v2:172.21.15.162:6800/2915749676,v1:172.21.15.162:6801/2915749676] boot 2024-06-02T03:59:56.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:56 smithi162 ceph-mon[47009]: osdmap e18: 3 total, 3 up, 3 in 2024-06-02T03:59:56.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:56 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T03:59:56.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:56 smithi123 ceph-mon[42885]: purged_snaps scrub starts 2024-06-02T03:59:56.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:56 smithi123 ceph-mon[42885]: purged_snaps scrub ok 2024-06-02T03:59:56.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:56 smithi123 ceph-mon[42885]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T03:59:56.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:56 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T03:59:56.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:56 smithi123 ceph-mon[42885]: osd.2 [v2:172.21.15.162:6800/2915749676,v1:172.21.15.162:6801/2915749676] boot 2024-06-02T03:59:56.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:56 smithi123 ceph-mon[42885]: osdmap e18: 3 total, 3 up, 3 in 2024-06-02T03:59:56.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:56 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T03:59:56.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:56 smithi136 ceph-mon[47443]: purged_snaps scrub starts 2024-06-02T03:59:56.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:56 smithi136 ceph-mon[47443]: purged_snaps scrub ok 2024-06-02T03:59:56.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:56 smithi136 ceph-mon[47443]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T03:59:56.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:56 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T03:59:56.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:56 smithi136 ceph-mon[47443]: osd.2 [v2:172.21.15.162:6800/2915749676,v1:172.21.15.162:6801/2915749676] boot 2024-06-02T03:59:56.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:56 smithi136 ceph-mon[47443]: osdmap e18: 3 total, 3 up, 3 in 2024-06-02T03:59:56.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:56 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-06-02T03:59:57.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:57 smithi162 ceph-mon[47009]: pgmap v63: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-02T03:59:57.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:57 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-06-02T03:59:57.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:57 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/1879733387' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e070364-12c6-4780-b2be-f6e933e65773"}]: dispatch 2024-06-02T03:59:57.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:57 smithi162 ceph-mon[47009]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e070364-12c6-4780-b2be-f6e933e65773"}]: dispatch 2024-06-02T03:59:57.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:57 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-06-02T03:59:57.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:57 smithi162 ceph-mon[47009]: osdmap e19: 3 total, 3 up, 3 in 2024-06-02T03:59:57.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:57 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-06-02T03:59:57.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:57 smithi162 ceph-mon[47009]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3e070364-12c6-4780-b2be-f6e933e65773"}]': finished 2024-06-02T03:59:57.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:57 smithi162 ceph-mon[47009]: osdmap e20: 4 total, 3 up, 4 in 2024-06-02T03:59:57.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:57 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T03:59:57.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:57 smithi123 ceph-mon[42885]: pgmap v63: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-02T03:59:57.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:57 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-06-02T03:59:57.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:57 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1879733387' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e070364-12c6-4780-b2be-f6e933e65773"}]: dispatch 2024-06-02T03:59:57.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:57 smithi123 ceph-mon[42885]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e070364-12c6-4780-b2be-f6e933e65773"}]: dispatch 2024-06-02T03:59:57.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:57 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-06-02T03:59:57.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:57 smithi123 ceph-mon[42885]: osdmap e19: 3 total, 3 up, 3 in 2024-06-02T03:59:57.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:57 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-06-02T03:59:57.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:57 smithi123 ceph-mon[42885]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3e070364-12c6-4780-b2be-f6e933e65773"}]': finished 2024-06-02T03:59:57.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:57 smithi123 ceph-mon[42885]: osdmap e20: 4 total, 3 up, 4 in 2024-06-02T03:59:57.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:57 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T03:59:57.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:57 smithi136 ceph-mon[47443]: pgmap v63: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-02T03:59:57.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:57 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-06-02T03:59:57.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:57 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/1879733387' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e070364-12c6-4780-b2be-f6e933e65773"}]: dispatch 2024-06-02T03:59:57.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:57 smithi136 ceph-mon[47443]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3e070364-12c6-4780-b2be-f6e933e65773"}]: dispatch 2024-06-02T03:59:57.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:57 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-06-02T03:59:57.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:57 smithi136 ceph-mon[47443]: osdmap e19: 3 total, 3 up, 3 in 2024-06-02T03:59:57.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:57 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-06-02T03:59:57.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:57 smithi136 ceph-mon[47443]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3e070364-12c6-4780-b2be-f6e933e65773"}]': finished 2024-06-02T03:59:57.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:57 smithi136 ceph-mon[47443]: osdmap e20: 4 total, 3 up, 4 in 2024-06-02T03:59:57.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:57 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T03:59:58.674 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:58 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/3582508849' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T03:59:58.674 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:58 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-06-02T03:59:58.675 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:58 smithi123 ceph-mon[42885]: osdmap e21: 4 total, 3 up, 4 in 2024-06-02T03:59:58.675 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:58 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T03:59:58.675 INFO:journalctl@ceph.osd.0.smithi123.stdout:Jun 02 03:59:58 smithi123 sudo[67293]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-02T03:59:58.675 INFO:journalctl@ceph.osd.0.smithi123.stdout:Jun 02 03:59:58 smithi123 sudo[67293]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T03:59:58.675 INFO:journalctl@ceph.osd.0.smithi123.stdout:Jun 02 03:59:58 smithi123 sudo[67293]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T03:59:58.675 INFO:journalctl@ceph.osd.0.smithi123.stdout:Jun 02 03:59:58 smithi123 sudo[67293]: pam_unix(sudo:session): session closed for user root 2024-06-02T03:59:58.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:58 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/3582508849' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T03:59:58.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:58 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-06-02T03:59:58.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:58 smithi162 ceph-mon[47009]: osdmap e21: 4 total, 3 up, 4 in 2024-06-02T03:59:58.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:58 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T03:59:58.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:58 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/3582508849' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T03:59:58.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:58 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-06-02T03:59:58.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:58 smithi136 ceph-mon[47443]: osdmap e21: 4 total, 3 up, 4 in 2024-06-02T03:59:58.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:58 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T03:59:59.072 INFO:journalctl@ceph.osd.0.smithi123.stdout:Jun 02 03:59:58 smithi123 sudo[67480]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-02T03:59:59.072 INFO:journalctl@ceph.osd.0.smithi123.stdout:Jun 02 03:59:58 smithi123 sudo[67480]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T03:59:59.072 INFO:journalctl@ceph.osd.0.smithi123.stdout:Jun 02 03:59:58 smithi123 sudo[67480]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T03:59:59.072 INFO:journalctl@ceph.osd.0.smithi123.stdout:Jun 02 03:59:58 smithi123 sudo[67480]: pam_unix(sudo:session): session closed for user root 2024-06-02T03:59:59.188 INFO:journalctl@ceph.osd.1.smithi136.stdout:Jun 02 03:59:58 smithi136 sudo[58052]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-02T03:59:59.188 INFO:journalctl@ceph.osd.1.smithi136.stdout:Jun 02 03:59:58 smithi136 sudo[58052]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T03:59:59.189 INFO:journalctl@ceph.osd.1.smithi136.stdout:Jun 02 03:59:58 smithi136 sudo[58052]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T03:59:59.189 INFO:journalctl@ceph.osd.1.smithi136.stdout:Jun 02 03:59:58 smithi136 sudo[58052]: pam_unix(sudo:session): session closed for user root 2024-06-02T03:59:59.189 INFO:journalctl@ceph.osd.1.smithi136.stdout:Jun 02 03:59:59 smithi136 sudo[58055]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-02T03:59:59.189 INFO:journalctl@ceph.osd.1.smithi136.stdout:Jun 02 03:59:59 smithi136 sudo[58055]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T03:59:59.189 INFO:journalctl@ceph.osd.1.smithi136.stdout:Jun 02 03:59:59 smithi136 sudo[58055]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T03:59:59.588 INFO:journalctl@ceph.osd.1.smithi136.stdout:Jun 02 03:59:59 smithi136 sudo[58055]: pam_unix(sudo:session): session closed for user root 2024-06-02T03:59:59.704 INFO:journalctl@ceph.osd.2.smithi162.stdout:Jun 02 03:59:59 smithi162 sudo[57647]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-02T03:59:59.704 INFO:journalctl@ceph.osd.2.smithi162.stdout:Jun 02 03:59:59 smithi162 sudo[57647]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T03:59:59.704 INFO:journalctl@ceph.osd.2.smithi162.stdout:Jun 02 03:59:59 smithi162 sudo[57647]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T03:59:59.704 INFO:journalctl@ceph.osd.2.smithi162.stdout:Jun 02 03:59:59 smithi162 sudo[57647]: pam_unix(sudo:session): session closed for user root 2024-06-02T03:59:59.704 INFO:journalctl@ceph.osd.2.smithi162.stdout:Jun 02 03:59:59 smithi162 sudo[57650]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-02T03:59:59.705 INFO:journalctl@ceph.osd.2.smithi162.stdout:Jun 02 03:59:59 smithi162 sudo[57650]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T03:59:59.705 INFO:journalctl@ceph.osd.2.smithi162.stdout:Jun 02 03:59:59 smithi162 sudo[57650]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T03:59:59.705 INFO:journalctl@ceph.osd.2.smithi162.stdout:Jun 02 03:59:59 smithi162 sudo[57650]: pam_unix(sudo:session): session closed for user root 2024-06-02T03:59:59.959 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:59 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T03:59:59.960 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:59 smithi123 ceph-mon[42885]: pgmap v67: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-02T03:59:59.960 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:59 smithi123 ceph-mon[42885]: osdmap e22: 4 total, 3 up, 4 in 2024-06-02T03:59:59.960 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:59 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T03:59:59.960 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:59 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:00.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:59 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:00.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:59 smithi162 ceph-mon[47009]: pgmap v67: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-02T04:00:00.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:59 smithi162 ceph-mon[47009]: osdmap e22: 4 total, 3 up, 4 in 2024-06-02T04:00:00.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:59 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T04:00:00.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 03:59:59 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:00.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:59 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:00.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:59 smithi136 ceph-mon[47443]: pgmap v67: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-02T04:00:00.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:59 smithi136 ceph-mon[47443]: osdmap e22: 4 total, 3 up, 4 in 2024-06-02T04:00:00.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:59 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T04:00:00.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 03:59:59 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:00.212 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:59 smithi123 sudo[68040]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-02T04:00:00.212 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:59 smithi123 sudo[68040]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T04:00:00.213 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:59 smithi123 sudo[68040]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T04:00:00.213 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 03:59:59 smithi123 sudo[68040]: pam_unix(sudo:session): session closed for user root 2024-06-02T04:00:00.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:00.225+0000 7fe5727fc700 1 -- 172.21.15.123:0/2168591853 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fe568010710 con 0x7fe574101060 2024-06-02T04:00:00.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:00 smithi123 sudo[68245]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-02T04:00:00.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:00 smithi123 sudo[68245]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T04:00:00.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:00 smithi123 sudo[68245]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T04:00:00.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:00 smithi123 sudo[68245]: pam_unix(sudo:session): session closed for user root 2024-06-02T04:00:00.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:00 smithi162 sudo[57653]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-02T04:00:00.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:00 smithi162 sudo[57653]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T04:00:00.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:00 smithi162 sudo[57653]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T04:00:00.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:00 smithi162 sudo[57653]: pam_unix(sudo:session): session closed for user root 2024-06-02T04:00:00.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:00 smithi162 sudo[57656]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-02T04:00:00.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:00 smithi162 sudo[57656]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T04:00:00.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:00 smithi162 sudo[57656]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T04:00:00.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:00 smithi162 sudo[57656]: pam_unix(sudo:session): session closed for user root 2024-06-02T04:00:01.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:00 smithi136 sudo[58058]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-06-02T04:00:01.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:00 smithi136 sudo[58058]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T04:00:01.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:00 smithi136 sudo[58058]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T04:00:01.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:00 smithi136 sudo[58058]: pam_unix(sudo:session): session closed for user root 2024-06-02T04:00:01.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:01 smithi136 sudo[58061]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-06-02T04:00:01.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:01 smithi136 sudo[58061]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-06-02T04:00:01.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:01 smithi136 sudo[58061]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-06-02T04:00:01.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:01 smithi136 sudo[58061]: pam_unix(sudo:session): session closed for user root 2024-06-02T04:00:01.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:01.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:01 smithi136 ceph-mon[47443]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T04:00:01.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:01 smithi136 ceph-mon[47443]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T04:00:01.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:01 smithi136 ceph-mon[47443]: overall HEALTH_OK 2024-06-02T04:00:01.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T04:00:01.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:00:01.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:00:01.340 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:01 smithi136 ceph-mon[47443]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T04:00:01.340 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:01 smithi136 ceph-mon[47443]: mgrmap e16: x(active, since 113s), standbys: z, y 2024-06-02T04:00:01.340 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T04:00:01.340 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:00:01.340 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:00:01.340 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:01 smithi136 ceph-mon[47443]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T04:00:01.340 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T04:00:01.340 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:00:01.340 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:00:01.543 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:01.543 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:01 smithi123 ceph-mon[42885]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T04:00:01.543 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:01 smithi123 ceph-mon[42885]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T04:00:01.543 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:01 smithi123 ceph-mon[42885]: overall HEALTH_OK 2024-06-02T04:00:01.543 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T04:00:01.543 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:00:01.543 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:00:01.544 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:01 smithi123 ceph-mon[42885]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T04:00:01.544 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:01 smithi123 ceph-mon[42885]: mgrmap e16: x(active, since 113s), standbys: z, y 2024-06-02T04:00:01.544 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T04:00:01.544 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:00:01.544 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:00:01.544 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:01 smithi123 ceph-mon[42885]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T04:00:01.544 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T04:00:01.544 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:00:01.544 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:00:01.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:01.550 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:01 smithi162 ceph-mon[47009]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T04:00:01.550 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:01 smithi162 ceph-mon[47009]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T04:00:01.550 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:01 smithi162 ceph-mon[47009]: overall HEALTH_OK 2024-06-02T04:00:01.550 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T04:00:01.550 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:00:01.550 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:00:01.550 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:01 smithi162 ceph-mon[47009]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T04:00:01.550 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:01 smithi162 ceph-mon[47009]: mgrmap e16: x(active, since 113s), standbys: z, y 2024-06-02T04:00:01.550 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T04:00:01.550 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:00:01.551 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:00:01.551 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:01 smithi162 ceph-mon[47009]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T04:00:01.551 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-06-02T04:00:01.551 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-06-02T04:00:01.551 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-06-02T04:00:02.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:02 smithi162 ceph-mon[47009]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T04:00:02.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:02 smithi162 ceph-mon[47009]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-02T04:00:02.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:02 smithi162 ceph-mon[47009]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T04:00:02.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:02 smithi123 ceph-mon[42885]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T04:00:02.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:02 smithi123 ceph-mon[42885]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-02T04:00:02.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:02 smithi123 ceph-mon[42885]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T04:00:02.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:02 smithi136 ceph-mon[47443]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-06-02T04:00:02.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:02 smithi136 ceph-mon[47443]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-02T04:00:02.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:02 smithi136 ceph-mon[47443]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-06-02T04:00:03.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:03 smithi123 ceph-mon[42885]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-02T04:00:03.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:03 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-02T04:00:03.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:03 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:03.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:03 smithi162 ceph-mon[47009]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-02T04:00:03.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:03 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-02T04:00:03.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:03 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:03.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:03 smithi136 ceph-mon[47443]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-06-02T04:00:03.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:03 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-06-02T04:00:03.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:03 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:04.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:04 smithi162 ceph-mon[47009]: Deploying daemon osd.3 on smithi123 2024-06-02T04:00:04.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:04 smithi123 ceph-mon[42885]: Deploying daemon osd.3 on smithi123 2024-06-02T04:00:04.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:04 smithi136 ceph-mon[47443]: Deploying daemon osd.3 on smithi123 2024-06-02T04:00:05.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:05 smithi162 ceph-mon[47009]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 229 KiB/s wr, 15 op/s 2024-06-02T04:00:05.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:05 smithi123 ceph-mon[42885]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 229 KiB/s wr, 15 op/s 2024-06-02T04:00:05.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:05 smithi136 ceph-mon[47443]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 4.7 KiB/s rd, 229 KiB/s wr, 15 op/s 2024-06-02T04:00:07.926 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:07 smithi123 ceph-mon[42885]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 3.5 KiB/s rd, 170 KiB/s wr, 11 op/s 2024-06-02T04:00:07.927 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:07 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:07.927 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:07 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:07.927 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:07 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:00:08.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:07 smithi162 ceph-mon[47009]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 3.5 KiB/s rd, 170 KiB/s wr, 11 op/s 2024-06-02T04:00:08.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:07 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:08.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:07 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:08.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:07 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:00:08.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:07 smithi136 ceph-mon[47443]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 3.5 KiB/s rd, 170 KiB/s wr, 11 op/s 2024-06-02T04:00:08.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:07 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:08.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:07 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:08.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:07 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:00:09.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:09.152+0000 7fe5727fc700 1 -- 172.21.15.123:0/2168591853 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe574069960 con 0x7fe55c0a1110 2024-06-02T04:00:09.152 INFO:teuthology.orchestra.run.smithi123.stdout:Created osd(s) 3 on host 'smithi123' 2024-06-02T04:00:09.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:09.155+0000 7fe57ba03700 1 -- 172.21.15.123:0/2168591853 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe55c0a1110 msgr2=0x7fe55c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:00:09.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:09.155+0000 7fe57ba03700 1 --2- 172.21.15.123:0/2168591853 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe55c0a1110 0x7fe55c0a35d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe56c007a60 tx=0x7fe56c006230 comp rx=0 tx=0).stop 2024-06-02T04:00:09.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:09.155+0000 7fe57ba03700 1 -- 172.21.15.123:0/2168591853 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe574101060 msgr2=0x7fe574199860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:00:09.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:09.155+0000 7fe57ba03700 1 --2- 172.21.15.123:0/2168591853 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe574101060 0x7fe574199860 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe56800d980 tx=0x7fe56800dc90 comp rx=0 tx=0).stop 2024-06-02T04:00:09.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:09.155+0000 7fe57ba03700 1 -- 172.21.15.123:0/2168591853 shutdown_connections 2024-06-02T04:00:09.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:09.155+0000 7fe57ba03700 1 --2- 172.21.15.123:0/2168591853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe574101a20 0x7fe5741a0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:00:09.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:09.155+0000 7fe57ba03700 1 --2- 172.21.15.123:0/2168591853 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe55c0a1110 0x7fe55c0a35d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:00:09.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:09.155+0000 7fe57ba03700 1 --2- 172.21.15.123:0/2168591853 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe5740fff00 0x7fe574199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:00:09.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:09.155+0000 7fe57ba03700 1 --2- 172.21.15.123:0/2168591853 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe574101060 0x7fe574199860 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:00:09.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:09.155+0000 7fe57ba03700 1 -- 172.21.15.123:0/2168591853 >> 172.21.15.123:0/2168591853 conn(0x7fe5740fb4c0 msgr2=0x7fe574069250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:00:09.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:09.155+0000 7fe57ba03700 1 -- 172.21.15.123:0/2168591853 shutdown_connections 2024-06-02T04:00:09.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:09.155+0000 7fe57ba03700 1 -- 172.21.15.123:0/2168591853 wait complete. 2024-06-02T04:00:09.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:09 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:09.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:09 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:09.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:09 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:09.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:09 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:00:09.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:09 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:09.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:09 smithi136 ceph-mon[47443]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 135 KiB/s wr, 9 op/s 2024-06-02T04:00:09.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:09 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:09.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:09 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:09.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:09 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:00:09.696 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:09 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:09.696 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:09 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:09.696 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:09 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:09.696 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:09 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:00:09.696 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:09 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:09.696 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:09 smithi123 ceph-mon[42885]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 135 KiB/s wr, 9 op/s 2024-06-02T04:00:09.696 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:09 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:09.696 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:09 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:09.696 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:09 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:00:09.698 DEBUG:teuthology.orchestra.run.smithi123:osd.3> sudo journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.3.service 2024-06-02T04:00:09.700 INFO:tasks.cephadm:Deploying osd.4 on smithi136 with /dev/vg_nvme/lv_3... 2024-06-02T04:00:09.700 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-06-02T04:00:09.729 INFO:journalctl@ceph.osd.3.smithi123.stdout:-- Logs begin at Sun 2024-06-02 03:41:15 UTC. -- 2024-06-02T04:00:09.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:09 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:09.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:09 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:09.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:09 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:09.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:09 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:00:09.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:09 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:09.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:09 smithi162 ceph-mon[47009]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 2.8 KiB/s rd, 135 KiB/s wr, 9 op/s 2024-06-02T04:00:09.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:09 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:09.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:09 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:09.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:09 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:00:09.936 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T04:00:11.277 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-06-02T04:00:11.277 INFO:teuthology.orchestra.run.smithi136.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-06-02T04:00:11.277 INFO:teuthology.orchestra.run.smithi136.stderr: stderr: 10+0 records in 2024-06-02T04:00:11.277 INFO:teuthology.orchestra.run.smithi136.stderr:10+0 records out 2024-06-02T04:00:11.278 INFO:teuthology.orchestra.run.smithi136.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00730373 s, 1.4 GB/s 2024-06-02T04:00:11.278 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping successful for: 2024-06-02T04:00:11.323 INFO:journalctl@ceph.osd.3.smithi123.stdout:Jun 02 04:00:10 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-3[69256]: 2024-06-02T04:00:10.842+0000 7ff6d3d707c0 -1 osd.3 0 log_to_monitors true 2024-06-02T04:00:11.611 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi136:vg_nvme/lv_3 2024-06-02T04:00:11.830 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T04:00:12.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:11 smithi123 ceph-mon[42885]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 112 KiB/s wr, 7 op/s 2024-06-02T04:00:12.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:11 smithi123 ceph-mon[42885]: from='osd.3 [v2:172.21.15.123:6810/1403773143,v1:172.21.15.123:6811/1403773143]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-02T04:00:12.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:11 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:12.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:11 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:12.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:11 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:00:12.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:11 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:00:12.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:11 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:12.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:11 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:12.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:11 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:00:12.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:11 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:12.109 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:11 smithi136 ceph-mon[47443]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 112 KiB/s wr, 7 op/s 2024-06-02T04:00:12.110 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:11 smithi136 ceph-mon[47443]: from='osd.3 [v2:172.21.15.123:6810/1403773143,v1:172.21.15.123:6811/1403773143]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-02T04:00:12.110 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:11 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:12.110 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:11 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:12.110 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:11 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:00:12.110 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:11 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:00:12.110 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:11 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:12.110 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:11 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:12.110 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:11 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:00:12.110 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:11 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:12.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:11 smithi162 ceph-mon[47009]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 2.3 KiB/s rd, 112 KiB/s wr, 7 op/s 2024-06-02T04:00:12.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:11 smithi162 ceph-mon[47009]: from='osd.3 [v2:172.21.15.123:6810/1403773143,v1:172.21.15.123:6811/1403773143]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-06-02T04:00:12.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:11 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:12.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:11 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:12.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:11 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:00:12.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:11 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:00:12.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:11 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:12.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:11 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:12.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:11 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:00:12.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:11 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:12.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.808+0000 7fb4b7820700 1 -- 172.21.15.136:0/209902978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4b0101060 msgr2=0x7fb4b01014e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:00:12.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.808+0000 7fb4b7820700 1 --2- 172.21.15.136:0/209902978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4b0101060 0x7fb4b01014e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb4a0009990 tx=0x7fb4a0009ca0 comp rx=0 tx=0).stop 2024-06-02T04:00:12.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.809+0000 7fb4b7820700 1 -- 172.21.15.136:0/209902978 shutdown_connections 2024-06-02T04:00:12.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.809+0000 7fb4b7820700 1 --2- 172.21.15.136:0/209902978 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4b0101a20 0x7fb4b0108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:00:12.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.809+0000 7fb4b7820700 1 --2- 172.21.15.136:0/209902978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4b00fff00 0x7fb4b0100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:00:12.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.809+0000 7fb4b7820700 1 --2- 172.21.15.136:0/209902978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4b0101060 0x7fb4b01014e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:00:12.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.809+0000 7fb4b7820700 1 -- 172.21.15.136:0/209902978 >> 172.21.15.136:0/209902978 conn(0x7fb4b00fb4a0 msgr2=0x7fb4b00fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:00:12.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.809+0000 7fb4b7820700 1 -- 172.21.15.136:0/209902978 shutdown_connections 2024-06-02T04:00:12.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.809+0000 7fb4b7820700 1 -- 172.21.15.136:0/209902978 wait complete. 2024-06-02T04:00:12.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.809+0000 7fb4b7820700 1 Processor -- start 2024-06-02T04:00:12.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.809+0000 7fb4b7820700 1 -- start start 2024-06-02T04:00:12.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.810+0000 7fb4b7820700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4b00fff00 0x7fb4b0196f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:00:12.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.810+0000 7fb4b7820700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4b0101060 0x7fb4b01974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:00:12.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.810+0000 7fb4b7820700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4b0101a20 0x7fb4b019e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:00:12.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.810+0000 7fb4b7820700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b019ea70 con 0x7fb4b0101a20 2024-06-02T04:00:12.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.810+0000 7fb4b7820700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b019ebb0 con 0x7fb4b0101060 2024-06-02T04:00:12.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.810+0000 7fb4b7820700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b019ed40 con 0x7fb4b00fff00 2024-06-02T04:00:12.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.810+0000 7fb4b4dbb700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4b0101060 0x7fb4b01974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:00:12.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.810+0000 7fb4b4dbb700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4b0101060 0x7fb4b01974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:56212/0 (socket says 172.21.15.136:56212) 2024-06-02T04:00:12.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.810+0000 7fb4b4dbb700 1 -- 172.21.15.136:0/1166857494 learned_addr learned my addr 172.21.15.136:0/1166857494 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-06-02T04:00:12.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.810+0000 7fb4b5dbd700 1 --2- 172.21.15.136:0/1166857494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4b0101a20 0x7fb4b019e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:00:12.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.810+0000 7fb4b55bc700 1 --2- 172.21.15.136:0/1166857494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4b00fff00 0x7fb4b0196f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:00:12.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.810+0000 7fb4b4dbb700 1 -- 172.21.15.136:0/1166857494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4b00fff00 msgr2=0x7fb4b0196f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:00:12.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.810+0000 7fb4b4dbb700 1 --2- 172.21.15.136:0/1166857494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4b00fff00 0x7fb4b0196f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:00:12.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.810+0000 7fb4b4dbb700 1 -- 172.21.15.136:0/1166857494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4b0101a20 msgr2=0x7fb4b019e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:00:12.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.810+0000 7fb4b4dbb700 1 --2- 172.21.15.136:0/1166857494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4b0101a20 0x7fb4b019e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:00:12.813 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.810+0000 7fb4b4dbb700 1 -- 172.21.15.136:0/1166857494 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a00095f0 con 0x7fb4b0101060 2024-06-02T04:00:12.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.810+0000 7fb4b55bc700 1 --2- 172.21.15.136:0/1166857494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4b00fff00 0x7fb4b0196f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:00:12.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.810+0000 7fb4b4dbb700 1 --2- 172.21.15.136:0/1166857494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4b0101060 0x7fb4b01974c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb4a000c010 tx=0x7fb4a0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:00:12.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.810+0000 7fb4a67fc700 1 -- 172.21.15.136:0/1166857494 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a001d070 con 0x7fb4b0101060 2024-06-02T04:00:12.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.810+0000 7fb4a67fc700 1 -- 172.21.15.136:0/1166857494 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb4a00054f0 con 0x7fb4b0101060 2024-06-02T04:00:12.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.810+0000 7fb4a67fc700 1 -- 172.21.15.136:0/1166857494 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a0004cd0 con 0x7fb4b0101060 2024-06-02T04:00:12.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.810+0000 7fb4b7820700 1 -- 172.21.15.136:0/1166857494 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4b019efc0 con 0x7fb4b0101060 2024-06-02T04:00:12.814 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.810+0000 7fb4b7820700 1 -- 172.21.15.136:0/1166857494 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4b019f320 con 0x7fb4b0101060 2024-06-02T04:00:12.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.811+0000 7fb4b7820700 1 -- 172.21.15.136:0/1166857494 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4b004ec60 con 0x7fb4b0101060 2024-06-02T04:00:12.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.812+0000 7fb4a67fc700 1 -- 172.21.15.136:0/1166857494 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fb4a000fc50 con 0x7fb4b0101060 2024-06-02T04:00:12.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.813+0000 7fb4a67fc700 1 --2- 172.21.15.136:0/1166857494 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb49c0a1120 0x7fb49c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:00:12.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.813+0000 7fb4a67fc700 1 -- 172.21.15.136:0/1166857494 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3373+0+0 (secure 0 0 0) 0x7fb4a00ccc50 con 0x7fb4b0101060 2024-06-02T04:00:12.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.813+0000 7fb4b55bc700 1 --2- 172.21.15.136:0/1166857494 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb49c0a1120 0x7fb49c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:00:12.815 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.814+0000 7fb4b55bc700 1 --2- 172.21.15.136:0/1166857494 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb49c0a1120 0x7fb49c0a35e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac009cb0 tx=0x7fb4ac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:00:12.817 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:12.817+0000 7fb4a67fc700 1 -- 172.21.15.136:0/1166857494 <== mon.2 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb4a00977c0 con 0x7fb4b0101060 2024-06-02T04:00:13.018 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:13.018+0000 7fb4b7820700 1 -- 172.21.15.136:0/1166857494 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fb4b0069090 con 0x7fb49c0a1120 2024-06-02T04:00:13.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:12 smithi162 ceph-mon[47009]: Detected new or changed devices on smithi123 2024-06-02T04:00:13.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:12 smithi162 ceph-mon[47009]: Adjusting osd_memory_target on smithi123 to 8557M 2024-06-02T04:00:13.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:12 smithi162 ceph-mon[47009]: from='osd.3 [v2:172.21.15.123:6810/1403773143,v1:172.21.15.123:6811/1403773143]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-02T04:00:13.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:12 smithi162 ceph-mon[47009]: osdmap e23: 4 total, 3 up, 4 in 2024-06-02T04:00:13.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:12 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T04:00:13.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:12 smithi162 ceph-mon[47009]: from='osd.3 [v2:172.21.15.123:6810/1403773143,v1:172.21.15.123:6811/1403773143]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-06-02T04:00:13.322 INFO:journalctl@ceph.osd.3.smithi123.stdout:Jun 02 04:00:12 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-3[69256]: 2024-06-02T04:00:12.865+0000 7ff6c93d4700 -1 osd.3 0 waiting for initial osdmap 2024-06-02T04:00:13.322 INFO:journalctl@ceph.osd.3.smithi123.stdout:Jun 02 04:00:12 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-3[69256]: 2024-06-02T04:00:12.874+0000 7ff6c51c9700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T04:00:13.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:12 smithi123 ceph-mon[42885]: Detected new or changed devices on smithi123 2024-06-02T04:00:13.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:12 smithi123 ceph-mon[42885]: Adjusting osd_memory_target on smithi123 to 8557M 2024-06-02T04:00:13.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:12 smithi123 ceph-mon[42885]: from='osd.3 [v2:172.21.15.123:6810/1403773143,v1:172.21.15.123:6811/1403773143]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-02T04:00:13.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:12 smithi123 ceph-mon[42885]: osdmap e23: 4 total, 3 up, 4 in 2024-06-02T04:00:13.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:12 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T04:00:13.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:12 smithi123 ceph-mon[42885]: from='osd.3 [v2:172.21.15.123:6810/1403773143,v1:172.21.15.123:6811/1403773143]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-06-02T04:00:13.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:12 smithi136 ceph-mon[47443]: Detected new or changed devices on smithi123 2024-06-02T04:00:13.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:12 smithi136 ceph-mon[47443]: Adjusting osd_memory_target on smithi123 to 8557M 2024-06-02T04:00:13.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:12 smithi136 ceph-mon[47443]: from='osd.3 [v2:172.21.15.123:6810/1403773143,v1:172.21.15.123:6811/1403773143]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-06-02T04:00:13.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:12 smithi136 ceph-mon[47443]: osdmap e23: 4 total, 3 up, 4 in 2024-06-02T04:00:13.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:12 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T04:00:13.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:12 smithi136 ceph-mon[47443]: from='osd.3 [v2:172.21.15.123:6810/1403773143,v1:172.21.15.123:6811/1403773143]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-06-02T04:00:14.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:13 smithi136 ceph-mon[47443]: purged_snaps scrub starts 2024-06-02T04:00:14.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:13 smithi136 ceph-mon[47443]: purged_snaps scrub ok 2024-06-02T04:00:14.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:13 smithi136 ceph-mon[47443]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-06-02T04:00:14.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:13 smithi136 ceph-mon[47443]: from='osd.3 [v2:172.21.15.123:6810/1403773143,v1:172.21.15.123:6811/1403773143]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-06-02T04:00:14.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:13 smithi136 ceph-mon[47443]: osdmap e24: 4 total, 3 up, 4 in 2024-06-02T04:00:14.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:13 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T04:00:14.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:13 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T04:00:14.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:13 smithi136 ceph-mon[47443]: from='client.24230 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:00:14.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:13 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:00:14.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:13 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:00:14.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:13 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:14.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:13 smithi136 ceph-mon[47443]: osd.3 [v2:172.21.15.123:6810/1403773143,v1:172.21.15.123:6811/1403773143] boot 2024-06-02T04:00:14.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:13 smithi136 ceph-mon[47443]: osdmap e25: 4 total, 4 up, 4 in 2024-06-02T04:00:14.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:13 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T04:00:14.268 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:13 smithi162 ceph-mon[47009]: purged_snaps scrub starts 2024-06-02T04:00:14.268 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:13 smithi162 ceph-mon[47009]: purged_snaps scrub ok 2024-06-02T04:00:14.268 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:13 smithi162 ceph-mon[47009]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-06-02T04:00:14.268 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:13 smithi162 ceph-mon[47009]: from='osd.3 [v2:172.21.15.123:6810/1403773143,v1:172.21.15.123:6811/1403773143]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-06-02T04:00:14.269 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:13 smithi162 ceph-mon[47009]: osdmap e24: 4 total, 3 up, 4 in 2024-06-02T04:00:14.269 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:13 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T04:00:14.269 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:13 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T04:00:14.269 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:13 smithi162 ceph-mon[47009]: from='client.24230 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:00:14.269 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:13 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:00:14.269 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:13 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:00:14.269 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:13 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:14.269 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:13 smithi162 ceph-mon[47009]: osd.3 [v2:172.21.15.123:6810/1403773143,v1:172.21.15.123:6811/1403773143] boot 2024-06-02T04:00:14.269 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:13 smithi162 ceph-mon[47009]: osdmap e25: 4 total, 4 up, 4 in 2024-06-02T04:00:14.269 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:13 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T04:00:14.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:13 smithi123 ceph-mon[42885]: purged_snaps scrub starts 2024-06-02T04:00:14.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:13 smithi123 ceph-mon[42885]: purged_snaps scrub ok 2024-06-02T04:00:14.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:13 smithi123 ceph-mon[42885]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-06-02T04:00:14.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:13 smithi123 ceph-mon[42885]: from='osd.3 [v2:172.21.15.123:6810/1403773143,v1:172.21.15.123:6811/1403773143]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-06-02T04:00:14.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:13 smithi123 ceph-mon[42885]: osdmap e24: 4 total, 3 up, 4 in 2024-06-02T04:00:14.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:13 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T04:00:14.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:13 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T04:00:14.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:13 smithi123 ceph-mon[42885]: from='client.24230 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:00:14.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:13 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:00:14.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:13 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:00:14.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:13 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:14.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:13 smithi123 ceph-mon[42885]: osd.3 [v2:172.21.15.123:6810/1403773143,v1:172.21.15.123:6811/1403773143] boot 2024-06-02T04:00:14.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:13 smithi123 ceph-mon[42885]: osdmap e25: 4 total, 4 up, 4 in 2024-06-02T04:00:14.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:13 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-06-02T04:00:16.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:15 smithi162 ceph-mon[47009]: pgmap v79: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T04:00:16.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:15 smithi162 ceph-mon[47009]: osdmap e26: 4 total, 4 up, 4 in 2024-06-02T04:00:16.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:15 smithi162 ceph-mon[47009]: from='client.? 172.21.15.136:0/1757785640' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87dd92dd-73c8-4785-bf8a-3756d79dee90"}]: dispatch 2024-06-02T04:00:16.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:15 smithi162 ceph-mon[47009]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87dd92dd-73c8-4785-bf8a-3756d79dee90"}]: dispatch 2024-06-02T04:00:16.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:15 smithi162 ceph-mon[47009]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87dd92dd-73c8-4785-bf8a-3756d79dee90"}]': finished 2024-06-02T04:00:16.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:15 smithi162 ceph-mon[47009]: osdmap e27: 5 total, 4 up, 5 in 2024-06-02T04:00:16.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:15 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:00:16.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:15 smithi162 ceph-mon[47009]: from='client.? 172.21.15.136:0/463182287' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:00:16.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:15 smithi123 ceph-mon[42885]: pgmap v79: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T04:00:16.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:15 smithi123 ceph-mon[42885]: osdmap e26: 4 total, 4 up, 4 in 2024-06-02T04:00:16.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:15 smithi123 ceph-mon[42885]: from='client.? 172.21.15.136:0/1757785640' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87dd92dd-73c8-4785-bf8a-3756d79dee90"}]: dispatch 2024-06-02T04:00:16.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:15 smithi123 ceph-mon[42885]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87dd92dd-73c8-4785-bf8a-3756d79dee90"}]: dispatch 2024-06-02T04:00:16.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:15 smithi123 ceph-mon[42885]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87dd92dd-73c8-4785-bf8a-3756d79dee90"}]': finished 2024-06-02T04:00:16.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:15 smithi123 ceph-mon[42885]: osdmap e27: 5 total, 4 up, 5 in 2024-06-02T04:00:16.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:15 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:00:16.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:15 smithi123 ceph-mon[42885]: from='client.? 172.21.15.136:0/463182287' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:00:16.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:15 smithi136 ceph-mon[47443]: pgmap v79: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T04:00:16.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:15 smithi136 ceph-mon[47443]: osdmap e26: 4 total, 4 up, 4 in 2024-06-02T04:00:16.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:15 smithi136 ceph-mon[47443]: from='client.? 172.21.15.136:0/1757785640' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87dd92dd-73c8-4785-bf8a-3756d79dee90"}]: dispatch 2024-06-02T04:00:16.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:15 smithi136 ceph-mon[47443]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87dd92dd-73c8-4785-bf8a-3756d79dee90"}]: dispatch 2024-06-02T04:00:16.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:15 smithi136 ceph-mon[47443]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87dd92dd-73c8-4785-bf8a-3756d79dee90"}]': finished 2024-06-02T04:00:16.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:15 smithi136 ceph-mon[47443]: osdmap e27: 5 total, 4 up, 5 in 2024-06-02T04:00:16.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:15 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:00:16.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:15 smithi136 ceph-mon[47443]: from='client.? 172.21.15.136:0/463182287' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:00:17.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:16 smithi162 ceph-mon[47009]: osdmap e28: 5 total, 4 up, 5 in 2024-06-02T04:00:17.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:16 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:00:17.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:16 smithi123 ceph-mon[42885]: osdmap e28: 5 total, 4 up, 5 in 2024-06-02T04:00:17.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:16 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:00:17.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:16 smithi136 ceph-mon[47443]: osdmap e28: 5 total, 4 up, 5 in 2024-06-02T04:00:17.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:16 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:00:18.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:17 smithi162 ceph-mon[47009]: pgmap v83: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T04:00:18.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:17 smithi162 ceph-mon[47009]: osdmap e29: 5 total, 4 up, 5 in 2024-06-02T04:00:18.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:17 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:00:18.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:17 smithi123 ceph-mon[42885]: pgmap v83: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T04:00:18.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:17 smithi123 ceph-mon[42885]: osdmap e29: 5 total, 4 up, 5 in 2024-06-02T04:00:18.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:00:18.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:17 smithi136 ceph-mon[47443]: pgmap v83: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T04:00:18.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:17 smithi136 ceph-mon[47443]: osdmap e29: 5 total, 4 up, 5 in 2024-06-02T04:00:18.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:17 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:00:20.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:19 smithi162 ceph-mon[47009]: pgmap v85: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T04:00:20.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:19 smithi123 ceph-mon[42885]: pgmap v85: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T04:00:20.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:19 smithi136 ceph-mon[47443]: pgmap v85: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T04:00:21.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:20 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-02T04:00:21.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:20 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:21.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:20 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-02T04:00:21.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:20 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:21.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:20 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-06-02T04:00:21.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:20 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:22.286 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:21 smithi136 ceph-mon[47443]: Deploying daemon osd.4 on smithi136 2024-06-02T04:00:22.286 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:21 smithi136 ceph-mon[47443]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-06-02T04:00:22.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:21 smithi162 ceph-mon[47009]: Deploying daemon osd.4 on smithi136 2024-06-02T04:00:22.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:21 smithi162 ceph-mon[47009]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-06-02T04:00:22.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:21 smithi123 ceph-mon[42885]: Deploying daemon osd.4 on smithi136 2024-06-02T04:00:22.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:21 smithi123 ceph-mon[42885]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-06-02T04:00:24.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:23 smithi136 ceph-mon[47443]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-06-02T04:00:24.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:23 smithi162 ceph-mon[47009]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-06-02T04:00:24.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:23 smithi123 ceph-mon[42885]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-06-02T04:00:25.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:24 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:00:25.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:24 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:25.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:24 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:25.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:24 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:00:25.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:24 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:25.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:24 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:25.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:24 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:00:25.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:24 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:25.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:24 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:26.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:25 smithi136 ceph-mon[47443]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-06-02T04:00:26.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:25 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:26.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:25 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:26.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:25 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:26.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:25 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:00:26.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:25 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:26.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:25 smithi162 ceph-mon[47009]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-06-02T04:00:26.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:25 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:26.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:25 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:26.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:25 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:26.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:25 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:00:26.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:25 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:26.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:25 smithi123 ceph-mon[42885]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-06-02T04:00:26.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:25 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:26.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:25 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:26.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:25 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:26.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:25 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:00:26.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:25 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:26.820 INFO:teuthology.orchestra.run.smithi136.stdout:Created osd(s) 4 on host 'smithi136' 2024-06-02T04:00:26.820 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:26.820+0000 7fb4a67fc700 1 -- 172.21.15.136:0/1166857494 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb4b0069090 con 0x7fb49c0a1120 2024-06-02T04:00:26.822 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:26.823+0000 7fb4b7820700 1 -- 172.21.15.136:0/1166857494 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb49c0a1120 msgr2=0x7fb49c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:00:26.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:26.823+0000 7fb4b7820700 1 --2- 172.21.15.136:0/1166857494 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb49c0a1120 0x7fb49c0a35e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac009cb0 tx=0x7fb4ac009260 comp rx=0 tx=0).stop 2024-06-02T04:00:26.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:26.823+0000 7fb4b7820700 1 -- 172.21.15.136:0/1166857494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4b0101060 msgr2=0x7fb4b01974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:00:26.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:26.823+0000 7fb4b7820700 1 --2- 172.21.15.136:0/1166857494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4b0101060 0x7fb4b01974c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb4a000c010 tx=0x7fb4a0004730 comp rx=0 tx=0).stop 2024-06-02T04:00:26.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:26.823+0000 7fb4b7820700 1 -- 172.21.15.136:0/1166857494 shutdown_connections 2024-06-02T04:00:26.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:26.823+0000 7fb4b7820700 1 --2- 172.21.15.136:0/1166857494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb4b0101a20 0x7fb4b019e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:00:26.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:26.823+0000 7fb4b7820700 1 --2- 172.21.15.136:0/1166857494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4b00fff00 0x7fb4b0196f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:00:26.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:26.823+0000 7fb4b7820700 1 --2- 172.21.15.136:0/1166857494 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb49c0a1120 0x7fb49c0a35e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:00:26.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:26.823+0000 7fb4b7820700 1 --2- 172.21.15.136:0/1166857494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4b0101060 0x7fb4b01974c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:00:26.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:26.823+0000 7fb4b7820700 1 -- 172.21.15.136:0/1166857494 >> 172.21.15.136:0/1166857494 conn(0x7fb4b00fb4a0 msgr2=0x7fb4b0068980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:00:26.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:26.823+0000 7fb4b7820700 1 -- 172.21.15.136:0/1166857494 shutdown_connections 2024-06-02T04:00:26.823 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:00:26.823+0000 7fb4b7820700 1 -- 172.21.15.136:0/1166857494 wait complete. 2024-06-02T04:00:27.237 DEBUG:teuthology.orchestra.run.smithi136:osd.4> sudo journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.4.service 2024-06-02T04:00:27.239 INFO:tasks.cephadm:Deploying osd.5 on smithi162 with /dev/vg_nvme/lv_3... 2024-06-02T04:00:27.239 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-06-02T04:00:27.270 INFO:journalctl@ceph.osd.4.smithi136.stdout:-- Logs begin at Sun 2024-06-02 03:40:52 UTC. -- 2024-06-02T04:00:27.475 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T04:00:27.891 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:27 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:27.891 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:27 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:27.891 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:27 smithi162 ceph-mon[47009]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-02T04:00:27.891 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:27 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:00:28.070 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:27 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:28.070 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:27 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:28.071 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:27 smithi136 ceph-mon[47443]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-02T04:00:28.071 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:27 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:00:28.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:27 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:28.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:27 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:28.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:27 smithi123 ceph-mon[42885]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-06-02T04:00:28.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:27 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:00:28.793 INFO:journalctl@ceph.osd.4.smithi136.stdout:Jun 02 04:00:28 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-4[61146]: 2024-06-02T04:00:28.509+0000 7fdb9c00c7c0 -1 osd.4 0 log_to_monitors true 2024-06-02T04:00:28.803 INFO:teuthology.orchestra.run.smithi162.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-06-02T04:00:28.803 INFO:teuthology.orchestra.run.smithi162.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-06-02T04:00:28.803 INFO:teuthology.orchestra.run.smithi162.stderr: stderr: 10+0 records in 2024-06-02T04:00:28.804 INFO:teuthology.orchestra.run.smithi162.stderr:10+0 records out 2024-06-02T04:00:28.804 INFO:teuthology.orchestra.run.smithi162.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0157506 s, 666 MB/s 2024-06-02T04:00:28.804 INFO:teuthology.orchestra.run.smithi162.stderr:--> Zapping successful for: 2024-06-02T04:00:29.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:28 smithi162 ceph-mon[47009]: from='osd.4 [v2:172.21.15.136:6808/1403526782,v1:172.21.15.136:6809/1403526782]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-02T04:00:29.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:28 smithi162 ceph-mon[47009]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-02T04:00:29.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:28 smithi123 ceph-mon[42885]: from='osd.4 [v2:172.21.15.136:6808/1403526782,v1:172.21.15.136:6809/1403526782]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-02T04:00:29.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:28 smithi123 ceph-mon[42885]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-02T04:00:29.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:28 smithi136 ceph-mon[47443]: from='osd.4 [v2:172.21.15.136:6808/1403526782,v1:172.21.15.136:6809/1403526782]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-02T04:00:29.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:28 smithi136 ceph-mon[47443]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-06-02T04:00:29.212 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi162:vg_nvme/lv_3 2024-06-02T04:00:29.430 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T04:00:30.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:29 smithi123 ceph-mon[42885]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-06-02T04:00:30.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:29 smithi123 ceph-mon[42885]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-02T04:00:30.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:29 smithi123 ceph-mon[42885]: osdmap e30: 5 total, 4 up, 5 in 2024-06-02T04:00:30.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:29 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:00:30.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:29 smithi123 ceph-mon[42885]: from='osd.4 [v2:172.21.15.136:6808/1403526782,v1:172.21.15.136:6809/1403526782]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-06-02T04:00:30.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:29 smithi123 ceph-mon[42885]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-06-02T04:00:30.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:29 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:30.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:29 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:30.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:29 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:00:30.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:29 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:00:30.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:29 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:30.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:29 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:30.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:29 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:00:30.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:29 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:30.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:29 smithi136 ceph-mon[47443]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-06-02T04:00:30.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:29 smithi136 ceph-mon[47443]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-02T04:00:30.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:29 smithi136 ceph-mon[47443]: osdmap e30: 5 total, 4 up, 5 in 2024-06-02T04:00:30.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:29 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:00:30.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:29 smithi136 ceph-mon[47443]: from='osd.4 [v2:172.21.15.136:6808/1403526782,v1:172.21.15.136:6809/1403526782]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-06-02T04:00:30.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:29 smithi136 ceph-mon[47443]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-06-02T04:00:30.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:29 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:30.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:29 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:30.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:29 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:00:30.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:29 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:00:30.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:29 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:30.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:29 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:30.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:29 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:00:30.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:29 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:30.090 INFO:journalctl@ceph.osd.4.smithi136.stdout:Jun 02 04:00:29 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-4[61146]: 2024-06-02T04:00:29.819+0000 7fdb91670700 -1 osd.4 0 waiting for initial osdmap 2024-06-02T04:00:30.090 INFO:journalctl@ceph.osd.4.smithi136.stdout:Jun 02 04:00:29 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-4[61146]: 2024-06-02T04:00:29.825+0000 7fdb8d465700 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T04:00:30.224 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:29 smithi162 ceph-mon[47009]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-06-02T04:00:30.225 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:29 smithi162 ceph-mon[47009]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-06-02T04:00:30.225 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:29 smithi162 ceph-mon[47009]: osdmap e30: 5 total, 4 up, 5 in 2024-06-02T04:00:30.225 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:29 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:00:30.225 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:29 smithi162 ceph-mon[47009]: from='osd.4 [v2:172.21.15.136:6808/1403526782,v1:172.21.15.136:6809/1403526782]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-06-02T04:00:30.225 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:29 smithi162 ceph-mon[47009]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-06-02T04:00:30.225 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:29 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:30.225 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:29 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:30.225 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:29 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:00:30.225 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:29 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:00:30.225 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:29 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:30.225 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:29 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:30.226 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:29 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:00:30.226 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:29 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:30.403 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.403+0000 7f475a200700 1 -- 172.21.15.162:0/2280720432 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47540fff00 msgr2=0x7f4754100320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:00:30.403 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.403+0000 7f475a200700 1 --2- 172.21.15.162:0/2280720432 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47540fff00 0x7f4754100320 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4744009990 tx=0x7f4744009ca0 comp rx=0 tx=0).stop 2024-06-02T04:00:30.403 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.403+0000 7f475a200700 1 -- 172.21.15.162:0/2280720432 shutdown_connections 2024-06-02T04:00:30.403 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.403+0000 7f475a200700 1 --2- 172.21.15.162:0/2280720432 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4754101a20 0x7f4754108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:00:30.403 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.403+0000 7f475a200700 1 --2- 172.21.15.162:0/2280720432 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47540fff00 0x7f4754100320 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:00:30.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.403+0000 7f475a200700 1 --2- 172.21.15.162:0/2280720432 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4754101060 0x7f47541014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:00:30.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.403+0000 7f475a200700 1 -- 172.21.15.162:0/2280720432 >> 172.21.15.162:0/2280720432 conn(0x7f47540fb4a0 msgr2=0x7f47540fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:00:30.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.403+0000 7f475a200700 1 -- 172.21.15.162:0/2280720432 shutdown_connections 2024-06-02T04:00:30.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.403+0000 7f475a200700 1 -- 172.21.15.162:0/2280720432 wait complete. 2024-06-02T04:00:30.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.403+0000 7f475a200700 1 Processor -- start 2024-06-02T04:00:30.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.404+0000 7f475a200700 1 -- start start 2024-06-02T04:00:30.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.404+0000 7f475a200700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47540fff00 0x7f4754196e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:00:30.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.404+0000 7f475a200700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4754101060 0x7f4754197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:00:30.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.404+0000 7f475a200700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4754101a20 0x7f475419e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:00:30.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.404+0000 7f475a200700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475419e970 con 0x7f4754101060 2024-06-02T04:00:30.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.404+0000 7f475a200700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475419eab0 con 0x7f4754101a20 2024-06-02T04:00:30.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.404+0000 7f475a200700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475419ec40 con 0x7f47540fff00 2024-06-02T04:00:30.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.404+0000 7f47537fe700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47540fff00 0x7f4754196e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:00:30.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.404+0000 7f47537fe700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47540fff00 0x7f4754196e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:57940/0 (socket says 172.21.15.162:57940) 2024-06-02T04:00:30.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.404+0000 7f47537fe700 1 -- 172.21.15.162:0/2796243076 learned_addr learned my addr 172.21.15.162:0/2796243076 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-06-02T04:00:30.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.404+0000 7f4753fff700 1 --2- 172.21.15.162:0/2796243076 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4754101a20 0x7f475419e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:00:30.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.404+0000 7f4752ffd700 1 --2- 172.21.15.162:0/2796243076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4754101060 0x7f4754197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:00:30.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.404+0000 7f47537fe700 1 -- 172.21.15.162:0/2796243076 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4754101a20 msgr2=0x7f475419e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:00:30.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.404+0000 7f47537fe700 1 --2- 172.21.15.162:0/2796243076 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4754101a20 0x7f475419e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:00:30.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.404+0000 7f47537fe700 1 -- 172.21.15.162:0/2796243076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4754101060 msgr2=0x7f4754197370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:00:30.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.404+0000 7f47537fe700 1 --2- 172.21.15.162:0/2796243076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4754101060 0x7f4754197370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:00:30.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.404+0000 7f47537fe700 1 -- 172.21.15.162:0/2796243076 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47440095f0 con 0x7f47540fff00 2024-06-02T04:00:30.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.404+0000 7f47537fe700 1 --2- 172.21.15.162:0/2796243076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47540fff00 0x7f4754196e30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f47440037f0 tx=0x7f474400f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:00:30.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.405+0000 7f4750ff9700 1 -- 172.21.15.162:0/2796243076 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474401d070 con 0x7f47540fff00 2024-06-02T04:00:30.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.405+0000 7f4750ff9700 1 -- 172.21.15.162:0/2796243076 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4744022470 con 0x7f47540fff00 2024-06-02T04:00:30.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.405+0000 7f475a200700 1 -- 172.21.15.162:0/2796243076 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f475419eec0 con 0x7f47540fff00 2024-06-02T04:00:30.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.405+0000 7f4750ff9700 1 -- 172.21.15.162:0/2796243076 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4744017650 con 0x7f47540fff00 2024-06-02T04:00:30.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.405+0000 7f475a200700 1 -- 172.21.15.162:0/2796243076 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f475419f270 con 0x7f47540fff00 2024-06-02T04:00:30.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.406+0000 7f475a200700 1 -- 172.21.15.162:0/2796243076 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f475404ec60 con 0x7f47540fff00 2024-06-02T04:00:30.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.407+0000 7f4750ff9700 1 -- 172.21.15.162:0/2796243076 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f47440225e0 con 0x7f47540fff00 2024-06-02T04:00:30.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.407+0000 7f4750ff9700 1 --2- 172.21.15.162:0/2796243076 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f473c0a1120 0x7f473c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:00:30.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.407+0000 7f4750ff9700 1 -- 172.21.15.162:0/2796243076 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 3821+0+0 (secure 0 0 0) 0x7f47440cc900 con 0x7f47540fff00 2024-06-02T04:00:30.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.408+0000 7f4752ffd700 1 --2- 172.21.15.162:0/2796243076 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f473c0a1120 0x7f473c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:00:30.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.408+0000 7f4752ffd700 1 --2- 172.21.15.162:0/2796243076 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f473c0a1120 0x7f473c0a35e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4748005950 tx=0x7f474800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:00:30.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.411+0000 7f4750ff9700 1 -- 172.21.15.162:0/2796243076 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f474405dd60 con 0x7f47540fff00 2024-06-02T04:00:30.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:30.615+0000 7f475a200700 1 -- 172.21.15.162:0/2796243076 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f4754069060 con 0x7f473c0a1120 2024-06-02T04:00:31.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:30 smithi136 ceph-mon[47443]: Detected new or changed devices on smithi136 2024-06-02T04:00:31.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:30 smithi136 ceph-mon[47443]: Adjusting osd_memory_target on smithi136 to 8556M 2024-06-02T04:00:31.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:30 smithi136 ceph-mon[47443]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-06-02T04:00:31.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:30 smithi136 ceph-mon[47443]: osdmap e31: 5 total, 4 up, 5 in 2024-06-02T04:00:31.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:30 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:00:31.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:30 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:00:31.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:30 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:00:31.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:30 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:00:31.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:30 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:31.160 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:30 smithi162 ceph-mon[47009]: Detected new or changed devices on smithi136 2024-06-02T04:00:31.160 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:30 smithi162 ceph-mon[47009]: Adjusting osd_memory_target on smithi136 to 8556M 2024-06-02T04:00:31.161 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:30 smithi162 ceph-mon[47009]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-06-02T04:00:31.161 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:30 smithi162 ceph-mon[47009]: osdmap e31: 5 total, 4 up, 5 in 2024-06-02T04:00:31.161 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:30 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:00:31.161 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:30 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:00:31.161 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:30 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:00:31.161 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:30 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:00:31.161 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:30 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:31.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:30 smithi123 ceph-mon[42885]: Detected new or changed devices on smithi136 2024-06-02T04:00:31.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:30 smithi123 ceph-mon[42885]: Adjusting osd_memory_target on smithi136 to 8556M 2024-06-02T04:00:31.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:30 smithi123 ceph-mon[42885]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-06-02T04:00:31.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:30 smithi123 ceph-mon[42885]: osdmap e31: 5 total, 4 up, 5 in 2024-06-02T04:00:31.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:30 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:00:31.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:30 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:00:31.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:30 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:00:31.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:30 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:00:31.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:30 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:32.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:31 smithi136 ceph-mon[47443]: purged_snaps scrub starts 2024-06-02T04:00:32.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:31 smithi136 ceph-mon[47443]: purged_snaps scrub ok 2024-06-02T04:00:32.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:31 smithi136 ceph-mon[47443]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:00:32.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:31 smithi136 ceph-mon[47443]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T04:00:32.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:31 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:00:32.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:31 smithi136 ceph-mon[47443]: osd.4 [v2:172.21.15.136:6808/1403526782,v1:172.21.15.136:6809/1403526782] boot 2024-06-02T04:00:32.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:31 smithi136 ceph-mon[47443]: osdmap e32: 5 total, 5 up, 5 in 2024-06-02T04:00:32.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:31 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:00:32.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:31 smithi162 ceph-mon[47009]: purged_snaps scrub starts 2024-06-02T04:00:32.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:31 smithi162 ceph-mon[47009]: purged_snaps scrub ok 2024-06-02T04:00:32.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:31 smithi162 ceph-mon[47009]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:00:32.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:31 smithi162 ceph-mon[47009]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T04:00:32.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:31 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:00:32.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:31 smithi162 ceph-mon[47009]: osd.4 [v2:172.21.15.136:6808/1403526782,v1:172.21.15.136:6809/1403526782] boot 2024-06-02T04:00:32.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:31 smithi162 ceph-mon[47009]: osdmap e32: 5 total, 5 up, 5 in 2024-06-02T04:00:32.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:31 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:00:32.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:31 smithi123 ceph-mon[42885]: purged_snaps scrub starts 2024-06-02T04:00:32.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:31 smithi123 ceph-mon[42885]: purged_snaps scrub ok 2024-06-02T04:00:32.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:31 smithi123 ceph-mon[42885]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:00:32.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:31 smithi123 ceph-mon[42885]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-06-02T04:00:32.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:31 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:00:32.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:31 smithi123 ceph-mon[42885]: osd.4 [v2:172.21.15.136:6808/1403526782,v1:172.21.15.136:6809/1403526782] boot 2024-06-02T04:00:32.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:31 smithi123 ceph-mon[42885]: osdmap e32: 5 total, 5 up, 5 in 2024-06-02T04:00:32.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:31 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-06-02T04:00:33.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:32 smithi136 ceph-mon[47443]: osdmap e33: 5 total, 5 up, 5 in 2024-06-02T04:00:33.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:32 smithi136 ceph-mon[47443]: from='client.? 172.21.15.162:0/542951595' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1a730863-6b56-43b7-a115-c80d3c8f3ee3"}]: dispatch 2024-06-02T04:00:33.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:32 smithi136 ceph-mon[47443]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1a730863-6b56-43b7-a115-c80d3c8f3ee3"}]: dispatch 2024-06-02T04:00:33.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:32 smithi136 ceph-mon[47443]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1a730863-6b56-43b7-a115-c80d3c8f3ee3"}]': finished 2024-06-02T04:00:33.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:32 smithi136 ceph-mon[47443]: osdmap e34: 6 total, 5 up, 6 in 2024-06-02T04:00:33.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:32 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:00:33.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:32 smithi162 ceph-mon[47009]: osdmap e33: 5 total, 5 up, 5 in 2024-06-02T04:00:33.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:32 smithi162 ceph-mon[47009]: from='client.? 172.21.15.162:0/542951595' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1a730863-6b56-43b7-a115-c80d3c8f3ee3"}]: dispatch 2024-06-02T04:00:33.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:32 smithi162 ceph-mon[47009]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1a730863-6b56-43b7-a115-c80d3c8f3ee3"}]: dispatch 2024-06-02T04:00:33.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:32 smithi162 ceph-mon[47009]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1a730863-6b56-43b7-a115-c80d3c8f3ee3"}]': finished 2024-06-02T04:00:33.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:32 smithi162 ceph-mon[47009]: osdmap e34: 6 total, 5 up, 6 in 2024-06-02T04:00:33.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:32 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:00:33.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:32 smithi123 ceph-mon[42885]: osdmap e33: 5 total, 5 up, 5 in 2024-06-02T04:00:33.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:32 smithi123 ceph-mon[42885]: from='client.? 172.21.15.162:0/542951595' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1a730863-6b56-43b7-a115-c80d3c8f3ee3"}]: dispatch 2024-06-02T04:00:33.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:32 smithi123 ceph-mon[42885]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1a730863-6b56-43b7-a115-c80d3c8f3ee3"}]: dispatch 2024-06-02T04:00:33.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:32 smithi123 ceph-mon[42885]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1a730863-6b56-43b7-a115-c80d3c8f3ee3"}]': finished 2024-06-02T04:00:33.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:32 smithi123 ceph-mon[42885]: osdmap e34: 6 total, 5 up, 6 in 2024-06-02T04:00:33.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:32 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:00:34.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:33 smithi136 ceph-mon[47443]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:00:34.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:33 smithi136 ceph-mon[47443]: from='client.? 172.21.15.162:0/459806220' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:00:34.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:33 smithi162 ceph-mon[47009]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:00:34.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:33 smithi162 ceph-mon[47009]: from='client.? 172.21.15.162:0/459806220' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:00:34.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:33 smithi123 ceph-mon[42885]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:00:34.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:33 smithi123 ceph-mon[42885]: from='client.? 172.21.15.162:0/459806220' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:00:36.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:35 smithi136 ceph-mon[47443]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:00:36.205 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:35 smithi162 ceph-mon[47009]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:00:36.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:35 smithi123 ceph-mon[42885]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:00:38.122 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:37 smithi162 ceph-mon[47009]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:00:38.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:37 smithi123 ceph-mon[42885]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:00:38.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:37 smithi136 ceph-mon[47443]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:00:38.989 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:38 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-02T04:00:38.989 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:38 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:39.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:38 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-02T04:00:39.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:38 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:39.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:38 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-06-02T04:00:39.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:38 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:39.975 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:39 smithi162 ceph-mon[47009]: Deploying daemon osd.5 on smithi162 2024-06-02T04:00:39.975 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:39 smithi162 ceph-mon[47009]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:00:40.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:39 smithi123 ceph-mon[42885]: Deploying daemon osd.5 on smithi162 2024-06-02T04:00:40.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:39 smithi123 ceph-mon[42885]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:00:40.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:39 smithi136 ceph-mon[47443]: Deploying daemon osd.5 on smithi162 2024-06-02T04:00:40.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:39 smithi136 ceph-mon[47443]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:00:42.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:41 smithi162 ceph-mon[47009]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:00:42.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:41 smithi123 ceph-mon[42885]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:00:42.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:41 smithi136 ceph-mon[47443]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:00:43.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:42 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:43.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:42 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:43.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:42 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:00:43.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:42 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:43.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:42 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:43.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:42 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:00:43.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:42 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:43.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:42 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:43.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:42 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:00:44.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:43 smithi162 ceph-mon[47009]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:00:44.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:43 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:44.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:43 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:44.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:43 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:44.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:43 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:00:44.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:43 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:44.170 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 5 on host 'smithi162' 2024-06-02T04:00:44.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:44.170+0000 7f4750ff9700 1 -- 172.21.15.162:0/2796243076 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4754069060 con 0x7f473c0a1120 2024-06-02T04:00:44.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:44.172+0000 7f475a200700 1 -- 172.21.15.162:0/2796243076 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f473c0a1120 msgr2=0x7f473c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:00:44.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:44.172+0000 7f475a200700 1 --2- 172.21.15.162:0/2796243076 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f473c0a1120 0x7f473c0a35e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4748005950 tx=0x7f474800b410 comp rx=0 tx=0).stop 2024-06-02T04:00:44.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:44.172+0000 7f475a200700 1 -- 172.21.15.162:0/2796243076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47540fff00 msgr2=0x7f4754196e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:00:44.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:44.172+0000 7f475a200700 1 --2- 172.21.15.162:0/2796243076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47540fff00 0x7f4754196e30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f47440037f0 tx=0x7f474400f690 comp rx=0 tx=0).stop 2024-06-02T04:00:44.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:44.172+0000 7f475a200700 1 -- 172.21.15.162:0/2796243076 shutdown_connections 2024-06-02T04:00:44.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:44.172+0000 7f475a200700 1 --2- 172.21.15.162:0/2796243076 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f473c0a1120 0x7f473c0a35e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:00:44.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:44.172+0000 7f475a200700 1 --2- 172.21.15.162:0/2796243076 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4754101a20 0x7f475419e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:00:44.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:44.172+0000 7f475a200700 1 --2- 172.21.15.162:0/2796243076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47540fff00 0x7f4754196e30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:00:44.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:44.172+0000 7f475a200700 1 --2- 172.21.15.162:0/2796243076 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4754101060 0x7f4754197370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:00:44.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:44.172+0000 7f475a200700 1 -- 172.21.15.162:0/2796243076 >> 172.21.15.162:0/2796243076 conn(0x7f47540fb4a0 msgr2=0x7f4754068950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:00:44.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:44.172+0000 7f475a200700 1 -- 172.21.15.162:0/2796243076 shutdown_connections 2024-06-02T04:00:44.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:00:44.172+0000 7f475a200700 1 -- 172.21.15.162:0/2796243076 wait complete. 2024-06-02T04:00:44.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:43 smithi123 ceph-mon[42885]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:00:44.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:43 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:44.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:43 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:44.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:43 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:44.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:43 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:00:44.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:43 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:44.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:43 smithi136 ceph-mon[47443]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:00:44.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:43 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:44.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:43 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:44.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:43 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:44.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:43 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:00:44.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:43 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:44.556 DEBUG:teuthology.orchestra.run.smithi162:osd.5> sudo journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.5.service 2024-06-02T04:00:44.558 INFO:tasks.cephadm:Deploying osd.6 on smithi123 with /dev/vg_nvme/lv_2... 2024-06-02T04:00:44.558 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-06-02T04:00:44.590 INFO:journalctl@ceph.osd.5.smithi162.stdout:-- Logs begin at Sun 2024-06-02 03:41:09 UTC. -- 2024-06-02T04:00:44.790 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:00:45.271 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:45 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:45.271 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:45 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:45.271 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:45 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:00:45.271 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:45 smithi123 ceph-mon[42885]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:00:45.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:45 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:45.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:45 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:45.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:45 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:00:45.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:45 smithi162 ceph-mon[47009]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:00:45.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:45.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:45.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:00:45.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:45 smithi136 ceph-mon[47443]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:00:46.107 INFO:teuthology.orchestra.run.smithi123.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-06-02T04:00:46.108 INFO:teuthology.orchestra.run.smithi123.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-06-02T04:00:46.108 INFO:teuthology.orchestra.run.smithi123.stderr: stderr: 10+0 records in 2024-06-02T04:00:46.108 INFO:teuthology.orchestra.run.smithi123.stderr:10+0 records out 2024-06-02T04:00:46.108 INFO:teuthology.orchestra.run.smithi123.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0116749 s, 898 MB/s 2024-06-02T04:00:46.108 INFO:teuthology.orchestra.run.smithi123.stderr:--> Zapping successful for: 2024-06-02T04:00:46.152 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jun 02 04:00:45 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-5[60832]: 2024-06-02T04:00:45.900+0000 7ff6bc3cc7c0 -1 osd.5 0 log_to_monitors true 2024-06-02T04:00:46.420 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:46 smithi162 ceph-mon[47009]: from='osd.5 [v2:172.21.15.162:6808/3094256489,v1:172.21.15.162:6809/3094256489]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-02T04:00:46.420 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:46 smithi162 ceph-mon[47009]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-02T04:00:46.441 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:46 smithi123 ceph-mon[42885]: from='osd.5 [v2:172.21.15.162:6808/3094256489,v1:172.21.15.162:6809/3094256489]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-02T04:00:46.441 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:46 smithi123 ceph-mon[42885]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-02T04:00:46.508 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi123:vg_nvme/lv_2 2024-06-02T04:00:46.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:46 smithi136 ceph-mon[47443]: from='osd.5 [v2:172.21.15.162:6808/3094256489,v1:172.21.15.162:6809/3094256489]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-02T04:00:46.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:46 smithi136 ceph-mon[47443]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-06-02T04:00:46.733 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:00:47.165 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:47 smithi123 ceph-mon[42885]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-02T04:00:47.165 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:47 smithi123 ceph-mon[42885]: osdmap e35: 6 total, 5 up, 6 in 2024-06-02T04:00:47.165 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:47 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:00:47.165 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:47 smithi123 ceph-mon[42885]: from='osd.5 [v2:172.21.15.162:6808/3094256489,v1:172.21.15.162:6809/3094256489]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-06-02T04:00:47.165 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:47 smithi123 ceph-mon[42885]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-06-02T04:00:47.165 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:47 smithi123 ceph-mon[42885]: Detected new or changed devices on smithi162 2024-06-02T04:00:47.165 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:47 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:47.165 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:47 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:47.165 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:47 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:00:47.165 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:47 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:00:47.166 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:47 smithi123 ceph-mon[42885]: Adjusting osd_memory_target on smithi162 to 8557M 2024-06-02T04:00:47.166 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:47 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:47.166 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:47 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:47.166 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:47 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:00:47.166 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:47 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:47.166 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:47 smithi123 ceph-mon[42885]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:00:47.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:47 smithi162 ceph-mon[47009]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-02T04:00:47.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:47 smithi162 ceph-mon[47009]: osdmap e35: 6 total, 5 up, 6 in 2024-06-02T04:00:47.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:47 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:00:47.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:47 smithi162 ceph-mon[47009]: from='osd.5 [v2:172.21.15.162:6808/3094256489,v1:172.21.15.162:6809/3094256489]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-06-02T04:00:47.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:47 smithi162 ceph-mon[47009]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-06-02T04:00:47.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:47 smithi162 ceph-mon[47009]: Detected new or changed devices on smithi162 2024-06-02T04:00:47.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:47 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:47.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:47 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:47.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:47 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:00:47.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:47 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:00:47.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:47 smithi162 ceph-mon[47009]: Adjusting osd_memory_target on smithi162 to 8557M 2024-06-02T04:00:47.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:47 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:47.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:47 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:47.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:47 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:00:47.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:47 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:47.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:47 smithi162 ceph-mon[47009]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:00:47.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:47 smithi136 ceph-mon[47443]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-06-02T04:00:47.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:47 smithi136 ceph-mon[47443]: osdmap e35: 6 total, 5 up, 6 in 2024-06-02T04:00:47.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:47 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:00:47.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:47 smithi136 ceph-mon[47443]: from='osd.5 [v2:172.21.15.162:6808/3094256489,v1:172.21.15.162:6809/3094256489]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-06-02T04:00:47.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:47 smithi136 ceph-mon[47443]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-06-02T04:00:47.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:47 smithi136 ceph-mon[47443]: Detected new or changed devices on smithi162 2024-06-02T04:00:47.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:47 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:47.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:47 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:47.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:47 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:00:47.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:47 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:00:47.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:47 smithi136 ceph-mon[47443]: Adjusting osd_memory_target on smithi162 to 8557M 2024-06-02T04:00:47.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:47 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:47.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:47 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:47.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:47 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:00:47.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:47 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:00:47.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:47 smithi136 ceph-mon[47443]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:00:47.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.799+0000 7f07b5e8d700 1 -- 172.21.15.123:0/999323655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07b0102b80 msgr2=0x7f07b0109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:00:47.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.799+0000 7f07b5e8d700 1 --2- 172.21.15.123:0/999323655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07b0102b80 0x7f07b0109430 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f07a800b0d0 tx=0x7f07a800b3e0 comp rx=0 tx=0).stop 2024-06-02T04:00:47.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.799+0000 7f07b5e8d700 1 -- 172.21.15.123:0/999323655 shutdown_connections 2024-06-02T04:00:47.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.799+0000 7f07b5e8d700 1 --2- 172.21.15.123:0/999323655 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07b0102b80 0x7f07b0109430 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:00:47.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.799+0000 7f07b5e8d700 1 --2- 172.21.15.123:0/999323655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07b0100fe0 0x7f07b0101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:00:47.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.799+0000 7f07b5e8d700 1 --2- 172.21.15.123:0/999323655 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f07b01021e0 0x7f07b0102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:00:47.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.800+0000 7f07b5e8d700 1 -- 172.21.15.123:0/999323655 >> 172.21.15.123:0/999323655 conn(0x7f07b00fc5a0 msgr2=0x7f07b00fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:00:47.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.800+0000 7f07b5e8d700 1 -- 172.21.15.123:0/999323655 shutdown_connections 2024-06-02T04:00:47.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.800+0000 7f07b5e8d700 1 -- 172.21.15.123:0/999323655 wait complete. 2024-06-02T04:00:47.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.800+0000 7f07b5e8d700 1 Processor -- start 2024-06-02T04:00:47.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.800+0000 7f07b5e8d700 1 -- start start 2024-06-02T04:00:47.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.800+0000 7f07b5e8d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f07b0100fe0 0x7f07b0197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:00:47.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.800+0000 7f07b5e8d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07b01021e0 0x7f07b01975d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:00:47.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.801+0000 7f07b5e8d700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07b0102b80 0x7f07b019e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:00:47.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.801+0000 7f07b5e8d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b019eb80 con 0x7f07b01021e0 2024-06-02T04:00:47.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.801+0000 7f07b5e8d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b019ecc0 con 0x7f07b0100fe0 2024-06-02T04:00:47.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.801+0000 7f07b5e8d700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b019ee50 con 0x7f07b0102b80 2024-06-02T04:00:47.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.801+0000 7f07aeffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07b01021e0 0x7f07b01975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:00:47.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.801+0000 7f07aeffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07b01021e0 0x7f07b01975d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:56932/0 (socket says 172.21.15.123:56932) 2024-06-02T04:00:47.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.801+0000 7f07aeffd700 1 -- 172.21.15.123:0/2247507567 learned_addr learned my addr 172.21.15.123:0/2247507567 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:00:47.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.801+0000 7f07affff700 1 --2- 172.21.15.123:0/2247507567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07b0102b80 0x7f07b019e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:00:47.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.801+0000 7f07af7fe700 1 --2- 172.21.15.123:0/2247507567 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f07b0100fe0 0x7f07b0197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:00:47.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.801+0000 7f07aeffd700 1 -- 172.21.15.123:0/2247507567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07b0102b80 msgr2=0x7f07b019e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:00:47.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.801+0000 7f07aeffd700 1 --2- 172.21.15.123:0/2247507567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07b0102b80 0x7f07b019e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:00:47.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.801+0000 7f07aeffd700 1 -- 172.21.15.123:0/2247507567 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f07b0100fe0 msgr2=0x7f07b0197090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:00:47.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.801+0000 7f07aeffd700 1 --2- 172.21.15.123:0/2247507567 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f07b0100fe0 0x7f07b0197090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:00:47.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.801+0000 7f07aeffd700 1 -- 172.21.15.123:0/2247507567 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a8009d00 con 0x7f07b01021e0 2024-06-02T04:00:47.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.801+0000 7f07af7fe700 1 --2- 172.21.15.123:0/2247507567 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f07b0100fe0 0x7f07b0197090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:00:47.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.801+0000 7f07aeffd700 1 --2- 172.21.15.123:0/2247507567 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07b01021e0 0x7f07b01975d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f07a400b560 tx=0x7f07a400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:00:47.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.801+0000 7f07acff9700 1 -- 172.21.15.123:0/2247507567 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a4011830 con 0x7f07b01021e0 2024-06-02T04:00:47.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.801+0000 7f07acff9700 1 -- 172.21.15.123:0/2247507567 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f07a4011e50 con 0x7f07b01021e0 2024-06-02T04:00:47.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.801+0000 7f07b5e8d700 1 -- 172.21.15.123:0/2247507567 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b019f130 con 0x7f07b01021e0 2024-06-02T04:00:47.810 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.801+0000 7f07acff9700 1 -- 172.21.15.123:0/2247507567 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a400f2e0 con 0x7f07b01021e0 2024-06-02T04:00:47.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.801+0000 7f07b5e8d700 1 -- 172.21.15.123:0/2247507567 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b019f680 con 0x7f07b01021e0 2024-06-02T04:00:47.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.802+0000 7f07b5e8d700 1 -- 172.21.15.123:0/2247507567 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b01083a0 con 0x7f07b01021e0 2024-06-02T04:00:47.811 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.805+0000 7f07acff9700 1 -- 172.21.15.123:0/2247507567 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f07a4010580 con 0x7f07b01021e0 2024-06-02T04:00:47.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.805+0000 7f07acff9700 1 --2- 172.21.15.123:0/2247507567 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f07980a11a0 0x7f07980a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:00:47.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.805+0000 7f07af7fe700 1 --2- 172.21.15.123:0/2247507567 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f07980a11a0 0x7f07980a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:00:47.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.805+0000 7f07acff9700 1 -- 172.21.15.123:0/2247507567 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4253+0+0 (secure 0 0 0) 0x7f07a40cb870 con 0x7f07b01021e0 2024-06-02T04:00:47.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.805+0000 7f07af7fe700 1 --2- 172.21.15.123:0/2247507567 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f07980a11a0 0x7f07980a3660 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f07a0005950 tx=0x7f07a00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:00:47.813 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:47.809+0000 7f07acff9700 1 -- 172.21.15.123:0/2247507567 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f07a4095fc0 con 0x7f07b01021e0 2024-06-02T04:00:48.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:00:48.010+0000 7f07b5e8d700 1 -- 172.21.15.123:0/2247507567 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f07b002ce10 con 0x7f07980a11a0 2024-06-02T04:00:48.048 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jun 02 04:00:47 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-5[60832]: 2024-06-02T04:00:47.588+0000 7ff6b1a30700 -1 osd.5 0 waiting for initial osdmap 2024-06-02T04:00:48.048 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jun 02 04:00:47 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-5[60832]: 2024-06-02T04:00:47.596+0000 7ff6a981d700 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T04:00:48.525 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:48 smithi123 ceph-mon[42885]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-06-02T04:00:48.525 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:48 smithi123 ceph-mon[42885]: osdmap e36: 6 total, 5 up, 6 in 2024-06-02T04:00:48.525 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:48 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:00:48.525 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:48 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:00:48.525 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:48 smithi123 ceph-mon[42885]: from='osd.5 ' entity='osd.5' 2024-06-02T04:00:48.525 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:48 smithi123 ceph-mon[42885]: from='client.14373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:00:48.525 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:48 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:00:48.525 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:48 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:00:48.525 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:48 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:48.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:48 smithi162 ceph-mon[47009]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-06-02T04:00:48.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:48 smithi162 ceph-mon[47009]: osdmap e36: 6 total, 5 up, 6 in 2024-06-02T04:00:48.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:48 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:00:48.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:48 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:00:48.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:48 smithi162 ceph-mon[47009]: from='osd.5 ' entity='osd.5' 2024-06-02T04:00:48.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:48 smithi162 ceph-mon[47009]: from='client.14373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:00:48.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:48 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:00:48.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:48 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:00:48.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:48 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:48.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:48 smithi136 ceph-mon[47443]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-06-02T04:00:48.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:48 smithi136 ceph-mon[47443]: osdmap e36: 6 total, 5 up, 6 in 2024-06-02T04:00:48.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:48 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:00:48.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:48 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:00:48.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:48 smithi136 ceph-mon[47443]: from='osd.5 ' entity='osd.5' 2024-06-02T04:00:48.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:48 smithi136 ceph-mon[47443]: from='client.14373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:00:48.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:48 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:00:48.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:48 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:00:48.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:48 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:49.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:49 smithi162 ceph-mon[47009]: purged_snaps scrub starts 2024-06-02T04:00:49.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:49 smithi162 ceph-mon[47009]: purged_snaps scrub ok 2024-06-02T04:00:49.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:49 smithi162 ceph-mon[47009]: osd.5 [v2:172.21.15.162:6808/3094256489,v1:172.21.15.162:6809/3094256489] boot 2024-06-02T04:00:49.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:49 smithi162 ceph-mon[47009]: osdmap e37: 6 total, 6 up, 6 in 2024-06-02T04:00:49.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:49 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:00:49.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:49 smithi162 ceph-mon[47009]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:00:49.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:49 smithi123 ceph-mon[42885]: purged_snaps scrub starts 2024-06-02T04:00:49.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:49 smithi123 ceph-mon[42885]: purged_snaps scrub ok 2024-06-02T04:00:49.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:49 smithi123 ceph-mon[42885]: osd.5 [v2:172.21.15.162:6808/3094256489,v1:172.21.15.162:6809/3094256489] boot 2024-06-02T04:00:49.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:49 smithi123 ceph-mon[42885]: osdmap e37: 6 total, 6 up, 6 in 2024-06-02T04:00:49.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:49 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:00:49.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:49 smithi123 ceph-mon[42885]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:00:49.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:49 smithi136 ceph-mon[47443]: purged_snaps scrub starts 2024-06-02T04:00:49.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:49 smithi136 ceph-mon[47443]: purged_snaps scrub ok 2024-06-02T04:00:49.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:49 smithi136 ceph-mon[47443]: osd.5 [v2:172.21.15.162:6808/3094256489,v1:172.21.15.162:6809/3094256489] boot 2024-06-02T04:00:49.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:49 smithi136 ceph-mon[47443]: osdmap e37: 6 total, 6 up, 6 in 2024-06-02T04:00:49.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:49 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-06-02T04:00:49.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:49 smithi136 ceph-mon[47443]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-06-02T04:00:50.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:50 smithi162 ceph-mon[47009]: osdmap e38: 6 total, 6 up, 6 in 2024-06-02T04:00:50.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:50 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/1574057536' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6f170b85-6c47-49ff-ba5b-7fe0596a4ce6"}]: dispatch 2024-06-02T04:00:50.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:50 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/1574057536' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6f170b85-6c47-49ff-ba5b-7fe0596a4ce6"}]': finished 2024-06-02T04:00:50.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:50 smithi162 ceph-mon[47009]: osdmap e39: 7 total, 6 up, 7 in 2024-06-02T04:00:50.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:50 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:00:50.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:50 smithi123 ceph-mon[42885]: osdmap e38: 6 total, 6 up, 6 in 2024-06-02T04:00:50.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:50 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1574057536' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6f170b85-6c47-49ff-ba5b-7fe0596a4ce6"}]: dispatch 2024-06-02T04:00:50.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:50 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1574057536' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6f170b85-6c47-49ff-ba5b-7fe0596a4ce6"}]': finished 2024-06-02T04:00:50.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:50 smithi123 ceph-mon[42885]: osdmap e39: 7 total, 6 up, 7 in 2024-06-02T04:00:50.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:50 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:00:50.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:50 smithi136 ceph-mon[47443]: osdmap e38: 6 total, 6 up, 6 in 2024-06-02T04:00:50.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:50 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/1574057536' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6f170b85-6c47-49ff-ba5b-7fe0596a4ce6"}]: dispatch 2024-06-02T04:00:50.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:50 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/1574057536' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6f170b85-6c47-49ff-ba5b-7fe0596a4ce6"}]': finished 2024-06-02T04:00:50.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:50 smithi136 ceph-mon[47443]: osdmap e39: 7 total, 6 up, 7 in 2024-06-02T04:00:50.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:50 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:00:51.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:51 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/4205834892' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:00:51.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:51 smithi162 ceph-mon[47009]: pgmap v111: 1 pgs: 1 remapped+peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-06-02T04:00:51.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:51 smithi162 ceph-mon[47009]: osdmap e40: 7 total, 6 up, 7 in 2024-06-02T04:00:51.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:51 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:00:51.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:51 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/4205834892' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:00:51.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:51 smithi123 ceph-mon[42885]: pgmap v111: 1 pgs: 1 remapped+peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-06-02T04:00:51.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:51 smithi123 ceph-mon[42885]: osdmap e40: 7 total, 6 up, 7 in 2024-06-02T04:00:51.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:51 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:00:51.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:51 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/4205834892' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:00:51.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:51 smithi136 ceph-mon[47443]: pgmap v111: 1 pgs: 1 remapped+peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-06-02T04:00:51.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:51 smithi136 ceph-mon[47443]: osdmap e40: 7 total, 6 up, 7 in 2024-06-02T04:00:51.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:51 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:00:53.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:53 smithi162 ceph-mon[47009]: osdmap e41: 7 total, 6 up, 7 in 2024-06-02T04:00:53.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:53 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:00:53.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:53 smithi123 ceph-mon[42885]: osdmap e41: 7 total, 6 up, 7 in 2024-06-02T04:00:53.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:53 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:00:53.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:53 smithi136 ceph-mon[47443]: osdmap e41: 7 total, 6 up, 7 in 2024-06-02T04:00:53.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:53 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:00:54.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:54 smithi162 ceph-mon[47009]: pgmap v114: 1 pgs: 1 remapped+peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-06-02T04:00:54.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:54 smithi123 ceph-mon[42885]: pgmap v114: 1 pgs: 1 remapped+peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-06-02T04:00:54.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:54 smithi136 ceph-mon[47443]: pgmap v114: 1 pgs: 1 remapped+peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-06-02T04:00:56.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:56 smithi123 ceph-mon[42885]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-06-02T04:00:56.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:56 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-02T04:00:56.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:56 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:56.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:56 smithi136 ceph-mon[47443]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-06-02T04:00:56.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:56 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-02T04:00:56.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:56 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:56.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:56 smithi162 ceph-mon[47009]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-06-02T04:00:56.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:56 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-06-02T04:00:56.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:56 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:00:57.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:57 smithi123 ceph-mon[42885]: Deploying daemon osd.6 on smithi123 2024-06-02T04:00:57.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:57 smithi136 ceph-mon[47443]: Deploying daemon osd.6 on smithi123 2024-06-02T04:00:57.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:57 smithi162 ceph-mon[47009]: Deploying daemon osd.6 on smithi123 2024-06-02T04:00:58.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:58 smithi123 ceph-mon[42885]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-06-02T04:00:58.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:58 smithi136 ceph-mon[47443]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-06-02T04:00:58.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:58 smithi162 ceph-mon[47009]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-06-02T04:00:59.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:00:59 smithi123 ceph-mon[42885]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-02T04:00:59.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:00:59 smithi136 ceph-mon[47443]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-02T04:00:59.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:00:59 smithi162 ceph-mon[47009]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-02T04:01:00.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:00 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:00.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:00 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:01:00.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:00 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:01.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:00 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:01.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:00 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:01:01.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:00 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:01.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:00 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:01.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:00 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:01:01.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:00 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:01.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:01 smithi162 ceph-mon[47009]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-06-02T04:01:01.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:01.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:01.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:01.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:01:01.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:01.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:01.955+0000 7f07acff9700 1 -- 172.21.15.123:0/2247507567 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f07b002ce10 con 0x7f07980a11a0 2024-06-02T04:01:01.956 INFO:teuthology.orchestra.run.smithi123.stdout:Created osd(s) 6 on host 'smithi123' 2024-06-02T04:01:01.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:01.957+0000 7f07b5e8d700 1 -- 172.21.15.123:0/2247507567 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f07980a11a0 msgr2=0x7f07980a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:01:01.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:01.957+0000 7f07b5e8d700 1 --2- 172.21.15.123:0/2247507567 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f07980a11a0 0x7f07980a3660 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f07a0005950 tx=0x7f07a00058e0 comp rx=0 tx=0).stop 2024-06-02T04:01:01.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:01.957+0000 7f07b5e8d700 1 -- 172.21.15.123:0/2247507567 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07b01021e0 msgr2=0x7f07b01975d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:01:01.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:01.957+0000 7f07b5e8d700 1 --2- 172.21.15.123:0/2247507567 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07b01021e0 0x7f07b01975d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f07a400b560 tx=0x7f07a400b870 comp rx=0 tx=0).stop 2024-06-02T04:01:01.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:01.957+0000 7f07b5e8d700 1 -- 172.21.15.123:0/2247507567 shutdown_connections 2024-06-02T04:01:01.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:01.957+0000 7f07b5e8d700 1 --2- 172.21.15.123:0/2247507567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07b0102b80 0x7f07b019e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:01.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:01.957+0000 7f07b5e8d700 1 --2- 172.21.15.123:0/2247507567 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f07980a11a0 0x7f07980a3660 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:01.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:01.957+0000 7f07b5e8d700 1 --2- 172.21.15.123:0/2247507567 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f07b0100fe0 0x7f07b0197090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:01.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:01.957+0000 7f07b5e8d700 1 --2- 172.21.15.123:0/2247507567 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f07b01021e0 0x7f07b01975d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:01.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:01.957+0000 7f07b5e8d700 1 -- 172.21.15.123:0/2247507567 >> 172.21.15.123:0/2247507567 conn(0x7f07b00fc5a0 msgr2=0x7f07b01054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:01:01.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:01.958+0000 7f07b5e8d700 1 -- 172.21.15.123:0/2247507567 shutdown_connections 2024-06-02T04:01:01.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:01.958+0000 7f07b5e8d700 1 -- 172.21.15.123:0/2247507567 wait complete. 2024-06-02T04:01:01.977 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:01 smithi123 ceph-mon[42885]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-06-02T04:01:01.977 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:01.977 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:01.977 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:01.977 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:01:01.977 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:02.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:01 smithi136 ceph-mon[47443]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-06-02T04:01:02.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:02.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:02.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:02.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:01:02.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:02.277 DEBUG:teuthology.orchestra.run.smithi123:osd.6> sudo journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.6.service 2024-06-02T04:01:02.279 INFO:tasks.cephadm:Deploying osd.7 on smithi136 with /dev/vg_nvme/lv_2... 2024-06-02T04:01:02.280 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-06-02T04:01:02.313 INFO:journalctl@ceph.osd.6.smithi123.stdout:-- Logs begin at Sun 2024-06-02 03:41:15 UTC. -- 2024-06-02T04:01:02.515 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T04:01:03.193 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:02 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:03.193 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:02 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:03.193 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:02 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:01:03.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:02 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:03.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:02 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:03.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:02 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:01:03.320 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:02 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:03.321 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:02 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:03.321 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:02 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:01:03.822 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:01:03 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:01:03.464+0000 7f1e8fd837c0 -1 osd.6 0 log_to_monitors true 2024-06-02T04:01:03.856 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-06-02T04:01:03.857 INFO:teuthology.orchestra.run.smithi136.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-06-02T04:01:03.857 INFO:teuthology.orchestra.run.smithi136.stderr: stderr: 10+0 records in 2024-06-02T04:01:03.857 INFO:teuthology.orchestra.run.smithi136.stderr:10+0 records out 2024-06-02T04:01:03.857 INFO:teuthology.orchestra.run.smithi136.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00713927 s, 1.5 GB/s 2024-06-02T04:01:03.857 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping successful for: 2024-06-02T04:01:04.206 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:03 smithi136 ceph-mon[47443]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-06-02T04:01:04.206 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:03 smithi136 ceph-mon[47443]: from='osd.6 [v2:172.21.15.123:6818/3025820432,v1:172.21.15.123:6819/3025820432]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-02T04:01:04.217 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:03 smithi123 ceph-mon[42885]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-06-02T04:01:04.217 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:03 smithi123 ceph-mon[42885]: from='osd.6 [v2:172.21.15.123:6818/3025820432,v1:172.21.15.123:6819/3025820432]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-02T04:01:04.225 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi136:vg_nvme/lv_2 2024-06-02T04:01:04.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:03 smithi162 ceph-mon[47009]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-06-02T04:01:04.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:03 smithi162 ceph-mon[47009]: from='osd.6 [v2:172.21.15.123:6818/3025820432,v1:172.21.15.123:6819/3025820432]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-06-02T04:01:04.448 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T04:01:05.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:04 smithi162 ceph-mon[47009]: from='osd.6 [v2:172.21.15.123:6818/3025820432,v1:172.21.15.123:6819/3025820432]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-02T04:01:05.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:04 smithi162 ceph-mon[47009]: osdmap e42: 7 total, 6 up, 7 in 2024-06-02T04:01:05.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:04 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:01:05.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:04 smithi162 ceph-mon[47009]: from='osd.6 [v2:172.21.15.123:6818/3025820432,v1:172.21.15.123:6819/3025820432]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-06-02T04:01:05.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:04 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:05.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:04 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:05.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:04 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:05.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:04 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:05.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:04 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:05.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:04 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:05.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:04 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:05.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:04 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:01:05.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:04 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:05.319 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:04 smithi136 ceph-mon[47443]: from='osd.6 [v2:172.21.15.123:6818/3025820432,v1:172.21.15.123:6819/3025820432]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-02T04:01:05.319 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:04 smithi136 ceph-mon[47443]: osdmap e42: 7 total, 6 up, 7 in 2024-06-02T04:01:05.320 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:04 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:01:05.320 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:04 smithi136 ceph-mon[47443]: from='osd.6 [v2:172.21.15.123:6818/3025820432,v1:172.21.15.123:6819/3025820432]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-06-02T04:01:05.320 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:04 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:05.320 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:04 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:05.320 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:04 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:05.320 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:04 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:05.320 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:04 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:05.320 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:04 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:05.320 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:04 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:05.320 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:04 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:01:05.320 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:04 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:05.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:04 smithi123 ceph-mon[42885]: from='osd.6 [v2:172.21.15.123:6818/3025820432,v1:172.21.15.123:6819/3025820432]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-06-02T04:01:05.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:04 smithi123 ceph-mon[42885]: osdmap e42: 7 total, 6 up, 7 in 2024-06-02T04:01:05.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:04 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:01:05.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:04 smithi123 ceph-mon[42885]: from='osd.6 [v2:172.21.15.123:6818/3025820432,v1:172.21.15.123:6819/3025820432]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-06-02T04:01:05.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:04 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:05.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:04 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:05.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:04 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:05.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:04 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:05.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:04 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:05.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:04 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:05.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:04 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:05.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:04 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:01:05.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:04 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:05.324 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:01:04 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:01:04.956+0000 7f1e853e7700 -1 osd.6 0 waiting for initial osdmap 2024-06-02T04:01:05.324 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:01:04 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:01:04.969+0000 7f1e811dc700 -1 osd.6 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T04:01:05.531 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.530+0000 7f2203ce7700 1 -- 172.21.15.136:0/4158279616 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21fc0fff00 msgr2=0x7f21fc100320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:01:05.531 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.530+0000 7f2203ce7700 1 --2- 172.21.15.136:0/4158279616 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21fc0fff00 0x7f21fc100320 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f21f0009990 tx=0x7f21f0009ca0 comp rx=0 tx=0).stop 2024-06-02T04:01:05.531 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.531+0000 7f2203ce7700 1 -- 172.21.15.136:0/4158279616 shutdown_connections 2024-06-02T04:01:05.531 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.531+0000 7f2203ce7700 1 --2- 172.21.15.136:0/4158279616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21fc101a20 0x7f21fc108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:05.531 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.531+0000 7f2203ce7700 1 --2- 172.21.15.136:0/4158279616 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21fc0fff00 0x7f21fc100320 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:05.532 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.531+0000 7f2203ce7700 1 --2- 172.21.15.136:0/4158279616 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21fc101060 0x7f21fc1014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:05.532 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.531+0000 7f2203ce7700 1 -- 172.21.15.136:0/4158279616 >> 172.21.15.136:0/4158279616 conn(0x7f21fc0fb4c0 msgr2=0x7f21fc0fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:01:05.532 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.531+0000 7f2203ce7700 1 -- 172.21.15.136:0/4158279616 shutdown_connections 2024-06-02T04:01:05.532 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.531+0000 7f2203ce7700 1 -- 172.21.15.136:0/4158279616 wait complete. 2024-06-02T04:01:05.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.531+0000 7f2203ce7700 1 Processor -- start 2024-06-02T04:01:05.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.531+0000 7f2203ce7700 1 -- start start 2024-06-02T04:01:05.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.531+0000 7f2203ce7700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21fc0fff00 0x7f21fc069d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:01:05.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.531+0000 7f2203ce7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21fc101060 0x7f21fc19bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:01:05.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.531+0000 7f2203ce7700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21fc101a20 0x7f21fc19e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:01:05.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.531+0000 7f2203ce7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21fc19e9d0 con 0x7f21fc101060 2024-06-02T04:01:05.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.531+0000 7f2203ce7700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21fc19eb40 con 0x7f21fc0fff00 2024-06-02T04:01:05.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.531+0000 7f2203ce7700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21fc19ed00 con 0x7f21fc101a20 2024-06-02T04:01:05.534 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.532+0000 7f2201a83700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21fc0fff00 0x7f21fc069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:01:05.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.532+0000 7f2201a83700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21fc0fff00 0x7f21fc069d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:58178/0 (socket says 172.21.15.136:58178) 2024-06-02T04:01:05.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.532+0000 7f2201a83700 1 -- 172.21.15.136:0/3678769426 learned_addr learned my addr 172.21.15.136:0/3678769426 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-06-02T04:01:05.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.532+0000 7f2201282700 1 --2- 172.21.15.136:0/3678769426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21fc101060 0x7f21fc19bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:01:05.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.532+0000 7f2202284700 1 --2- 172.21.15.136:0/3678769426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21fc101a20 0x7f21fc19e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:01:05.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.532+0000 7f2201a83700 1 -- 172.21.15.136:0/3678769426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21fc101a20 msgr2=0x7f21fc19e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:01:05.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.532+0000 7f2201a83700 1 --2- 172.21.15.136:0/3678769426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21fc101a20 0x7f21fc19e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:05.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.532+0000 7f2201a83700 1 -- 172.21.15.136:0/3678769426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21fc101060 msgr2=0x7f21fc19bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:01:05.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.532+0000 7f2201a83700 1 --2- 172.21.15.136:0/3678769426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21fc101060 0x7f21fc19bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:05.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.532+0000 7f2201a83700 1 -- 172.21.15.136:0/3678769426 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f00095f0 con 0x7f21fc0fff00 2024-06-02T04:01:05.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.532+0000 7f2201282700 1 --2- 172.21.15.136:0/3678769426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21fc101060 0x7f21fc19bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:01:05.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.532+0000 7f2202284700 1 --2- 172.21.15.136:0/3678769426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21fc101a20 0x7f21fc19e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:01:05.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.532+0000 7f2201a83700 1 --2- 172.21.15.136:0/3678769426 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21fc0fff00 0x7f21fc069d90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f21f000c010 tx=0x7f21f0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:01:05.535 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.532+0000 7f21eeffd700 1 -- 172.21.15.136:0/3678769426 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f001d070 con 0x7f21fc0fff00 2024-06-02T04:01:05.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.532+0000 7f21eeffd700 1 -- 172.21.15.136:0/3678769426 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f21f00054f0 con 0x7f21fc0fff00 2024-06-02T04:01:05.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.532+0000 7f2203ce7700 1 -- 172.21.15.136:0/3678769426 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21fc19ef80 con 0x7f21fc0fff00 2024-06-02T04:01:05.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.532+0000 7f21eeffd700 1 -- 172.21.15.136:0/3678769426 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f0004d10 con 0x7f21fc0fff00 2024-06-02T04:01:05.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.532+0000 7f2203ce7700 1 -- 172.21.15.136:0/3678769426 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21fc19f2e0 con 0x7f21fc0fff00 2024-06-02T04:01:05.536 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.533+0000 7f2203ce7700 1 -- 172.21.15.136:0/3678769426 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21fc1073d0 con 0x7f21fc0fff00 2024-06-02T04:01:05.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.534+0000 7f21eeffd700 1 -- 172.21.15.136:0/3678769426 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f21f000fc50 con 0x7f21fc0fff00 2024-06-02T04:01:05.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.535+0000 7f21eeffd700 1 --2- 172.21.15.136:0/3678769426 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f21e80a11a0 0x7f21e80a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:01:05.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.535+0000 7f21eeffd700 1 -- 172.21.15.136:0/3678769426 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4685+0+0 (secure 0 0 0) 0x7f21f00ccd10 con 0x7f21fc0fff00 2024-06-02T04:01:05.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.535+0000 7f2201282700 1 --2- 172.21.15.136:0/3678769426 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f21e80a11a0 0x7f21e80a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:01:05.537 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.535+0000 7f2201282700 1 --2- 172.21.15.136:0/3678769426 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f21e80a11a0 0x7f21e80a3660 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f21f8011490 tx=0x7f21f8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:01:05.539 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.539+0000 7f21eeffd700 1 -- 172.21.15.136:0/3678769426 <== mon.2 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f21f00972c0 con 0x7f21fc0fff00 2024-06-02T04:01:05.739 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:05.738+0000 7f2203ce7700 1 -- 172.21.15.136:0/3678769426 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f21fc02cf00 con 0x7f21e80a11a0 2024-06-02T04:01:06.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:05 smithi162 ceph-mon[47009]: Detected new or changed devices on smithi123 2024-06-02T04:01:06.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:05 smithi162 ceph-mon[47009]: Adjusting osd_memory_target on smithi123 to 5704M 2024-06-02T04:01:06.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:05 smithi162 ceph-mon[47009]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-02T04:01:06.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:05 smithi162 ceph-mon[47009]: from='osd.6 [v2:172.21.15.123:6818/3025820432,v1:172.21.15.123:6819/3025820432]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-06-02T04:01:06.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:05 smithi162 ceph-mon[47009]: osdmap e43: 7 total, 6 up, 7 in 2024-06-02T04:01:06.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:05 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:01:06.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:05 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:01:06.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:05 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:01:06.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:05 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:01:06.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:05 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:06.312 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:05 smithi136 ceph-mon[47443]: Detected new or changed devices on smithi123 2024-06-02T04:01:06.312 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:05 smithi136 ceph-mon[47443]: Adjusting osd_memory_target on smithi123 to 5704M 2024-06-02T04:01:06.312 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:05 smithi136 ceph-mon[47443]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-02T04:01:06.312 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:05 smithi136 ceph-mon[47443]: from='osd.6 [v2:172.21.15.123:6818/3025820432,v1:172.21.15.123:6819/3025820432]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-06-02T04:01:06.312 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:05 smithi136 ceph-mon[47443]: osdmap e43: 7 total, 6 up, 7 in 2024-06-02T04:01:06.312 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:05 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:01:06.312 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:05 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:01:06.313 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:05 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:01:06.313 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:05 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:01:06.313 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:05 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:06.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:05 smithi123 ceph-mon[42885]: Detected new or changed devices on smithi123 2024-06-02T04:01:06.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:05 smithi123 ceph-mon[42885]: Adjusting osd_memory_target on smithi123 to 5704M 2024-06-02T04:01:06.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:05 smithi123 ceph-mon[42885]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-02T04:01:06.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:05 smithi123 ceph-mon[42885]: from='osd.6 [v2:172.21.15.123:6818/3025820432,v1:172.21.15.123:6819/3025820432]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-06-02T04:01:06.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:05 smithi123 ceph-mon[42885]: osdmap e43: 7 total, 6 up, 7 in 2024-06-02T04:01:06.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:05 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:01:06.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:05 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:01:06.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:05 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:01:06.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:05 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:01:06.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:05 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:07.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:06 smithi162 ceph-mon[47009]: purged_snaps scrub starts 2024-06-02T04:01:07.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:06 smithi162 ceph-mon[47009]: purged_snaps scrub ok 2024-06-02T04:01:07.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:06 smithi162 ceph-mon[47009]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:01:07.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:06 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:01:07.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:06 smithi162 ceph-mon[47009]: osd.6 [v2:172.21.15.123:6818/3025820432,v1:172.21.15.123:6819/3025820432] boot 2024-06-02T04:01:07.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:06 smithi162 ceph-mon[47009]: osdmap e44: 7 total, 7 up, 7 in 2024-06-02T04:01:07.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:06 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:01:07.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:06 smithi123 ceph-mon[42885]: purged_snaps scrub starts 2024-06-02T04:01:07.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:06 smithi123 ceph-mon[42885]: purged_snaps scrub ok 2024-06-02T04:01:07.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:06 smithi123 ceph-mon[42885]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:01:07.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:06 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:01:07.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:06 smithi123 ceph-mon[42885]: osd.6 [v2:172.21.15.123:6818/3025820432,v1:172.21.15.123:6819/3025820432] boot 2024-06-02T04:01:07.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:06 smithi123 ceph-mon[42885]: osdmap e44: 7 total, 7 up, 7 in 2024-06-02T04:01:07.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:06 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:01:07.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:06 smithi136 ceph-mon[47443]: purged_snaps scrub starts 2024-06-02T04:01:07.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:06 smithi136 ceph-mon[47443]: purged_snaps scrub ok 2024-06-02T04:01:07.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:06 smithi136 ceph-mon[47443]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:01:07.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:06 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:01:07.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:06 smithi136 ceph-mon[47443]: osd.6 [v2:172.21.15.123:6818/3025820432,v1:172.21.15.123:6819/3025820432] boot 2024-06-02T04:01:07.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:06 smithi136 ceph-mon[47443]: osdmap e44: 7 total, 7 up, 7 in 2024-06-02T04:01:07.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:06 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-06-02T04:01:08.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:07 smithi162 ceph-mon[47009]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-02T04:01:08.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:07 smithi162 ceph-mon[47009]: osdmap e45: 7 total, 7 up, 7 in 2024-06-02T04:01:08.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:07 smithi162 ceph-mon[47009]: from='client.? 172.21.15.136:0/1536003398' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee66bb7a-6c0d-4e5a-b717-258a39f93a87"}]: dispatch 2024-06-02T04:01:08.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:07 smithi162 ceph-mon[47009]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee66bb7a-6c0d-4e5a-b717-258a39f93a87"}]: dispatch 2024-06-02T04:01:08.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:07 smithi162 ceph-mon[47009]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ee66bb7a-6c0d-4e5a-b717-258a39f93a87"}]': finished 2024-06-02T04:01:08.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:07 smithi162 ceph-mon[47009]: osdmap e46: 8 total, 7 up, 8 in 2024-06-02T04:01:08.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:07 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:01:08.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:07 smithi123 ceph-mon[42885]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-02T04:01:08.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:07 smithi123 ceph-mon[42885]: osdmap e45: 7 total, 7 up, 7 in 2024-06-02T04:01:08.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:07 smithi123 ceph-mon[42885]: from='client.? 172.21.15.136:0/1536003398' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee66bb7a-6c0d-4e5a-b717-258a39f93a87"}]: dispatch 2024-06-02T04:01:08.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:07 smithi123 ceph-mon[42885]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee66bb7a-6c0d-4e5a-b717-258a39f93a87"}]: dispatch 2024-06-02T04:01:08.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:07 smithi123 ceph-mon[42885]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ee66bb7a-6c0d-4e5a-b717-258a39f93a87"}]': finished 2024-06-02T04:01:08.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:07 smithi123 ceph-mon[42885]: osdmap e46: 8 total, 7 up, 8 in 2024-06-02T04:01:08.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:07 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:01:08.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:07 smithi136 ceph-mon[47443]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-06-02T04:01:08.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:07 smithi136 ceph-mon[47443]: osdmap e45: 7 total, 7 up, 7 in 2024-06-02T04:01:08.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:07 smithi136 ceph-mon[47443]: from='client.? 172.21.15.136:0/1536003398' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee66bb7a-6c0d-4e5a-b717-258a39f93a87"}]: dispatch 2024-06-02T04:01:08.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:07 smithi136 ceph-mon[47443]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee66bb7a-6c0d-4e5a-b717-258a39f93a87"}]: dispatch 2024-06-02T04:01:08.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:07 smithi136 ceph-mon[47443]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ee66bb7a-6c0d-4e5a-b717-258a39f93a87"}]': finished 2024-06-02T04:01:08.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:07 smithi136 ceph-mon[47443]: osdmap e46: 8 total, 7 up, 8 in 2024-06-02T04:01:08.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:07 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:01:09.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:08 smithi162 ceph-mon[47009]: from='client.? 172.21.15.136:0/3788862119' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:01:09.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:08 smithi123 ceph-mon[42885]: from='client.? 172.21.15.136:0/3788862119' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:01:09.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:08 smithi136 ceph-mon[47443]: from='client.? 172.21.15.136:0/3788862119' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:01:10.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:09 smithi162 ceph-mon[47009]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:01:10.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:09 smithi123 ceph-mon[42885]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:01:10.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:09 smithi136 ceph-mon[47443]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:01:12.253 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:11 smithi136 ceph-mon[47443]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:01:12.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:11 smithi162 ceph-mon[47009]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:01:12.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:11 smithi123 ceph-mon[42885]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:01:14.258 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:13 smithi136 ceph-mon[47443]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:01:14.258 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:13 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-02T04:01:14.258 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:13 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:14.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:13 smithi162 ceph-mon[47009]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:01:14.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:13 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-02T04:01:14.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:13 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:14.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:13 smithi123 ceph-mon[42885]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:01:14.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:13 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-06-02T04:01:14.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:13 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:15.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:14 smithi162 ceph-mon[47009]: Deploying daemon osd.7 on smithi136 2024-06-02T04:01:15.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:14 smithi123 ceph-mon[42885]: Deploying daemon osd.7 on smithi136 2024-06-02T04:01:15.328 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:14 smithi136 ceph-mon[47443]: Deploying daemon osd.7 on smithi136 2024-06-02T04:01:16.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:15 smithi162 ceph-mon[47009]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:01:16.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:15 smithi123 ceph-mon[42885]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:01:16.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:15 smithi136 ceph-mon[47443]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:01:18.012 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:17 smithi136 ceph-mon[47443]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:01:18.012 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:17 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:18.012 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:17 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:18.012 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:17 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:01:18.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:17 smithi162 ceph-mon[47009]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:01:18.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:17 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:18.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:17 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:18.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:17 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:01:18.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:17 smithi123 ceph-mon[42885]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:01:18.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:18.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:18.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:01:19.638 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:19.639+0000 7f21eeffd700 1 -- 172.21.15.136:0/3678769426 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f21fc02cf00 con 0x7f21e80a11a0 2024-06-02T04:01:19.639 INFO:teuthology.orchestra.run.smithi136.stdout:Created osd(s) 7 on host 'smithi136' 2024-06-02T04:01:19.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:19.641+0000 7f2203ce7700 1 -- 172.21.15.136:0/3678769426 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f21e80a11a0 msgr2=0x7f21e80a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:01:19.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:19.641+0000 7f2203ce7700 1 --2- 172.21.15.136:0/3678769426 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f21e80a11a0 0x7f21e80a3660 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f21f8011490 tx=0x7f21f8009260 comp rx=0 tx=0).stop 2024-06-02T04:01:19.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:19.642+0000 7f2203ce7700 1 -- 172.21.15.136:0/3678769426 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21fc0fff00 msgr2=0x7f21fc069d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:01:19.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:19.642+0000 7f2203ce7700 1 --2- 172.21.15.136:0/3678769426 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21fc0fff00 0x7f21fc069d90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f21f000c010 tx=0x7f21f0004730 comp rx=0 tx=0).stop 2024-06-02T04:01:19.641 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:19.642+0000 7f2203ce7700 1 -- 172.21.15.136:0/3678769426 shutdown_connections 2024-06-02T04:01:19.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:19.642+0000 7f2203ce7700 1 --2- 172.21.15.136:0/3678769426 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21fc101a20 0x7f21fc19e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:19.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:19.642+0000 7f2203ce7700 1 --2- 172.21.15.136:0/3678769426 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f21e80a11a0 0x7f21e80a3660 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:19.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:19.642+0000 7f2203ce7700 1 --2- 172.21.15.136:0/3678769426 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f21fc0fff00 0x7f21fc069d90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:19.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:19.642+0000 7f2203ce7700 1 --2- 172.21.15.136:0/3678769426 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f21fc101060 0x7f21fc19bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:19.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:19.642+0000 7f2203ce7700 1 -- 172.21.15.136:0/3678769426 >> 172.21.15.136:0/3678769426 conn(0x7f21fc0fb4c0 msgr2=0x7f21fc104510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:01:19.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:19.642+0000 7f2203ce7700 1 -- 172.21.15.136:0/3678769426 shutdown_connections 2024-06-02T04:01:19.642 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:19.642+0000 7f2203ce7700 1 -- 172.21.15.136:0/3678769426 wait complete. 2024-06-02T04:01:20.046 DEBUG:teuthology.orchestra.run.smithi136:osd.7> sudo journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.7.service 2024-06-02T04:01:20.049 INFO:tasks.cephadm:Deploying osd.8 on smithi162 with /dev/vg_nvme/lv_2... 2024-06-02T04:01:20.049 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-06-02T04:01:20.074 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:19 smithi136 ceph-mon[47443]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:01:20.074 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:19 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:20.075 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:19 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:20.075 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:19 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:20.075 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:19 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:01:20.075 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:19 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:20.075 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:19 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:20.076 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:19 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:20.076 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:19 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:01:20.081 INFO:journalctl@ceph.osd.7.smithi136.stdout:-- Logs begin at Sun 2024-06-02 03:40:52 UTC. -- 2024-06-02T04:01:20.282 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T04:01:20.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:19 smithi162 ceph-mon[47009]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:01:20.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:19 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:20.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:19 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:20.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:19 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:20.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:19 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:01:20.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:19 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:20.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:19 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:20.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:19 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:20.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:19 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:01:20.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:19 smithi123 ceph-mon[42885]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:01:20.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:19 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:20.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:19 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:20.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:19 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:20.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:19 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:01:20.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:19 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:20.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:19 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:20.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:19 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:20.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:19 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:01:21.589 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:01:21 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:01:21.320+0000 7f067bc0f7c0 -1 osd.7 0 log_to_monitors true 2024-06-02T04:01:21.601 INFO:teuthology.orchestra.run.smithi162.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-06-02T04:01:21.601 INFO:teuthology.orchestra.run.smithi162.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-06-02T04:01:21.601 INFO:teuthology.orchestra.run.smithi162.stderr: stderr: 10+0 records in 2024-06-02T04:01:21.601 INFO:teuthology.orchestra.run.smithi162.stderr:10+0 records out 2024-06-02T04:01:21.601 INFO:teuthology.orchestra.run.smithi162.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112007 s, 936 MB/s 2024-06-02T04:01:21.601 INFO:teuthology.orchestra.run.smithi162.stderr:--> Zapping successful for: 2024-06-02T04:01:21.992 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi162:vg_nvme/lv_2 2024-06-02T04:01:22.212 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T04:01:22.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:21 smithi162 ceph-mon[47009]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:01:22.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:21 smithi162 ceph-mon[47009]: from='osd.7 [v2:172.21.15.136:6816/1948829505,v1:172.21.15.136:6817/1948829505]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-02T04:01:22.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:21 smithi162 ceph-mon[47009]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-02T04:01:22.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:21 smithi123 ceph-mon[42885]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:01:22.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:21 smithi123 ceph-mon[42885]: from='osd.7 [v2:172.21.15.136:6816/1948829505,v1:172.21.15.136:6817/1948829505]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-02T04:01:22.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:21 smithi123 ceph-mon[42885]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-02T04:01:22.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:21 smithi136 ceph-mon[47443]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:01:22.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:21 smithi136 ceph-mon[47443]: from='osd.7 [v2:172.21.15.136:6816/1948829505,v1:172.21.15.136:6817/1948829505]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-02T04:01:22.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:21 smithi136 ceph-mon[47443]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-06-02T04:01:23.047 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:22 smithi162 ceph-mon[47009]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-02T04:01:23.047 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:22 smithi162 ceph-mon[47009]: osdmap e47: 8 total, 7 up, 8 in 2024-06-02T04:01:23.047 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:22 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:01:23.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:22 smithi162 ceph-mon[47009]: from='osd.7 [v2:172.21.15.136:6816/1948829505,v1:172.21.15.136:6817/1948829505]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-06-02T04:01:23.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:22 smithi162 ceph-mon[47009]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-06-02T04:01:23.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:22 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:23.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:22 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:23.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:22 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:23.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:22 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:23.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:22 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:23.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:22 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:23.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:22 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:23.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:22 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:01:23.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:22 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:23.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.233+0000 7f9e99320700 1 -- 172.21.15.162:0/3067421677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e94100b60 msgr2=0x7f9e94108400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:01:23.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.233+0000 7f9e99320700 1 --2- 172.21.15.162:0/3067421677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e94100b60 0x7f9e94108400 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c00b0a0 tx=0x7f9e8c00b3b0 comp rx=0 tx=0).stop 2024-06-02T04:01:23.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.233+0000 7f9e99320700 1 -- 172.21.15.162:0/3067421677 shutdown_connections 2024-06-02T04:01:23.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.233+0000 7f9e99320700 1 --2- 172.21.15.162:0/3067421677 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e94100b60 0x7f9e94108400 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:23.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.233+0000 7f9e99320700 1 --2- 172.21.15.162:0/3067421677 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e94101540 0x7f9e94101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:23.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.233+0000 7f9e99320700 1 --2- 172.21.15.162:0/3067421677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e941001a0 0x7f9e94100620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:23.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.233+0000 7f9e99320700 1 -- 172.21.15.162:0/3067421677 >> 172.21.15.162:0/3067421677 conn(0x7f9e940facb0 msgr2=0x7f9e940fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:01:23.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.233+0000 7f9e99320700 1 -- 172.21.15.162:0/3067421677 shutdown_connections 2024-06-02T04:01:23.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.233+0000 7f9e99320700 1 -- 172.21.15.162:0/3067421677 wait complete. 2024-06-02T04:01:23.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.233+0000 7f9e99320700 1 Processor -- start 2024-06-02T04:01:23.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.233+0000 7f9e99320700 1 -- start start 2024-06-02T04:01:23.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.234+0000 7f9e99320700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e941001a0 0x7f9e94195f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:01:23.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.234+0000 7f9e99320700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e94100b60 0x7f9e941964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:01:23.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.234+0000 7f9e99320700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e94101540 0x7f9e9419d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:01:23.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.234+0000 7f9e99320700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9419dab0 con 0x7f9e94101540 2024-06-02T04:01:23.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.234+0000 7f9e99320700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9419dbf0 con 0x7f9e941001a0 2024-06-02T04:01:23.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.234+0000 7f9e99320700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9419dd80 con 0x7f9e94100b60 2024-06-02T04:01:23.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.234+0000 7f9e927fc700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e94100b60 0x7f9e941964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:01:23.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.234+0000 7f9e927fc700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e94100b60 0x7f9e941964b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51758/0 (socket says 172.21.15.162:51758) 2024-06-02T04:01:23.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.234+0000 7f9e927fc700 1 -- 172.21.15.162:0/1808148355 learned_addr learned my addr 172.21.15.162:0/1808148355 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-06-02T04:01:23.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.234+0000 7f9e937fe700 1 --2- 172.21.15.162:0/1808148355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e94101540 0x7f9e9419d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:01:23.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.234+0000 7f9e92ffd700 1 --2- 172.21.15.162:0/1808148355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e941001a0 0x7f9e94195f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:01:23.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.234+0000 7f9e927fc700 1 -- 172.21.15.162:0/1808148355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e941001a0 msgr2=0x7f9e94195f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:01:23.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.234+0000 7f9e927fc700 1 --2- 172.21.15.162:0/1808148355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e941001a0 0x7f9e94195f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:23.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.234+0000 7f9e927fc700 1 -- 172.21.15.162:0/1808148355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e94101540 msgr2=0x7f9e9419d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:01:23.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.234+0000 7f9e927fc700 1 --2- 172.21.15.162:0/1808148355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e94101540 0x7f9e9419d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:23.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.234+0000 7f9e927fc700 1 -- 172.21.15.162:0/1808148355 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8c009d00 con 0x7f9e94100b60 2024-06-02T04:01:23.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.234+0000 7f9e92ffd700 1 --2- 172.21.15.162:0/1808148355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e941001a0 0x7f9e94195f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:01:23.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.234+0000 7f9e927fc700 1 --2- 172.21.15.162:0/1808148355 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e94100b60 0x7f9e941964b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9e840099a0 tx=0x7f9e84009cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:01:23.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.234+0000 7f9e7bfff700 1 -- 172.21.15.162:0/1808148355 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e84012070 con 0x7f9e94100b60 2024-06-02T04:01:23.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.234+0000 7f9e99320700 1 -- 172.21.15.162:0/1808148355 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e940ff0f0 con 0x7f9e94100b60 2024-06-02T04:01:23.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.234+0000 7f9e7bfff700 1 -- 172.21.15.162:0/1808148355 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9e8400d8f0 con 0x7f9e94100b60 2024-06-02T04:01:23.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.234+0000 7f9e7bfff700 1 -- 172.21.15.162:0/1808148355 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8400c9c0 con 0x7f9e94100b60 2024-06-02T04:01:23.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.234+0000 7f9e99320700 1 -- 172.21.15.162:0/1808148355 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e940ff640 con 0x7f9e94100b60 2024-06-02T04:01:23.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.235+0000 7f9e99320700 1 -- 172.21.15.162:0/1808148355 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e9404ec60 con 0x7f9e94100b60 2024-06-02T04:01:23.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.236+0000 7f9e7bfff700 1 -- 172.21.15.162:0/1808148355 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f9e84007c00 con 0x7f9e94100b60 2024-06-02T04:01:23.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.237+0000 7f9e7bfff700 1 --2- 172.21.15.162:0/1808148355 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9e7c0a1120 0x7f9e7c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:01:23.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.237+0000 7f9e7bfff700 1 -- 172.21.15.162:0/1808148355 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5117+0+0 (secure 0 0 0) 0x7f9e840ccc90 con 0x7f9e94100b60 2024-06-02T04:01:23.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.237+0000 7f9e92ffd700 1 --2- 172.21.15.162:0/1808148355 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9e7c0a1120 0x7f9e7c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:01:23.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.238+0000 7f9e92ffd700 1 --2- 172.21.15.162:0/1808148355 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9e7c0a1120 0x7f9e7c0a35e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9e88005950 tx=0x7f9e880058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:01:23.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.241+0000 7f9e7bfff700 1 -- 172.21.15.162:0/1808148355 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9e84097000 con 0x7f9e94100b60 2024-06-02T04:01:23.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:22 smithi123 ceph-mon[42885]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-02T04:01:23.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:22 smithi123 ceph-mon[42885]: osdmap e47: 8 total, 7 up, 8 in 2024-06-02T04:01:23.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:22 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:01:23.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:22 smithi123 ceph-mon[42885]: from='osd.7 [v2:172.21.15.136:6816/1948829505,v1:172.21.15.136:6817/1948829505]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-06-02T04:01:23.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:22 smithi123 ceph-mon[42885]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-06-02T04:01:23.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:22 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:23.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:22 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:23.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:22 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:23.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:22 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:23.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:22 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:23.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:22 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:23.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:22 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:23.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:22 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:01:23.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:22 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:23.338 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:01:22 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:01:22.923+0000 7f0671273700 -1 osd.7 0 waiting for initial osdmap 2024-06-02T04:01:23.338 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:01:22 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:01:22.932+0000 7f066d068700 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T04:01:23.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:22 smithi136 ceph-mon[47443]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-06-02T04:01:23.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:22 smithi136 ceph-mon[47443]: osdmap e47: 8 total, 7 up, 8 in 2024-06-02T04:01:23.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:22 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:01:23.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:22 smithi136 ceph-mon[47443]: from='osd.7 [v2:172.21.15.136:6816/1948829505,v1:172.21.15.136:6817/1948829505]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-06-02T04:01:23.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:22 smithi136 ceph-mon[47443]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-06-02T04:01:23.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:22 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:23.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:22 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:23.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:22 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:23.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:22 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:23.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:22 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:23.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:22 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:23.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:22 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:23.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:22 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:01:23.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:22 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:23.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:23.439+0000 7f9e99320700 1 -- 172.21.15.162:0/1808148355 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e94106e60 con 0x7f9e7c0a1120 2024-06-02T04:01:24.145 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:23 smithi162 ceph-mon[47009]: Detected new or changed devices on smithi136 2024-06-02T04:01:24.145 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:23 smithi162 ceph-mon[47009]: Adjusting osd_memory_target on smithi136 to 5704M 2024-06-02T04:01:24.145 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:23 smithi162 ceph-mon[47009]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:01:24.145 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:23 smithi162 ceph-mon[47009]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-06-02T04:01:24.145 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:23 smithi162 ceph-mon[47009]: osdmap e48: 8 total, 7 up, 8 in 2024-06-02T04:01:24.145 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:23 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:01:24.146 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:23 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:01:24.146 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:23 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:01:24.146 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:23 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:01:24.146 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:23 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:24.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:23 smithi123 ceph-mon[42885]: Detected new or changed devices on smithi136 2024-06-02T04:01:24.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:23 smithi123 ceph-mon[42885]: Adjusting osd_memory_target on smithi136 to 5704M 2024-06-02T04:01:24.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:23 smithi123 ceph-mon[42885]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:01:24.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:23 smithi123 ceph-mon[42885]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-06-02T04:01:24.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:23 smithi123 ceph-mon[42885]: osdmap e48: 8 total, 7 up, 8 in 2024-06-02T04:01:24.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:23 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:01:24.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:23 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:01:24.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:23 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:01:24.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:23 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:01:24.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:23 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:24.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:23 smithi136 ceph-mon[47443]: Detected new or changed devices on smithi136 2024-06-02T04:01:24.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:23 smithi136 ceph-mon[47443]: Adjusting osd_memory_target on smithi136 to 5704M 2024-06-02T04:01:24.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:23 smithi136 ceph-mon[47443]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-06-02T04:01:24.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:23 smithi136 ceph-mon[47443]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-06-02T04:01:24.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:23 smithi136 ceph-mon[47443]: osdmap e48: 8 total, 7 up, 8 in 2024-06-02T04:01:24.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:23 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:01:24.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:23 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:01:24.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:23 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:01:24.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:23 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:01:24.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:23 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:25.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:24 smithi162 ceph-mon[47009]: purged_snaps scrub starts 2024-06-02T04:01:25.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:24 smithi162 ceph-mon[47009]: purged_snaps scrub ok 2024-06-02T04:01:25.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:24 smithi162 ceph-mon[47009]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:01:25.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:24 smithi162 ceph-mon[47009]: osd.7 [v2:172.21.15.136:6816/1948829505,v1:172.21.15.136:6817/1948829505] boot 2024-06-02T04:01:25.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:24 smithi162 ceph-mon[47009]: osdmap e49: 8 total, 8 up, 8 in 2024-06-02T04:01:25.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:24 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:01:25.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:24 smithi123 ceph-mon[42885]: purged_snaps scrub starts 2024-06-02T04:01:25.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:24 smithi123 ceph-mon[42885]: purged_snaps scrub ok 2024-06-02T04:01:25.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:24 smithi123 ceph-mon[42885]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:01:25.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:24 smithi123 ceph-mon[42885]: osd.7 [v2:172.21.15.136:6816/1948829505,v1:172.21.15.136:6817/1948829505] boot 2024-06-02T04:01:25.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:24 smithi123 ceph-mon[42885]: osdmap e49: 8 total, 8 up, 8 in 2024-06-02T04:01:25.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:24 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:01:25.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:24 smithi136 ceph-mon[47443]: purged_snaps scrub starts 2024-06-02T04:01:25.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:24 smithi136 ceph-mon[47443]: purged_snaps scrub ok 2024-06-02T04:01:25.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:24 smithi136 ceph-mon[47443]: from='client.24310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:01:25.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:24 smithi136 ceph-mon[47443]: osd.7 [v2:172.21.15.136:6816/1948829505,v1:172.21.15.136:6817/1948829505] boot 2024-06-02T04:01:25.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:24 smithi136 ceph-mon[47443]: osdmap e49: 8 total, 8 up, 8 in 2024-06-02T04:01:25.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:24 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-06-02T04:01:26.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:25 smithi162 ceph-mon[47009]: pgmap v138: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:01:26.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:25 smithi162 ceph-mon[47009]: osdmap e50: 8 total, 8 up, 8 in 2024-06-02T04:01:26.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:25 smithi162 ceph-mon[47009]: from='client.? 172.21.15.162:0/3629405416' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0ff77e33-53a5-43ef-85da-2036a1fcdb09"}]: dispatch 2024-06-02T04:01:26.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:25 smithi162 ceph-mon[47009]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0ff77e33-53a5-43ef-85da-2036a1fcdb09"}]: dispatch 2024-06-02T04:01:26.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:25 smithi162 ceph-mon[47009]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0ff77e33-53a5-43ef-85da-2036a1fcdb09"}]': finished 2024-06-02T04:01:26.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:25 smithi162 ceph-mon[47009]: osdmap e51: 9 total, 8 up, 9 in 2024-06-02T04:01:26.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:25 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:01:26.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:25 smithi123 ceph-mon[42885]: pgmap v138: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:01:26.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:25 smithi123 ceph-mon[42885]: osdmap e50: 8 total, 8 up, 8 in 2024-06-02T04:01:26.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:25 smithi123 ceph-mon[42885]: from='client.? 172.21.15.162:0/3629405416' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0ff77e33-53a5-43ef-85da-2036a1fcdb09"}]: dispatch 2024-06-02T04:01:26.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:25 smithi123 ceph-mon[42885]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0ff77e33-53a5-43ef-85da-2036a1fcdb09"}]: dispatch 2024-06-02T04:01:26.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:25 smithi123 ceph-mon[42885]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0ff77e33-53a5-43ef-85da-2036a1fcdb09"}]': finished 2024-06-02T04:01:26.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:25 smithi123 ceph-mon[42885]: osdmap e51: 9 total, 8 up, 9 in 2024-06-02T04:01:26.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:25 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:01:26.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:25 smithi136 ceph-mon[47443]: pgmap v138: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:01:26.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:25 smithi136 ceph-mon[47443]: osdmap e50: 8 total, 8 up, 8 in 2024-06-02T04:01:26.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:25 smithi136 ceph-mon[47443]: from='client.? 172.21.15.162:0/3629405416' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0ff77e33-53a5-43ef-85da-2036a1fcdb09"}]: dispatch 2024-06-02T04:01:26.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:25 smithi136 ceph-mon[47443]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0ff77e33-53a5-43ef-85da-2036a1fcdb09"}]: dispatch 2024-06-02T04:01:26.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:25 smithi136 ceph-mon[47443]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0ff77e33-53a5-43ef-85da-2036a1fcdb09"}]': finished 2024-06-02T04:01:26.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:25 smithi136 ceph-mon[47443]: osdmap e51: 9 total, 8 up, 9 in 2024-06-02T04:01:26.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:25 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:01:27.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:26 smithi162 ceph-mon[47009]: from='client.? 172.21.15.162:0/4123010198' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:01:27.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:26 smithi162 ceph-mon[47009]: osdmap e52: 9 total, 8 up, 9 in 2024-06-02T04:01:27.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:26 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:01:27.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:26 smithi123 ceph-mon[42885]: from='client.? 172.21.15.162:0/4123010198' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:01:27.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:26 smithi123 ceph-mon[42885]: osdmap e52: 9 total, 8 up, 9 in 2024-06-02T04:01:27.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:26 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:01:27.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:26 smithi136 ceph-mon[47443]: from='client.? 172.21.15.162:0/4123010198' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:01:27.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:26 smithi136 ceph-mon[47443]: osdmap e52: 9 total, 8 up, 9 in 2024-06-02T04:01:27.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:26 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:01:28.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:28 smithi123 ceph-mon[42885]: pgmap v142: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:01:28.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:28 smithi123 ceph-mon[42885]: osdmap e53: 9 total, 8 up, 9 in 2024-06-02T04:01:28.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:28 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:01:28.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:28 smithi136 ceph-mon[47443]: pgmap v142: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:01:28.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:28 smithi136 ceph-mon[47443]: osdmap e53: 9 total, 8 up, 9 in 2024-06-02T04:01:28.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:28 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:01:28.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:28 smithi162 ceph-mon[47009]: pgmap v142: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:01:28.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:28 smithi162 ceph-mon[47009]: osdmap e53: 9 total, 8 up, 9 in 2024-06-02T04:01:28.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:28 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:01:30.194 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:30 smithi162 ceph-mon[47009]: pgmap v144: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:01:30.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:30 smithi123 ceph-mon[42885]: pgmap v144: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:01:30.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:30 smithi136 ceph-mon[47443]: pgmap v144: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:01:32.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:32 smithi162 ceph-mon[47009]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:01:32.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:32 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-06-02T04:01:32.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:32 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:32.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:32 smithi123 ceph-mon[42885]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:01:32.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:32 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-06-02T04:01:32.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:32 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:32.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:32 smithi136 ceph-mon[47443]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:01:32.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:32 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-06-02T04:01:32.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:32 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:33.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:33 smithi162 ceph-mon[47009]: Deploying daemon osd.8 on smithi162 2024-06-02T04:01:33.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:33 smithi162 ceph-mon[47009]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:01:33.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:33 smithi123 ceph-mon[42885]: Deploying daemon osd.8 on smithi162 2024-06-02T04:01:33.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:33 smithi123 ceph-mon[42885]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:01:33.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:33 smithi136 ceph-mon[47443]: Deploying daemon osd.8 on smithi162 2024-06-02T04:01:33.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:33 smithi136 ceph-mon[47443]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:01:36.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:35 smithi162 ceph-mon[47009]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:01:36.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:35 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:36.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:35 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:36.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:35 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:01:36.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:35 smithi123 ceph-mon[42885]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:01:36.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:35 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:36.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:35 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:36.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:35 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:01:36.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:35 smithi136 ceph-mon[47443]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:01:36.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:35 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:36.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:35 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:36.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:35 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:01:37.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:37.197+0000 7f9e7bfff700 1 -- 172.21.15.162:0/1808148355 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9e94106e60 con 0x7f9e7c0a1120 2024-06-02T04:01:37.197 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 8 on host 'smithi162' 2024-06-02T04:01:37.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:37.199+0000 7f9e99320700 1 -- 172.21.15.162:0/1808148355 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9e7c0a1120 msgr2=0x7f9e7c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:01:37.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:37.199+0000 7f9e99320700 1 --2- 172.21.15.162:0/1808148355 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9e7c0a1120 0x7f9e7c0a35e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9e88005950 tx=0x7f9e880058e0 comp rx=0 tx=0).stop 2024-06-02T04:01:37.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:37.199+0000 7f9e99320700 1 -- 172.21.15.162:0/1808148355 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e94100b60 msgr2=0x7f9e941964b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:01:37.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:37.199+0000 7f9e99320700 1 --2- 172.21.15.162:0/1808148355 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e94100b60 0x7f9e941964b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9e840099a0 tx=0x7f9e84009cb0 comp rx=0 tx=0).stop 2024-06-02T04:01:37.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:37.199+0000 7f9e99320700 1 -- 172.21.15.162:0/1808148355 shutdown_connections 2024-06-02T04:01:37.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:37.199+0000 7f9e99320700 1 --2- 172.21.15.162:0/1808148355 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e94101540 0x7f9e9419d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:37.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:37.199+0000 7f9e99320700 1 --2- 172.21.15.162:0/1808148355 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9e7c0a1120 0x7f9e7c0a35e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:37.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:37.199+0000 7f9e99320700 1 --2- 172.21.15.162:0/1808148355 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e941001a0 0x7f9e94195f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:37.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:37.199+0000 7f9e99320700 1 --2- 172.21.15.162:0/1808148355 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e94100b60 0x7f9e941964b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:37.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:37.199+0000 7f9e99320700 1 -- 172.21.15.162:0/1808148355 >> 172.21.15.162:0/1808148355 conn(0x7f9e940facb0 msgr2=0x7f9e941044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:01:37.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:37.199+0000 7f9e99320700 1 -- 172.21.15.162:0/1808148355 shutdown_connections 2024-06-02T04:01:37.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:01:37.199+0000 7f9e99320700 1 -- 172.21.15.162:0/1808148355 wait complete. 2024-06-02T04:01:37.501 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:37 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:37.501 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:37 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:37.501 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:37 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:37.501 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:37 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:01:37.501 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:37 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:37.501 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:37 smithi162 ceph-mon[47009]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:01:37.502 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:37 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:37.502 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:37 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:37.502 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:37 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:01:37.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:37 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:37.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:37 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:37.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:37 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:37.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:37 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:01:37.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:37 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:37.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:37 smithi123 ceph-mon[42885]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:01:37.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:37 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:37.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:37 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:37.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:37 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:01:37.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:37 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:37.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:37 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:37.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:37 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:37.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:37 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:01:37.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:37 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:37.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:37 smithi136 ceph-mon[47443]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:01:37.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:37 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:37.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:37 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:37.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:37 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:01:37.615 DEBUG:teuthology.orchestra.run.smithi162:osd.8> sudo journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.8.service 2024-06-02T04:01:37.617 INFO:tasks.cephadm:Deploying osd.9 on smithi123 with /dev/vg_nvme/lv_1... 2024-06-02T04:01:37.618 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-06-02T04:01:37.660 INFO:journalctl@ceph.osd.8.smithi162.stdout:-- Logs begin at Sun 2024-06-02 03:41:09 UTC. -- 2024-06-02T04:01:37.863 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:01:39.120 INFO:teuthology.orchestra.run.smithi123.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-06-02T04:01:39.120 INFO:teuthology.orchestra.run.smithi123.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-06-02T04:01:39.120 INFO:teuthology.orchestra.run.smithi123.stderr: stderr: 10+0 records in 2024-06-02T04:01:39.120 INFO:teuthology.orchestra.run.smithi123.stderr:10+0 records out 2024-06-02T04:01:39.120 INFO:teuthology.orchestra.run.smithi123.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0115061 s, 911 MB/s 2024-06-02T04:01:39.121 INFO:teuthology.orchestra.run.smithi123.stderr: stderr: 2024-06-02T04:01:39.121 INFO:teuthology.orchestra.run.smithi123.stderr:--> Zapping successful for: 2024-06-02T04:01:39.298 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:01:38 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:01:38.941+0000 7fecad8537c0 -1 osd.8 0 log_to_monitors true 2024-06-02T04:01:39.494 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi123:vg_nvme/lv_1 2024-06-02T04:01:39.715 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:01:39.862 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:39 smithi162 ceph-mon[47009]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:01:39.862 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:39 smithi162 ceph-mon[47009]: from='osd.8 [v2:172.21.15.162:6816/1590839230,v1:172.21.15.162:6817/1590839230]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-02T04:01:39.862 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:39 smithi162 ceph-mon[47009]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-02T04:01:39.862 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:39 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:40.137 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:39 smithi123 ceph-mon[42885]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:01:40.137 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:39 smithi123 ceph-mon[42885]: from='osd.8 [v2:172.21.15.162:6816/1590839230,v1:172.21.15.162:6817/1590839230]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-02T04:01:40.138 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:39 smithi123 ceph-mon[42885]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-02T04:01:40.138 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:39 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:40.138 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:39 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:40.138 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:39 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:40.138 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:39 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:40.138 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:39 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:40.138 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:39 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:40.138 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:39 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:40.138 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:39 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:01:40.138 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:39 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:40.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:39 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:40.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:39 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:40.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:39 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:40.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:39 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:40.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:39 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:40.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:39 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:40.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:39 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:01:40.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:39 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:40.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:39 smithi136 ceph-mon[47443]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:01:40.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:39 smithi136 ceph-mon[47443]: from='osd.8 [v2:172.21.15.162:6816/1590839230,v1:172.21.15.162:6817/1590839230]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-02T04:01:40.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:39 smithi136 ceph-mon[47443]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-06-02T04:01:40.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:39 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:40.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:39 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:40.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:39 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:40.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:39 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:40.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:39 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:40.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:39 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:40.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:39 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:40.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:39 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:01:40.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:39 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:40.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.684+0000 7fc5d38e3700 1 -- 172.21.15.123:0/2316690890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5cc101060 msgr2=0x7fc5cc1014e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:01:40.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.684+0000 7fc5d38e3700 1 --2- 172.21.15.123:0/2316690890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5cc101060 0x7fc5cc1014e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc009990 tx=0x7fc5bc009ca0 comp rx=0 tx=0).stop 2024-06-02T04:01:40.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.684+0000 7fc5d38e3700 1 -- 172.21.15.123:0/2316690890 shutdown_connections 2024-06-02T04:01:40.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.684+0000 7fc5d38e3700 1 --2- 172.21.15.123:0/2316690890 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5cc101a20 0x7fc5cc108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:40.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.684+0000 7fc5d38e3700 1 --2- 172.21.15.123:0/2316690890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5cc0fff00 0x7fc5cc100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:40.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.684+0000 7fc5d38e3700 1 --2- 172.21.15.123:0/2316690890 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5cc101060 0x7fc5cc1014e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:40.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.684+0000 7fc5d38e3700 1 -- 172.21.15.123:0/2316690890 >> 172.21.15.123:0/2316690890 conn(0x7fc5cc0fb4c0 msgr2=0x7fc5cc0fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:01:40.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.684+0000 7fc5d38e3700 1 -- 172.21.15.123:0/2316690890 shutdown_connections 2024-06-02T04:01:40.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.684+0000 7fc5d38e3700 1 -- 172.21.15.123:0/2316690890 wait complete. 2024-06-02T04:01:40.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.684+0000 7fc5d38e3700 1 Processor -- start 2024-06-02T04:01:40.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.684+0000 7fc5d38e3700 1 -- start start 2024-06-02T04:01:40.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.685+0000 7fc5d38e3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5cc0fff00 0x7fc5cc069d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:01:40.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.685+0000 7fc5d38e3700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5cc101060 0x7fc5cc19bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:01:40.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.685+0000 7fc5d38e3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5cc101a20 0x7fc5cc19e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:01:40.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.685+0000 7fc5d38e3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc19ea10 con 0x7fc5cc101a20 2024-06-02T04:01:40.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.685+0000 7fc5d38e3700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc19eb80 con 0x7fc5cc0fff00 2024-06-02T04:01:40.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.685+0000 7fc5d38e3700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc19ed40 con 0x7fc5cc101060 2024-06-02T04:01:40.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.685+0000 7fc5d1e80700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5cc101a20 0x7fc5cc19e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:01:40.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.685+0000 7fc5d1e80700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5cc101a20 0x7fc5cc19e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:39516/0 (socket says 172.21.15.123:39516) 2024-06-02T04:01:40.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.685+0000 7fc5d1e80700 1 -- 172.21.15.123:0/2309642345 learned_addr learned my addr 172.21.15.123:0/2309642345 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:01:40.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.685+0000 7fc5d167f700 1 --2- 172.21.15.123:0/2309642345 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5cc0fff00 0x7fc5cc069d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:01:40.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.685+0000 7fc5d0e7e700 1 --2- 172.21.15.123:0/2309642345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5cc101060 0x7fc5cc19bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:01:40.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.685+0000 7fc5d1e80700 1 -- 172.21.15.123:0/2309642345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5cc101060 msgr2=0x7fc5cc19bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:01:40.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.685+0000 7fc5d1e80700 1 --2- 172.21.15.123:0/2309642345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5cc101060 0x7fc5cc19bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:40.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.685+0000 7fc5d1e80700 1 -- 172.21.15.123:0/2309642345 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5cc0fff00 msgr2=0x7fc5cc069d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:01:40.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.685+0000 7fc5d1e80700 1 --2- 172.21.15.123:0/2309642345 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5cc0fff00 0x7fc5cc069d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:40.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.685+0000 7fc5d1e80700 1 -- 172.21.15.123:0/2309642345 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5bc0095f0 con 0x7fc5cc101a20 2024-06-02T04:01:40.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.685+0000 7fc5d1e80700 1 --2- 172.21.15.123:0/2309642345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5cc101a20 0x7fc5cc19e270 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc5c400ada0 tx=0x7fc5c400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:01:40.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.685+0000 7fc5c27fc700 1 -- 172.21.15.123:0/2309642345 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c400f070 con 0x7fc5cc101a20 2024-06-02T04:01:40.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.685+0000 7fc5c27fc700 1 -- 172.21.15.123:0/2309642345 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc5c4007b30 con 0x7fc5cc101a20 2024-06-02T04:01:40.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.685+0000 7fc5d38e3700 1 -- 172.21.15.123:0/2309642345 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5cc19efc0 con 0x7fc5cc101a20 2024-06-02T04:01:40.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.685+0000 7fc5c27fc700 1 -- 172.21.15.123:0/2309642345 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c4005280 con 0x7fc5cc101a20 2024-06-02T04:01:40.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.685+0000 7fc5d38e3700 1 -- 172.21.15.123:0/2309642345 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5cc19f440 con 0x7fc5cc101a20 2024-06-02T04:01:40.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.686+0000 7fc5d38e3700 1 -- 172.21.15.123:0/2309642345 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5cc1073d0 con 0x7fc5cc101a20 2024-06-02T04:01:40.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.687+0000 7fc5c27fc700 1 -- 172.21.15.123:0/2309642345 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fc5c400c8d0 con 0x7fc5cc101a20 2024-06-02T04:01:40.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.688+0000 7fc5c27fc700 1 --2- 172.21.15.123:0/2309642345 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc5b80a1120 0x7fc5b80a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:01:40.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.688+0000 7fc5d167f700 1 --2- 172.21.15.123:0/2309642345 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc5b80a1120 0x7fc5b80a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:01:40.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.688+0000 7fc5c27fc700 1 -- 172.21.15.123:0/2309642345 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5533+0+0 (secure 0 0 0) 0x7fc5c40cb400 con 0x7fc5cc101a20 2024-06-02T04:01:40.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.688+0000 7fc5d167f700 1 --2- 172.21.15.123:0/2309642345 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc5b80a1120 0x7fc5b80a35e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8005950 tx=0x7fc5c800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:01:40.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.692+0000 7fc5c27fc700 1 -- 172.21.15.123:0/2309642345 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc5c40990f0 con 0x7fc5cc101a20 2024-06-02T04:01:40.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:40.898+0000 7fc5d38e3700 1 -- 172.21.15.123:0/2309642345 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5cc02ce10 con 0x7fc5b80a1120 2024-06-02T04:01:41.259 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:40 smithi123 ceph-mon[42885]: Detected new or changed devices on smithi162 2024-06-02T04:01:41.259 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:40 smithi123 ceph-mon[42885]: Adjusting osd_memory_target on smithi162 to 5704M 2024-06-02T04:01:41.259 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:40 smithi123 ceph-mon[42885]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-06-02T04:01:41.259 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:40 smithi123 ceph-mon[42885]: osdmap e54: 9 total, 8 up, 9 in 2024-06-02T04:01:41.259 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:40 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:01:41.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:40 smithi123 ceph-mon[42885]: from='osd.8 [v2:172.21.15.162:6816/1590839230,v1:172.21.15.162:6817/1590839230]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-06-02T04:01:41.260 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:40 smithi123 ceph-mon[42885]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-06-02T04:01:41.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:40 smithi162 ceph-mon[47009]: Detected new or changed devices on smithi162 2024-06-02T04:01:41.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:40 smithi162 ceph-mon[47009]: Adjusting osd_memory_target on smithi162 to 5704M 2024-06-02T04:01:41.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:40 smithi162 ceph-mon[47009]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-06-02T04:01:41.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:40 smithi162 ceph-mon[47009]: osdmap e54: 9 total, 8 up, 9 in 2024-06-02T04:01:41.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:40 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:01:41.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:40 smithi162 ceph-mon[47009]: from='osd.8 [v2:172.21.15.162:6816/1590839230,v1:172.21.15.162:6817/1590839230]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-06-02T04:01:41.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:40 smithi162 ceph-mon[47009]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-06-02T04:01:41.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:40 smithi136 ceph-mon[47443]: Detected new or changed devices on smithi162 2024-06-02T04:01:41.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:40 smithi136 ceph-mon[47443]: Adjusting osd_memory_target on smithi162 to 5704M 2024-06-02T04:01:41.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:40 smithi136 ceph-mon[47443]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-06-02T04:01:41.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:40 smithi136 ceph-mon[47443]: osdmap e54: 9 total, 8 up, 9 in 2024-06-02T04:01:41.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:40 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:01:41.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:40 smithi136 ceph-mon[47443]: from='osd.8 [v2:172.21.15.162:6816/1590839230,v1:172.21.15.162:6817/1590839230]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-06-02T04:01:41.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:40 smithi136 ceph-mon[47443]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-06-02T04:01:41.798 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:01:41 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:01:41.372+0000 7feca2eb7700 -1 osd.8 0 waiting for initial osdmap 2024-06-02T04:01:41.798 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:01:41 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:01:41.386+0000 7fec9aca4700 -1 osd.8 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T04:01:42.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:41 smithi162 ceph-mon[47009]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:01:42.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:41 smithi162 ceph-mon[47009]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-06-02T04:01:42.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:41 smithi162 ceph-mon[47009]: osdmap e55: 9 total, 8 up, 9 in 2024-06-02T04:01:42.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:41 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:01:42.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:41 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:01:42.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:41 smithi162 ceph-mon[47009]: from='client.14439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:01:42.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:41 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:01:42.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:41 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:01:42.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:41 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:42.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:41 smithi162 ceph-mon[47009]: osdmap e56: 9 total, 8 up, 9 in 2024-06-02T04:01:42.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:41 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:01:42.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:41 smithi162 ceph-mon[47009]: from='osd.8 ' entity='osd.8' 2024-06-02T04:01:42.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:41 smithi123 ceph-mon[42885]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:01:42.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:41 smithi123 ceph-mon[42885]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-06-02T04:01:42.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:41 smithi123 ceph-mon[42885]: osdmap e55: 9 total, 8 up, 9 in 2024-06-02T04:01:42.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:41 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:01:42.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:41 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:01:42.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:41 smithi123 ceph-mon[42885]: from='client.14439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:01:42.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:41 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:01:42.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:41 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:01:42.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:41 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:42.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:41 smithi123 ceph-mon[42885]: osdmap e56: 9 total, 8 up, 9 in 2024-06-02T04:01:42.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:41 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:01:42.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:41 smithi123 ceph-mon[42885]: from='osd.8 ' entity='osd.8' 2024-06-02T04:01:42.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:41 smithi136 ceph-mon[47443]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:01:42.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:41 smithi136 ceph-mon[47443]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-06-02T04:01:42.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:41 smithi136 ceph-mon[47443]: osdmap e55: 9 total, 8 up, 9 in 2024-06-02T04:01:42.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:41 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:01:42.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:41 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:01:42.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:41 smithi136 ceph-mon[47443]: from='client.14439 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi123:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:01:42.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:41 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:01:42.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:41 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:01:42.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:41 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:42.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:41 smithi136 ceph-mon[47443]: osdmap e56: 9 total, 8 up, 9 in 2024-06-02T04:01:42.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:41 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:01:42.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:41 smithi136 ceph-mon[47443]: from='osd.8 ' entity='osd.8' 2024-06-02T04:01:43.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:42 smithi162 ceph-mon[47009]: purged_snaps scrub starts 2024-06-02T04:01:43.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:42 smithi162 ceph-mon[47009]: purged_snaps scrub ok 2024-06-02T04:01:43.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:42 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:01:43.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:42 smithi162 ceph-mon[47009]: osd.8 [v2:172.21.15.162:6816/1590839230,v1:172.21.15.162:6817/1590839230] boot 2024-06-02T04:01:43.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:42 smithi162 ceph-mon[47009]: osdmap e57: 9 total, 9 up, 9 in 2024-06-02T04:01:43.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:42 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:01:43.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:42 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/2580911154' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1670731c-5e8f-4cbc-8f35-6aeb14ea3075"}]: dispatch 2024-06-02T04:01:43.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:42 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/2580911154' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1670731c-5e8f-4cbc-8f35-6aeb14ea3075"}]': finished 2024-06-02T04:01:43.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:42 smithi162 ceph-mon[47009]: osdmap e58: 10 total, 9 up, 10 in 2024-06-02T04:01:43.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:42 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:01:43.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:42 smithi123 ceph-mon[42885]: purged_snaps scrub starts 2024-06-02T04:01:43.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:42 smithi123 ceph-mon[42885]: purged_snaps scrub ok 2024-06-02T04:01:43.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:42 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:01:43.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:42 smithi123 ceph-mon[42885]: osd.8 [v2:172.21.15.162:6816/1590839230,v1:172.21.15.162:6817/1590839230] boot 2024-06-02T04:01:43.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:42 smithi123 ceph-mon[42885]: osdmap e57: 9 total, 9 up, 9 in 2024-06-02T04:01:43.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:42 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:01:43.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:42 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2580911154' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1670731c-5e8f-4cbc-8f35-6aeb14ea3075"}]: dispatch 2024-06-02T04:01:43.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:42 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2580911154' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1670731c-5e8f-4cbc-8f35-6aeb14ea3075"}]': finished 2024-06-02T04:01:43.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:42 smithi123 ceph-mon[42885]: osdmap e58: 10 total, 9 up, 10 in 2024-06-02T04:01:43.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:42 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:01:43.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:42 smithi136 ceph-mon[47443]: purged_snaps scrub starts 2024-06-02T04:01:43.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:42 smithi136 ceph-mon[47443]: purged_snaps scrub ok 2024-06-02T04:01:43.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:42 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:01:43.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:42 smithi136 ceph-mon[47443]: osd.8 [v2:172.21.15.162:6816/1590839230,v1:172.21.15.162:6817/1590839230] boot 2024-06-02T04:01:43.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:42 smithi136 ceph-mon[47443]: osdmap e57: 9 total, 9 up, 9 in 2024-06-02T04:01:43.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:42 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-06-02T04:01:43.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:42 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/2580911154' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1670731c-5e8f-4cbc-8f35-6aeb14ea3075"}]: dispatch 2024-06-02T04:01:43.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:42 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/2580911154' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1670731c-5e8f-4cbc-8f35-6aeb14ea3075"}]': finished 2024-06-02T04:01:43.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:42 smithi136 ceph-mon[47443]: osdmap e58: 10 total, 9 up, 10 in 2024-06-02T04:01:43.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:42 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:01:44.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:43 smithi162 ceph-mon[47009]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:01:44.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:43 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/2455987419' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:01:44.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:43 smithi162 ceph-mon[47009]: osdmap e59: 10 total, 9 up, 10 in 2024-06-02T04:01:44.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:43 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:01:44.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:43 smithi123 ceph-mon[42885]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:01:44.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:43 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2455987419' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:01:44.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:43 smithi123 ceph-mon[42885]: osdmap e59: 10 total, 9 up, 10 in 2024-06-02T04:01:44.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:43 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:01:44.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:43 smithi136 ceph-mon[47443]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-06-02T04:01:44.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:43 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/2455987419' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:01:44.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:43 smithi136 ceph-mon[47443]: osdmap e59: 10 total, 9 up, 10 in 2024-06-02T04:01:44.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:43 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:01:46.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:45 smithi162 ceph-mon[47009]: osdmap e60: 10 total, 9 up, 10 in 2024-06-02T04:01:46.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:45 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:01:46.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:45 smithi162 ceph-mon[47009]: pgmap v159: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 258 MiB used, 804 GiB / 805 GiB avail; 154 KiB/s, 0 objects/s recovering 2024-06-02T04:01:46.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:45 smithi123 ceph-mon[42885]: osdmap e60: 10 total, 9 up, 10 in 2024-06-02T04:01:46.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:45 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:01:46.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:45 smithi123 ceph-mon[42885]: pgmap v159: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 258 MiB used, 804 GiB / 805 GiB avail; 154 KiB/s, 0 objects/s recovering 2024-06-02T04:01:46.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:45 smithi136 ceph-mon[47443]: osdmap e60: 10 total, 9 up, 10 in 2024-06-02T04:01:46.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:01:46.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:45 smithi136 ceph-mon[47443]: pgmap v159: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 258 MiB used, 804 GiB / 805 GiB avail; 154 KiB/s, 0 objects/s recovering 2024-06-02T04:01:47.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:46 smithi162 ceph-mon[47009]: osdmap e61: 10 total, 9 up, 10 in 2024-06-02T04:01:47.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:46 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:01:47.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:46 smithi123 ceph-mon[42885]: osdmap e61: 10 total, 9 up, 10 in 2024-06-02T04:01:47.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:46 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:01:47.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:46 smithi136 ceph-mon[47443]: osdmap e61: 10 total, 9 up, 10 in 2024-06-02T04:01:47.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:46 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:01:47.969 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:47 smithi123 ceph-mon[42885]: pgmap v161: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 141 KiB/s, 0 objects/s recovering 2024-06-02T04:01:48.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:47 smithi162 ceph-mon[47009]: pgmap v161: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 141 KiB/s, 0 objects/s recovering 2024-06-02T04:01:48.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:47 smithi136 ceph-mon[47443]: pgmap v161: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 141 KiB/s, 0 objects/s recovering 2024-06-02T04:01:49.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:48 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-06-02T04:01:49.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:48 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:49.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:48 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-06-02T04:01:49.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:48 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:49.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:48 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-06-02T04:01:49.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:48 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:50.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:49 smithi162 ceph-mon[47009]: Deploying daemon osd.9 on smithi123 2024-06-02T04:01:50.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:49 smithi162 ceph-mon[47009]: pgmap v162: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-02T04:01:50.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:49 smithi123 ceph-mon[42885]: Deploying daemon osd.9 on smithi123 2024-06-02T04:01:50.075 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:49 smithi123 ceph-mon[42885]: pgmap v162: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-02T04:01:50.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:49 smithi136 ceph-mon[47443]: Deploying daemon osd.9 on smithi123 2024-06-02T04:01:50.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:49 smithi136 ceph-mon[47443]: pgmap v162: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-06-02T04:01:52.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:51 smithi123 ceph-mon[42885]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-06-02T04:01:52.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:51 smithi162 ceph-mon[47009]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-06-02T04:01:52.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:51 smithi136 ceph-mon[47443]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-06-02T04:01:53.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:53 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:53.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:53 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:53.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:53 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:01:53.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:53 smithi123 ceph-mon[42885]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-02T04:01:53.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:53 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:53.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:53 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:53.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:53 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:01:53.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:53 smithi162 ceph-mon[47009]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-02T04:01:53.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:53 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:53.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:53 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:53.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:53 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:01:53.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:53 smithi136 ceph-mon[47443]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-02T04:01:54.697 INFO:teuthology.orchestra.run.smithi123.stdout:Created osd(s) 9 on host 'smithi123' 2024-06-02T04:01:54.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:54.697+0000 7fc5c27fc700 1 -- 172.21.15.123:0/2309642345 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc5cc02ce10 con 0x7fc5b80a1120 2024-06-02T04:01:54.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:54.699+0000 7fc5d38e3700 1 -- 172.21.15.123:0/2309642345 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc5b80a1120 msgr2=0x7fc5b80a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:01:54.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:54.699+0000 7fc5d38e3700 1 --2- 172.21.15.123:0/2309642345 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc5b80a1120 0x7fc5b80a35e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8005950 tx=0x7fc5c800a300 comp rx=0 tx=0).stop 2024-06-02T04:01:54.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:54.699+0000 7fc5d38e3700 1 -- 172.21.15.123:0/2309642345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5cc101a20 msgr2=0x7fc5cc19e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:01:54.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:54.699+0000 7fc5d38e3700 1 --2- 172.21.15.123:0/2309642345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5cc101a20 0x7fc5cc19e270 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc5c400ada0 tx=0x7fc5c400c330 comp rx=0 tx=0).stop 2024-06-02T04:01:54.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:54.699+0000 7fc5d38e3700 1 -- 172.21.15.123:0/2309642345 shutdown_connections 2024-06-02T04:01:54.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:54.699+0000 7fc5d38e3700 1 --2- 172.21.15.123:0/2309642345 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc5cc101a20 0x7fc5cc19e270 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:54.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:54.699+0000 7fc5d38e3700 1 --2- 172.21.15.123:0/2309642345 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc5b80a1120 0x7fc5b80a35e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:54.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:54.699+0000 7fc5d38e3700 1 --2- 172.21.15.123:0/2309642345 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5cc0fff00 0x7fc5cc069d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:54.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:54.699+0000 7fc5d38e3700 1 --2- 172.21.15.123:0/2309642345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc5cc101060 0x7fc5cc19bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:54.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:54.699+0000 7fc5d38e3700 1 -- 172.21.15.123:0/2309642345 >> 172.21.15.123:0/2309642345 conn(0x7fc5cc0fb4c0 msgr2=0x7fc5cc104510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:01:54.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:54.699+0000 7fc5d38e3700 1 -- 172.21.15.123:0/2309642345 shutdown_connections 2024-06-02T04:01:54.700 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:01:54.699+0000 7fc5d38e3700 1 -- 172.21.15.123:0/2309642345 wait complete. 2024-06-02T04:01:55.040 DEBUG:teuthology.orchestra.run.smithi123:osd.9> sudo journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.9.service 2024-06-02T04:01:55.042 INFO:tasks.cephadm:Deploying osd.10 on smithi136 with /dev/vg_nvme/lv_1... 2024-06-02T04:01:55.043 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-06-02T04:01:55.075 INFO:journalctl@ceph.osd.9.smithi123.stdout:-- Logs begin at Sun 2024-06-02 03:41:15 UTC. -- 2024-06-02T04:01:55.284 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:55 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:55.284 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:55 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:55.284 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:55 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:55.284 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:55 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:01:55.284 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:55 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:55.284 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:55 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:55.284 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:55 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:55.285 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:55 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:01:55.285 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:55 smithi123 ceph-mon[42885]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-02T04:01:55.290 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T04:01:55.408 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:55 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:55.408 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:55 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:55.408 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:55 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:55.408 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:55 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:01:55.409 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:55 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:55.409 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:55 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:55.409 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:55 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:55.409 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:55 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:01:55.409 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:55 smithi136 ceph-mon[47443]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-02T04:01:55.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:55 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:55.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:55 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:55.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:55 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:55.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:55 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:01:55.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:55 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:55.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:55 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:55.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:55 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:55.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:55 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:01:55.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:55 smithi162 ceph-mon[47009]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-02T04:01:56.665 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-06-02T04:01:56.666 INFO:teuthology.orchestra.run.smithi136.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-06-02T04:01:56.666 INFO:teuthology.orchestra.run.smithi136.stderr: stderr: 10+0 records in 2024-06-02T04:01:56.666 INFO:teuthology.orchestra.run.smithi136.stderr:10+0 records out 2024-06-02T04:01:56.666 INFO:teuthology.orchestra.run.smithi136.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00712376 s, 1.5 GB/s 2024-06-02T04:01:56.666 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping successful for: 2024-06-02T04:01:56.690 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:01:56 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:01:56.378+0000 7f93d1bc67c0 -1 osd.9 0 log_to_monitors true 2024-06-02T04:01:56.690 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:56 smithi123 ceph-mon[42885]: from='osd.9 [v2:172.21.15.123:6826/608720685,v1:172.21.15.123:6827/608720685]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-02T04:01:57.003 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:56 smithi136 ceph-mon[47443]: from='osd.9 [v2:172.21.15.123:6826/608720685,v1:172.21.15.123:6827/608720685]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-02T04:01:57.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:56 smithi162 ceph-mon[47009]: from='osd.9 [v2:172.21.15.123:6826/608720685,v1:172.21.15.123:6827/608720685]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-06-02T04:01:57.080 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi136:vg_nvme/lv_1 2024-06-02T04:01:57.304 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T04:01:57.798 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:57 smithi136 ceph-mon[47443]: from='osd.9 [v2:172.21.15.123:6826/608720685,v1:172.21.15.123:6827/608720685]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-06-02T04:01:57.799 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:57 smithi136 ceph-mon[47443]: osdmap e62: 10 total, 9 up, 10 in 2024-06-02T04:01:57.799 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:57 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:01:57.799 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:57 smithi136 ceph-mon[47443]: from='osd.9 [v2:172.21.15.123:6826/608720685,v1:172.21.15.123:6827/608720685]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-06-02T04:01:57.799 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:57 smithi136 ceph-mon[47443]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-02T04:01:57.799 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:57 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:57.799 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:57 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:57.799 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:57 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:57.799 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:57 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:57.800 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:57 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:57.800 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:57 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:57.800 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:57 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:57.800 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:57 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:57.800 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:57 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:01:57.800 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:57 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:58.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:57 smithi162 ceph-mon[47009]: from='osd.9 [v2:172.21.15.123:6826/608720685,v1:172.21.15.123:6827/608720685]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-06-02T04:01:58.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:57 smithi162 ceph-mon[47009]: osdmap e62: 10 total, 9 up, 10 in 2024-06-02T04:01:58.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:57 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:01:58.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:57 smithi162 ceph-mon[47009]: from='osd.9 [v2:172.21.15.123:6826/608720685,v1:172.21.15.123:6827/608720685]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-06-02T04:01:58.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:57 smithi162 ceph-mon[47009]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-02T04:01:58.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:57 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:58.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:57 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:58.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:57 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:58.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:57 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:58.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:57 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:58.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:57 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:58.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:57 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:58.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:57 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:58.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:57 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:01:58.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:57 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:58.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:57 smithi123 ceph-mon[42885]: from='osd.9 [v2:172.21.15.123:6826/608720685,v1:172.21.15.123:6827/608720685]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-06-02T04:01:58.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:57 smithi123 ceph-mon[42885]: osdmap e62: 10 total, 9 up, 10 in 2024-06-02T04:01:58.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:57 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:01:58.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:57 smithi123 ceph-mon[42885]: from='osd.9 [v2:172.21.15.123:6826/608720685,v1:172.21.15.123:6827/608720685]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]: dispatch 2024-06-02T04:01:58.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:57 smithi123 ceph-mon[42885]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-02T04:01:58.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:57 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:58.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:57 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:58.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:57 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:58.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:57 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:58.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:57 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:58.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:57 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:01:58.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:57 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:58.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:57 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:58.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:57 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:01:58.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:57 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:01:58.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.361+0000 7fa05ab0c700 1 -- 172.21.15.136:0/95252990 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa054102b80 msgr2=0x7fa054109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:01:58.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.361+0000 7fa05ab0c700 1 --2- 172.21.15.136:0/95252990 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa054102b80 0x7fa054109430 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa04c00b0d0 tx=0x7fa04c00b3e0 comp rx=0 tx=0).stop 2024-06-02T04:01:58.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.361+0000 7fa05ab0c700 1 -- 172.21.15.136:0/95252990 shutdown_connections 2024-06-02T04:01:58.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.361+0000 7fa05ab0c700 1 --2- 172.21.15.136:0/95252990 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa054102b80 0x7fa054109430 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:58.362 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.361+0000 7fa05ab0c700 1 --2- 172.21.15.136:0/95252990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa054100fe0 0x7fa054101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:58.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.361+0000 7fa05ab0c700 1 --2- 172.21.15.136:0/95252990 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa0541021e0 0x7fa054102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:58.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.361+0000 7fa05ab0c700 1 -- 172.21.15.136:0/95252990 >> 172.21.15.136:0/95252990 conn(0x7fa0540fc580 msgr2=0x7fa0540fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:01:58.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.361+0000 7fa05ab0c700 1 -- 172.21.15.136:0/95252990 shutdown_connections 2024-06-02T04:01:58.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.361+0000 7fa05ab0c700 1 -- 172.21.15.136:0/95252990 wait complete. 2024-06-02T04:01:58.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.361+0000 7fa05ab0c700 1 Processor -- start 2024-06-02T04:01:58.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.361+0000 7fa05ab0c700 1 -- start start 2024-06-02T04:01:58.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.362+0000 7fa05ab0c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa054100fe0 0x7fa054074cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:01:58.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.362+0000 7fa05ab0c700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0541021e0 0x7fa054073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:01:58.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.362+0000 7fa05ab0c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa054102b80 0x7fa0540738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:01:58.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.362+0000 7fa05ab0c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa054074070 con 0x7fa054100fe0 2024-06-02T04:01:58.363 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.362+0000 7fa05ab0c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0540741e0 con 0x7fa054102b80 2024-06-02T04:01:58.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.362+0000 7fa05ab0c700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0541a1030 con 0x7fa0541021e0 2024-06-02T04:01:58.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.362+0000 7fa0590a9700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa054102b80 0x7fa0540738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:01:58.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.362+0000 7fa0590a9700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa054102b80 0x7fa0540738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:53308/0 (socket says 172.21.15.136:53308) 2024-06-02T04:01:58.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.362+0000 7fa0590a9700 1 -- 172.21.15.136:0/1428846179 learned_addr learned my addr 172.21.15.136:0/1428846179 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-06-02T04:01:58.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.362+0000 7fa053fff700 1 --2- 172.21.15.136:0/1428846179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0541021e0 0x7fa054073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:01:58.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.362+0000 7fa0588a8700 1 --2- 172.21.15.136:0/1428846179 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa054100fe0 0x7fa054074cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:01:58.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.362+0000 7fa0590a9700 1 -- 172.21.15.136:0/1428846179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0541021e0 msgr2=0x7fa054073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:01:58.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.362+0000 7fa0590a9700 1 --2- 172.21.15.136:0/1428846179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0541021e0 0x7fa054073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:58.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.362+0000 7fa0590a9700 1 -- 172.21.15.136:0/1428846179 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa054100fe0 msgr2=0x7fa054074cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:01:58.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.362+0000 7fa0590a9700 1 --2- 172.21.15.136:0/1428846179 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa054100fe0 0x7fa054074cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:01:58.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.362+0000 7fa0590a9700 1 -- 172.21.15.136:0/1428846179 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04c009d00 con 0x7fa054102b80 2024-06-02T04:01:58.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.362+0000 7fa0590a9700 1 --2- 172.21.15.136:0/1428846179 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa054102b80 0x7fa0540738d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa04c007b60 tx=0x7fa04c008ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:01:58.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.362+0000 7fa051ffb700 1 -- 172.21.15.136:0/1428846179 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04c00e040 con 0x7fa054102b80 2024-06-02T04:01:58.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.362+0000 7fa051ffb700 1 -- 172.21.15.136:0/1428846179 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa04c01d930 con 0x7fa054102b80 2024-06-02T04:01:58.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.362+0000 7fa051ffb700 1 -- 172.21.15.136:0/1428846179 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04c01ba00 con 0x7fa054102b80 2024-06-02T04:01:58.365 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.362+0000 7fa05ab0c700 1 -- 172.21.15.136:0/1428846179 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0541a1260 con 0x7fa054102b80 2024-06-02T04:01:58.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.363+0000 7fa05ab0c700 1 -- 172.21.15.136:0/1428846179 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0541a16d0 con 0x7fa054102b80 2024-06-02T04:01:58.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.364+0000 7fa05ab0c700 1 -- 172.21.15.136:0/1428846179 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0541083c0 con 0x7fa054102b80 2024-06-02T04:01:58.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.365+0000 7fa051ffb700 1 -- 172.21.15.136:0/1428846179 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fa04c01daa0 con 0x7fa054102b80 2024-06-02T04:01:58.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.365+0000 7fa051ffb700 1 --2- 172.21.15.136:0/1428846179 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa0440a11a0 0x7fa0440a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:01:58.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.365+0000 7fa051ffb700 1 -- 172.21.15.136:0/1428846179 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5981+0+0 (secure 0 0 0) 0x7fa04c0cd770 con 0x7fa054102b80 2024-06-02T04:01:58.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.365+0000 7fa0588a8700 1 --2- 172.21.15.136:0/1428846179 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa0440a11a0 0x7fa0440a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:01:58.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.366+0000 7fa0588a8700 1 --2- 172.21.15.136:0/1428846179 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa0440a11a0 0x7fa0440a3660 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa054102040 tx=0x7fa048009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:01:58.368 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.369+0000 7fa051ffb700 1 -- 172.21.15.136:0/1428846179 <== mon.2 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa04c0978b0 con 0x7fa054102b80 2024-06-02T04:01:58.568 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:01:58.569+0000 7fa05ab0c700 1 -- 172.21.15.136:0/1428846179 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fa05402ce10 con 0x7fa0440a11a0 2024-06-02T04:01:58.572 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:01:58 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:01:58.141+0000 7f93c722a700 -1 osd.9 0 waiting for initial osdmap 2024-06-02T04:01:58.572 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:01:58 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:01:58.156+0000 7f93bf017700 -1 osd.9 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T04:01:58.954 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:58 smithi136 ceph-mon[47443]: Detected new or changed devices on smithi123 2024-06-02T04:01:58.955 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:58 smithi136 ceph-mon[47443]: Adjusting osd_memory_target on smithi123 to 4278M 2024-06-02T04:01:58.955 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:58 smithi136 ceph-mon[47443]: from='osd.9 [v2:172.21.15.123:6826/608720685,v1:172.21.15.123:6827/608720685]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-06-02T04:01:58.955 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:58 smithi136 ceph-mon[47443]: osdmap e63: 10 total, 9 up, 10 in 2024-06-02T04:01:58.955 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:58 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:01:58.955 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:58 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:01:58.955 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:58 smithi136 ceph-mon[47443]: from='osd.9 [v2:172.21.15.123:6826/608720685,v1:172.21.15.123:6827/608720685]' entity='osd.9' 2024-06-02T04:01:58.955 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:58 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:01:58.955 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:58 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:01:58.955 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:58 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:59.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:58 smithi162 ceph-mon[47009]: Detected new or changed devices on smithi123 2024-06-02T04:01:59.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:58 smithi162 ceph-mon[47009]: Adjusting osd_memory_target on smithi123 to 4278M 2024-06-02T04:01:59.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:58 smithi162 ceph-mon[47009]: from='osd.9 [v2:172.21.15.123:6826/608720685,v1:172.21.15.123:6827/608720685]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-06-02T04:01:59.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:58 smithi162 ceph-mon[47009]: osdmap e63: 10 total, 9 up, 10 in 2024-06-02T04:01:59.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:58 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:01:59.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:58 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:01:59.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:58 smithi162 ceph-mon[47009]: from='osd.9 [v2:172.21.15.123:6826/608720685,v1:172.21.15.123:6827/608720685]' entity='osd.9' 2024-06-02T04:01:59.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:58 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:01:59.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:58 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:01:59.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:58 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:01:59.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:58 smithi123 ceph-mon[42885]: Detected new or changed devices on smithi123 2024-06-02T04:01:59.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:58 smithi123 ceph-mon[42885]: Adjusting osd_memory_target on smithi123 to 4278M 2024-06-02T04:01:59.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:58 smithi123 ceph-mon[42885]: from='osd.9 [v2:172.21.15.123:6826/608720685,v1:172.21.15.123:6827/608720685]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi123", "root=default"]}]': finished 2024-06-02T04:01:59.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:58 smithi123 ceph-mon[42885]: osdmap e63: 10 total, 9 up, 10 in 2024-06-02T04:01:59.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:58 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:01:59.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:58 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:01:59.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:58 smithi123 ceph-mon[42885]: from='osd.9 [v2:172.21.15.123:6826/608720685,v1:172.21.15.123:6827/608720685]' entity='osd.9' 2024-06-02T04:01:59.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:58 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:01:59.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:58 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:01:59.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:58 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:00.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:59 smithi162 ceph-mon[47009]: purged_snaps scrub starts 2024-06-02T04:02:00.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:59 smithi162 ceph-mon[47009]: purged_snaps scrub ok 2024-06-02T04:02:00.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:59 smithi162 ceph-mon[47009]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:02:00.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:59 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:02:00.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:59 smithi162 ceph-mon[47009]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-02T04:02:00.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:59 smithi162 ceph-mon[47009]: osd.9 [v2:172.21.15.123:6826/608720685,v1:172.21.15.123:6827/608720685] boot 2024-06-02T04:02:00.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:59 smithi162 ceph-mon[47009]: osdmap e64: 10 total, 10 up, 10 in 2024-06-02T04:02:00.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:01:59 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:02:00.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:59 smithi123 ceph-mon[42885]: purged_snaps scrub starts 2024-06-02T04:02:00.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:59 smithi123 ceph-mon[42885]: purged_snaps scrub ok 2024-06-02T04:02:00.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:59 smithi123 ceph-mon[42885]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:02:00.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:59 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:02:00.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:59 smithi123 ceph-mon[42885]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-02T04:02:00.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:59 smithi123 ceph-mon[42885]: osd.9 [v2:172.21.15.123:6826/608720685,v1:172.21.15.123:6827/608720685] boot 2024-06-02T04:02:00.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:59 smithi123 ceph-mon[42885]: osdmap e64: 10 total, 10 up, 10 in 2024-06-02T04:02:00.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:01:59 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:02:00.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:59 smithi136 ceph-mon[47443]: purged_snaps scrub starts 2024-06-02T04:02:00.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:59 smithi136 ceph-mon[47443]: purged_snaps scrub ok 2024-06-02T04:02:00.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:59 smithi136 ceph-mon[47443]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:02:00.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:59 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:02:00.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:59 smithi136 ceph-mon[47443]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-06-02T04:02:00.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:59 smithi136 ceph-mon[47443]: osd.9 [v2:172.21.15.123:6826/608720685,v1:172.21.15.123:6827/608720685] boot 2024-06-02T04:02:00.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:59 smithi136 ceph-mon[47443]: osdmap e64: 10 total, 10 up, 10 in 2024-06-02T04:02:00.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:01:59 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-06-02T04:02:01.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:01 smithi162 ceph-mon[47009]: osdmap e65: 10 total, 10 up, 10 in 2024-06-02T04:02:01.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:01 smithi162 ceph-mon[47009]: from='client.? 172.21.15.136:0/638405372' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ae138b96-13e7-46ac-9d4d-48308132465d"}]: dispatch 2024-06-02T04:02:01.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:01 smithi162 ceph-mon[47009]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ae138b96-13e7-46ac-9d4d-48308132465d"}]: dispatch 2024-06-02T04:02:01.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:01 smithi162 ceph-mon[47009]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ae138b96-13e7-46ac-9d4d-48308132465d"}]': finished 2024-06-02T04:02:01.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:01 smithi162 ceph-mon[47009]: osdmap e66: 11 total, 10 up, 11 in 2024-06-02T04:02:01.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:02:01.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:01 smithi162 ceph-mon[47009]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:02:01.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:01 smithi123 ceph-mon[42885]: osdmap e65: 10 total, 10 up, 10 in 2024-06-02T04:02:01.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:01 smithi123 ceph-mon[42885]: from='client.? 172.21.15.136:0/638405372' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ae138b96-13e7-46ac-9d4d-48308132465d"}]: dispatch 2024-06-02T04:02:01.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:01 smithi123 ceph-mon[42885]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ae138b96-13e7-46ac-9d4d-48308132465d"}]: dispatch 2024-06-02T04:02:01.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:01 smithi123 ceph-mon[42885]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ae138b96-13e7-46ac-9d4d-48308132465d"}]': finished 2024-06-02T04:02:01.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:01 smithi123 ceph-mon[42885]: osdmap e66: 11 total, 10 up, 11 in 2024-06-02T04:02:01.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:02:01.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:01 smithi123 ceph-mon[42885]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:02:01.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:01 smithi136 ceph-mon[47443]: osdmap e65: 10 total, 10 up, 10 in 2024-06-02T04:02:01.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:01 smithi136 ceph-mon[47443]: from='client.? 172.21.15.136:0/638405372' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ae138b96-13e7-46ac-9d4d-48308132465d"}]: dispatch 2024-06-02T04:02:01.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:01 smithi136 ceph-mon[47443]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ae138b96-13e7-46ac-9d4d-48308132465d"}]: dispatch 2024-06-02T04:02:01.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:01 smithi136 ceph-mon[47443]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ae138b96-13e7-46ac-9d4d-48308132465d"}]': finished 2024-06-02T04:02:01.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:01 smithi136 ceph-mon[47443]: osdmap e66: 11 total, 10 up, 11 in 2024-06-02T04:02:01.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:02:01.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:01 smithi136 ceph-mon[47443]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:02:02.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:02 smithi162 ceph-mon[47009]: from='client.? 172.21.15.136:0/4019347349' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:02:02.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:02 smithi123 ceph-mon[42885]: from='client.? 172.21.15.136:0/4019347349' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:02:02.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:02 smithi136 ceph-mon[47443]: from='client.? 172.21.15.136:0/4019347349' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:02:03.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:03 smithi162 ceph-mon[47009]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:02:03.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:03 smithi123 ceph-mon[42885]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:02:03.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:03 smithi136 ceph-mon[47443]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:02:06.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:05 smithi136 ceph-mon[47443]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:02:06.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:05 smithi162 ceph-mon[47009]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:02:06.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:05 smithi123 ceph-mon[42885]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:02:07.180 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:06 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-06-02T04:02:07.180 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:06 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:07.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:06 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-06-02T04:02:07.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:06 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:07.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:06 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-06-02T04:02:07.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:06 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:08.224 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:07 smithi136 ceph-mon[47443]: Deploying daemon osd.10 on smithi136 2024-06-02T04:02:08.225 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:07 smithi136 ceph-mon[47443]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:02:08.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:07 smithi162 ceph-mon[47009]: Deploying daemon osd.10 on smithi136 2024-06-02T04:02:08.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:07 smithi162 ceph-mon[47009]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:02:08.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:07 smithi123 ceph-mon[42885]: Deploying daemon osd.10 on smithi136 2024-06-02T04:02:08.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:07 smithi123 ceph-mon[42885]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:02:10.193 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:09 smithi136 ceph-mon[47443]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:02:10.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:09 smithi162 ceph-mon[47009]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:02:10.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:09 smithi123 ceph-mon[42885]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:02:11.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:11 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:11.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:11 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:11.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:11 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:02:11.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:11 smithi123 ceph-mon[42885]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:02:11.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:11 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:11.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:11 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:11.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:11 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:02:11.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:11 smithi136 ceph-mon[47443]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:02:11.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:11 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:11.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:11 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:11.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:11 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:02:11.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:11 smithi162 ceph-mon[47009]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:02:12.774 INFO:teuthology.orchestra.run.smithi136.stdout:Created osd(s) 10 on host 'smithi136' 2024-06-02T04:02:12.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:02:12.770+0000 7fa051ffb700 1 -- 172.21.15.136:0/1428846179 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7fa05402ce10 con 0x7fa0440a11a0 2024-06-02T04:02:12.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:02:12.773+0000 7fa05ab0c700 1 -- 172.21.15.136:0/1428846179 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa0440a11a0 msgr2=0x7fa0440a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:12.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:02:12.773+0000 7fa05ab0c700 1 --2- 172.21.15.136:0/1428846179 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa0440a11a0 0x7fa0440a3660 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa054102040 tx=0x7fa048009260 comp rx=0 tx=0).stop 2024-06-02T04:02:12.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:02:12.773+0000 7fa05ab0c700 1 -- 172.21.15.136:0/1428846179 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa054102b80 msgr2=0x7fa0540738d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:12.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:02:12.773+0000 7fa05ab0c700 1 --2- 172.21.15.136:0/1428846179 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa054102b80 0x7fa0540738d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa04c007b60 tx=0x7fa04c008ec0 comp rx=0 tx=0).stop 2024-06-02T04:02:12.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:02:12.773+0000 7fa05ab0c700 1 -- 172.21.15.136:0/1428846179 shutdown_connections 2024-06-02T04:02:12.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:02:12.773+0000 7fa05ab0c700 1 --2- 172.21.15.136:0/1428846179 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa0440a11a0 0x7fa0440a3660 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:12.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:02:12.773+0000 7fa05ab0c700 1 --2- 172.21.15.136:0/1428846179 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa054102b80 0x7fa0540738d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:12.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:02:12.773+0000 7fa05ab0c700 1 --2- 172.21.15.136:0/1428846179 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa054100fe0 0x7fa054074cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:12.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:02:12.773+0000 7fa05ab0c700 1 --2- 172.21.15.136:0/1428846179 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa0541021e0 0x7fa054073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:12.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:02:12.773+0000 7fa05ab0c700 1 -- 172.21.15.136:0/1428846179 >> 172.21.15.136:0/1428846179 conn(0x7fa0540fc580 msgr2=0x7fa054105500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:12.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:02:12.773+0000 7fa05ab0c700 1 -- 172.21.15.136:0/1428846179 shutdown_connections 2024-06-02T04:02:12.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-06-02T04:02:12.773+0000 7fa05ab0c700 1 -- 172.21.15.136:0/1428846179 wait complete. 2024-06-02T04:02:13.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:13 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:13.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:13 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:13.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:13 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:13.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:13 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:02:13.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:13 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:13.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:13 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:13.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:13 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:13.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:13 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:02:13.132 DEBUG:teuthology.orchestra.run.smithi136:osd.10> sudo journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.10.service 2024-06-02T04:02:13.134 INFO:tasks.cephadm:Deploying osd.11 on smithi162 with /dev/vg_nvme/lv_1... 2024-06-02T04:02:13.135 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-06-02T04:02:13.166 INFO:journalctl@ceph.osd.10.smithi136.stdout:-- Logs begin at Sun 2024-06-02 03:40:52 UTC. -- 2024-06-02T04:02:13.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:13 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:13.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:13 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:13.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:13 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:13.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:13 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:02:13.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:13 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:13.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:13 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:13.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:13 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:13.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:13 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:02:13.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:13 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:13.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:13 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:13.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:13 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:13.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:13 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:02:13.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:13 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:13.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:13 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:13.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:13 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:13.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:13 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:02:13.368 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T04:02:14.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:14 smithi162 ceph-mon[47009]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:02:14.279 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:14 smithi136 ceph-mon[47443]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:02:14.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:14 smithi123 ceph-mon[42885]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:02:14.588 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:02:14 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:02:14.278+0000 7f57f904e7c0 -1 osd.10 0 log_to_monitors true 2024-06-02T04:02:14.701 INFO:teuthology.orchestra.run.smithi162.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-06-02T04:02:14.701 INFO:teuthology.orchestra.run.smithi162.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-06-02T04:02:14.702 INFO:teuthology.orchestra.run.smithi162.stderr: stderr: 10+0 records in 2024-06-02T04:02:14.702 INFO:teuthology.orchestra.run.smithi162.stderr:10+0 records out 2024-06-02T04:02:14.702 INFO:teuthology.orchestra.run.smithi162.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111663 s, 939 MB/s 2024-06-02T04:02:14.702 INFO:teuthology.orchestra.run.smithi162.stderr:--> Zapping successful for: 2024-06-02T04:02:15.154 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi162:vg_nvme/lv_1 2024-06-02T04:02:15.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:15 smithi162 ceph-mon[47009]: from='osd.10 [v2:172.21.15.136:6824/3777263126,v1:172.21.15.136:6825/3777263126]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-02T04:02:15.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:15 smithi162 ceph-mon[47009]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-02T04:02:15.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:15 smithi123 ceph-mon[42885]: from='osd.10 [v2:172.21.15.136:6824/3777263126,v1:172.21.15.136:6825/3777263126]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-02T04:02:15.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:15 smithi123 ceph-mon[42885]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-02T04:02:15.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:15 smithi136 ceph-mon[47443]: from='osd.10 [v2:172.21.15.136:6824/3777263126,v1:172.21.15.136:6825/3777263126]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-02T04:02:15.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:15 smithi136 ceph-mon[47443]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-06-02T04:02:15.374 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T04:02:16.184 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:16 smithi162 ceph-mon[47009]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:02:16.184 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:16 smithi162 ceph-mon[47009]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-06-02T04:02:16.184 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:16 smithi162 ceph-mon[47009]: osdmap e67: 11 total, 10 up, 11 in 2024-06-02T04:02:16.185 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:16 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:02:16.185 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:16 smithi162 ceph-mon[47009]: from='osd.10 [v2:172.21.15.136:6824/3777263126,v1:172.21.15.136:6825/3777263126]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-06-02T04:02:16.185 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:16 smithi162 ceph-mon[47009]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-06-02T04:02:16.185 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:16 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:16.185 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:16 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:16.185 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:16 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:02:16.185 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:16 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:02:16.185 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:16 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:02:16.185 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:16 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:02:16.185 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:16 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:16.185 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:16 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:16.185 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:16 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:02:16.186 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:16 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:16.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:16 smithi123 ceph-mon[42885]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:02:16.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:16 smithi123 ceph-mon[42885]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-06-02T04:02:16.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:16 smithi123 ceph-mon[42885]: osdmap e67: 11 total, 10 up, 11 in 2024-06-02T04:02:16.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:16 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:02:16.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:16 smithi123 ceph-mon[42885]: from='osd.10 [v2:172.21.15.136:6824/3777263126,v1:172.21.15.136:6825/3777263126]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-06-02T04:02:16.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:16 smithi123 ceph-mon[42885]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-06-02T04:02:16.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:16 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:16.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:16 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:16.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:16 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:02:16.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:16 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:02:16.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:16 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:02:16.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:16 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:02:16.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:16 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:16.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:16 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:16.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:16 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:02:16.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:16 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:16.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:02:16 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:02:16.040+0000 7f57ee6b2700 -1 osd.10 0 waiting for initial osdmap 2024-06-02T04:02:16.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:02:16 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:02:16.055+0000 7f57ea4a7700 -1 osd.10 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T04:02:16.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:16 smithi136 ceph-mon[47443]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:02:16.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:16 smithi136 ceph-mon[47443]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-06-02T04:02:16.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:16 smithi136 ceph-mon[47443]: osdmap e67: 11 total, 10 up, 11 in 2024-06-02T04:02:16.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:16 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:02:16.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:16 smithi136 ceph-mon[47443]: from='osd.10 [v2:172.21.15.136:6824/3777263126,v1:172.21.15.136:6825/3777263126]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-06-02T04:02:16.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:16 smithi136 ceph-mon[47443]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-06-02T04:02:16.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:16 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:16.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:16 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:16.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:16 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:02:16.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:16 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:02:16.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:16 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:02:16.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:16 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:02:16.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:16 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:16.340 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:16 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:16.340 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:16 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:02:16.340 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:16 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:16.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.363+0000 7f6768bcd700 1 -- 172.21.15.162:0/2934261009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6764108f00 msgr2=0x7f676410b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:16.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.363+0000 7f6768bcd700 1 --2- 172.21.15.162:0/2934261009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6764108f00 0x7f676410b370 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f675c00b0a0 tx=0x7f675c00b3b0 comp rx=0 tx=0).stop 2024-06-02T04:02:16.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.363+0000 7f6768bcd700 1 -- 172.21.15.162:0/2934261009 shutdown_connections 2024-06-02T04:02:16.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.363+0000 7f6768bcd700 1 --2- 172.21.15.162:0/2934261009 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6764108f00 0x7f676410b370 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:16.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.363+0000 7f6768bcd700 1 --2- 172.21.15.162:0/2934261009 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6764074f50 0x7f67640733b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:16.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.363+0000 7f6768bcd700 1 --2- 172.21.15.162:0/2934261009 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6764073980 0x7f6764073e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:16.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.363+0000 7f6768bcd700 1 -- 172.21.15.162:0/2934261009 >> 172.21.15.162:0/2934261009 conn(0x7f67640fc5a0 msgr2=0x7f67640fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:16.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.363+0000 7f6768bcd700 1 -- 172.21.15.162:0/2934261009 shutdown_connections 2024-06-02T04:02:16.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.363+0000 7f6768bcd700 1 -- 172.21.15.162:0/2934261009 wait complete. 2024-06-02T04:02:16.366 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.364+0000 7f6768bcd700 1 Processor -- start 2024-06-02T04:02:16.366 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.364+0000 7f6768bcd700 1 -- start start 2024-06-02T04:02:16.366 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.364+0000 7f6768bcd700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6764073980 0x7f67641991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:16.366 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.364+0000 7f6768bcd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6764074f50 0x7f6764199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:16.366 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.364+0000 7f6768bcd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6764108f00 0x7f67641a0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:16.366 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.364+0000 7f6768bcd700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67641a0d30 con 0x7f6764074f50 2024-06-02T04:02:16.366 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.364+0000 7f6768bcd700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67641a0e70 con 0x7f6764108f00 2024-06-02T04:02:16.366 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.364+0000 7f6768bcd700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67641a1000 con 0x7f6764073980 2024-06-02T04:02:16.366 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.364+0000 7f676259c700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6764073980 0x7f67641991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:16.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.364+0000 7f676259c700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6764073980 0x7f67641991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:33040/0 (socket says 172.21.15.162:33040) 2024-06-02T04:02:16.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.364+0000 7f676259c700 1 -- 172.21.15.162:0/1285392770 learned_addr learned my addr 172.21.15.162:0/1285392770 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-06-02T04:02:16.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.364+0000 7f6761d9b700 1 --2- 172.21.15.162:0/1285392770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6764074f50 0x7f6764199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:16.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.364+0000 7f6762d9d700 1 --2- 172.21.15.162:0/1285392770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6764108f00 0x7f67641a0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:16.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.364+0000 7f676259c700 1 -- 172.21.15.162:0/1285392770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6764108f00 msgr2=0x7f67641a0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:16.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.364+0000 7f676259c700 1 --2- 172.21.15.162:0/1285392770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6764108f00 0x7f67641a0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:16.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.364+0000 7f676259c700 1 -- 172.21.15.162:0/1285392770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6764074f50 msgr2=0x7f6764199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:16.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.364+0000 7f676259c700 1 --2- 172.21.15.162:0/1285392770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6764074f50 0x7f6764199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:16.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.364+0000 7f676259c700 1 -- 172.21.15.162:0/1285392770 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f675c009d00 con 0x7f6764073980 2024-06-02T04:02:16.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.364+0000 7f6761d9b700 1 --2- 172.21.15.162:0/1285392770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6764074f50 0x7f6764199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:02:16.368 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.365+0000 7f676259c700 1 --2- 172.21.15.162:0/1285392770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6764073980 0x7f67641991f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f675400c950 tx=0x7f675400cd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:02:16.368 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.365+0000 7f67537fe700 1 -- 172.21.15.162:0/1285392770 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6754007ac0 con 0x7f6764073980 2024-06-02T04:02:16.368 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.365+0000 7f67537fe700 1 -- 172.21.15.162:0/1285392770 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6754004cf0 con 0x7f6764073980 2024-06-02T04:02:16.368 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.365+0000 7f6768bcd700 1 -- 172.21.15.162:0/1285392770 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67641a12e0 con 0x7f6764073980 2024-06-02T04:02:16.368 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.365+0000 7f67537fe700 1 -- 172.21.15.162:0/1285392770 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6754005550 con 0x7f6764073980 2024-06-02T04:02:16.368 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.365+0000 7f6768bcd700 1 -- 172.21.15.162:0/1285392770 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67641a1830 con 0x7f6764073980 2024-06-02T04:02:16.368 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.366+0000 7f6768bcd700 1 -- 172.21.15.162:0/1285392770 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6764107d10 con 0x7f6764073980 2024-06-02T04:02:16.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.367+0000 7f67537fe700 1 -- 172.21.15.162:0/1285392770 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f6754004750 con 0x7f6764073980 2024-06-02T04:02:16.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.367+0000 7f67537fe700 1 --2- 172.21.15.162:0/1285392770 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f674c0a11a0 0x7f674c0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:16.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.368+0000 7f67537fe700 1 -- 172.21.15.162:0/1285392770 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6447+0+0 (secure 0 0 0) 0x7f67540cc130 con 0x7f6764073980 2024-06-02T04:02:16.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.368+0000 7f6761d9b700 1 --2- 172.21.15.162:0/1285392770 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f674c0a11a0 0x7f674c0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:16.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.368+0000 7f6761d9b700 1 --2- 172.21.15.162:0/1285392770 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f674c0a11a0 0x7f674c0a3660 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6758005950 tx=0x7f6758005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:02:16.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.371+0000 7f67537fe700 1 -- 172.21.15.162:0/1285392770 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6754096090 con 0x7f6764073980 2024-06-02T04:02:16.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:16.573+0000 7f6768bcd700 1 -- 172.21.15.162:0/1285392770 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f67640613e0 con 0x7f674c0a11a0 2024-06-02T04:02:17.261 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:17 smithi162 ceph-mon[47009]: Detected new or changed devices on smithi136 2024-06-02T04:02:17.261 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:17 smithi162 ceph-mon[47009]: Adjusting osd_memory_target on smithi136 to 4278M 2024-06-02T04:02:17.261 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:17 smithi162 ceph-mon[47009]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-06-02T04:02:17.261 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:17 smithi162 ceph-mon[47009]: osdmap e68: 11 total, 10 up, 11 in 2024-06-02T04:02:17.261 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:17 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:02:17.262 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:17 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:02:17.262 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:17 smithi162 ceph-mon[47009]: osdmap e69: 11 total, 10 up, 11 in 2024-06-02T04:02:17.262 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:17 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:02:17.262 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:17 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:02:17.262 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:17 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:02:17.262 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:17 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:17.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:17 smithi123 ceph-mon[42885]: Detected new or changed devices on smithi136 2024-06-02T04:02:17.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:17 smithi123 ceph-mon[42885]: Adjusting osd_memory_target on smithi136 to 4278M 2024-06-02T04:02:17.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:17 smithi123 ceph-mon[42885]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-06-02T04:02:17.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:17 smithi123 ceph-mon[42885]: osdmap e68: 11 total, 10 up, 11 in 2024-06-02T04:02:17.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:02:17.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:02:17.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:17 smithi123 ceph-mon[42885]: osdmap e69: 11 total, 10 up, 11 in 2024-06-02T04:02:17.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:02:17.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:02:17.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:02:17.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:17.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:17 smithi136 ceph-mon[47443]: Detected new or changed devices on smithi136 2024-06-02T04:02:17.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:17 smithi136 ceph-mon[47443]: Adjusting osd_memory_target on smithi136 to 4278M 2024-06-02T04:02:17.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:17 smithi136 ceph-mon[47443]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-06-02T04:02:17.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:17 smithi136 ceph-mon[47443]: osdmap e68: 11 total, 10 up, 11 in 2024-06-02T04:02:17.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:17 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:02:17.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:17 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:02:17.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:17 smithi136 ceph-mon[47443]: osdmap e69: 11 total, 10 up, 11 in 2024-06-02T04:02:17.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:17 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:02:17.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:17 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-06-02T04:02:17.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:17 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-06-02T04:02:17.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:17 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:18.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:18 smithi162 ceph-mon[47009]: purged_snaps scrub starts 2024-06-02T04:02:18.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:18 smithi162 ceph-mon[47009]: purged_snaps scrub ok 2024-06-02T04:02:18.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:18 smithi162 ceph-mon[47009]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:02:18.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:18 smithi162 ceph-mon[47009]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:02:18.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:18 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:02:18.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:18 smithi162 ceph-mon[47009]: osd.10 [v2:172.21.15.136:6824/3777263126,v1:172.21.15.136:6825/3777263126] boot 2024-06-02T04:02:18.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:18 smithi162 ceph-mon[47009]: osdmap e70: 11 total, 11 up, 11 in 2024-06-02T04:02:18.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:18 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:02:18.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:18 smithi123 ceph-mon[42885]: purged_snaps scrub starts 2024-06-02T04:02:18.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:18 smithi123 ceph-mon[42885]: purged_snaps scrub ok 2024-06-02T04:02:18.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:18 smithi123 ceph-mon[42885]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:02:18.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:18 smithi123 ceph-mon[42885]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:02:18.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:18 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:02:18.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:18 smithi123 ceph-mon[42885]: osd.10 [v2:172.21.15.136:6824/3777263126,v1:172.21.15.136:6825/3777263126] boot 2024-06-02T04:02:18.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:18 smithi123 ceph-mon[42885]: osdmap e70: 11 total, 11 up, 11 in 2024-06-02T04:02:18.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:18 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:02:18.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:18 smithi136 ceph-mon[47443]: purged_snaps scrub starts 2024-06-02T04:02:18.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:18 smithi136 ceph-mon[47443]: purged_snaps scrub ok 2024-06-02T04:02:18.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:18 smithi136 ceph-mon[47443]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:02:18.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:18 smithi136 ceph-mon[47443]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-06-02T04:02:18.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:18 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:02:18.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:18 smithi136 ceph-mon[47443]: osd.10 [v2:172.21.15.136:6824/3777263126,v1:172.21.15.136:6825/3777263126] boot 2024-06-02T04:02:18.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:18 smithi136 ceph-mon[47443]: osdmap e70: 11 total, 11 up, 11 in 2024-06-02T04:02:18.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:18 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-06-02T04:02:19.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:19 smithi123 ceph-mon[42885]: osdmap e71: 11 total, 11 up, 11 in 2024-06-02T04:02:19.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:19 smithi123 ceph-mon[42885]: from='client.? 172.21.15.162:0/495909325' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69f4ede0-7e9b-4edb-be54-01f74f002a06"}]: dispatch 2024-06-02T04:02:19.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:19 smithi123 ceph-mon[42885]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69f4ede0-7e9b-4edb-be54-01f74f002a06"}]: dispatch 2024-06-02T04:02:19.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:19 smithi123 ceph-mon[42885]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "69f4ede0-7e9b-4edb-be54-01f74f002a06"}]': finished 2024-06-02T04:02:19.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:19 smithi123 ceph-mon[42885]: osdmap e72: 12 total, 11 up, 12 in 2024-06-02T04:02:19.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:19 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:02:19.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:19 smithi123 ceph-mon[42885]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-06-02T04:02:19.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:19 smithi123 ceph-mon[42885]: from='client.? 172.21.15.162:0/1575434419' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:02:19.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:19 smithi136 ceph-mon[47443]: osdmap e71: 11 total, 11 up, 11 in 2024-06-02T04:02:19.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:19 smithi136 ceph-mon[47443]: from='client.? 172.21.15.162:0/495909325' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69f4ede0-7e9b-4edb-be54-01f74f002a06"}]: dispatch 2024-06-02T04:02:19.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:19 smithi136 ceph-mon[47443]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69f4ede0-7e9b-4edb-be54-01f74f002a06"}]: dispatch 2024-06-02T04:02:19.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:19 smithi136 ceph-mon[47443]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "69f4ede0-7e9b-4edb-be54-01f74f002a06"}]': finished 2024-06-02T04:02:19.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:19 smithi136 ceph-mon[47443]: osdmap e72: 12 total, 11 up, 12 in 2024-06-02T04:02:19.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:19 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:02:19.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:19 smithi136 ceph-mon[47443]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-06-02T04:02:19.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:19 smithi136 ceph-mon[47443]: from='client.? 172.21.15.162:0/1575434419' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:02:19.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:19 smithi162 ceph-mon[47009]: osdmap e71: 11 total, 11 up, 11 in 2024-06-02T04:02:19.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:19 smithi162 ceph-mon[47009]: from='client.? 172.21.15.162:0/495909325' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69f4ede0-7e9b-4edb-be54-01f74f002a06"}]: dispatch 2024-06-02T04:02:19.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:19 smithi162 ceph-mon[47009]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69f4ede0-7e9b-4edb-be54-01f74f002a06"}]: dispatch 2024-06-02T04:02:19.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:19 smithi162 ceph-mon[47009]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "69f4ede0-7e9b-4edb-be54-01f74f002a06"}]': finished 2024-06-02T04:02:19.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:19 smithi162 ceph-mon[47009]: osdmap e72: 12 total, 11 up, 12 in 2024-06-02T04:02:19.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:19 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:02:19.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:19 smithi162 ceph-mon[47009]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-06-02T04:02:19.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:19 smithi162 ceph-mon[47009]: from='client.? 172.21.15.162:0/1575434419' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-06-02T04:02:20.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:20 smithi162 ceph-mon[47009]: osdmap e73: 12 total, 11 up, 12 in 2024-06-02T04:02:20.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:20 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:02:20.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:20 smithi123 ceph-mon[42885]: osdmap e73: 12 total, 11 up, 12 in 2024-06-02T04:02:20.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:20 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:02:20.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:20 smithi136 ceph-mon[47443]: osdmap e73: 12 total, 11 up, 12 in 2024-06-02T04:02:20.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:20 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:02:21.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:21 smithi162 ceph-mon[47009]: osdmap e74: 12 total, 11 up, 12 in 2024-06-02T04:02:21.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:21 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:02:21.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:21 smithi162 ceph-mon[47009]: pgmap v191: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 154 KiB/s, 0 objects/s recovering 2024-06-02T04:02:21.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:21 smithi123 ceph-mon[42885]: osdmap e74: 12 total, 11 up, 12 in 2024-06-02T04:02:21.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:21 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:02:21.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:21 smithi123 ceph-mon[42885]: pgmap v191: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 154 KiB/s, 0 objects/s recovering 2024-06-02T04:02:21.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:21 smithi136 ceph-mon[47443]: osdmap e74: 12 total, 11 up, 12 in 2024-06-02T04:02:21.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:21 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:02:21.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:21 smithi136 ceph-mon[47443]: pgmap v191: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 154 KiB/s, 0 objects/s recovering 2024-06-02T04:02:24.177 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:23 smithi162 ceph-mon[47009]: pgmap v192: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-06-02T04:02:24.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:23 smithi123 ceph-mon[42885]: pgmap v192: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-06-02T04:02:24.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:23 smithi136 ceph-mon[47443]: pgmap v192: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 121 KiB/s, 0 objects/s recovering 2024-06-02T04:02:24.990 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:24 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-06-02T04:02:24.990 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:24 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:25.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:24 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-06-02T04:02:25.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:24 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:25.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:24 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-06-02T04:02:25.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:24 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:26.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:25 smithi162 ceph-mon[47009]: Deploying daemon osd.11 on smithi162 2024-06-02T04:02:26.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:25 smithi162 ceph-mon[47009]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-06-02T04:02:26.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:25 smithi123 ceph-mon[42885]: Deploying daemon osd.11 on smithi162 2024-06-02T04:02:26.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:25 smithi123 ceph-mon[42885]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-06-02T04:02:26.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:25 smithi136 ceph-mon[47443]: Deploying daemon osd.11 on smithi162 2024-06-02T04:02:26.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:25 smithi136 ceph-mon[47443]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-06-02T04:02:28.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:27 smithi162 ceph-mon[47009]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-02T04:02:28.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:27 smithi123 ceph-mon[42885]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-02T04:02:28.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:27 smithi136 ceph-mon[47443]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-06-02T04:02:29.215 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:28 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:29.215 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:28 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:29.216 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:28 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:02:29.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:28 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:29.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:28 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:29.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:28 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:02:29.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:28 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:29.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:28 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:29.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:28 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:02:30.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:29 smithi162 ceph-mon[47009]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-06-02T04:02:30.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:29 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:30.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:29 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:30.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:29 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:30.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:29 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:02:30.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:29 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:30.126 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 11 on host 'smithi162' 2024-06-02T04:02:30.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:30.125+0000 7f67537fe700 1 -- 172.21.15.162:0/1285392770 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f67640613e0 con 0x7f674c0a11a0 2024-06-02T04:02:30.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:30.128+0000 7f6768bcd700 1 -- 172.21.15.162:0/1285392770 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f674c0a11a0 msgr2=0x7f674c0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:30.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:30.128+0000 7f6768bcd700 1 --2- 172.21.15.162:0/1285392770 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f674c0a11a0 0x7f674c0a3660 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6758005950 tx=0x7f6758005f50 comp rx=0 tx=0).stop 2024-06-02T04:02:30.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:30.128+0000 7f6768bcd700 1 -- 172.21.15.162:0/1285392770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6764073980 msgr2=0x7f67641991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:30.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:30.128+0000 7f6768bcd700 1 --2- 172.21.15.162:0/1285392770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6764073980 0x7f67641991f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f675400c950 tx=0x7f675400cd10 comp rx=0 tx=0).stop 2024-06-02T04:02:30.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:30.128+0000 7f6768bcd700 1 -- 172.21.15.162:0/1285392770 shutdown_connections 2024-06-02T04:02:30.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:30.128+0000 7f6768bcd700 1 --2- 172.21.15.162:0/1285392770 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f674c0a11a0 0x7f674c0a3660 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:30.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:30.128+0000 7f6768bcd700 1 --2- 172.21.15.162:0/1285392770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6764108f00 0x7f67641a0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:30.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:30.128+0000 7f6768bcd700 1 --2- 172.21.15.162:0/1285392770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6764073980 0x7f67641991f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:30.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:30.128+0000 7f6768bcd700 1 --2- 172.21.15.162:0/1285392770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6764074f50 0x7f6764199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:30.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:30.128+0000 7f6768bcd700 1 -- 172.21.15.162:0/1285392770 >> 172.21.15.162:0/1285392770 conn(0x7f67640fc5a0 msgr2=0x7f6764104e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:30.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:30.128+0000 7f6768bcd700 1 -- 172.21.15.162:0/1285392770 shutdown_connections 2024-06-02T04:02:30.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:30.128+0000 7f6768bcd700 1 -- 172.21.15.162:0/1285392770 wait complete. 2024-06-02T04:02:30.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:29 smithi123 ceph-mon[42885]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-06-02T04:02:30.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:29 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:30.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:29 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:30.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:29 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:30.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:29 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:02:30.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:29 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:30.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:29 smithi136 ceph-mon[47443]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-06-02T04:02:30.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:29 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:30.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:29 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:30.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:29 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:30.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:29 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:02:30.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:29 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:30.508 DEBUG:teuthology.orchestra.run.smithi162:osd.11> sudo journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.11.service 2024-06-02T04:02:30.510 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-06-02T04:02:30.510 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph osd stat -f json 2024-06-02T04:02:30.541 INFO:journalctl@ceph.osd.11.smithi162.stdout:-- Logs begin at Sun 2024-06-02 03:41:09 UTC. -- 2024-06-02T04:02:30.758 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:02:31.203 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:31 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:31.204 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:31 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:31.204 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:31 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:02:31.204 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:31 smithi123 ceph-mon[42885]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-06-02T04:02:31.282 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:31 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:31.282 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:31 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:31.282 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:31 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:02:31.282 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:31 smithi162 ceph-mon[47009]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-06-02T04:02:31.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:31 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:31.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:31 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:31.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:31 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:02:31.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:31 smithi136 ceph-mon[47443]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-06-02T04:02:31.748 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.747+0000 7f3131e7c700 1 -- 172.21.15.123:0/2741542935 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f312c102ba0 msgr2=0x7f312c109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:31.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.747+0000 7f3131e7c700 1 --2- 172.21.15.123:0/2741542935 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f312c102ba0 0x7f312c109450 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f312400b0d0 tx=0x7f312400b3e0 comp rx=0 tx=0).stop 2024-06-02T04:02:31.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.747+0000 7f3131e7c700 1 -- 172.21.15.123:0/2741542935 shutdown_connections 2024-06-02T04:02:31.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.747+0000 7f3131e7c700 1 --2- 172.21.15.123:0/2741542935 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f312c102ba0 0x7f312c109450 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:31.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.747+0000 7f3131e7c700 1 --2- 172.21.15.123:0/2741542935 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f312c101000 0x7f312c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:31.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.747+0000 7f3131e7c700 1 --2- 172.21.15.123:0/2741542935 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f312c102200 0x7f312c102660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:31.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.747+0000 7f3131e7c700 1 -- 172.21.15.123:0/2741542935 >> 172.21.15.123:0/2741542935 conn(0x7f312c0fc5c0 msgr2=0x7f312c0fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:31.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.747+0000 7f3131e7c700 1 -- 172.21.15.123:0/2741542935 shutdown_connections 2024-06-02T04:02:31.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.747+0000 7f3131e7c700 1 -- 172.21.15.123:0/2741542935 wait complete. 2024-06-02T04:02:31.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.747+0000 7f3131e7c700 1 Processor -- start 2024-06-02T04:02:31.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.748+0000 7f3131e7c700 1 -- start start 2024-06-02T04:02:31.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.748+0000 7f3131e7c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f312c101000 0x7f312c1970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:31.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.748+0000 7f3131e7c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f312c102200 0x7f312c197620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:31.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.748+0000 7f3131e7c700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f312c102ba0 0x7f312c19e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:31.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.748+0000 7f3131e7c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c19eb80 con 0x7f312c101000 2024-06-02T04:02:31.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.748+0000 7f3131e7c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c19ecc0 con 0x7f312c102200 2024-06-02T04:02:31.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.748+0000 7f3131e7c700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312c19ee50 con 0x7f312c102ba0 2024-06-02T04:02:31.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.748+0000 7f312b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f312c101000 0x7f312c1970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:31.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.748+0000 7f312b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f312c101000 0x7f312c1970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38092/0 (socket says 172.21.15.123:38092) 2024-06-02T04:02:31.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.748+0000 7f312b7fe700 1 -- 172.21.15.123:0/383454907 learned_addr learned my addr 172.21.15.123:0/383454907 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:02:31.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.748+0000 7f312bfff700 1 --2- 172.21.15.123:0/383454907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f312c102ba0 0x7f312c19e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:31.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.748+0000 7f312affd700 1 --2- 172.21.15.123:0/383454907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f312c102200 0x7f312c197620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:31.750 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.748+0000 7f312b7fe700 1 -- 172.21.15.123:0/383454907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f312c102ba0 msgr2=0x7f312c19e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.748+0000 7f312b7fe700 1 --2- 172.21.15.123:0/383454907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f312c102ba0 0x7f312c19e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.748+0000 7f312b7fe700 1 -- 172.21.15.123:0/383454907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f312c102200 msgr2=0x7f312c197620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.748+0000 7f312b7fe700 1 --2- 172.21.15.123:0/383454907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f312c102200 0x7f312c197620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.748+0000 7f312b7fe700 1 -- 172.21.15.123:0/383454907 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3124009d00 con 0x7f312c101000 2024-06-02T04:02:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.748+0000 7f312b7fe700 1 --2- 172.21.15.123:0/383454907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f312c101000 0x7f312c1970e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f312000d9b0 tx=0x7f312000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:02:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.748+0000 7f3128ff9700 1 -- 172.21.15.123:0/383454907 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312000b950 con 0x7f312c101000 2024-06-02T04:02:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.749+0000 7f3128ff9700 1 -- 172.21.15.123:0/383454907 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3120007620 con 0x7f312c101000 2024-06-02T04:02:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.749+0000 7f3131e7c700 1 -- 172.21.15.123:0/383454907 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f312c19f130 con 0x7f312c101000 2024-06-02T04:02:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.749+0000 7f3128ff9700 1 -- 172.21.15.123:0/383454907 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312000f3c0 con 0x7f312c101000 2024-06-02T04:02:31.751 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.749+0000 7f3131e7c700 1 -- 172.21.15.123:0/383454907 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f312c19f630 con 0x7f312c101000 2024-06-02T04:02:31.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.749+0000 7f3131e7c700 1 -- 172.21.15.123:0/383454907 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f312c1083c0 con 0x7f312c101000 2024-06-02T04:02:31.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.751+0000 7f3128ff9700 1 -- 172.21.15.123:0/383454907 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f3120010460 con 0x7f312c101000 2024-06-02T04:02:31.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.751+0000 7f3128ff9700 1 --2- 172.21.15.123:0/383454907 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f31140a1120 0x7f31140a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:31.752 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.751+0000 7f312affd700 1 --2- 172.21.15.123:0/383454907 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f31140a1120 0x7f31140a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:31.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.751+0000 7f3128ff9700 1 -- 172.21.15.123:0/383454907 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f31200cc9e0 con 0x7f312c101000 2024-06-02T04:02:31.753 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.752+0000 7f312affd700 1 --2- 172.21.15.123:0/383454907 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f31140a1120 0x7f31140a35e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f311c009be0 tx=0x7f311c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:02:31.754 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.755+0000 7f3128ff9700 1 -- 172.21.15.123:0/383454907 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3120096750 con 0x7f312c101000 2024-06-02T04:02:31.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.951+0000 7f3131e7c700 1 -- 172.21.15.123:0/383454907 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f312c04ec60 con 0x7f312c101000 2024-06-02T04:02:31.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.952+0000 7f3128ff9700 1 -- 172.21.15.123:0/383454907 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) v1 ==== 74+0+133 (secure 0 0 0) 0x7f3120099d70 con 0x7f312c101000 2024-06-02T04:02:31.952 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:02:31.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.954+0000 7f3131e7c700 1 -- 172.21.15.123:0/383454907 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f31140a1120 msgr2=0x7f31140a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:31.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.954+0000 7f3131e7c700 1 --2- 172.21.15.123:0/383454907 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f31140a1120 0x7f31140a35e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f311c009be0 tx=0x7f311c009260 comp rx=0 tx=0).stop 2024-06-02T04:02:31.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.954+0000 7f3131e7c700 1 -- 172.21.15.123:0/383454907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f312c101000 msgr2=0x7f312c1970e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:31.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.954+0000 7f3131e7c700 1 --2- 172.21.15.123:0/383454907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f312c101000 0x7f312c1970e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f312000d9b0 tx=0x7f312000dcc0 comp rx=0 tx=0).stop 2024-06-02T04:02:31.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.954+0000 7f3131e7c700 1 -- 172.21.15.123:0/383454907 shutdown_connections 2024-06-02T04:02:31.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.954+0000 7f3131e7c700 1 --2- 172.21.15.123:0/383454907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f312c102ba0 0x7f312c19e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:31.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.954+0000 7f3131e7c700 1 --2- 172.21.15.123:0/383454907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f312c101000 0x7f312c1970e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:31.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.954+0000 7f3131e7c700 1 --2- 172.21.15.123:0/383454907 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f31140a1120 0x7f31140a35e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:31.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.954+0000 7f3131e7c700 1 --2- 172.21.15.123:0/383454907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f312c102200 0x7f312c197620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:31.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.954+0000 7f3131e7c700 1 -- 172.21.15.123:0/383454907 >> 172.21.15.123:0/383454907 conn(0x7f312c0fc5c0 msgr2=0x7f312c105500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:31.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.954+0000 7f3131e7c700 1 -- 172.21.15.123:0/383454907 shutdown_connections 2024-06-02T04:02:31.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:31.954+0000 7f3131e7c700 1 -- 172.21.15.123:0/383454907 wait complete. 2024-06-02T04:02:32.209 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:02:31 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:02:31.890+0000 7f857029d7c0 -1 osd.11 0 log_to_monitors true 2024-06-02T04:02:32.209 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:32 smithi162 ceph-mon[47009]: from='osd.11 [v2:172.21.15.162:6824/704809754,v1:172.21.15.162:6825/704809754]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-02T04:02:32.209 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:32 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/383454907' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-02T04:02:32.240 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:32 smithi123 ceph-mon[42885]: from='osd.11 [v2:172.21.15.162:6824/704809754,v1:172.21.15.162:6825/704809754]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-02T04:02:32.240 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:32 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/383454907' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-02T04:02:32.315 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":74,"num_osds":12,"num_up_osds":11,"osd_up_since":1717300937,"num_in_osds":12,"osd_in_since":1717300938,"num_remapped_pgs":0} 2024-06-02T04:02:32.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:32 smithi136 ceph-mon[47443]: from='osd.11 [v2:172.21.15.162:6824/704809754,v1:172.21.15.162:6825/704809754]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-06-02T04:02:32.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:32 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/383454907' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-02T04:02:33.316 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph osd stat -f json 2024-06-02T04:02:33.533 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:33 smithi162 ceph-mon[47009]: from='osd.11 [v2:172.21.15.162:6824/704809754,v1:172.21.15.162:6825/704809754]' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-06-02T04:02:33.534 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:33 smithi162 ceph-mon[47009]: osdmap e75: 12 total, 11 up, 12 in 2024-06-02T04:02:33.534 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:33 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:02:33.534 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:33 smithi162 ceph-mon[47009]: from='osd.11 [v2:172.21.15.162:6824/704809754,v1:172.21.15.162:6825/704809754]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-06-02T04:02:33.534 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:33 smithi162 ceph-mon[47009]: Detected new or changed devices on smithi162 2024-06-02T04:02:33.534 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:33 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:33.534 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:33 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:33.534 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:33 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:02:33.534 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:33 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:02:33.534 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:33 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:02:33.534 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:33 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:02:33.534 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:33 smithi162 ceph-mon[47009]: Adjusting osd_memory_target on smithi162 to 4278M 2024-06-02T04:02:33.535 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:33 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:33.535 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:33 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:33.535 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:33 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:02:33.535 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:33 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:33.535 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:33 smithi162 ceph-mon[47009]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-06-02T04:02:33.545 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:02:33.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:33 smithi123 ceph-mon[42885]: from='osd.11 [v2:172.21.15.162:6824/704809754,v1:172.21.15.162:6825/704809754]' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-06-02T04:02:33.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:33 smithi123 ceph-mon[42885]: osdmap e75: 12 total, 11 up, 12 in 2024-06-02T04:02:33.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:33 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:02:33.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:33 smithi123 ceph-mon[42885]: from='osd.11 [v2:172.21.15.162:6824/704809754,v1:172.21.15.162:6825/704809754]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-06-02T04:02:33.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:33 smithi123 ceph-mon[42885]: Detected new or changed devices on smithi162 2024-06-02T04:02:33.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:33 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:33.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:33 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:33.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:33 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:02:33.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:33 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:02:33.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:33 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:02:33.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:33 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:02:33.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:33 smithi123 ceph-mon[42885]: Adjusting osd_memory_target on smithi162 to 4278M 2024-06-02T04:02:33.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:33 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:33.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:33 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:33.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:33 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:02:33.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:33 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:33.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:33 smithi123 ceph-mon[42885]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-06-02T04:02:33.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:33 smithi136 ceph-mon[47443]: from='osd.11 [v2:172.21.15.162:6824/704809754,v1:172.21.15.162:6825/704809754]' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-06-02T04:02:33.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:33 smithi136 ceph-mon[47443]: osdmap e75: 12 total, 11 up, 12 in 2024-06-02T04:02:33.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:33 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:02:33.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:33 smithi136 ceph-mon[47443]: from='osd.11 [v2:172.21.15.162:6824/704809754,v1:172.21.15.162:6825/704809754]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2024-06-02T04:02:33.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:33 smithi136 ceph-mon[47443]: Detected new or changed devices on smithi162 2024-06-02T04:02:33.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:33 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:33.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:33 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:33.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:33 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:02:33.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:33 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:02:33.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:33 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:02:33.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:33 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:02:33.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:33 smithi136 ceph-mon[47443]: Adjusting osd_memory_target on smithi162 to 4278M 2024-06-02T04:02:33.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:33 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:33.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:33 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:33.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:33 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:02:33.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:33 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:33.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:33 smithi136 ceph-mon[47443]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-06-02T04:02:33.798 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:02:33 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:02:33.533+0000 7f8565901700 -1 osd.11 0 waiting for initial osdmap 2024-06-02T04:02:33.798 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:02:33 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:02:33.550+0000 7f855d6ee700 -1 osd.11 76 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-06-02T04:02:34.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:34 smithi123 ceph-mon[42885]: from='osd.11 [v2:172.21.15.162:6824/704809754,v1:172.21.15.162:6825/704809754]' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-06-02T04:02:34.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:34 smithi123 ceph-mon[42885]: osdmap e76: 12 total, 11 up, 12 in 2024-06-02T04:02:34.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:34 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:02:34.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:34 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:02:34.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:34 smithi123 ceph-mon[42885]: from='osd.11 [v2:172.21.15.162:6824/704809754,v1:172.21.15.162:6825/704809754]' entity='osd.11' 2024-06-02T04:02:34.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:34 smithi162 ceph-mon[47009]: from='osd.11 [v2:172.21.15.162:6824/704809754,v1:172.21.15.162:6825/704809754]' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-06-02T04:02:34.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:34 smithi162 ceph-mon[47009]: osdmap e76: 12 total, 11 up, 12 in 2024-06-02T04:02:34.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:34 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:02:34.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:34 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:02:34.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:34 smithi162 ceph-mon[47009]: from='osd.11 [v2:172.21.15.162:6824/704809754,v1:172.21.15.162:6825/704809754]' entity='osd.11' 2024-06-02T04:02:34.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.555+0000 7f29c98a3700 1 -- 172.21.15.123:0/39048820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29c4100fe0 msgr2=0x7f29c4101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:34.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.555+0000 7f29c98a3700 1 --2- 172.21.15.123:0/39048820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29c4100fe0 0x7f29c4101400 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f29b40099c0 tx=0x7f29b4009cd0 comp rx=0 tx=0).stop 2024-06-02T04:02:34.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.555+0000 7f29c98a3700 1 -- 172.21.15.123:0/39048820 shutdown_connections 2024-06-02T04:02:34.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.555+0000 7f29c98a3700 1 --2- 172.21.15.123:0/39048820 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29c4102b80 0x7f29c4109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:34.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.555+0000 7f29c98a3700 1 --2- 172.21.15.123:0/39048820 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29c4100fe0 0x7f29c4101400 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:34.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.555+0000 7f29c98a3700 1 --2- 172.21.15.123:0/39048820 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29c41021e0 0x7f29c4102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:34.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.555+0000 7f29c98a3700 1 -- 172.21.15.123:0/39048820 >> 172.21.15.123:0/39048820 conn(0x7f29c40fc5a0 msgr2=0x7f29c40fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:34.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.555+0000 7f29c98a3700 1 -- 172.21.15.123:0/39048820 shutdown_connections 2024-06-02T04:02:34.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.555+0000 7f29c98a3700 1 -- 172.21.15.123:0/39048820 wait complete. 2024-06-02T04:02:34.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.556+0000 7f29c98a3700 1 Processor -- start 2024-06-02T04:02:34.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.556+0000 7f29c98a3700 1 -- start start 2024-06-02T04:02:34.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.556+0000 7f29c98a3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29c4100fe0 0x7f29c4196fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:34.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.556+0000 7f29c98a3700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29c41021e0 0x7f29c41974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:34.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.556+0000 7f29c98a3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29c4102b80 0x7f29c419e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:34.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.556+0000 7f29c98a3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c419eae0 con 0x7f29c4102b80 2024-06-02T04:02:34.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.556+0000 7f29c98a3700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c419ec20 con 0x7f29c4100fe0 2024-06-02T04:02:34.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.556+0000 7f29c98a3700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c419edb0 con 0x7f29c41021e0 2024-06-02T04:02:34.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.556+0000 7f29c37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29c4102b80 0x7f29c419e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:34.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.556+0000 7f29c37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29c4102b80 0x7f29c419e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54196/0 (socket says 172.21.15.123:54196) 2024-06-02T04:02:34.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.556+0000 7f29c37fe700 1 -- 172.21.15.123:0/3615941396 learned_addr learned my addr 172.21.15.123:0/3615941396 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:02:34.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.557+0000 7f29c27fc700 1 --2- 172.21.15.123:0/3615941396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29c41021e0 0x7f29c41974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:34.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.557+0000 7f29c2ffd700 1 --2- 172.21.15.123:0/3615941396 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29c4100fe0 0x7f29c4196fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:34.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.557+0000 7f29c37fe700 1 -- 172.21.15.123:0/3615941396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29c41021e0 msgr2=0x7f29c41974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:34.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.557+0000 7f29c37fe700 1 --2- 172.21.15.123:0/3615941396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29c41021e0 0x7f29c41974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:34.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.557+0000 7f29c37fe700 1 -- 172.21.15.123:0/3615941396 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29c4100fe0 msgr2=0x7f29c4196fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:34.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.557+0000 7f29c37fe700 1 --2- 172.21.15.123:0/3615941396 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29c4100fe0 0x7f29c4196fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:34.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.557+0000 7f29c37fe700 1 -- 172.21.15.123:0/3615941396 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b40095f0 con 0x7f29c4102b80 2024-06-02T04:02:34.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.557+0000 7f29c2ffd700 1 --2- 172.21.15.123:0/3615941396 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29c4100fe0 0x7f29c4196fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:02:34.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.557+0000 7f29c37fe700 1 --2- 172.21.15.123:0/3615941396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29c4102b80 0x7f29c419e510 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f29bc00add0 tx=0x7f29bc00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:02:34.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.557+0000 7f29c88a1700 1 -- 172.21.15.123:0/3615941396 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc00f070 con 0x7f29c4102b80 2024-06-02T04:02:34.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.557+0000 7f29c88a1700 1 -- 172.21.15.123:0/3615941396 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f29bc007b30 con 0x7f29c4102b80 2024-06-02T04:02:34.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.557+0000 7f29c98a3700 1 -- 172.21.15.123:0/3615941396 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c419f090 con 0x7f29c4102b80 2024-06-02T04:02:34.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.557+0000 7f29c88a1700 1 -- 172.21.15.123:0/3615941396 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc005310 con 0x7f29c4102b80 2024-06-02T04:02:34.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.557+0000 7f29c98a3700 1 -- 172.21.15.123:0/3615941396 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c419f590 con 0x7f29c4102b80 2024-06-02T04:02:34.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.558+0000 7f29c98a3700 1 -- 172.21.15.123:0/3615941396 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c41084b0 con 0x7f29c4102b80 2024-06-02T04:02:34.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.559+0000 7f29c88a1700 1 -- 172.21.15.123:0/3615941396 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f29bc00c940 con 0x7f29c4102b80 2024-06-02T04:02:34.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.559+0000 7f29c88a1700 1 --2- 172.21.15.123:0/3615941396 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f29ac0a1120 0x7f29ac0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:34.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.560+0000 7f29c2ffd700 1 --2- 172.21.15.123:0/3615941396 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f29ac0a1120 0x7f29ac0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:34.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.560+0000 7f29c88a1700 1 -- 172.21.15.123:0/3615941396 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f29bc0cba10 con 0x7f29c4102b80 2024-06-02T04:02:34.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.560+0000 7f29c2ffd700 1 --2- 172.21.15.123:0/3615941396 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f29ac0a1120 0x7f29ac0a35e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f29b400b580 tx=0x7f29b4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:02:34.564 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.564+0000 7f29c88a1700 1 -- 172.21.15.123:0/3615941396 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f29bc0956d0 con 0x7f29c4102b80 2024-06-02T04:02:34.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:34 smithi136 ceph-mon[47443]: from='osd.11 [v2:172.21.15.162:6824/704809754,v1:172.21.15.162:6825/704809754]' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2024-06-02T04:02:34.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:34 smithi136 ceph-mon[47443]: osdmap e76: 12 total, 11 up, 12 in 2024-06-02T04:02:34.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:34 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:02:34.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:34 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:02:34.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:34 smithi136 ceph-mon[47443]: from='osd.11 [v2:172.21.15.162:6824/704809754,v1:172.21.15.162:6825/704809754]' entity='osd.11' 2024-06-02T04:02:34.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.758+0000 7f29c98a3700 1 -- 172.21.15.123:0/3615941396 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f29c404ec60 con 0x7f29c4102b80 2024-06-02T04:02:34.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.759+0000 7f29c88a1700 1 -- 172.21.15.123:0/3615941396 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v77) v1 ==== 74+0+133 (secure 0 0 0) 0x7f29bc098cf0 con 0x7f29c4102b80 2024-06-02T04:02:34.759 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:02:34.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.761+0000 7f29c98a3700 1 -- 172.21.15.123:0/3615941396 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f29ac0a1120 msgr2=0x7f29ac0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:34.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.761+0000 7f29c98a3700 1 --2- 172.21.15.123:0/3615941396 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f29ac0a1120 0x7f29ac0a35e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f29b400b580 tx=0x7f29b4005fb0 comp rx=0 tx=0).stop 2024-06-02T04:02:34.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.761+0000 7f29c98a3700 1 -- 172.21.15.123:0/3615941396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29c4102b80 msgr2=0x7f29c419e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:34.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.761+0000 7f29c98a3700 1 --2- 172.21.15.123:0/3615941396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29c4102b80 0x7f29c419e510 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f29bc00add0 tx=0x7f29bc00c330 comp rx=0 tx=0).stop 2024-06-02T04:02:34.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.761+0000 7f29c98a3700 1 -- 172.21.15.123:0/3615941396 shutdown_connections 2024-06-02T04:02:34.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.761+0000 7f29c98a3700 1 --2- 172.21.15.123:0/3615941396 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f29c4102b80 0x7f29c419e510 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:34.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.761+0000 7f29c98a3700 1 --2- 172.21.15.123:0/3615941396 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f29ac0a1120 0x7f29ac0a35e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:34.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.761+0000 7f29c98a3700 1 --2- 172.21.15.123:0/3615941396 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29c4100fe0 0x7f29c4196fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:34.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.761+0000 7f29c98a3700 1 --2- 172.21.15.123:0/3615941396 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29c41021e0 0x7f29c41974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:34.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.761+0000 7f29c98a3700 1 -- 172.21.15.123:0/3615941396 >> 172.21.15.123:0/3615941396 conn(0x7f29c40fc5a0 msgr2=0x7f29c41055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:34.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.761+0000 7f29c98a3700 1 -- 172.21.15.123:0/3615941396 shutdown_connections 2024-06-02T04:02:34.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:34.761+0000 7f29c98a3700 1 -- 172.21.15.123:0/3615941396 wait complete. 2024-06-02T04:02:35.149 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":77,"num_osds":12,"num_up_osds":12,"osd_up_since":1717300954,"num_in_osds":12,"osd_in_since":1717300938,"num_remapped_pgs":0} 2024-06-02T04:02:35.149 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-02T04:02:35.369 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:02:35.459 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:35 smithi123 ceph-mon[42885]: purged_snaps scrub starts 2024-06-02T04:02:35.459 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:35 smithi123 ceph-mon[42885]: purged_snaps scrub ok 2024-06-02T04:02:35.459 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:35 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:02:35.459 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:35 smithi123 ceph-mon[42885]: osd.11 [v2:172.21.15.162:6824/704809754,v1:172.21.15.162:6825/704809754] boot 2024-06-02T04:02:35.459 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:35 smithi123 ceph-mon[42885]: osdmap e77: 12 total, 12 up, 12 in 2024-06-02T04:02:35.460 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:35 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:02:35.460 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:35 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/3615941396' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-02T04:02:35.460 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:35 smithi123 ceph-mon[42885]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-06-02T04:02:35.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:35 smithi162 ceph-mon[47009]: purged_snaps scrub starts 2024-06-02T04:02:35.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:35 smithi162 ceph-mon[47009]: purged_snaps scrub ok 2024-06-02T04:02:35.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:35 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:02:35.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:35 smithi162 ceph-mon[47009]: osd.11 [v2:172.21.15.162:6824/704809754,v1:172.21.15.162:6825/704809754] boot 2024-06-02T04:02:35.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:35 smithi162 ceph-mon[47009]: osdmap e77: 12 total, 12 up, 12 in 2024-06-02T04:02:35.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:35 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:02:35.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:35 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/3615941396' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-02T04:02:35.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:35 smithi162 ceph-mon[47009]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-06-02T04:02:35.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:35 smithi136 ceph-mon[47443]: purged_snaps scrub starts 2024-06-02T04:02:35.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:35 smithi136 ceph-mon[47443]: purged_snaps scrub ok 2024-06-02T04:02:35.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:35 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:02:35.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:35 smithi136 ceph-mon[47443]: osd.11 [v2:172.21.15.162:6824/704809754,v1:172.21.15.162:6825/704809754] boot 2024-06-02T04:02:35.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:35 smithi136 ceph-mon[47443]: osdmap e77: 12 total, 12 up, 12 in 2024-06-02T04:02:35.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:35 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-06-02T04:02:35.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:35 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/3615941396' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-06-02T04:02:35.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:35 smithi136 ceph-mon[47443]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-06-02T04:02:36.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.227+0000 7f8db291a700 1 -- 172.21.15.123:0/3123940433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dac100890 msgr2=0x7f8dac10cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:36.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.227+0000 7f8db291a700 1 --2- 172.21.15.123:0/3123940433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dac100890 0x7f8dac10cd40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8da400b0a0 tx=0x7f8da400b3b0 comp rx=0 tx=0).stop 2024-06-02T04:02:36.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.227+0000 7f8db291a700 1 -- 172.21.15.123:0/3123940433 shutdown_connections 2024-06-02T04:02:36.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.227+0000 7f8db291a700 1 --2- 172.21.15.123:0/3123940433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dac100890 0x7f8dac10cd40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:36.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.227+0000 7f8db291a700 1 --2- 172.21.15.123:0/3123940433 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dac105f00 0x7f8dac1062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:36.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.227+0000 7f8db291a700 1 --2- 172.21.15.123:0/3123940433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8dac0ffed0 0x7f8dac100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:36.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.227+0000 7f8db291a700 1 -- 172.21.15.123:0/3123940433 >> 172.21.15.123:0/3123940433 conn(0x7f8dac075f80 msgr2=0x7f8dac076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:36.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.227+0000 7f8db291a700 1 -- 172.21.15.123:0/3123940433 shutdown_connections 2024-06-02T04:02:36.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.228+0000 7f8db291a700 1 -- 172.21.15.123:0/3123940433 wait complete. 2024-06-02T04:02:36.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.228+0000 7f8db291a700 1 Processor -- start 2024-06-02T04:02:36.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.228+0000 7f8db291a700 1 -- start start 2024-06-02T04:02:36.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.228+0000 7f8db291a700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8dac0ffed0 0x7f8dac197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:36.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.228+0000 7f8db291a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dac100890 0x7f8dac197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:36.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.228+0000 7f8db291a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dac105f00 0x7f8dac19bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:36.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.228+0000 7f8db291a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac19c330 con 0x7f8dac100890 2024-06-02T04:02:36.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.228+0000 7f8db291a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac19c4a0 con 0x7f8dac105f00 2024-06-02T04:02:36.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.228+0000 7f8db291a700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dac19c660 con 0x7f8dac0ffed0 2024-06-02T04:02:36.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.229+0000 7f8dab7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dac100890 0x7f8dac197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:36.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.229+0000 7f8dab7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dac100890 0x7f8dac197970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54216/0 (socket says 172.21.15.123:54216) 2024-06-02T04:02:36.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.229+0000 7f8dab7fe700 1 -- 172.21.15.123:0/2422878347 learned_addr learned my addr 172.21.15.123:0/2422878347 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:02:36.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.229+0000 7f8dabfff700 1 --2- 172.21.15.123:0/2422878347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8dac0ffed0 0x7f8dac197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:36.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.229+0000 7f8dab7fe700 1 -- 172.21.15.123:0/2422878347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8dac0ffed0 msgr2=0x7f8dac197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:36.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.229+0000 7f8db0eb7700 1 --2- 172.21.15.123:0/2422878347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dac105f00 0x7f8dac19bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:36.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.229+0000 7f8dab7fe700 1 --2- 172.21.15.123:0/2422878347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8dac0ffed0 0x7f8dac197430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:36.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.229+0000 7f8dab7fe700 1 -- 172.21.15.123:0/2422878347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dac105f00 msgr2=0x7f8dac19bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:36.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.229+0000 7f8dab7fe700 1 --2- 172.21.15.123:0/2422878347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dac105f00 0x7f8dac19bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:36.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.229+0000 7f8dab7fe700 1 -- 172.21.15.123:0/2422878347 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da4009d00 con 0x7f8dac100890 2024-06-02T04:02:36.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.229+0000 7f8dabfff700 1 --2- 172.21.15.123:0/2422878347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8dac0ffed0 0x7f8dac197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:02:36.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.229+0000 7f8db0eb7700 1 --2- 172.21.15.123:0/2422878347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dac105f00 0x7f8dac19bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:02:36.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.229+0000 7f8dab7fe700 1 --2- 172.21.15.123:0/2422878347 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dac100890 0x7f8dac197970 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8da000d950 tx=0x7f8da000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:02:36.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.229+0000 7f8da97fa700 1 -- 172.21.15.123:0/2422878347 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da0009b40 con 0x7f8dac100890 2024-06-02T04:02:36.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.229+0000 7f8da97fa700 1 -- 172.21.15.123:0/2422878347 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8da0009ca0 con 0x7f8dac100890 2024-06-02T04:02:36.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.229+0000 7f8db291a700 1 -- 172.21.15.123:0/2422878347 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dac19c940 con 0x7f8dac100890 2024-06-02T04:02:36.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.229+0000 7f8db291a700 1 -- 172.21.15.123:0/2422878347 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dac1a41a0 con 0x7f8dac100890 2024-06-02T04:02:36.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.229+0000 7f8da97fa700 1 -- 172.21.15.123:0/2422878347 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da000f620 con 0x7f8dac100890 2024-06-02T04:02:36.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.230+0000 7f8db291a700 1 -- 172.21.15.123:0/2422878347 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d980052f0 con 0x7f8dac100890 2024-06-02T04:02:36.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.231+0000 7f8da97fa700 1 -- 172.21.15.123:0/2422878347 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f8da0010460 con 0x7f8dac100890 2024-06-02T04:02:36.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.232+0000 7f8da97fa700 1 --2- 172.21.15.123:0/2422878347 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f8d940a1120 0x7f8d940a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:36.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.232+0000 7f8dabfff700 1 --2- 172.21.15.123:0/2422878347 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f8d940a1120 0x7f8d940a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:36.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.232+0000 7f8da97fa700 1 -- 172.21.15.123:0/2422878347 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8da00cc700 con 0x7f8dac100890 2024-06-02T04:02:36.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.232+0000 7f8dabfff700 1 --2- 172.21.15.123:0/2422878347 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f8d940a1120 0x7f8d940a35e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c00baa0 tx=0x7f8d9c005db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:02:36.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.235+0000 7f8da97fa700 1 -- 172.21.15.123:0/2422878347 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8da0096330 con 0x7f8dac100890 2024-06-02T04:02:36.430 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.429+0000 7f8db291a700 1 -- 172.21.15.123:0/2422878347 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d98005160 con 0x7f8dac100890 2024-06-02T04:02:36.431 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.431+0000 7f8da97fa700 1 -- 172.21.15.123:0/2422878347 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+18478 (secure 0 0 0) 0x7f8da0099950 con 0x7f8dac100890 2024-06-02T04:02:36.431 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:02:36.431 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":78,"fsid":"1b432ae0-2094-11ef-bc9b-c7b262605968","created":"2024-06-02T03:57:17.383774+0000","modified":"2024-06-02T04:02:35.537597+0000","last_up_change":"2024-06-02T04:02:34.535591+0000","last_in_change":"2024-06-02T04:02:18.346560+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T03:59:57.079448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d9d8fb5a-dac5-4b14-98e5-665bdbc696ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6803","nonce":2763421276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6805","nonce":2763421276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6809","nonce":2763421276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6807","nonce":2763421276}]},"public_addr":"172.21.15.123:6803/2763421276","cluster_addr":"172.21.15.123:6805/2763421276","heartbeat_back_addr":"172.21.15.123:6809/2763421276","heartbeat_front_addr":"172.21.15.123:6807/2763421276","state":["exists","up"]},{"osd":1,"uuid":"121bbe3c-bb76-4ec4-9596-37db68fbf1ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6801","nonce":956325510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6803","nonce":956325510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6807","nonce":956325510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6805","nonce":956325510}]},"public_addr":"172.21.15.136:6801/956325510","cluster_addr":"172.21.15.136:6803/956325510","heartbeat_back_addr":"172.21.15.136:6807/956325510","heartbeat_front_addr":"172.21.15.136:6805/956325510","state":["exists","up"]},{"osd":2,"uuid":"df9edf0d-f9f0-4699-a6ed-bbcf2dfb1b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6801","nonce":2915749676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6803","nonce":2915749676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6807","nonce":2915749676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6805","nonce":2915749676}]},"public_addr":"172.21.15.162:6801/2915749676","cluster_addr":"172.21.15.162:6803/2915749676","heartbeat_back_addr":"172.21.15.162:6807/2915749676","heartbeat_front_addr":"172.21.15.162:6805/2915749676","state":["exists","up"]},{"osd":3,"uuid":"3e070364-12c6-4780-b2be-f6e933e65773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6811","nonce":1403773143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6813","nonce":1403773143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6817","nonce":1403773143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6815","nonce":1403773143}]},"public_addr":"172.21.15.123:6811/1403773143","cluster_addr":"172.21.15.123:6813/1403773143","heartbeat_back_addr":"172.21.15.123:6817/1403773143","heartbeat_front_addr":"172.21.15.123:6815/1403773143","state":["exists","up"]},{"osd":4,"uuid":"87dd92dd-73c8-4785-bf8a-3756d79dee90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6809","nonce":1403526782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6811","nonce":1403526782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6815","nonce":1403526782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6813","nonce":1403526782}]},"public_addr":"172.21.15.136:6809/1403526782","cluster_addr":"172.21.15.136:6811/1403526782","heartbeat_back_addr":"172.21.15.136:6815/1403526782","heartbeat_front_addr":"172.21.15.136:6813/1403526782","state":["exists","up"]},{"osd":5,"uuid":"1a730863-6b56-43b7-a115-c80d3c8f3ee3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6809","nonce":3094256489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6811","nonce":3094256489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6815","nonce":3094256489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6813","nonce":3094256489}]},"public_addr":"172.21.15.162:6809/3094256489","cluster_addr":"172.21.15.162:6811/3094256489","heartbeat_back_addr":"172.21.15.162:6815/3094256489","heartbeat_front_addr":"172.21.15.162:6813/3094256489","state":["exists","up"]},{"osd":6,"uuid":"6f170b85-6c47-49ff-ba5b-7fe0596a4ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6819","nonce":3025820432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6821","nonce":3025820432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6825","nonce":3025820432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6823","nonce":3025820432}]},"public_addr":"172.21.15.123:6819/3025820432","cluster_addr":"172.21.15.123:6821/3025820432","heartbeat_back_addr":"172.21.15.123:6825/3025820432","heartbeat_front_addr":"172.21.15.123:6823/3025820432","state":["exists","up"]},{"osd":7,"uuid":"ee66bb7a-6c0d-4e5a-b717-258a39f93a87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6817","nonce":1948829505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6819","nonce":1948829505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6823","nonce":1948829505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6821","nonce":1948829505}]},"public_addr":"172.21.15.136:6817/1948829505","cluster_addr":"172.21.15.136:6819/1948829505","heartbeat_back_addr":"172.21.15.136:6823/1948829505","heartbeat_front_addr":"172.21.15.136:6821/1948829505","state":["exists","up"]},{"osd":8,"uuid":"0ff77e33-53a5-43ef-85da-2036a1fcdb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6817","nonce":1590839230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6819","nonce":1590839230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6823","nonce":1590839230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6821","nonce":1590839230}]},"public_addr":"172.21.15.162:6817/1590839230","cluster_addr":"172.21.15.162:6819/1590839230","heartbeat_back_addr":"172.21.15.162:6823/1590839230","heartbeat_front_addr":"172.21.15.162:6821/1590839230","state":["exists","up"]},{"osd":9,"uuid":"1670731c-5e8f-4cbc-8f35-6aeb14ea3075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6827","nonce":608720685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6829","nonce":608720685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6833","nonce":608720685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6831","nonce":608720685}]},"public_addr":"172.21.15.123:6827/608720685","cluster_addr":"172.21.15.123:6829/608720685","heartbeat_back_addr":"172.21.15.123:6833/608720685","heartbeat_front_addr":"172.21.15.123:6831/608720685","state":["exists","up"]},{"osd":10,"uuid":"ae138b96-13e7-46ac-9d4d-48308132465d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6825","nonce":3777263126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6827","nonce":3777263126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6831","nonce":3777263126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6829","nonce":3777263126}]},"public_addr":"172.21.15.136:6825/3777263126","cluster_addr":"172.21.15.136:6827/3777263126","heartbeat_back_addr":"172.21.15.136:6831/3777263126","heartbeat_front_addr":"172.21.15.136:6829/3777263126","state":["exists","up"]},{"osd":11,"uuid":"69f4ede0-7e9b-4edb-be54-01f74f002a06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6825","nonce":704809754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6827","nonce":704809754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6831","nonce":704809754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6829","nonce":704809754}]},"public_addr":"172.21.15.162:6825/704809754","cluster_addr":"172.21.15.162:6827/704809754","heartbeat_back_addr":"172.21.15.162:6831/704809754","heartbeat_front_addr":"172.21.15.162:6829/704809754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:19.188506+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:36.535261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:54.242294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:11.815314+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:29.512086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:46.874319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:04.437358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:22.312520+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:39.917998+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:57.340043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:15.252797+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:32.898924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:0/69783025":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/10165744":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/2081407856":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/4026642298":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/1442330765":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/1595718606":"2024-06-03T03:57:45.611046+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:02:36.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.433+0000 7f8db291a700 1 -- 172.21.15.123:0/2422878347 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f8d940a1120 msgr2=0x7f8d940a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:36.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.433+0000 7f8db291a700 1 --2- 172.21.15.123:0/2422878347 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f8d940a1120 0x7f8d940a35e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c00baa0 tx=0x7f8d9c005db0 comp rx=0 tx=0).stop 2024-06-02T04:02:36.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.433+0000 7f8db291a700 1 -- 172.21.15.123:0/2422878347 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dac100890 msgr2=0x7f8dac197970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:36.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.433+0000 7f8db291a700 1 --2- 172.21.15.123:0/2422878347 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dac100890 0x7f8dac197970 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8da000d950 tx=0x7f8da000dd10 comp rx=0 tx=0).stop 2024-06-02T04:02:36.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.433+0000 7f8db291a700 1 -- 172.21.15.123:0/2422878347 shutdown_connections 2024-06-02T04:02:36.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.433+0000 7f8db291a700 1 --2- 172.21.15.123:0/2422878347 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f8d940a1120 0x7f8d940a35e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:36.433 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.433+0000 7f8db291a700 1 --2- 172.21.15.123:0/2422878347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dac105f00 0x7f8dac19bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:36.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.433+0000 7f8db291a700 1 --2- 172.21.15.123:0/2422878347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8dac0ffed0 0x7f8dac197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:36.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.433+0000 7f8db291a700 1 --2- 172.21.15.123:0/2422878347 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8dac100890 0x7f8dac197970 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:36.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.433+0000 7f8db291a700 1 -- 172.21.15.123:0/2422878347 >> 172.21.15.123:0/2422878347 conn(0x7f8dac075f80 msgr2=0x7f8dac0ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:36.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.433+0000 7f8db291a700 1 -- 172.21.15.123:0/2422878347 shutdown_connections 2024-06-02T04:02:36.434 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:36.433+0000 7f8db291a700 1 -- 172.21.15.123:0/2422878347 wait complete. 2024-06-02T04:02:36.764 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:36 smithi123 ceph-mon[42885]: osdmap e78: 12 total, 12 up, 12 in 2024-06-02T04:02:36.764 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:36 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2422878347' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:02:36.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:36 smithi162 ceph-mon[47009]: osdmap e78: 12 total, 12 up, 12 in 2024-06-02T04:02:36.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:36 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/2422878347' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:02:36.816 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T03:59:57.079448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-02T04:02:36.816 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-06-02T04:02:36.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:36 smithi136 ceph-mon[47443]: osdmap e78: 12 total, 12 up, 12 in 2024-06-02T04:02:36.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:36 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/2422878347' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:02:37.036 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:02:37.778 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:37 smithi123 ceph-mon[42885]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:37.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:37 smithi136 ceph-mon[47443]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:37.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.949+0000 7f8f747d8700 1 -- 172.21.15.123:0/2365643867 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f6c105f80 msgr2=0x7f8f6c106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:37.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.949+0000 7f8f747d8700 1 --2- 172.21.15.123:0/2365643867 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f6c105f80 0x7f8f6c106360 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c009990 tx=0x7f8f5c009ca0 comp rx=0 tx=0).stop 2024-06-02T04:02:37.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.949+0000 7f8f747d8700 1 -- 172.21.15.123:0/2365643867 shutdown_connections 2024-06-02T04:02:37.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.949+0000 7f8f747d8700 1 --2- 172.21.15.123:0/2365643867 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f6c100bb0 0x7f8f6c10cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:37.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.949+0000 7f8f747d8700 1 --2- 172.21.15.123:0/2365643867 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f6c105f80 0x7f8f6c106360 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:37.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.949+0000 7f8f747d8700 1 --2- 172.21.15.123:0/2365643867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f6c1001f0 0x7f8f6c100670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:37.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.949+0000 7f8f747d8700 1 -- 172.21.15.123:0/2365643867 >> 172.21.15.123:0/2365643867 conn(0x7f8f6c076c50 msgr2=0x7f8f6c077060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:37.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.949+0000 7f8f747d8700 1 -- 172.21.15.123:0/2365643867 shutdown_connections 2024-06-02T04:02:37.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.949+0000 7f8f747d8700 1 -- 172.21.15.123:0/2365643867 wait complete. 2024-06-02T04:02:37.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.950+0000 7f8f747d8700 1 Processor -- start 2024-06-02T04:02:37.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.950+0000 7f8f747d8700 1 -- start start 2024-06-02T04:02:37.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.950+0000 7f8f747d8700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f6c1001f0 0x7f8f6c196330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:37.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.950+0000 7f8f747d8700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f6c100bb0 0x7f8f6c196870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:37.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.950+0000 7f8f747d8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f6c105f80 0x7f8f6c19ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:37.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.950+0000 7f8f747d8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c19b230 con 0x7f8f6c105f80 2024-06-02T04:02:37.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.950+0000 7f8f747d8700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c19b3a0 con 0x7f8f6c1001f0 2024-06-02T04:02:37.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.950+0000 7f8f747d8700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c19b560 con 0x7f8f6c100bb0 2024-06-02T04:02:37.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.950+0000 7f8f72d75700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f6c105f80 0x7f8f6c19ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:37.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.950+0000 7f8f72d75700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f6c105f80 0x7f8f6c19ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54226/0 (socket says 172.21.15.123:54226) 2024-06-02T04:02:37.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.950+0000 7f8f72d75700 1 -- 172.21.15.123:0/2220502561 learned_addr learned my addr 172.21.15.123:0/2220502561 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:02:37.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.950+0000 7f8f71d73700 1 --2- 172.21.15.123:0/2220502561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f6c100bb0 0x7f8f6c196870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:37.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.950+0000 7f8f72574700 1 --2- 172.21.15.123:0/2220502561 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f6c1001f0 0x7f8f6c196330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:37.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.950+0000 7f8f72d75700 1 -- 172.21.15.123:0/2220502561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f6c100bb0 msgr2=0x7f8f6c196870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:37.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.950+0000 7f8f72d75700 1 --2- 172.21.15.123:0/2220502561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f6c100bb0 0x7f8f6c196870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:37.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.950+0000 7f8f72d75700 1 -- 172.21.15.123:0/2220502561 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f6c1001f0 msgr2=0x7f8f6c196330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:37.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.950+0000 7f8f72d75700 1 --2- 172.21.15.123:0/2220502561 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f6c1001f0 0x7f8f6c196330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:37.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.950+0000 7f8f72d75700 1 -- 172.21.15.123:0/2220502561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5c0095f0 con 0x7f8f6c105f80 2024-06-02T04:02:37.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.950+0000 7f8f71d73700 1 --2- 172.21.15.123:0/2220502561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f6c100bb0 0x7f8f6c196870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:02:37.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.950+0000 7f8f72d75700 1 --2- 172.21.15.123:0/2220502561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f6c105f80 0x7f8f6c19ac20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8f6400db90 tx=0x7f8f6400df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:02:37.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.951+0000 7f8f637fe700 1 -- 172.21.15.123:0/2220502561 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6400e800 con 0x7f8f6c105f80 2024-06-02T04:02:37.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.951+0000 7f8f747d8700 1 -- 172.21.15.123:0/2220502561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f6c19b7e0 con 0x7f8f6c105f80 2024-06-02T04:02:37.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.951+0000 7f8f637fe700 1 -- 172.21.15.123:0/2220502561 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f6400bac0 con 0x7f8f6c105f80 2024-06-02T04:02:37.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.951+0000 7f8f637fe700 1 -- 172.21.15.123:0/2220502561 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f640163f0 con 0x7f8f6c105f80 2024-06-02T04:02:37.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.951+0000 7f8f747d8700 1 -- 172.21.15.123:0/2220502561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f6c0697b0 con 0x7f8f6c105f80 2024-06-02T04:02:37.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.952+0000 7f8f747d8700 1 -- 172.21.15.123:0/2220502561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f6c068e90 con 0x7f8f6c105f80 2024-06-02T04:02:37.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.953+0000 7f8f637fe700 1 -- 172.21.15.123:0/2220502561 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f8f64009580 con 0x7f8f6c105f80 2024-06-02T04:02:37.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.953+0000 7f8f637fe700 1 --2- 172.21.15.123:0/2220502561 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f8f580a1120 0x7f8f580a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:37.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.953+0000 7f8f72574700 1 --2- 172.21.15.123:0/2220502561 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f8f580a1120 0x7f8f580a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:37.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.953+0000 7f8f637fe700 1 -- 172.21.15.123:0/2220502561 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8f64006e40 con 0x7f8f6c105f80 2024-06-02T04:02:37.955 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.953+0000 7f8f72574700 1 --2- 172.21.15.123:0/2220502561 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f8f580a1120 0x7f8f580a35e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c006010 tx=0x7f8f5c00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:02:37.957 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:37.957+0000 7f8f637fe700 1 -- 172.21.15.123:0/2220502561 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8f64050d60 con 0x7f8f6c105f80 2024-06-02T04:02:38.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:37 smithi162 ceph-mon[47009]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:38.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:38.149+0000 7f8f747d8700 1 -- 172.21.15.123:0/2220502561 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8f6c1976e0 con 0x7f8f6c105f80 2024-06-02T04:02:38.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:38.149+0000 7f8f637fe700 1 -- 172.21.15.123:0/2220502561 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8f640975e0 con 0x7f8f6c105f80 2024-06-02T04:02:38.149 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-06-02T04:02:38.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:38.151+0000 7f8f747d8700 1 -- 172.21.15.123:0/2220502561 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f8f580a1120 msgr2=0x7f8f580a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:38.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:38.151+0000 7f8f747d8700 1 --2- 172.21.15.123:0/2220502561 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f8f580a1120 0x7f8f580a35e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c006010 tx=0x7f8f5c00b540 comp rx=0 tx=0).stop 2024-06-02T04:02:38.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:38.151+0000 7f8f747d8700 1 -- 172.21.15.123:0/2220502561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f6c105f80 msgr2=0x7f8f6c19ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:38.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:38.151+0000 7f8f747d8700 1 --2- 172.21.15.123:0/2220502561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f6c105f80 0x7f8f6c19ac20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8f6400db90 tx=0x7f8f6400df50 comp rx=0 tx=0).stop 2024-06-02T04:02:38.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:38.151+0000 7f8f747d8700 1 -- 172.21.15.123:0/2220502561 shutdown_connections 2024-06-02T04:02:38.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:38.151+0000 7f8f747d8700 1 --2- 172.21.15.123:0/2220502561 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8f6c105f80 0x7f8f6c19ac20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:38.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:38.151+0000 7f8f747d8700 1 --2- 172.21.15.123:0/2220502561 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f8f580a1120 0x7f8f580a35e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:38.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:38.151+0000 7f8f747d8700 1 --2- 172.21.15.123:0/2220502561 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f6c1001f0 0x7f8f6c196330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:38.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:38.151+0000 7f8f747d8700 1 --2- 172.21.15.123:0/2220502561 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f6c100bb0 0x7f8f6c196870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:38.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:38.151+0000 7f8f747d8700 1 -- 172.21.15.123:0/2220502561 >> 172.21.15.123:0/2220502561 conn(0x7f8f6c076c50 msgr2=0x7f8f6c0feff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:38.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:38.151+0000 7f8f747d8700 1 -- 172.21.15.123:0/2220502561 shutdown_connections 2024-06-02T04:02:38.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:38.152+0000 7f8f747d8700 1 -- 172.21.15.123:0/2220502561 wait complete. 2024-06-02T04:02:38.540 INFO:tasks.cephadm:Adding mds.a on smithi123 2024-06-02T04:02:38.540 INFO:tasks.cephadm:Adding mds.d on smithi123 2024-06-02T04:02:38.540 INFO:tasks.cephadm:Adding mds.g on smithi123 2024-06-02T04:02:38.540 INFO:tasks.cephadm:Adding mds.j on smithi123 2024-06-02T04:02:38.540 INFO:tasks.cephadm:Adding mds.b on smithi136 2024-06-02T04:02:38.540 INFO:tasks.cephadm:Adding mds.e on smithi136 2024-06-02T04:02:38.541 INFO:tasks.cephadm:Adding mds.h on smithi136 2024-06-02T04:02:38.541 INFO:tasks.cephadm:Adding mds.k on smithi136 2024-06-02T04:02:38.541 INFO:tasks.cephadm:Adding mds.c on smithi162 2024-06-02T04:02:38.541 INFO:tasks.cephadm:Adding mds.f on smithi162 2024-06-02T04:02:38.541 INFO:tasks.cephadm:Adding mds.i on smithi162 2024-06-02T04:02:38.541 INFO:tasks.cephadm:Adding mds.l on smithi162 2024-06-02T04:02:38.541 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph orch apply mds all '12;smithi123=a;smithi123=d;smithi123=g;smithi123=j;smithi136=b;smithi136=e;smithi136=h;smithi136=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l' 2024-06-02T04:02:38.778 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T04:02:38.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:38 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2220502561' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:02:38.837 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:38 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/2220502561' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:02:38.896 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:38 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/2220502561' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:02:39.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.791+0000 7f72dec2f700 1 -- 172.21.15.162:0/2681757783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72d80fff00 msgr2=0x7f72d8100320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:39.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.791+0000 7f72dec2f700 1 --2- 172.21.15.162:0/2681757783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72d80fff00 0x7f72d8100320 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f72cc009990 tx=0x7f72cc009ca0 comp rx=0 tx=0).stop 2024-06-02T04:02:39.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.792+0000 7f72dec2f700 1 -- 172.21.15.162:0/2681757783 shutdown_connections 2024-06-02T04:02:39.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.792+0000 7f72dec2f700 1 --2- 172.21.15.162:0/2681757783 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72d8101a20 0x7f72d8108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:39.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.792+0000 7f72dec2f700 1 --2- 172.21.15.162:0/2681757783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72d80fff00 0x7f72d8100320 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:39.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.792+0000 7f72dec2f700 1 --2- 172.21.15.162:0/2681757783 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72d8101060 0x7f72d81014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:39.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.792+0000 7f72dec2f700 1 -- 172.21.15.162:0/2681757783 >> 172.21.15.162:0/2681757783 conn(0x7f72d80fb4a0 msgr2=0x7f72d80fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:39.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.792+0000 7f72dec2f700 1 -- 172.21.15.162:0/2681757783 shutdown_connections 2024-06-02T04:02:39.792 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.792+0000 7f72dec2f700 1 -- 172.21.15.162:0/2681757783 wait complete. 2024-06-02T04:02:39.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.792+0000 7f72dec2f700 1 Processor -- start 2024-06-02T04:02:39.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.792+0000 7f72dec2f700 1 -- start start 2024-06-02T04:02:39.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.792+0000 7f72dec2f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72d80fff00 0x7f72d8196e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:39.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.792+0000 7f72dec2f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72d8101060 0x7f72d8197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:39.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.792+0000 7f72dec2f700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72d8101a20 0x7f72d819e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:39.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.792+0000 7f72dec2f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d819e960 con 0x7f72d80fff00 2024-06-02T04:02:39.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.792+0000 7f72dec2f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d819eaa0 con 0x7f72d8101060 2024-06-02T04:02:39.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.792+0000 7f72dec2f700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d819ec30 con 0x7f72d8101a20 2024-06-02T04:02:39.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.792+0000 7f72dd1cc700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72d8101a20 0x7f72d819e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:39.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.792+0000 7f72dd1cc700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72d8101a20 0x7f72d819e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:45548/0 (socket says 172.21.15.162:45548) 2024-06-02T04:02:39.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.792+0000 7f72dd1cc700 1 -- 172.21.15.162:0/775444451 learned_addr learned my addr 172.21.15.162:0/775444451 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-06-02T04:02:39.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.793+0000 7f72dc9cb700 1 --2- 172.21.15.162:0/775444451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72d80fff00 0x7f72d8196e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:39.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.793+0000 7f72d7fff700 1 --2- 172.21.15.162:0/775444451 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72d8101060 0x7f72d8197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:39.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.793+0000 7f72dd1cc700 1 -- 172.21.15.162:0/775444451 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72d8101060 msgr2=0x7f72d8197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:39.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.793+0000 7f72dd1cc700 1 --2- 172.21.15.162:0/775444451 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72d8101060 0x7f72d8197360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:39.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.793+0000 7f72dd1cc700 1 -- 172.21.15.162:0/775444451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72d80fff00 msgr2=0x7f72d8196e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:39.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.793+0000 7f72dd1cc700 1 --2- 172.21.15.162:0/775444451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72d80fff00 0x7f72d8196e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:39.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.793+0000 7f72dd1cc700 1 -- 172.21.15.162:0/775444451 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72cc0095f0 con 0x7f72d8101a20 2024-06-02T04:02:39.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.793+0000 7f72dc9cb700 1 --2- 172.21.15.162:0/775444451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72d80fff00 0x7f72d8196e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:02:39.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.793+0000 7f72dd1cc700 1 --2- 172.21.15.162:0/775444451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72d8101a20 0x7f72d819e390 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f72d0007d40 tx=0x7f72d000a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:02:39.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.793+0000 7f72d5ffb700 1 -- 172.21.15.162:0/775444451 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d000ad60 con 0x7f72d8101a20 2024-06-02T04:02:39.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.793+0000 7f72d5ffb700 1 -- 172.21.15.162:0/775444451 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f72d00128e0 con 0x7f72d8101a20 2024-06-02T04:02:39.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.793+0000 7f72dec2f700 1 -- 172.21.15.162:0/775444451 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72d819ef10 con 0x7f72d8101a20 2024-06-02T04:02:39.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.793+0000 7f72d5ffb700 1 -- 172.21.15.162:0/775444451 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d00117e0 con 0x7f72d8101a20 2024-06-02T04:02:39.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.793+0000 7f72dec2f700 1 -- 172.21.15.162:0/775444451 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72d819f320 con 0x7f72d8101a20 2024-06-02T04:02:39.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.794+0000 7f72dec2f700 1 -- 172.21.15.162:0/775444451 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72d804ec60 con 0x7f72d8101a20 2024-06-02T04:02:39.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.795+0000 7f72d5ffb700 1 -- 172.21.15.162:0/775444451 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f72d0012420 con 0x7f72d8101a20 2024-06-02T04:02:39.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.796+0000 7f72d5ffb700 1 --2- 172.21.15.162:0/775444451 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f72c80a1120 0x7f72c80a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:39.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.796+0000 7f72d5ffb700 1 -- 172.21.15.162:0/775444451 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f72d00cc820 con 0x7f72d8101a20 2024-06-02T04:02:39.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.796+0000 7f72dc9cb700 1 --2- 172.21.15.162:0/775444451 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f72c80a1120 0x7f72c80a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:39.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.796+0000 7f72dc9cb700 1 --2- 172.21.15.162:0/775444451 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f72c80a1120 0x7f72c80a35e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f72cc000c00 tx=0x7f72cc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:02:39.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:39.800+0000 7f72d5ffb700 1 -- 172.21.15.162:0/775444451 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f72d00963b0 con 0x7f72d8101a20 2024-06-02T04:02:39.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:39 smithi123 ceph-mon[42885]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:39.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:39 smithi136 ceph-mon[47443]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:40.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:40.004+0000 7f72dec2f700 1 -- 172.21.15.162:0/775444451 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi123=a;smithi123=d;smithi123=g;smithi123=j;smithi136=b;smithi136=e;smithi136=h;smithi136=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l", "target": ["mon-mgr", ""]}) v1 -- 0x7f72d80fd770 con 0x7f72c80a1120 2024-06-02T04:02:40.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:40.014+0000 7f72d5ffb700 1 -- 172.21.15.162:0/775444451 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f72d80fd770 con 0x7f72c80a1120 2024-06-02T04:02:40.013 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled mds.all update... 2024-06-02T04:02:40.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:40.016+0000 7f72dec2f700 1 -- 172.21.15.162:0/775444451 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f72c80a1120 msgr2=0x7f72c80a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:40.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:40.016+0000 7f72dec2f700 1 --2- 172.21.15.162:0/775444451 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f72c80a1120 0x7f72c80a35e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f72cc000c00 tx=0x7f72cc005fb0 comp rx=0 tx=0).stop 2024-06-02T04:02:40.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:40.016+0000 7f72dec2f700 1 -- 172.21.15.162:0/775444451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72d8101a20 msgr2=0x7f72d819e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:40.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:40.016+0000 7f72dec2f700 1 --2- 172.21.15.162:0/775444451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72d8101a20 0x7f72d819e390 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f72d0007d40 tx=0x7f72d000a340 comp rx=0 tx=0).stop 2024-06-02T04:02:40.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:40.016+0000 7f72dec2f700 1 -- 172.21.15.162:0/775444451 shutdown_connections 2024-06-02T04:02:40.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:40.016+0000 7f72dec2f700 1 --2- 172.21.15.162:0/775444451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72d8101a20 0x7f72d819e390 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:40.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:40.016+0000 7f72dec2f700 1 --2- 172.21.15.162:0/775444451 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f72d80fff00 0x7f72d8196e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:40.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:40.016+0000 7f72dec2f700 1 --2- 172.21.15.162:0/775444451 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f72c80a1120 0x7f72c80a35e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:40.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:40.016+0000 7f72dec2f700 1 --2- 172.21.15.162:0/775444451 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f72d8101060 0x7f72d8197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:40.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:40.016+0000 7f72dec2f700 1 -- 172.21.15.162:0/775444451 >> 172.21.15.162:0/775444451 conn(0x7f72d80fb4a0 msgr2=0x7f72d80fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:40.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:40.016+0000 7f72dec2f700 1 -- 172.21.15.162:0/775444451 shutdown_connections 2024-06-02T04:02:40.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-06-02T04:02:40.016+0000 7f72dec2f700 1 -- 172.21.15.162:0/775444451 wait complete. 2024-06-02T04:02:40.039 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:39 smithi162 ceph-mon[47009]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:40.382 DEBUG:teuthology.orchestra.run.smithi123:mds.a> sudo journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.a.service 2024-06-02T04:02:40.384 DEBUG:teuthology.orchestra.run.smithi123:mds.d> sudo journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.d.service 2024-06-02T04:02:40.414 INFO:journalctl@ceph.mds.a.smithi123.stdout:-- Logs begin at Sun 2024-06-02 03:41:15 UTC. -- 2024-06-02T04:02:40.415 DEBUG:teuthology.orchestra.run.smithi123:mds.g> sudo journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.g.service 2024-06-02T04:02:40.441 INFO:journalctl@ceph.mds.d.smithi123.stdout:-- Logs begin at Sun 2024-06-02 03:41:15 UTC. -- 2024-06-02T04:02:40.442 DEBUG:teuthology.orchestra.run.smithi123:mds.j> sudo journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.j.service 2024-06-02T04:02:40.469 INFO:journalctl@ceph.mds.g.smithi123.stdout:-- Logs begin at Sun 2024-06-02 03:41:15 UTC. -- 2024-06-02T04:02:40.470 DEBUG:teuthology.orchestra.run.smithi136:mds.b> sudo journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.b.service 2024-06-02T04:02:40.472 DEBUG:teuthology.orchestra.run.smithi136:mds.e> sudo journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.e.service 2024-06-02T04:02:40.495 INFO:journalctl@ceph.mds.j.smithi123.stdout:-- Logs begin at Sun 2024-06-02 03:41:15 UTC. -- 2024-06-02T04:02:40.511 INFO:journalctl@ceph.mds.b.smithi136.stdout:-- Logs begin at Sun 2024-06-02 03:40:52 UTC. -- 2024-06-02T04:02:40.512 DEBUG:teuthology.orchestra.run.smithi136:mds.h> sudo journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.h.service 2024-06-02T04:02:40.541 INFO:journalctl@ceph.mds.e.smithi136.stdout:-- Logs begin at Sun 2024-06-02 03:40:52 UTC. -- 2024-06-02T04:02:40.543 DEBUG:teuthology.orchestra.run.smithi136:mds.k> sudo journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.k.service 2024-06-02T04:02:40.570 INFO:journalctl@ceph.mds.h.smithi136.stdout:-- Logs begin at Sun 2024-06-02 03:40:52 UTC. -- 2024-06-02T04:02:40.572 DEBUG:teuthology.orchestra.run.smithi162:mds.c> sudo journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.c.service 2024-06-02T04:02:40.574 DEBUG:teuthology.orchestra.run.smithi162:mds.f> sudo journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.f.service 2024-06-02T04:02:40.599 INFO:journalctl@ceph.mds.k.smithi136.stdout:-- Logs begin at Sun 2024-06-02 03:40:52 UTC. -- 2024-06-02T04:02:40.604 INFO:journalctl@ceph.mds.c.smithi162.stdout:-- Logs begin at Sun 2024-06-02 03:41:09 UTC. -- 2024-06-02T04:02:40.605 DEBUG:teuthology.orchestra.run.smithi162:mds.i> sudo journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.i.service 2024-06-02T04:02:40.632 INFO:journalctl@ceph.mds.f.smithi162.stdout:-- Logs begin at Sun 2024-06-02 03:41:09 UTC. -- 2024-06-02T04:02:40.633 DEBUG:teuthology.orchestra.run.smithi162:mds.l> sudo journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.l.service 2024-06-02T04:02:40.661 INFO:journalctl@ceph.mds.i.smithi162.stdout:-- Logs begin at Sun 2024-06-02 03:41:09 UTC. -- 2024-06-02T04:02:40.662 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-06-02T04:02:40.662 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:02:40.690 INFO:journalctl@ceph.mds.l.smithi162.stdout:-- Logs begin at Sun 2024-06-02 03:41:09 UTC. -- 2024-06-02T04:02:40.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.795+0000 7f8864bfd700 1 -- 172.21.15.123:0/3754251827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8860101920 msgr2=0x7f88601081d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:40.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.795+0000 7f8864bfd700 1 --2- 172.21.15.123:0/3754251827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8860101920 0x7f88601081d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f885800b0d0 tx=0x7f885800b3e0 comp rx=0 tx=0).stop 2024-06-02T04:02:40.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.795+0000 7f8864bfd700 1 -- 172.21.15.123:0/3754251827 shutdown_connections 2024-06-02T04:02:40.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.795+0000 7f8864bfd700 1 --2- 172.21.15.123:0/3754251827 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8860101920 0x7f88601081d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:40.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.795+0000 7f8864bfd700 1 --2- 172.21.15.123:0/3754251827 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f88600ffd90 0x7f88601001b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:40.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.795+0000 7f8864bfd700 1 --2- 172.21.15.123:0/3754251827 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8860100f80 0x7f88601013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:40.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.795+0000 7f8864bfd700 1 -- 172.21.15.123:0/3754251827 >> 172.21.15.123:0/3754251827 conn(0x7f88600fb300 msgr2=0x7f88600fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:40.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.795+0000 7f8864bfd700 1 -- 172.21.15.123:0/3754251827 shutdown_connections 2024-06-02T04:02:40.796 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.795+0000 7f8864bfd700 1 -- 172.21.15.123:0/3754251827 wait complete. 2024-06-02T04:02:40.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.796+0000 7f8864bfd700 1 Processor -- start 2024-06-02T04:02:40.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.796+0000 7f8864bfd700 1 -- start start 2024-06-02T04:02:40.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.796+0000 7f8864bfd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f88600ffd90 0x7f8860195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:40.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.796+0000 7f8864bfd700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8860100f80 0x7f8860196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:40.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.796+0000 7f8864bfd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8860101920 0x7f886019d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:40.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.796+0000 7f8864bfd700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886019d930 con 0x7f8860101920 2024-06-02T04:02:40.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.796+0000 7f8864bfd700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886019da70 con 0x7f88600ffd90 2024-06-02T04:02:40.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.796+0000 7f8864bfd700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886019dc00 con 0x7f8860100f80 2024-06-02T04:02:40.798 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.796+0000 7f885ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8860101920 0x7f886019d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:40.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.796+0000 7f885e59c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f88600ffd90 0x7f8860195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:40.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.796+0000 7f885ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8860101920 0x7f886019d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54246/0 (socket says 172.21.15.123:54246) 2024-06-02T04:02:40.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.796+0000 7f885ed9d700 1 -- 172.21.15.123:0/64357090 learned_addr learned my addr 172.21.15.123:0/64357090 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:02:40.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.796+0000 7f885dd9b700 1 --2- 172.21.15.123:0/64357090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8860100f80 0x7f8860196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:40.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.796+0000 7f885ed9d700 1 -- 172.21.15.123:0/64357090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8860100f80 msgr2=0x7f8860196340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:40.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.796+0000 7f885ed9d700 1 --2- 172.21.15.123:0/64357090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8860100f80 0x7f8860196340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:40.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.796+0000 7f885ed9d700 1 -- 172.21.15.123:0/64357090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f88600ffd90 msgr2=0x7f8860195e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:40.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.796+0000 7f885ed9d700 1 --2- 172.21.15.123:0/64357090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f88600ffd90 0x7f8860195e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:40.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.797+0000 7f885ed9d700 1 -- 172.21.15.123:0/64357090 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8858009d00 con 0x7f8860101920 2024-06-02T04:02:40.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.797+0000 7f885dd9b700 1 --2- 172.21.15.123:0/64357090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8860100f80 0x7f8860196340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:02:40.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.797+0000 7f885e59c700 1 --2- 172.21.15.123:0/64357090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f88600ffd90 0x7f8860195e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:02:40.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.797+0000 7f885ed9d700 1 --2- 172.21.15.123:0/64357090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8860101920 0x7f886019d360 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8858007b60 tx=0x7f8858008e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:02:40.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.797+0000 7f884f7fe700 1 -- 172.21.15.123:0/64357090 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885800e040 con 0x7f8860101920 2024-06-02T04:02:40.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.797+0000 7f8864bfd700 1 -- 172.21.15.123:0/64357090 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f886019de80 con 0x7f8860101920 2024-06-02T04:02:40.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.797+0000 7f884f7fe700 1 -- 172.21.15.123:0/64357090 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f885801d930 con 0x7f8860101920 2024-06-02T04:02:40.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.797+0000 7f884f7fe700 1 -- 172.21.15.123:0/64357090 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885801ba40 con 0x7f8860101920 2024-06-02T04:02:40.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.797+0000 7f8864bfd700 1 -- 172.21.15.123:0/64357090 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f886019e2a0 con 0x7f8860101920 2024-06-02T04:02:40.800 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.798+0000 7f8864bfd700 1 -- 172.21.15.123:0/64357090 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8860107140 con 0x7f8860101920 2024-06-02T04:02:40.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.799+0000 7f884f7fe700 1 -- 172.21.15.123:0/64357090 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f885801daa0 con 0x7f8860101920 2024-06-02T04:02:40.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.799+0000 7f884f7fe700 1 --2- 172.21.15.123:0/64357090 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f88480a1120 0x7f88480a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:40.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.800+0000 7f885e59c700 1 --2- 172.21.15.123:0/64357090 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f88480a1120 0x7f88480a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:40.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.800+0000 7f884f7fe700 1 -- 172.21.15.123:0/64357090 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f88580cda10 con 0x7f8860101920 2024-06-02T04:02:40.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.800+0000 7f885e59c700 1 --2- 172.21.15.123:0/64357090 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f88480a1120 0x7f88480a35e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8860100de0 tx=0x7f8854009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:02:40.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:40.804+0000 7f884f7fe700 1 -- 172.21.15.123:0/64357090 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f88580976d0 con 0x7f8860101920 2024-06-02T04:02:41.003 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.003+0000 7f8864bfd700 1 -- 172.21.15.123:0/64357090 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8860067380 con 0x7f8860101920 2024-06-02T04:02:41.004 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.004+0000 7f884f7fe700 1 -- 172.21.15.123:0/64357090 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+18478 (secure 0 0 0) 0x7f885809acf0 con 0x7f8860101920 2024-06-02T04:02:41.005 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:02:41.005 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":78,"fsid":"1b432ae0-2094-11ef-bc9b-c7b262605968","created":"2024-06-02T03:57:17.383774+0000","modified":"2024-06-02T04:02:35.537597+0000","last_up_change":"2024-06-02T04:02:34.535591+0000","last_in_change":"2024-06-02T04:02:18.346560+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T03:59:57.079448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d9d8fb5a-dac5-4b14-98e5-665bdbc696ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6803","nonce":2763421276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6805","nonce":2763421276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6809","nonce":2763421276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6807","nonce":2763421276}]},"public_addr":"172.21.15.123:6803/2763421276","cluster_addr":"172.21.15.123:6805/2763421276","heartbeat_back_addr":"172.21.15.123:6809/2763421276","heartbeat_front_addr":"172.21.15.123:6807/2763421276","state":["exists","up"]},{"osd":1,"uuid":"121bbe3c-bb76-4ec4-9596-37db68fbf1ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6801","nonce":956325510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6803","nonce":956325510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6807","nonce":956325510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6805","nonce":956325510}]},"public_addr":"172.21.15.136:6801/956325510","cluster_addr":"172.21.15.136:6803/956325510","heartbeat_back_addr":"172.21.15.136:6807/956325510","heartbeat_front_addr":"172.21.15.136:6805/956325510","state":["exists","up"]},{"osd":2,"uuid":"df9edf0d-f9f0-4699-a6ed-bbcf2dfb1b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6801","nonce":2915749676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6803","nonce":2915749676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6807","nonce":2915749676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6805","nonce":2915749676}]},"public_addr":"172.21.15.162:6801/2915749676","cluster_addr":"172.21.15.162:6803/2915749676","heartbeat_back_addr":"172.21.15.162:6807/2915749676","heartbeat_front_addr":"172.21.15.162:6805/2915749676","state":["exists","up"]},{"osd":3,"uuid":"3e070364-12c6-4780-b2be-f6e933e65773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6811","nonce":1403773143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6813","nonce":1403773143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6817","nonce":1403773143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6815","nonce":1403773143}]},"public_addr":"172.21.15.123:6811/1403773143","cluster_addr":"172.21.15.123:6813/1403773143","heartbeat_back_addr":"172.21.15.123:6817/1403773143","heartbeat_front_addr":"172.21.15.123:6815/1403773143","state":["exists","up"]},{"osd":4,"uuid":"87dd92dd-73c8-4785-bf8a-3756d79dee90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6809","nonce":1403526782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6811","nonce":1403526782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6815","nonce":1403526782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6813","nonce":1403526782}]},"public_addr":"172.21.15.136:6809/1403526782","cluster_addr":"172.21.15.136:6811/1403526782","heartbeat_back_addr":"172.21.15.136:6815/1403526782","heartbeat_front_addr":"172.21.15.136:6813/1403526782","state":["exists","up"]},{"osd":5,"uuid":"1a730863-6b56-43b7-a115-c80d3c8f3ee3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6809","nonce":3094256489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6811","nonce":3094256489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6815","nonce":3094256489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6813","nonce":3094256489}]},"public_addr":"172.21.15.162:6809/3094256489","cluster_addr":"172.21.15.162:6811/3094256489","heartbeat_back_addr":"172.21.15.162:6815/3094256489","heartbeat_front_addr":"172.21.15.162:6813/3094256489","state":["exists","up"]},{"osd":6,"uuid":"6f170b85-6c47-49ff-ba5b-7fe0596a4ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6819","nonce":3025820432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6821","nonce":3025820432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6825","nonce":3025820432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6823","nonce":3025820432}]},"public_addr":"172.21.15.123:6819/3025820432","cluster_addr":"172.21.15.123:6821/3025820432","heartbeat_back_addr":"172.21.15.123:6825/3025820432","heartbeat_front_addr":"172.21.15.123:6823/3025820432","state":["exists","up"]},{"osd":7,"uuid":"ee66bb7a-6c0d-4e5a-b717-258a39f93a87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6817","nonce":1948829505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6819","nonce":1948829505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6823","nonce":1948829505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6821","nonce":1948829505}]},"public_addr":"172.21.15.136:6817/1948829505","cluster_addr":"172.21.15.136:6819/1948829505","heartbeat_back_addr":"172.21.15.136:6823/1948829505","heartbeat_front_addr":"172.21.15.136:6821/1948829505","state":["exists","up"]},{"osd":8,"uuid":"0ff77e33-53a5-43ef-85da-2036a1fcdb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6817","nonce":1590839230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6819","nonce":1590839230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6823","nonce":1590839230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6821","nonce":1590839230}]},"public_addr":"172.21.15.162:6817/1590839230","cluster_addr":"172.21.15.162:6819/1590839230","heartbeat_back_addr":"172.21.15.162:6823/1590839230","heartbeat_front_addr":"172.21.15.162:6821/1590839230","state":["exists","up"]},{"osd":9,"uuid":"1670731c-5e8f-4cbc-8f35-6aeb14ea3075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6827","nonce":608720685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6829","nonce":608720685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6833","nonce":608720685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6831","nonce":608720685}]},"public_addr":"172.21.15.123:6827/608720685","cluster_addr":"172.21.15.123:6829/608720685","heartbeat_back_addr":"172.21.15.123:6833/608720685","heartbeat_front_addr":"172.21.15.123:6831/608720685","state":["exists","up"]},{"osd":10,"uuid":"ae138b96-13e7-46ac-9d4d-48308132465d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6825","nonce":3777263126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6827","nonce":3777263126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6831","nonce":3777263126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6829","nonce":3777263126}]},"public_addr":"172.21.15.136:6825/3777263126","cluster_addr":"172.21.15.136:6827/3777263126","heartbeat_back_addr":"172.21.15.136:6831/3777263126","heartbeat_front_addr":"172.21.15.136:6829/3777263126","state":["exists","up"]},{"osd":11,"uuid":"69f4ede0-7e9b-4edb-be54-01f74f002a06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6825","nonce":704809754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6827","nonce":704809754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6831","nonce":704809754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6829","nonce":704809754}]},"public_addr":"172.21.15.162:6825/704809754","cluster_addr":"172.21.15.162:6827/704809754","heartbeat_back_addr":"172.21.15.162:6831/704809754","heartbeat_front_addr":"172.21.15.162:6829/704809754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:19.188506+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:36.535261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:54.242294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:11.815314+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:29.512086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:46.874319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:04.437358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:22.312520+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:39.917998+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:57.340043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:15.252797+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:32.898924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:0/69783025":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/10165744":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/2081407856":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/4026642298":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/1442330765":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/1595718606":"2024-06-03T03:57:45.611046+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:02:41.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.007+0000 7f8864bfd700 1 -- 172.21.15.123:0/64357090 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f88480a1120 msgr2=0x7f88480a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:41.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.007+0000 7f8864bfd700 1 --2- 172.21.15.123:0/64357090 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f88480a1120 0x7f88480a35e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8860100de0 tx=0x7f8854009260 comp rx=0 tx=0).stop 2024-06-02T04:02:41.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.007+0000 7f8864bfd700 1 -- 172.21.15.123:0/64357090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8860101920 msgr2=0x7f886019d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:41.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.007+0000 7f8864bfd700 1 --2- 172.21.15.123:0/64357090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8860101920 0x7f886019d360 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8858007b60 tx=0x7f8858008e40 comp rx=0 tx=0).stop 2024-06-02T04:02:41.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.007+0000 7f8864bfd700 1 -- 172.21.15.123:0/64357090 shutdown_connections 2024-06-02T04:02:41.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.007+0000 7f8864bfd700 1 --2- 172.21.15.123:0/64357090 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8860101920 0x7f886019d360 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:41.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.007+0000 7f8864bfd700 1 --2- 172.21.15.123:0/64357090 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f88480a1120 0x7f88480a35e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:41.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.007+0000 7f8864bfd700 1 --2- 172.21.15.123:0/64357090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f88600ffd90 0x7f8860195e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:41.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.007+0000 7f8864bfd700 1 --2- 172.21.15.123:0/64357090 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8860100f80 0x7f8860196340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:41.007 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.007+0000 7f8864bfd700 1 -- 172.21.15.123:0/64357090 >> 172.21.15.123:0/64357090 conn(0x7f88600fb300 msgr2=0x7f8860104280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:41.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.007+0000 7f8864bfd700 1 -- 172.21.15.123:0/64357090 shutdown_connections 2024-06-02T04:02:41.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.007+0000 7f8864bfd700 1 -- 172.21.15.123:0/64357090 wait complete. 2024-06-02T04:02:41.020 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T03:59:57.079448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-02T04:02:41.020 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-02T04:02:41.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.144+0000 7fe275557700 1 -- 172.21.15.123:0/921788462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe270100fd0 msgr2=0x7fe270101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:41.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.144+0000 7fe275557700 1 --2- 172.21.15.123:0/921788462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe270100fd0 0x7fe270101450 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe260009990 tx=0x7fe260009ca0 comp rx=0 tx=0).stop 2024-06-02T04:02:41.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.144+0000 7fe275557700 1 -- 172.21.15.123:0/921788462 shutdown_connections 2024-06-02T04:02:41.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.144+0000 7fe275557700 1 --2- 172.21.15.123:0/921788462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe270101990 0x7fe2701082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:41.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.144+0000 7fe275557700 1 --2- 172.21.15.123:0/921788462 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2700ffe80 0x7fe2701002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:41.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.144+0000 7fe275557700 1 --2- 172.21.15.123:0/921788462 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe270100fd0 0x7fe270101450 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:41.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.144+0000 7fe275557700 1 -- 172.21.15.123:0/921788462 >> 172.21.15.123:0/921788462 conn(0x7fe2700fb3f0 msgr2=0x7fe2700fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:41.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.144+0000 7fe275557700 1 -- 172.21.15.123:0/921788462 shutdown_connections 2024-06-02T04:02:41.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.144+0000 7fe275557700 1 -- 172.21.15.123:0/921788462 wait complete. 2024-06-02T04:02:41.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.144+0000 7fe275557700 1 Processor -- start 2024-06-02T04:02:41.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.145+0000 7fe275557700 1 -- start start 2024-06-02T04:02:41.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.145+0000 7fe275557700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2700ffe80 0x7fe270196f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:41.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.145+0000 7fe275557700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe270100fd0 0x7fe270197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:41.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.145+0000 7fe275557700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe270101990 0x7fe27019e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:41.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.145+0000 7fe275557700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27019ea60 con 0x7fe2700ffe80 2024-06-02T04:02:41.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.145+0000 7fe275557700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27019eba0 con 0x7fe270100fd0 2024-06-02T04:02:41.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.145+0000 7fe275557700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27019ed30 con 0x7fe270101990 2024-06-02T04:02:41.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.145+0000 7fe26effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2700ffe80 0x7fe270196f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:41.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.145+0000 7fe26effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2700ffe80 0x7fe270196f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54264/0 (socket says 172.21.15.123:54264) 2024-06-02T04:02:41.147 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.145+0000 7fe26effd700 1 -- 172.21.15.123:0/2296881566 learned_addr learned my addr 172.21.15.123:0/2296881566 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:02:41.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.145+0000 7fe26f7fe700 1 --2- 172.21.15.123:0/2296881566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe270101990 0x7fe27019e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:41.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.145+0000 7fe26e7fc700 1 --2- 172.21.15.123:0/2296881566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe270100fd0 0x7fe270197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:41.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.145+0000 7fe26effd700 1 -- 172.21.15.123:0/2296881566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe270101990 msgr2=0x7fe27019e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:41.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.145+0000 7fe26effd700 1 --2- 172.21.15.123:0/2296881566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe270101990 0x7fe27019e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:41.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.145+0000 7fe26effd700 1 -- 172.21.15.123:0/2296881566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe270100fd0 msgr2=0x7fe270197470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:41.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.145+0000 7fe26effd700 1 --2- 172.21.15.123:0/2296881566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe270100fd0 0x7fe270197470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:41.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.145+0000 7fe26effd700 1 -- 172.21.15.123:0/2296881566 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2600095f0 con 0x7fe2700ffe80 2024-06-02T04:02:41.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.145+0000 7fe26effd700 1 --2- 172.21.15.123:0/2296881566 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2700ffe80 0x7fe270196f30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe26400c920 tx=0x7fe26400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:02:41.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.145+0000 7fe257fff700 1 -- 172.21.15.123:0/2296881566 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe264004a30 con 0x7fe2700ffe80 2024-06-02T04:02:41.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.146+0000 7fe275557700 1 -- 172.21.15.123:0/2296881566 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe27019efb0 con 0x7fe2700ffe80 2024-06-02T04:02:41.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.146+0000 7fe257fff700 1 -- 172.21.15.123:0/2296881566 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe2640054e0 con 0x7fe2700ffe80 2024-06-02T04:02:41.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.146+0000 7fe257fff700 1 -- 172.21.15.123:0/2296881566 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe264007c10 con 0x7fe2700ffe80 2024-06-02T04:02:41.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.146+0000 7fe275557700 1 -- 172.21.15.123:0/2296881566 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe27019f430 con 0x7fe2700ffe80 2024-06-02T04:02:41.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.147+0000 7fe275557700 1 -- 172.21.15.123:0/2296881566 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe270068140 con 0x7fe2700ffe80 2024-06-02T04:02:41.149 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.147+0000 7fe257fff700 1 -- 172.21.15.123:0/2296881566 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fe264005000 con 0x7fe2700ffe80 2024-06-02T04:02:41.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.148+0000 7fe257fff700 1 --2- 172.21.15.123:0/2296881566 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe2580a1120 0x7fe2580a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:41.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.148+0000 7fe26e7fc700 1 --2- 172.21.15.123:0/2296881566 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe2580a1120 0x7fe2580a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:41.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.148+0000 7fe257fff700 1 -- 172.21.15.123:0/2296881566 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe2640cc330 con 0x7fe2700ffe80 2024-06-02T04:02:41.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.148+0000 7fe26e7fc700 1 --2- 172.21.15.123:0/2296881566 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe2580a1120 0x7fe2580a35e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe26000b5c0 tx=0x7fe260003790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:02:41.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.153+0000 7fe257fff700 1 -- 172.21.15.123:0/2296881566 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe264095f60 con 0x7fe2700ffe80 2024-06-02T04:02:41.186 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:41 smithi162 ceph-mon[47009]: from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi123=a;smithi123=d;smithi123=g;smithi123=j;smithi136=b;smithi136=e;smithi136=h;smithi136=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:02:41.187 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:41 smithi162 ceph-mon[47009]: Saving service mds.all spec with placement smithi123=a;smithi123=d;smithi123=g;smithi123=j;smithi136=b;smithi136=e;smithi136=h;smithi136=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l;count:12 2024-06-02T04:02:41.187 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:41 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:41.187 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:41 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:02:41.187 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:41 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:41.187 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:41 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:02:41.187 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:41 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:41.187 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:41 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:02:41.187 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:41 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:02:41.187 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:41 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:41.187 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:41 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/64357090' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:02:41.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:41 smithi123 ceph-mon[42885]: from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi123=a;smithi123=d;smithi123=g;smithi123=j;smithi136=b;smithi136=e;smithi136=h;smithi136=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:02:41.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:41 smithi123 ceph-mon[42885]: Saving service mds.all spec with placement smithi123=a;smithi123=d;smithi123=g;smithi123=j;smithi136=b;smithi136=e;smithi136=h;smithi136=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l;count:12 2024-06-02T04:02:41.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:41 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:41.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:41 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:02:41.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:41 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:41.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:41 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:02:41.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:41 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:41.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:41 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:02:41.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:41 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:02:41.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:41 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:41.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:41 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/64357090' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:02:41.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:41 smithi136 ceph-mon[47443]: from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi123=a;smithi123=d;smithi123=g;smithi123=j;smithi136=b;smithi136=e;smithi136=h;smithi136=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:02:41.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:41 smithi136 ceph-mon[47443]: Saving service mds.all spec with placement smithi123=a;smithi123=d;smithi123=g;smithi123=j;smithi136=b;smithi136=e;smithi136=h;smithi136=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l;count:12 2024-06-02T04:02:41.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:41 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:41.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:41 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:02:41.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:41 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:41.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:41 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:02:41.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:41 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:41.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:41 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:02:41.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:41 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:02:41.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:41 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:41.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:41 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/64357090' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:02:41.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.349+0000 7fe275557700 1 -- 172.21.15.123:0/2296881566 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe27019f7a0 con 0x7fe2700ffe80 2024-06-02T04:02:41.349 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.350+0000 7fe257fff700 1 -- 172.21.15.123:0/2296881566 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe264099580 con 0x7fe2700ffe80 2024-06-02T04:02:41.349 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-06-02T04:02:41.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.352+0000 7fe275557700 1 -- 172.21.15.123:0/2296881566 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe2580a1120 msgr2=0x7fe2580a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:41.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.352+0000 7fe275557700 1 --2- 172.21.15.123:0/2296881566 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe2580a1120 0x7fe2580a35e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe26000b5c0 tx=0x7fe260003790 comp rx=0 tx=0).stop 2024-06-02T04:02:41.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.352+0000 7fe275557700 1 -- 172.21.15.123:0/2296881566 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2700ffe80 msgr2=0x7fe270196f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:41.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.352+0000 7fe275557700 1 --2- 172.21.15.123:0/2296881566 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2700ffe80 0x7fe270196f30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe26400c920 tx=0x7fe26400cc30 comp rx=0 tx=0).stop 2024-06-02T04:02:41.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.352+0000 7fe275557700 1 -- 172.21.15.123:0/2296881566 shutdown_connections 2024-06-02T04:02:41.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.352+0000 7fe275557700 1 --2- 172.21.15.123:0/2296881566 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe270101990 0x7fe27019e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:41.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.352+0000 7fe275557700 1 --2- 172.21.15.123:0/2296881566 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2700ffe80 0x7fe270196f30 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:41.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.352+0000 7fe275557700 1 --2- 172.21.15.123:0/2296881566 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe2580a1120 0x7fe2580a35e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:41.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.352+0000 7fe275557700 1 --2- 172.21.15.123:0/2296881566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe270100fd0 0x7fe270197470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:41.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.352+0000 7fe275557700 1 -- 172.21.15.123:0/2296881566 >> 172.21.15.123:0/2296881566 conn(0x7fe2700fb3f0 msgr2=0x7fe270069520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:41.352 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.352+0000 7fe275557700 1 -- 172.21.15.123:0/2296881566 shutdown_connections 2024-06-02T04:02:41.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.352+0000 7fe275557700 1 -- 172.21.15.123:0/2296881566 wait complete. 2024-06-02T04:02:41.364 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:02:41.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.487+0000 7f0b77c64700 1 -- 172.21.15.123:0/2212213797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b70101340 msgr2=0x7f0b70101760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:41.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.487+0000 7f0b77c64700 1 --2- 172.21.15.123:0/2212213797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b70101340 0x7f0b70101760 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c009990 tx=0x7f0b6c009ca0 comp rx=0 tx=0).stop 2024-06-02T04:02:41.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.487+0000 7f0b77c64700 1 -- 172.21.15.123:0/2212213797 shutdown_connections 2024-06-02T04:02:41.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.487+0000 7f0b77c64700 1 --2- 172.21.15.123:0/2212213797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b70100950 0x7f0b701081f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:41.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.487+0000 7f0b77c64700 1 --2- 172.21.15.123:0/2212213797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b70101340 0x7f0b70101760 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:41.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.487+0000 7f0b77c64700 1 --2- 172.21.15.123:0/2212213797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b700fff90 0x7f0b70100410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:41.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.487+0000 7f0b77c64700 1 -- 172.21.15.123:0/2212213797 >> 172.21.15.123:0/2212213797 conn(0x7f0b700faaa0 msgr2=0x7f0b700fcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:41.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.487+0000 7f0b77c64700 1 -- 172.21.15.123:0/2212213797 shutdown_connections 2024-06-02T04:02:41.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.487+0000 7f0b77c64700 1 -- 172.21.15.123:0/2212213797 wait complete. 2024-06-02T04:02:41.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.488+0000 7f0b77c64700 1 Processor -- start 2024-06-02T04:02:41.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.488+0000 7f0b77c64700 1 -- start start 2024-06-02T04:02:41.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.488+0000 7f0b77c64700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b700fff90 0x7f0b70195d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:41.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.488+0000 7f0b77c64700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b70100950 0x7f0b70196240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:41.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.488+0000 7f0b77c64700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b70101340 0x7f0b7019d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:41.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.488+0000 7f0b77c64700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7019d820 con 0x7f0b700fff90 2024-06-02T04:02:41.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.488+0000 7f0b77c64700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7019d990 con 0x7f0b70100950 2024-06-02T04:02:41.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.488+0000 7f0b77c64700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7019db50 con 0x7f0b70101340 2024-06-02T04:02:41.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.488+0000 7f0b75a00700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b700fff90 0x7f0b70195d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:41.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.488+0000 7f0b75a00700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b700fff90 0x7f0b70195d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54286/0 (socket says 172.21.15.123:54286) 2024-06-02T04:02:41.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.488+0000 7f0b75a00700 1 -- 172.21.15.123:0/2771176487 learned_addr learned my addr 172.21.15.123:0/2771176487 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:02:41.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.488+0000 7f0b751ff700 1 --2- 172.21.15.123:0/2771176487 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b70100950 0x7f0b70196240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:41.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.488+0000 7f0b76201700 1 --2- 172.21.15.123:0/2771176487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b70101340 0x7f0b7019d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:41.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.488+0000 7f0b75a00700 1 -- 172.21.15.123:0/2771176487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b70101340 msgr2=0x7f0b7019d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:41.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.488+0000 7f0b75a00700 1 --2- 172.21.15.123:0/2771176487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b70101340 0x7f0b7019d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:41.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.488+0000 7f0b75a00700 1 -- 172.21.15.123:0/2771176487 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b70100950 msgr2=0x7f0b70196240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:41.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.488+0000 7f0b75a00700 1 --2- 172.21.15.123:0/2771176487 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b70100950 0x7f0b70196240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:41.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.488+0000 7f0b75a00700 1 -- 172.21.15.123:0/2771176487 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c0095f0 con 0x7f0b700fff90 2024-06-02T04:02:41.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.488+0000 7f0b75a00700 1 --2- 172.21.15.123:0/2771176487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b700fff90 0x7f0b70195d00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c006010 tx=0x7f0b6c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:02:41.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.489+0000 7f0b66ffd700 1 -- 172.21.15.123:0/2771176487 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c01d070 con 0x7f0b700fff90 2024-06-02T04:02:41.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.489+0000 7f0b77c64700 1 -- 172.21.15.123:0/2771176487 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b700fee80 con 0x7f0b700fff90 2024-06-02T04:02:41.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.489+0000 7f0b66ffd700 1 -- 172.21.15.123:0/2771176487 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b6c005030 con 0x7f0b700fff90 2024-06-02T04:02:41.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.489+0000 7f0b66ffd700 1 -- 172.21.15.123:0/2771176487 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c004ba0 con 0x7f0b700fff90 2024-06-02T04:02:41.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.489+0000 7f0b77c64700 1 -- 172.21.15.123:0/2771176487 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b700ff380 con 0x7f0b700fff90 2024-06-02T04:02:41.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.490+0000 7f0b77c64700 1 -- 172.21.15.123:0/2771176487 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b70068060 con 0x7f0b700fff90 2024-06-02T04:02:41.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.491+0000 7f0b66ffd700 1 -- 172.21.15.123:0/2771176487 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f0b6c004d00 con 0x7f0b700fff90 2024-06-02T04:02:41.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.491+0000 7f0b66ffd700 1 --2- 172.21.15.123:0/2771176487 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0b5c0a1120 0x7f0b5c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:41.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.491+0000 7f0b751ff700 1 --2- 172.21.15.123:0/2771176487 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0b5c0a1120 0x7f0b5c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:41.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.491+0000 7f0b66ffd700 1 -- 172.21.15.123:0/2771176487 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f0b6c0cd4b0 con 0x7f0b700fff90 2024-06-02T04:02:41.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.492+0000 7f0b751ff700 1 --2- 172.21.15.123:0/2771176487 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0b5c0a1120 0x7f0b5c0a35e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0b701971b0 tx=0x7f0b60009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:02:41.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.496+0000 7f0b66ffd700 1 -- 172.21.15.123:0/2771176487 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0b6c097170 con 0x7f0b700fff90 2024-06-02T04:02:41.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.739+0000 7f0b77c64700 1 -- 172.21.15.123:0/2771176487 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b700ffd70 con 0x7f0b700fff90 2024-06-02T04:02:41.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.739+0000 7f0b66ffd700 1 -- 172.21.15.123:0/2771176487 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+501 (secure 0 0 0) 0x7f0b6c09a790 con 0x7f0b700fff90 2024-06-02T04:02:41.739 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:02:41.739 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-06-02T04:02:41.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.741+0000 7f0b77c64700 1 -- 172.21.15.123:0/2771176487 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0b5c0a1120 msgr2=0x7f0b5c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:41.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.741+0000 7f0b77c64700 1 --2- 172.21.15.123:0/2771176487 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0b5c0a1120 0x7f0b5c0a35e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0b701971b0 tx=0x7f0b60009260 comp rx=0 tx=0).stop 2024-06-02T04:02:41.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.741+0000 7f0b77c64700 1 -- 172.21.15.123:0/2771176487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b700fff90 msgr2=0x7f0b70195d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:41.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.741+0000 7f0b77c64700 1 --2- 172.21.15.123:0/2771176487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b700fff90 0x7f0b70195d00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c006010 tx=0x7f0b6c004730 comp rx=0 tx=0).stop 2024-06-02T04:02:41.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.741+0000 7f0b77c64700 1 -- 172.21.15.123:0/2771176487 shutdown_connections 2024-06-02T04:02:41.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.741+0000 7f0b77c64700 1 --2- 172.21.15.123:0/2771176487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b70101340 0x7f0b7019d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:41.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.741+0000 7f0b77c64700 1 --2- 172.21.15.123:0/2771176487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b700fff90 0x7f0b70195d00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:41.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.741+0000 7f0b77c64700 1 --2- 172.21.15.123:0/2771176487 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0b5c0a1120 0x7f0b5c0a35e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:41.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.742+0000 7f0b77c64700 1 --2- 172.21.15.123:0/2771176487 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b70100950 0x7f0b70196240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:41.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.742+0000 7f0b77c64700 1 -- 172.21.15.123:0/2771176487 >> 172.21.15.123:0/2771176487 conn(0x7f0b700faaa0 msgr2=0x7f0b70104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:41.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.742+0000 7f0b77c64700 1 -- 172.21.15.123:0/2771176487 shutdown_connections 2024-06-02T04:02:41.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:41.742+0000 7f0b77c64700 1 -- 172.21.15.123:0/2771176487 wait complete. 2024-06-02T04:02:41.743 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 1 2024-06-02T04:02:41.798 INFO:journalctl@ceph.mds.l.smithi162.stdout:Jun 02 04:02:41 smithi162 systemd[1]: Starting Ceph mds.l for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:02:42.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:42 smithi162 ceph-mon[47009]: Deploying daemon mds.l on smithi162 2024-06-02T04:02:42.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:42 smithi162 ceph-mon[47009]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:42.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:42 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/2296881566' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:02:42.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:42 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/2771176487' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:02:42.299 INFO:journalctl@ceph.mds.l.smithi162.stdout:Jun 02 04:02:42 smithi162 ceph-mds[82625]: -- 172.21.15.162:0/386857143 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55dcd720c1a0 con 0x55dcd71e3000 2024-06-02T04:02:42.299 INFO:journalctl@ceph.mds.l.smithi162.stdout:Jun 02 04:02:42 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-l[82601]: starting mds.l at 2024-06-02T04:02:42.299 INFO:journalctl@ceph.mds.l.smithi162.stdout:Jun 02 04:02:42 smithi162 bash[82586]: 295f177da5056fab1faa858cdfe98898d4a56be46cc15a47394c19cbc5a9e2a7 2024-06-02T04:02:42.299 INFO:journalctl@ceph.mds.l.smithi162.stdout:Jun 02 04:02:42 smithi162 systemd[1]: Started Ceph mds.l for 1b432ae0-2094-11ef-bc9b-c7b262605968. 2024-06-02T04:02:42.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:42 smithi123 ceph-mon[42885]: Deploying daemon mds.l on smithi162 2024-06-02T04:02:42.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:42 smithi123 ceph-mon[42885]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:42.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:42 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2296881566' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:02:42.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:42 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2771176487' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:02:42.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:42 smithi136 ceph-mon[47443]: Deploying daemon mds.l on smithi162 2024-06-02T04:02:42.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:42 smithi136 ceph-mon[47443]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:42.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:42 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/2296881566' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:02:42.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:42 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/2771176487' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:02:43.263 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:43 smithi136 ceph-mon[47443]: mds.? [v2:172.21.15.162:6832/3583622784,v1:172.21.15.162:6833/3583622784] up:boot 2024-06-02T04:02:43.263 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:43 smithi136 ceph-mon[47443]: fsmap 1 up:standby 2024-06-02T04:02:43.263 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:43 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-02T04:02:43.263 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:43 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:43.263 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:43 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:43.263 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:43 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:43.263 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:43 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:02:43.263 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:43 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:02:43.263 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:43 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:43.263 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:43 smithi136 ceph-mon[47443]: Deploying daemon mds.k on smithi136 2024-06-02T04:02:43.264 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:43 smithi136 ceph-mon[47443]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:43.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:43 smithi162 ceph-mon[47009]: mds.? [v2:172.21.15.162:6832/3583622784,v1:172.21.15.162:6833/3583622784] up:boot 2024-06-02T04:02:43.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:43 smithi162 ceph-mon[47009]: fsmap 1 up:standby 2024-06-02T04:02:43.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:43 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-02T04:02:43.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:43 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:43.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:43 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:43.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:43 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:43.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:43 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:02:43.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:43 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:02:43.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:43 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:43.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:43 smithi162 ceph-mon[47009]: Deploying daemon mds.k on smithi136 2024-06-02T04:02:43.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:43 smithi162 ceph-mon[47009]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:43.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:43 smithi123 ceph-mon[42885]: mds.? [v2:172.21.15.162:6832/3583622784,v1:172.21.15.162:6833/3583622784] up:boot 2024-06-02T04:02:43.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:43 smithi123 ceph-mon[42885]: fsmap 1 up:standby 2024-06-02T04:02:43.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:43 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-02T04:02:43.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:43 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:43.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:43 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:43.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:43 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:43.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:43 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:02:43.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:43 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:02:43.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:43 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:43.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:43 smithi123 ceph-mon[42885]: Deploying daemon mds.k on smithi136 2024-06-02T04:02:43.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:43 smithi123 ceph-mon[42885]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:43.754 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:02:43.838 INFO:journalctl@ceph.mds.k.smithi136.stdout:Jun 02 04:02:43 smithi136 systemd[1]: Starting Ceph mds.k for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:02:43.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.893+0000 7f9d24aed700 1 -- 172.21.15.123:0/3325630664 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d20101920 msgr2=0x7f9d201081d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:43.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.893+0000 7f9d24aed700 1 --2- 172.21.15.123:0/3325630664 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d20101920 0x7f9d201081d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9d1800b0d0 tx=0x7f9d1800b3e0 comp rx=0 tx=0).stop 2024-06-02T04:02:43.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.893+0000 7f9d24aed700 1 -- 172.21.15.123:0/3325630664 shutdown_connections 2024-06-02T04:02:43.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.893+0000 7f9d24aed700 1 --2- 172.21.15.123:0/3325630664 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d20101920 0x7f9d201081d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:43.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.893+0000 7f9d24aed700 1 --2- 172.21.15.123:0/3325630664 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d200ffd90 0x7f9d201001b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:43.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.893+0000 7f9d24aed700 1 --2- 172.21.15.123:0/3325630664 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d20100f80 0x7f9d201013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:43.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.893+0000 7f9d24aed700 1 -- 172.21.15.123:0/3325630664 >> 172.21.15.123:0/3325630664 conn(0x7f9d200fb300 msgr2=0x7f9d200fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:43.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.894+0000 7f9d24aed700 1 -- 172.21.15.123:0/3325630664 shutdown_connections 2024-06-02T04:02:43.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.894+0000 7f9d24aed700 1 -- 172.21.15.123:0/3325630664 wait complete. 2024-06-02T04:02:43.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.894+0000 7f9d24aed700 1 Processor -- start 2024-06-02T04:02:43.896 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.894+0000 7f9d24aed700 1 -- start start 2024-06-02T04:02:43.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.894+0000 7f9d24aed700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d200ffd90 0x7f9d20199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:43.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.894+0000 7f9d24aed700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d20100f80 0x7f9d201996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:43.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.894+0000 7f9d24aed700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d20101920 0x7f9d201a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:43.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.894+0000 7f9d24aed700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d201a0ca0 con 0x7f9d20100f80 2024-06-02T04:02:43.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.894+0000 7f9d24aed700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d201a0de0 con 0x7f9d20101920 2024-06-02T04:02:43.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.894+0000 7f9d24aed700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d201a0f70 con 0x7f9d200ffd90 2024-06-02T04:02:43.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.895+0000 7f9d1dd9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d20100f80 0x7f9d201996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:43.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.895+0000 7f9d1dd9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d20100f80 0x7f9d201996b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:54306/0 (socket says 172.21.15.123:54306) 2024-06-02T04:02:43.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.895+0000 7f9d1dd9b700 1 -- 172.21.15.123:0/609277908 learned_addr learned my addr 172.21.15.123:0/609277908 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:02:43.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.895+0000 7f9d1e59c700 1 --2- 172.21.15.123:0/609277908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d200ffd90 0x7f9d20199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:43.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.895+0000 7f9d1ed9d700 1 --2- 172.21.15.123:0/609277908 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d20101920 0x7f9d201a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:43.897 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.895+0000 7f9d1dd9b700 1 -- 172.21.15.123:0/609277908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d200ffd90 msgr2=0x7f9d20199170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:43.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.895+0000 7f9d1dd9b700 1 --2- 172.21.15.123:0/609277908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d200ffd90 0x7f9d20199170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:43.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.895+0000 7f9d1dd9b700 1 -- 172.21.15.123:0/609277908 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d20101920 msgr2=0x7f9d201a06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:43.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.895+0000 7f9d1dd9b700 1 --2- 172.21.15.123:0/609277908 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d20101920 0x7f9d201a06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:43.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.895+0000 7f9d1dd9b700 1 -- 172.21.15.123:0/609277908 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d18009d00 con 0x7f9d20100f80 2024-06-02T04:02:43.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.895+0000 7f9d1dd9b700 1 --2- 172.21.15.123:0/609277908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d20100f80 0x7f9d201996b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000d950 tx=0x7f9d1000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:02:43.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.895+0000 7f9d0f7fe700 1 -- 172.21.15.123:0/609277908 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d10009940 con 0x7f9d20100f80 2024-06-02T04:02:43.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.895+0000 7f9d0f7fe700 1 -- 172.21.15.123:0/609277908 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9d10010460 con 0x7f9d20100f80 2024-06-02T04:02:43.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.895+0000 7f9d0f7fe700 1 -- 172.21.15.123:0/609277908 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1000f620 con 0x7f9d20100f80 2024-06-02T04:02:43.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.895+0000 7f9d24aed700 1 -- 172.21.15.123:0/609277908 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d201a1250 con 0x7f9d20100f80 2024-06-02T04:02:43.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.895+0000 7f9d24aed700 1 -- 172.21.15.123:0/609277908 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d201a1710 con 0x7f9d20100f80 2024-06-02T04:02:43.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.896+0000 7f9d24aed700 1 -- 172.21.15.123:0/609277908 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d20067380 con 0x7f9d20100f80 2024-06-02T04:02:43.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.897+0000 7f9d0f7fe700 1 -- 172.21.15.123:0/609277908 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f9d100108d0 con 0x7f9d20100f80 2024-06-02T04:02:43.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.898+0000 7f9d0f7fe700 1 --2- 172.21.15.123:0/609277908 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9d080a1120 0x7f9d080a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:43.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.898+0000 7f9d1e59c700 1 --2- 172.21.15.123:0/609277908 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9d080a1120 0x7f9d080a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:43.899 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.898+0000 7f9d0f7fe700 1 -- 172.21.15.123:0/609277908 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f9d100cc380 con 0x7f9d20100f80 2024-06-02T04:02:43.900 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.898+0000 7f9d1e59c700 1 --2- 172.21.15.123:0/609277908 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9d080a1120 0x7f9d080a35e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9d20100de0 tx=0x7f9d14009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:02:43.902 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:43.902+0000 7f9d0f7fe700 1 -- 172.21.15.123:0/609277908 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9d10095f10 con 0x7f9d20100f80 2024-06-02T04:02:44.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:44.161+0000 7f9d24aed700 1 -- 172.21.15.123:0/609277908 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d2010b600 con 0x7f9d20100f80 2024-06-02T04:02:44.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:44.161+0000 7f9d0f7fe700 1 -- 172.21.15.123:0/609277908 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1260 (secure 0 0 0) 0x7f9d10099530 con 0x7f9d20100f80 2024-06-02T04:02:44.161 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:02:44.161 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3583622784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3583622784},{"type":"v1","addr":"172.21.15.162:6833","nonce":3583622784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-06-02T04:02:44.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:44.164+0000 7f9d24aed700 1 -- 172.21.15.123:0/609277908 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9d080a1120 msgr2=0x7f9d080a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:44.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:44.164+0000 7f9d24aed700 1 --2- 172.21.15.123:0/609277908 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9d080a1120 0x7f9d080a35e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9d20100de0 tx=0x7f9d14009260 comp rx=0 tx=0).stop 2024-06-02T04:02:44.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:44.164+0000 7f9d24aed700 1 -- 172.21.15.123:0/609277908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d20100f80 msgr2=0x7f9d201996b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:44.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:44.164+0000 7f9d24aed700 1 --2- 172.21.15.123:0/609277908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d20100f80 0x7f9d201996b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000d950 tx=0x7f9d1000dc60 comp rx=0 tx=0).stop 2024-06-02T04:02:44.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:44.164+0000 7f9d24aed700 1 -- 172.21.15.123:0/609277908 shutdown_connections 2024-06-02T04:02:44.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:44.164+0000 7f9d24aed700 1 --2- 172.21.15.123:0/609277908 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9d080a1120 0x7f9d080a35e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:44.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:44.164+0000 7f9d24aed700 1 --2- 172.21.15.123:0/609277908 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d20101920 0x7f9d201a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:44.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:44.164+0000 7f9d24aed700 1 --2- 172.21.15.123:0/609277908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d200ffd90 0x7f9d20199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:44.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:44.164+0000 7f9d24aed700 1 --2- 172.21.15.123:0/609277908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d20100f80 0x7f9d201996b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:44.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:44.164+0000 7f9d24aed700 1 -- 172.21.15.123:0/609277908 >> 172.21.15.123:0/609277908 conn(0x7f9d200fb300 msgr2=0x7f9d200fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:44.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:44.164+0000 7f9d24aed700 1 -- 172.21.15.123:0/609277908 shutdown_connections 2024-06-02T04:02:44.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:44.164+0000 7f9d24aed700 1 -- 172.21.15.123:0/609277908 wait complete. 2024-06-02T04:02:44.165 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 2 2024-06-02T04:02:44.338 INFO:journalctl@ceph.mds.k.smithi136.stdout:Jun 02 04:02:43 smithi136 ceph-mds[83765]: -- 172.21.15.136:0/1165980967 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562befb381a0 con 0x562befb0e800 2024-06-02T04:02:44.338 INFO:journalctl@ceph.mds.k.smithi136.stdout:Jun 02 04:02:43 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-k[83742]: starting mds.k at 2024-06-02T04:02:44.338 INFO:journalctl@ceph.mds.k.smithi136.stdout:Jun 02 04:02:43 smithi136 bash[83727]: 819045821bf06f4151197acb5dd57d11e2f70eaafede0994533d2d25b2c50e81 2024-06-02T04:02:44.338 INFO:journalctl@ceph.mds.k.smithi136.stdout:Jun 02 04:02:43 smithi136 systemd[1]: Started Ceph mds.k for 1b432ae0-2094-11ef-bc9b-c7b262605968. 2024-06-02T04:02:45.247 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:44 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:45.247 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:44 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:45.247 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:44 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:45.247 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:44 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:02:45.247 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:44 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:02:45.247 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:44 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:45.247 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:44 smithi123 ceph-mon[42885]: Deploying daemon mds.j on smithi123 2024-06-02T04:02:45.247 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:44 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/609277908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:02:45.247 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:44 smithi123 ceph-mon[42885]: mds.? [v2:172.21.15.136:6832/2006585076,v1:172.21.15.136:6833/2006585076] up:boot 2024-06-02T04:02:45.247 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:44 smithi123 ceph-mon[42885]: fsmap 2 up:standby 2024-06-02T04:02:45.248 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:44 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-02T04:02:45.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:44 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:45.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:44 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:45.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:44 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:45.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:44 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:02:45.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:44 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:02:45.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:44 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:45.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:44 smithi162 ceph-mon[47009]: Deploying daemon mds.j on smithi123 2024-06-02T04:02:45.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:44 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/609277908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:02:45.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:44 smithi162 ceph-mon[47009]: mds.? [v2:172.21.15.136:6832/2006585076,v1:172.21.15.136:6833/2006585076] up:boot 2024-06-02T04:02:45.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:44 smithi162 ceph-mon[47009]: fsmap 2 up:standby 2024-06-02T04:02:45.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:44 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-02T04:02:45.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:44 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:45.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:44 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:45.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:44 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:45.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:44 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:02:45.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:44 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:02:45.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:44 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:45.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:44 smithi136 ceph-mon[47443]: Deploying daemon mds.j on smithi123 2024-06-02T04:02:45.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:44 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/609277908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:02:45.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:44 smithi136 ceph-mon[47443]: mds.? [v2:172.21.15.136:6832/2006585076,v1:172.21.15.136:6833/2006585076] up:boot 2024-06-02T04:02:45.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:44 smithi136 ceph-mon[47443]: fsmap 2 up:standby 2024-06-02T04:02:45.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:44 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-02T04:02:45.572 INFO:journalctl@ceph.mds.j.smithi123.stdout:Jun 02 04:02:45 smithi123 systemd[1]: Starting Ceph mds.j for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:02:45.984 INFO:journalctl@ceph.mds.j.smithi123.stdout:Jun 02 04:02:45 smithi123 ceph-mds[92331]: -- 172.21.15.123:0/3497238207 <== mon.0 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55666e7661a0 con 0x55666e73cc00 2024-06-02T04:02:45.984 INFO:journalctl@ceph.mds.j.smithi123.stdout:Jun 02 04:02:45 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-j[92308]: starting mds.j at 2024-06-02T04:02:45.984 INFO:journalctl@ceph.mds.j.smithi123.stdout:Jun 02 04:02:45 smithi123 bash[92293]: 9b2a784010c8c6be40a4e672b082aa3ab8e0915e2eec6e730681cf517bf08674 2024-06-02T04:02:45.985 INFO:journalctl@ceph.mds.j.smithi123.stdout:Jun 02 04:02:45 smithi123 systemd[1]: Started Ceph mds.j for 1b432ae0-2094-11ef-bc9b-c7b262605968. 2024-06-02T04:02:45.985 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:45 smithi123 ceph-mon[42885]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:45.985 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:45 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:45.985 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:45 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:45.985 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:45 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:45.985 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:45 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:02:45.985 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:45 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:02:45.985 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:45 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:46.177 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:02:46.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:45 smithi162 ceph-mon[47009]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:46.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:45 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:46.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:45 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:46.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:45 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:46.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:45 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:02:46.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:45 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:02:46.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:45 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:46.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.307+0000 7f98a78c5700 1 -- 172.21.15.123:0/582329534 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98a01006d0 msgr2=0x7f98a0100b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:46.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.307+0000 7f98a78c5700 1 --2- 172.21.15.123:0/582329534 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98a01006d0 0x7f98a0100b30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f989000aad0 tx=0x7f989000ade0 comp rx=0 tx=0).stop 2024-06-02T04:02:46.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.307+0000 7f98a78c5700 1 -- 172.21.15.123:0/582329534 shutdown_connections 2024-06-02T04:02:46.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.307+0000 7f98a78c5700 1 --2- 172.21.15.123:0/582329534 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98a0101070 0x7f98a0107920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:46.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.307+0000 7f98a78c5700 1 --2- 172.21.15.123:0/582329534 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98a00ff4e0 0x7f98a00ff900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:46.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.307+0000 7f98a78c5700 1 --2- 172.21.15.123:0/582329534 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98a01006d0 0x7f98a0100b30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:46.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.307+0000 7f98a78c5700 1 -- 172.21.15.123:0/582329534 >> 172.21.15.123:0/582329534 conn(0x7f98a00faa70 msgr2=0x7f98a00fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:46.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.307+0000 7f98a78c5700 1 -- 172.21.15.123:0/582329534 shutdown_connections 2024-06-02T04:02:46.308 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.307+0000 7f98a78c5700 1 -- 172.21.15.123:0/582329534 wait complete. 2024-06-02T04:02:46.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.308+0000 7f98a78c5700 1 Processor -- start 2024-06-02T04:02:46.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.308+0000 7f98a78c5700 1 -- start start 2024-06-02T04:02:46.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.308+0000 7f98a78c5700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98a00ff4e0 0x7f98a0194be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:46.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.308+0000 7f98a78c5700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98a01006d0 0x7f98a0195120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:46.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.308+0000 7f98a78c5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98a0101070 0x7f98a019c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:46.310 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.308+0000 7f98a78c5700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a019c710 con 0x7f98a0101070 2024-06-02T04:02:46.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.308+0000 7f98a78c5700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a019c850 con 0x7f98a01006d0 2024-06-02T04:02:46.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.308+0000 7f98a78c5700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a019c9e0 con 0x7f98a00ff4e0 2024-06-02T04:02:46.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.308+0000 7f98a5e62700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98a0101070 0x7f98a019c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:46.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.308+0000 7f98a5e62700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98a0101070 0x7f98a019c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50496/0 (socket says 172.21.15.123:50496) 2024-06-02T04:02:46.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.308+0000 7f98a5e62700 1 -- 172.21.15.123:0/3496364576 learned_addr learned my addr 172.21.15.123:0/3496364576 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:02:46.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.308+0000 7f98a4e60700 1 --2- 172.21.15.123:0/3496364576 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98a01006d0 0x7f98a0195120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:46.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.308+0000 7f98a5661700 1 --2- 172.21.15.123:0/3496364576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98a00ff4e0 0x7f98a0194be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:46.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.308+0000 7f98a5e62700 1 -- 172.21.15.123:0/3496364576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98a00ff4e0 msgr2=0x7f98a0194be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:46.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.308+0000 7f98a5e62700 1 --2- 172.21.15.123:0/3496364576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98a00ff4e0 0x7f98a0194be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:46.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.308+0000 7f98a5e62700 1 -- 172.21.15.123:0/3496364576 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98a01006d0 msgr2=0x7f98a0195120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:46.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.308+0000 7f98a5e62700 1 --2- 172.21.15.123:0/3496364576 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98a01006d0 0x7f98a0195120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:46.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.308+0000 7f98a5e62700 1 -- 172.21.15.123:0/3496364576 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989000a700 con 0x7f98a0101070 2024-06-02T04:02:46.311 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.309+0000 7f98a5e62700 1 --2- 172.21.15.123:0/3496364576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98a0101070 0x7f98a019c140 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f989c007b50 tx=0x7f989c007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:02:46.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.309+0000 7f98967fc700 1 -- 172.21.15.123:0/3496364576 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c011070 con 0x7f98a0101070 2024-06-02T04:02:46.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.309+0000 7f98967fc700 1 -- 172.21.15.123:0/3496364576 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f989c00c2e0 con 0x7f98a0101070 2024-06-02T04:02:46.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.309+0000 7f98967fc700 1 -- 172.21.15.123:0/3496364576 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c00a980 con 0x7f98a0101070 2024-06-02T04:02:46.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.309+0000 7f98a78c5700 1 -- 172.21.15.123:0/3496364576 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a019ccc0 con 0x7f98a0101070 2024-06-02T04:02:46.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.309+0000 7f98a78c5700 1 -- 172.21.15.123:0/3496364576 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a019d180 con 0x7f98a0101070 2024-06-02T04:02:46.312 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.310+0000 7f98a78c5700 1 -- 172.21.15.123:0/3496364576 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a0106960 con 0x7f98a0101070 2024-06-02T04:02:46.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.311+0000 7f98967fc700 1 -- 172.21.15.123:0/3496364576 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f989c00aae0 con 0x7f98a0101070 2024-06-02T04:02:46.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.312+0000 7f98967fc700 1 --2- 172.21.15.123:0/3496364576 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f988c0a11a0 0x7f988c0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:46.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.312+0000 7f98a5661700 1 --2- 172.21.15.123:0/3496364576 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f988c0a11a0 0x7f988c0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:46.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.312+0000 7f98967fc700 1 -- 172.21.15.123:0/3496364576 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f989c0cdc90 con 0x7f98a0101070 2024-06-02T04:02:46.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.312+0000 7f98a5661700 1 --2- 172.21.15.123:0/3496364576 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f988c0a11a0 0x7f988c0a3660 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9898009550 tx=0x7f98980091b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:02:46.315 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.315+0000 7f98967fc700 1 -- 172.21.15.123:0/3496364576 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f989c0978c0 con 0x7f98a0101070 2024-06-02T04:02:46.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:45 smithi136 ceph-mon[47443]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:46.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:46.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:46.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:46.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:02:46.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:02:46.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:45 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:46.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.571+0000 7f98a78c5700 1 -- 172.21.15.123:0/3496364576 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98a0067380 con 0x7f98a0101070 2024-06-02T04:02:46.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.571+0000 7f98967fc700 1 -- 172.21.15.123:0/3496364576 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2780 (secure 0 0 0) 0x7f989c09aee0 con 0x7f98a0101070 2024-06-02T04:02:46.572 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:02:46.572 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1940848601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1940848601},{"type":"v1","addr":"172.21.15.123:6835","nonce":1940848601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/2006585076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2006585076},{"type":"v1","addr":"172.21.15.136:6833","nonce":2006585076}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3583622784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3583622784},{"type":"v1","addr":"172.21.15.162:6833","nonce":3583622784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-06-02T04:02:46.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.573+0000 7f98a78c5700 1 -- 172.21.15.123:0/3496364576 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f988c0a11a0 msgr2=0x7f988c0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:46.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.573+0000 7f98a78c5700 1 --2- 172.21.15.123:0/3496364576 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f988c0a11a0 0x7f988c0a3660 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9898009550 tx=0x7f98980091b0 comp rx=0 tx=0).stop 2024-06-02T04:02:46.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.573+0000 7f98a78c5700 1 -- 172.21.15.123:0/3496364576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98a0101070 msgr2=0x7f98a019c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:46.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.573+0000 7f98a78c5700 1 --2- 172.21.15.123:0/3496364576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98a0101070 0x7f98a019c140 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f989c007b50 tx=0x7f989c007e60 comp rx=0 tx=0).stop 2024-06-02T04:02:46.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.573+0000 7f98a78c5700 1 -- 172.21.15.123:0/3496364576 shutdown_connections 2024-06-02T04:02:46.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.573+0000 7f98a78c5700 1 --2- 172.21.15.123:0/3496364576 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98a0101070 0x7f98a019c140 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:46.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.573+0000 7f98a78c5700 1 --2- 172.21.15.123:0/3496364576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98a00ff4e0 0x7f98a0194be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:46.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.573+0000 7f98a78c5700 1 --2- 172.21.15.123:0/3496364576 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f988c0a11a0 0x7f988c0a3660 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:46.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.573+0000 7f98a78c5700 1 --2- 172.21.15.123:0/3496364576 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98a01006d0 0x7f98a0195120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:46.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.573+0000 7f98a78c5700 1 -- 172.21.15.123:0/3496364576 >> 172.21.15.123:0/3496364576 conn(0x7f98a00faa70 msgr2=0x7f98a0103aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:46.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.573+0000 7f98a78c5700 1 -- 172.21.15.123:0/3496364576 shutdown_connections 2024-06-02T04:02:46.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:46.573+0000 7f98a78c5700 1 -- 172.21.15.123:0/3496364576 wait complete. 2024-06-02T04:02:46.575 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 4 2024-06-02T04:02:47.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:46 smithi162 ceph-mon[47009]: Deploying daemon mds.d on smithi123 2024-06-02T04:02:47.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:46 smithi162 ceph-mon[47009]: mds.? [v2:172.21.15.123:6834/1940848601,v1:172.21.15.123:6835/1940848601] up:boot 2024-06-02T04:02:47.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:46 smithi162 ceph-mon[47009]: fsmap 3 up:standby 2024-06-02T04:02:47.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:46 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-02T04:02:47.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:46 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/3496364576' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:02:47.313 INFO:journalctl@ceph.mds.d.smithi123.stdout:Jun 02 04:02:47 smithi123 systemd[1]: Starting Ceph mds.d for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:02:47.313 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:46 smithi123 ceph-mon[42885]: Deploying daemon mds.d on smithi123 2024-06-02T04:02:47.313 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:46 smithi123 ceph-mon[42885]: mds.? [v2:172.21.15.123:6834/1940848601,v1:172.21.15.123:6835/1940848601] up:boot 2024-06-02T04:02:47.313 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:46 smithi123 ceph-mon[42885]: fsmap 3 up:standby 2024-06-02T04:02:47.314 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:46 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-02T04:02:47.314 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:46 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/3496364576' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:02:47.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:46 smithi136 ceph-mon[47443]: Deploying daemon mds.d on smithi123 2024-06-02T04:02:47.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:46 smithi136 ceph-mon[47443]: mds.? [v2:172.21.15.123:6834/1940848601,v1:172.21.15.123:6835/1940848601] up:boot 2024-06-02T04:02:47.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:46 smithi136 ceph-mon[47443]: fsmap 3 up:standby 2024-06-02T04:02:47.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:46 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-06-02T04:02:47.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:46 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/3496364576' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:02:47.822 INFO:journalctl@ceph.mds.d.smithi123.stdout:Jun 02 04:02:47 smithi123 ceph-mds[92718]: -- 172.21.15.123:0/1823986330 <== mon.0 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fafe1881a0 con 0x55fafe15e800 2024-06-02T04:02:47.823 INFO:journalctl@ceph.mds.d.smithi123.stdout:Jun 02 04:02:47 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-d[92695]: starting mds.d at 2024-06-02T04:02:47.823 INFO:journalctl@ceph.mds.d.smithi123.stdout:Jun 02 04:02:47 smithi123 bash[92680]: b4853ad862cfc4998e91b269895e832684c437b31e5e015fbed1a1112d76eabe 2024-06-02T04:02:47.823 INFO:journalctl@ceph.mds.d.smithi123.stdout:Jun 02 04:02:47 smithi123 systemd[1]: Started Ceph mds.d for 1b432ae0-2094-11ef-bc9b-c7b262605968. 2024-06-02T04:02:48.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:47 smithi162 ceph-mon[47009]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:48.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:47 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:48.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:47 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:48.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:47 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:48.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:47 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:02:48.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:47 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:02:48.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:47 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:48.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:47 smithi123 ceph-mon[42885]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:48.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:47 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:48.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:47 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:48.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:47 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:48.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:47 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:02:48.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:47 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:02:48.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:47 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:48.337 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:47 smithi136 ceph-mon[47443]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:48.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:47 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:48.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:47 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:48.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:47 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:48.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:47 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:02:48.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:47 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:02:48.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:47 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:48.587 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:02:48.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.728+0000 7f910007a700 1 -- 172.21.15.123:0/228680027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90f8101fd0 msgr2=0x7f90f8102450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:48.730 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.728+0000 7f910007a700 1 --2- 172.21.15.123:0/228680027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90f8101fd0 0x7f90f8102450 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f90e8009990 tx=0x7f90e8009ca0 comp rx=0 tx=0).stop 2024-06-02T04:02:48.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.728+0000 7f910007a700 1 -- 172.21.15.123:0/228680027 shutdown_connections 2024-06-02T04:02:48.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.728+0000 7f910007a700 1 --2- 172.21.15.123:0/228680027 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90f8102990 0x7f90f81092b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:48.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.728+0000 7f910007a700 1 --2- 172.21.15.123:0/228680027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90f8100e80 0x7f90f81012a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:48.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.729+0000 7f910007a700 1 --2- 172.21.15.123:0/228680027 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90f8101fd0 0x7f90f8102450 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:48.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.729+0000 7f910007a700 1 -- 172.21.15.123:0/228680027 >> 172.21.15.123:0/228680027 conn(0x7f90f80fc410 msgr2=0x7f90f80fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:48.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.729+0000 7f910007a700 1 -- 172.21.15.123:0/228680027 shutdown_connections 2024-06-02T04:02:48.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.729+0000 7f910007a700 1 -- 172.21.15.123:0/228680027 wait complete. 2024-06-02T04:02:48.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.729+0000 7f910007a700 1 Processor -- start 2024-06-02T04:02:48.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.730+0000 7f910007a700 1 -- start start 2024-06-02T04:02:48.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.730+0000 7f910007a700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90f8100e80 0x7f90f8196e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:48.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.730+0000 7f910007a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90f8101fd0 0x7f90f8197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:48.731 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.730+0000 7f910007a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90f8102990 0x7f90f819e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:48.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.730+0000 7f910007a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f819e940 con 0x7f90f8101fd0 2024-06-02T04:02:48.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.730+0000 7f910007a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f819ea80 con 0x7f90f8102990 2024-06-02T04:02:48.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.730+0000 7f910007a700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f819ec10 con 0x7f90f8100e80 2024-06-02T04:02:48.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.730+0000 7f90fd615700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90f8101fd0 0x7f90f8197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:48.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.730+0000 7f90fd615700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90f8101fd0 0x7f90f8197350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50542/0 (socket says 172.21.15.123:50542) 2024-06-02T04:02:48.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.730+0000 7f90fd615700 1 -- 172.21.15.123:0/1461268134 learned_addr learned my addr 172.21.15.123:0/1461268134 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:02:48.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.730+0000 7f90fd615700 1 -- 172.21.15.123:0/1461268134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90f8100e80 msgr2=0x7f90f8196e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:48.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.730+0000 7f90fd615700 1 --2- 172.21.15.123:0/1461268134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90f8100e80 0x7f90f8196e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:48.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.730+0000 7f90fd615700 1 -- 172.21.15.123:0/1461268134 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90f8102990 msgr2=0x7f90f819e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:48.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.730+0000 7f90fd615700 1 --2- 172.21.15.123:0/1461268134 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90f8102990 0x7f90f819e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:48.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.730+0000 7f90fd615700 1 -- 172.21.15.123:0/1461268134 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e80095f0 con 0x7f90f8101fd0 2024-06-02T04:02:48.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.730+0000 7f90fd615700 1 --2- 172.21.15.123:0/1461268134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90f8101fd0 0x7f90f8197350 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f90e800b5c0 tx=0x7f90e8009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:02:48.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.730+0000 7f90eeffd700 1 -- 172.21.15.123:0/1461268134 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e801d070 con 0x7f90f8101fd0 2024-06-02T04:02:48.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.730+0000 7f910007a700 1 -- 172.21.15.123:0/1461268134 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f819ee90 con 0x7f90f8101fd0 2024-06-02T04:02:48.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.730+0000 7f90eeffd700 1 -- 172.21.15.123:0/1461268134 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f90e80041d0 con 0x7f90f8101fd0 2024-06-02T04:02:48.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.730+0000 7f90eeffd700 1 -- 172.21.15.123:0/1461268134 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e800f460 con 0x7f90f8101fd0 2024-06-02T04:02:48.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.730+0000 7f910007a700 1 -- 172.21.15.123:0/1461268134 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f819f2d0 con 0x7f90f8101fd0 2024-06-02T04:02:48.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.731+0000 7f910007a700 1 -- 172.21.15.123:0/1461268134 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f8067c80 con 0x7f90f8101fd0 2024-06-02T04:02:48.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.732+0000 7f90eeffd700 1 -- 172.21.15.123:0/1461268134 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f90e8022700 con 0x7f90f8101fd0 2024-06-02T04:02:48.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.733+0000 7f90eeffd700 1 --2- 172.21.15.123:0/1461268134 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f90e40a1120 0x7f90e40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:48.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.733+0000 7f90fde16700 1 --2- 172.21.15.123:0/1461268134 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f90e40a1120 0x7f90e40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:48.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.733+0000 7f90eeffd700 1 -- 172.21.15.123:0/1461268134 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f90e80cdb80 con 0x7f90f8101fd0 2024-06-02T04:02:48.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.733+0000 7f90fde16700 1 --2- 172.21.15.123:0/1461268134 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f90e40a1120 0x7f90e40a35e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f90f400a990 tx=0x7f90f4005c80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:02:48.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.736+0000 7f90eeffd700 1 -- 172.21.15.123:0/1461268134 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f90e8097840 con 0x7f90f8101fd0 2024-06-02T04:02:48.979 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.980+0000 7f910007a700 1 -- 172.21.15.123:0/1461268134 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90f8108290 con 0x7f90f8101fd0 2024-06-02T04:02:48.980 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.980+0000 7f90eeffd700 1 -- 172.21.15.123:0/1461268134 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3534 (secure 0 0 0) 0x7f90e8031de0 con 0x7f90f8101fd0 2024-06-02T04:02:48.980 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:02:48.980 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1940848601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1940848601},{"type":"v1","addr":"172.21.15.123:6835","nonce":1940848601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/54447879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":54447879},{"type":"v1","addr":"172.21.15.123:6837","nonce":54447879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/2006585076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2006585076},{"type":"v1","addr":"172.21.15.136:6833","nonce":2006585076}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3583622784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3583622784},{"type":"v1","addr":"172.21.15.162:6833","nonce":3583622784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-06-02T04:02:48.982 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.982+0000 7f910007a700 1 -- 172.21.15.123:0/1461268134 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f90e40a1120 msgr2=0x7f90e40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:48.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.982+0000 7f910007a700 1 --2- 172.21.15.123:0/1461268134 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f90e40a1120 0x7f90e40a35e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f90f400a990 tx=0x7f90f4005c80 comp rx=0 tx=0).stop 2024-06-02T04:02:48.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.982+0000 7f910007a700 1 -- 172.21.15.123:0/1461268134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90f8101fd0 msgr2=0x7f90f8197350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:48.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.982+0000 7f910007a700 1 --2- 172.21.15.123:0/1461268134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90f8101fd0 0x7f90f8197350 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f90e800b5c0 tx=0x7f90e8009f70 comp rx=0 tx=0).stop 2024-06-02T04:02:48.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.982+0000 7f910007a700 1 -- 172.21.15.123:0/1461268134 shutdown_connections 2024-06-02T04:02:48.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.982+0000 7f910007a700 1 --2- 172.21.15.123:0/1461268134 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f90e40a1120 0x7f90e40a35e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:48.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.982+0000 7f910007a700 1 --2- 172.21.15.123:0/1461268134 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90f8102990 0x7f90f819e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:48.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.982+0000 7f910007a700 1 --2- 172.21.15.123:0/1461268134 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90f8100e80 0x7f90f8196e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:48.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.982+0000 7f910007a700 1 --2- 172.21.15.123:0/1461268134 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f90f8101fd0 0x7f90f8197350 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:48.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.982+0000 7f910007a700 1 -- 172.21.15.123:0/1461268134 >> 172.21.15.123:0/1461268134 conn(0x7f90f80fc410 msgr2=0x7f90f81053d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:48.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.982+0000 7f910007a700 1 -- 172.21.15.123:0/1461268134 shutdown_connections 2024-06-02T04:02:48.983 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:48.982+0000 7f910007a700 1 -- 172.21.15.123:0/1461268134 wait complete. 2024-06-02T04:02:48.984 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 5 2024-06-02T04:02:48.989 INFO:journalctl@ceph.mds.e.smithi136.stdout:Jun 02 04:02:48 smithi136 systemd[1]: Starting Ceph mds.e for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:02:49.265 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:48 smithi136 ceph-mon[47443]: Deploying daemon mds.e on smithi136 2024-06-02T04:02:49.265 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:48 smithi136 ceph-mon[47443]: mds.? [v2:172.21.15.123:6836/54447879,v1:172.21.15.123:6837/54447879] up:boot 2024-06-02T04:02:49.266 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:48 smithi136 ceph-mon[47443]: fsmap 4 up:standby 2024-06-02T04:02:49.266 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:48 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-02T04:02:49.266 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:48 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/1461268134' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:02:49.266 INFO:journalctl@ceph.mds.e.smithi136.stdout:Jun 02 04:02:49 smithi136 ceph-mds[84106]: -- 172.21.15.136:0/2241698777 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5581b32a81a0 con 0x5581b327ec00 2024-06-02T04:02:49.266 INFO:journalctl@ceph.mds.e.smithi136.stdout:Jun 02 04:02:49 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-e[84083]: starting mds.e at 2024-06-02T04:02:49.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:48 smithi162 ceph-mon[47009]: Deploying daemon mds.e on smithi136 2024-06-02T04:02:49.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:48 smithi162 ceph-mon[47009]: mds.? [v2:172.21.15.123:6836/54447879,v1:172.21.15.123:6837/54447879] up:boot 2024-06-02T04:02:49.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:48 smithi162 ceph-mon[47009]: fsmap 4 up:standby 2024-06-02T04:02:49.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:48 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-02T04:02:49.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:48 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/1461268134' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:02:49.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:48 smithi123 ceph-mon[42885]: Deploying daemon mds.e on smithi136 2024-06-02T04:02:49.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:48 smithi123 ceph-mon[42885]: mds.? [v2:172.21.15.123:6836/54447879,v1:172.21.15.123:6837/54447879] up:boot 2024-06-02T04:02:49.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:48 smithi123 ceph-mon[42885]: fsmap 4 up:standby 2024-06-02T04:02:49.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:48 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-06-02T04:02:49.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:48 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1461268134' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:02:49.588 INFO:journalctl@ceph.mds.e.smithi136.stdout:Jun 02 04:02:49 smithi136 bash[84068]: 5b761a49304ddc7dd040b3a89bcb104383176b9ba5855ccd19fdc924a121ab5d 2024-06-02T04:02:49.588 INFO:journalctl@ceph.mds.e.smithi136.stdout:Jun 02 04:02:49 smithi136 systemd[1]: Started Ceph mds.e for 1b432ae0-2094-11ef-bc9b-c7b262605968. 2024-06-02T04:02:50.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:49 smithi162 ceph-mon[47009]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:50.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:49 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:50.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:49 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:50.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:49 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:50.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:49 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:02:50.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:49 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:02:50.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:49 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:50.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:49 smithi123 ceph-mon[42885]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:50.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:49 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:50.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:49 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:50.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:49 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:50.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:49 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:02:50.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:49 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:02:50.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:49 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:50.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:49 smithi136 ceph-mon[47443]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:50.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:49 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:50.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:49 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:50.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:49 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:50.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:49 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:02:50.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:49 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:02:50.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:49 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:50.798 INFO:journalctl@ceph.mds.f.smithi162.stdout:Jun 02 04:02:50 smithi162 systemd[1]: Starting Ceph mds.f for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:02:50.996 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:02:51.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.140+0000 7f52eb721700 1 -- 172.21.15.123:0/558992539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52e40ff780 msgr2=0x7f52e40ffba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:51.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.140+0000 7f52eb721700 1 --2- 172.21.15.123:0/558992539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52e40ff780 0x7f52e40ffba0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f52d4009990 tx=0x7f52d4009ca0 comp rx=0 tx=0).stop 2024-06-02T04:02:51.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.140+0000 7f52eb721700 1 -- 172.21.15.123:0/558992539 shutdown_connections 2024-06-02T04:02:51.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.140+0000 7f52eb721700 1 --2- 172.21.15.123:0/558992539 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f52e4100aa0 0x7f52e4100f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:51.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.140+0000 7f52eb721700 1 --2- 172.21.15.123:0/558992539 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52e40ff780 0x7f52e40ffba0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:51.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.140+0000 7f52eb721700 1 --2- 172.21.15.123:0/558992539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52e41000e0 0x7f52e4100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:51.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.140+0000 7f52eb721700 1 -- 172.21.15.123:0/558992539 >> 172.21.15.123:0/558992539 conn(0x7f52e40fb300 msgr2=0x7f52e40fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:51.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.140+0000 7f52eb721700 1 -- 172.21.15.123:0/558992539 shutdown_connections 2024-06-02T04:02:51.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.140+0000 7f52eb721700 1 -- 172.21.15.123:0/558992539 wait complete. 2024-06-02T04:02:51.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.141+0000 7f52eb721700 1 Processor -- start 2024-06-02T04:02:51.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.141+0000 7f52eb721700 1 -- start start 2024-06-02T04:02:51.143 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.141+0000 7f52eb721700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52e40ff780 0x7f52e4199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:51.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.141+0000 7f52eb721700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f52e41000e0 0x7f52e4199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:51.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.141+0000 7f52eb721700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52e4100aa0 0x7f52e41a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:51.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.141+0000 7f52eb721700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e41a0b50 con 0x7f52e40ff780 2024-06-02T04:02:51.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.141+0000 7f52eb721700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e41a0c90 con 0x7f52e41000e0 2024-06-02T04:02:51.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.141+0000 7f52eb721700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e41a0e20 con 0x7f52e4100aa0 2024-06-02T04:02:51.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.141+0000 7f52e94bd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52e40ff780 0x7f52e4199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:51.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.141+0000 7f52e94bd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52e40ff780 0x7f52e4199020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50556/0 (socket says 172.21.15.123:50556) 2024-06-02T04:02:51.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.141+0000 7f52e94bd700 1 -- 172.21.15.123:0/3589539941 learned_addr learned my addr 172.21.15.123:0/3589539941 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:02:51.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.142+0000 7f52e94bd700 1 -- 172.21.15.123:0/3589539941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52e4100aa0 msgr2=0x7f52e41a0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:51.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.142+0000 7f52e94bd700 1 --2- 172.21.15.123:0/3589539941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52e4100aa0 0x7f52e41a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:51.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.142+0000 7f52e8cbc700 1 --2- 172.21.15.123:0/3589539941 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f52e41000e0 0x7f52e4199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:51.144 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.142+0000 7f52e94bd700 1 -- 172.21.15.123:0/3589539941 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f52e41000e0 msgr2=0x7f52e4199560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:51.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.142+0000 7f52e94bd700 1 --2- 172.21.15.123:0/3589539941 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f52e41000e0 0x7f52e4199560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:51.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.142+0000 7f52e94bd700 1 -- 172.21.15.123:0/3589539941 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d40095f0 con 0x7f52e40ff780 2024-06-02T04:02:51.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.142+0000 7f52e94bd700 1 --2- 172.21.15.123:0/3589539941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52e40ff780 0x7f52e4199020 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f52d40059d0 tx=0x7f52d4005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:02:51.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.142+0000 7f52da7fc700 1 -- 172.21.15.123:0/3589539941 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d401d070 con 0x7f52e40ff780 2024-06-02T04:02:51.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.142+0000 7f52da7fc700 1 -- 172.21.15.123:0/3589539941 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f52d4004120 con 0x7f52e40ff780 2024-06-02T04:02:51.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.142+0000 7f52eb721700 1 -- 172.21.15.123:0/3589539941 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52e41a10a0 con 0x7f52e40ff780 2024-06-02T04:02:51.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.142+0000 7f52da7fc700 1 -- 172.21.15.123:0/3589539941 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d4022d40 con 0x7f52e40ff780 2024-06-02T04:02:51.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.142+0000 7f52eb721700 1 -- 172.21.15.123:0/3589539941 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52e41a15a0 con 0x7f52e40ff780 2024-06-02T04:02:51.145 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.143+0000 7f52eb721700 1 -- 172.21.15.123:0/3589539941 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52e410a560 con 0x7f52e40ff780 2024-06-02T04:02:51.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.144+0000 7f52da7fc700 1 -- 172.21.15.123:0/3589539941 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f52d4022470 con 0x7f52e40ff780 2024-06-02T04:02:51.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.145+0000 7f52da7fc700 1 --2- 172.21.15.123:0/3589539941 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f52d00a11a0 0x7f52d00a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:51.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.145+0000 7f52da7fc700 1 -- 172.21.15.123:0/3589539941 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f52d40ce100 con 0x7f52e40ff780 2024-06-02T04:02:51.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.145+0000 7f52e8cbc700 1 --2- 172.21.15.123:0/3589539941 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f52d00a11a0 0x7f52d00a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:51.146 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.145+0000 7f52e8cbc700 1 --2- 172.21.15.123:0/3589539941 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f52d00a11a0 0x7f52d00a3660 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f52e0006fd0 tx=0x7f52e0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:02:51.148 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.148+0000 7f52da7fc700 1 -- 172.21.15.123:0/3589539941 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f52d4097dc0 con 0x7f52e40ff780 2024-06-02T04:02:51.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:50 smithi162 ceph-mon[47009]: Deploying daemon mds.f on smithi162 2024-06-02T04:02:51.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:50 smithi162 ceph-mon[47009]: mds.? [v2:172.21.15.136:6834/2894031422,v1:172.21.15.136:6835/2894031422] up:boot 2024-06-02T04:02:51.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:50 smithi162 ceph-mon[47009]: fsmap 5 up:standby 2024-06-02T04:02:51.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:50 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-02T04:02:51.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:50 smithi123 ceph-mon[42885]: Deploying daemon mds.f on smithi162 2024-06-02T04:02:51.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:50 smithi123 ceph-mon[42885]: mds.? [v2:172.21.15.136:6834/2894031422,v1:172.21.15.136:6835/2894031422] up:boot 2024-06-02T04:02:51.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:50 smithi123 ceph-mon[42885]: fsmap 5 up:standby 2024-06-02T04:02:51.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:50 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-02T04:02:51.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:50 smithi136 ceph-mon[47443]: Deploying daemon mds.f on smithi162 2024-06-02T04:02:51.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:50 smithi136 ceph-mon[47443]: mds.? [v2:172.21.15.136:6834/2894031422,v1:172.21.15.136:6835/2894031422] up:boot 2024-06-02T04:02:51.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:50 smithi136 ceph-mon[47443]: fsmap 5 up:standby 2024-06-02T04:02:51.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:50 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-02T04:02:51.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.394+0000 7f52eb721700 1 -- 172.21.15.123:0/3589539941 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52e4068060 con 0x7f52e40ff780 2024-06-02T04:02:51.394 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.394+0000 7f52da7fc700 1 -- 172.21.15.123:0/3589539941 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4294 (secure 0 0 0) 0x7f52d409b3e0 con 0x7f52e40ff780 2024-06-02T04:02:51.394 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:02:51.394 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1940848601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1940848601},{"type":"v1","addr":"172.21.15.123:6835","nonce":1940848601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/54447879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":54447879},{"type":"v1","addr":"172.21.15.123:6837","nonce":54447879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/2006585076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2006585076},{"type":"v1","addr":"172.21.15.136:6833","nonce":2006585076}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3583622784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3583622784},{"type":"v1","addr":"172.21.15.162:6833","nonce":3583622784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2894031422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2894031422},{"type":"v1","addr":"172.21.15.136:6835","nonce":2894031422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[]} 2024-06-02T04:02:51.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.396+0000 7f52eb721700 1 -- 172.21.15.123:0/3589539941 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f52d00a11a0 msgr2=0x7f52d00a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:51.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.396+0000 7f52eb721700 1 --2- 172.21.15.123:0/3589539941 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f52d00a11a0 0x7f52d00a3660 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f52e0006fd0 tx=0x7f52e0008040 comp rx=0 tx=0).stop 2024-06-02T04:02:51.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.396+0000 7f52eb721700 1 -- 172.21.15.123:0/3589539941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52e40ff780 msgr2=0x7f52e4199020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:51.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.396+0000 7f52eb721700 1 --2- 172.21.15.123:0/3589539941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52e40ff780 0x7f52e4199020 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f52d40059d0 tx=0x7f52d4005ef0 comp rx=0 tx=0).stop 2024-06-02T04:02:51.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.396+0000 7f52eb721700 1 -- 172.21.15.123:0/3589539941 shutdown_connections 2024-06-02T04:02:51.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.396+0000 7f52eb721700 1 --2- 172.21.15.123:0/3589539941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52e4100aa0 0x7f52e41a0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:51.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.396+0000 7f52eb721700 1 --2- 172.21.15.123:0/3589539941 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f52e40ff780 0x7f52e4199020 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:51.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.396+0000 7f52eb721700 1 --2- 172.21.15.123:0/3589539941 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f52d00a11a0 0x7f52d00a3660 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:51.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.396+0000 7f52eb721700 1 --2- 172.21.15.123:0/3589539941 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f52e41000e0 0x7f52e4199560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:51.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.396+0000 7f52eb721700 1 -- 172.21.15.123:0/3589539941 >> 172.21.15.123:0/3589539941 conn(0x7f52e40fb300 msgr2=0x7f52e40fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:51.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.396+0000 7f52eb721700 1 -- 172.21.15.123:0/3589539941 shutdown_connections 2024-06-02T04:02:51.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:51.397+0000 7f52eb721700 1 -- 172.21.15.123:0/3589539941 wait complete. 2024-06-02T04:02:51.398 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 6 2024-06-02T04:02:51.783 INFO:journalctl@ceph.mds.f.smithi162.stdout:Jun 02 04:02:51 smithi162 ceph-mds[82968]: -- 172.21.15.162:0/1219502773 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e9c2cb01a0 con 0x55e9c2c86800 2024-06-02T04:02:51.783 INFO:journalctl@ceph.mds.f.smithi162.stdout:Jun 02 04:02:51 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-f[82945]: starting mds.f at 2024-06-02T04:02:51.783 INFO:journalctl@ceph.mds.f.smithi162.stdout:Jun 02 04:02:51 smithi162 bash[82930]: 0888f15e05c850ff24705d396a94726935c1a9ffafcb374e6da4736e32058fcb 2024-06-02T04:02:51.783 INFO:journalctl@ceph.mds.f.smithi162.stdout:Jun 02 04:02:51 smithi162 systemd[1]: Started Ceph mds.f for 1b432ae0-2094-11ef-bc9b-c7b262605968. 2024-06-02T04:02:52.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:51 smithi162 ceph-mon[47009]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:52.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:51 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:52.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:51 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:52.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:51 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/3589539941' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:02:52.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:51 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:52.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:51 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:02:52.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:51 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:02:52.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:51 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:52.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:51 smithi123 ceph-mon[42885]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:52.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:51 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:52.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:51 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:52.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:51 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/3589539941' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:02:52.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:51 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:52.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:51 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:02:52.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:51 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:02:52.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:51 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:52.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:51 smithi136 ceph-mon[47443]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:52.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:51 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:52.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:51 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:52.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:51 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/3589539941' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:02:52.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:51 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:52.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:51 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:02:52.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:51 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:02:52.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:51 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:52.798 INFO:journalctl@ceph.mds.c.smithi162.stdout:Jun 02 04:02:52 smithi162 systemd[1]: Starting Ceph mds.c for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:02:53.298 INFO:journalctl@ceph.mds.c.smithi162.stdout:Jun 02 04:02:53 smithi162 ceph-mds[83309]: -- 172.21.15.162:0/2440644466 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ba07cd81a0 con 0x55ba07caec00 2024-06-02T04:02:53.298 INFO:journalctl@ceph.mds.c.smithi162.stdout:Jun 02 04:02:53 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-c[83286]: starting mds.c at 2024-06-02T04:02:53.298 INFO:journalctl@ceph.mds.c.smithi162.stdout:Jun 02 04:02:53 smithi162 bash[83272]: 1af4c4a4e4caeb4225ac75fff8cfb17473591dedb18e51e9f7464334da5fd32e 2024-06-02T04:02:53.298 INFO:journalctl@ceph.mds.c.smithi162.stdout:Jun 02 04:02:53 smithi162 systemd[1]: Started Ceph mds.c for 1b432ae0-2094-11ef-bc9b-c7b262605968. 2024-06-02T04:02:53.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:52 smithi162 ceph-mon[47009]: Deploying daemon mds.c on smithi162 2024-06-02T04:02:53.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:52 smithi162 ceph-mon[47009]: mds.? [v2:172.21.15.162:6834/2478943987,v1:172.21.15.162:6835/2478943987] up:boot 2024-06-02T04:02:53.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:52 smithi162 ceph-mon[47009]: fsmap 6 up:standby 2024-06-02T04:02:53.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:52 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-02T04:02:53.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:52 smithi123 ceph-mon[42885]: Deploying daemon mds.c on smithi162 2024-06-02T04:02:53.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:52 smithi123 ceph-mon[42885]: mds.? [v2:172.21.15.162:6834/2478943987,v1:172.21.15.162:6835/2478943987] up:boot 2024-06-02T04:02:53.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:52 smithi123 ceph-mon[42885]: fsmap 6 up:standby 2024-06-02T04:02:53.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:52 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-02T04:02:53.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:52 smithi136 ceph-mon[47443]: Deploying daemon mds.c on smithi162 2024-06-02T04:02:53.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:52 smithi136 ceph-mon[47443]: mds.? [v2:172.21.15.162:6834/2478943987,v1:172.21.15.162:6835/2478943987] up:boot 2024-06-02T04:02:53.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:52 smithi136 ceph-mon[47443]: fsmap 6 up:standby 2024-06-02T04:02:53.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:52 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-02T04:02:53.409 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:02:53.553 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.551+0000 7fd7ba9fd700 1 -- 172.21.15.123:0/1975440931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7b4102a90 msgr2=0x7fd7b4109340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:53.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.551+0000 7fd7ba9fd700 1 --2- 172.21.15.123:0/1975440931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7b4102a90 0x7fd7b4109340 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac00b0a0 tx=0x7fd7ac00b3b0 comp rx=0 tx=0).stop 2024-06-02T04:02:53.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.551+0000 7fd7ba9fd700 1 -- 172.21.15.123:0/1975440931 shutdown_connections 2024-06-02T04:02:53.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.551+0000 7fd7ba9fd700 1 --2- 172.21.15.123:0/1975440931 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7b4102a90 0x7fd7b4109340 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:53.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.551+0000 7fd7ba9fd700 1 --2- 172.21.15.123:0/1975440931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7b40ff120 0x7fd7b40ff540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:53.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.551+0000 7fd7ba9fd700 1 --2- 172.21.15.123:0/1975440931 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7b41020f0 0x7fd7b4102550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:53.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.551+0000 7fd7ba9fd700 1 -- 172.21.15.123:0/1975440931 >> 172.21.15.123:0/1975440931 conn(0x7fd7b40faa70 msgr2=0x7fd7b40fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:53.554 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.551+0000 7fd7ba9fd700 1 -- 172.21.15.123:0/1975440931 shutdown_connections 2024-06-02T04:02:53.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.551+0000 7fd7ba9fd700 1 -- 172.21.15.123:0/1975440931 wait complete. 2024-06-02T04:02:53.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.551+0000 7fd7ba9fd700 1 Processor -- start 2024-06-02T04:02:53.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.552+0000 7fd7ba9fd700 1 -- start start 2024-06-02T04:02:53.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.552+0000 7fd7ba9fd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7b40ff120 0x7fd7b4101a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:53.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.552+0000 7fd7ba9fd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7b41020f0 0x7fd7b41000a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:53.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.552+0000 7fd7ba9fd700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7b4102a90 0x7fd7b41005e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:53.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.552+0000 7fd7ba9fd700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b4100d80 con 0x7fd7b41020f0 2024-06-02T04:02:53.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.552+0000 7fd7ba9fd700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b4100ef0 con 0x7fd7b40ff120 2024-06-02T04:02:53.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.552+0000 7fd7ba9fd700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b41a0f20 con 0x7fd7b4102a90 2024-06-02T04:02:53.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.552+0000 7fd7b37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7b41020f0 0x7fd7b41000a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:53.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.552+0000 7fd7b37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7b41020f0 0x7fd7b41000a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:50570/0 (socket says 172.21.15.123:50570) 2024-06-02T04:02:53.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.552+0000 7fd7b37fe700 1 -- 172.21.15.123:0/3196067778 learned_addr learned my addr 172.21.15.123:0/3196067778 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:02:53.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.552+0000 7fd7b3fff700 1 --2- 172.21.15.123:0/3196067778 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7b40ff120 0x7fd7b4101a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:53.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.552+0000 7fd7b8f9a700 1 --2- 172.21.15.123:0/3196067778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7b4102a90 0x7fd7b41005e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:53.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.552+0000 7fd7b37fe700 1 -- 172.21.15.123:0/3196067778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7b4102a90 msgr2=0x7fd7b41005e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:53.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.552+0000 7fd7b37fe700 1 --2- 172.21.15.123:0/3196067778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7b4102a90 0x7fd7b41005e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:53.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.552+0000 7fd7b37fe700 1 -- 172.21.15.123:0/3196067778 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7b40ff120 msgr2=0x7fd7b4101a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:53.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.552+0000 7fd7b37fe700 1 --2- 172.21.15.123:0/3196067778 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7b40ff120 0x7fd7b4101a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:53.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.552+0000 7fd7b37fe700 1 -- 172.21.15.123:0/3196067778 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79c009520 con 0x7fd7b41020f0 2024-06-02T04:02:53.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.552+0000 7fd7b8f9a700 1 --2- 172.21.15.123:0/3196067778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7b4102a90 0x7fd7b41005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:02:53.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.553+0000 7fd7b37fe700 1 --2- 172.21.15.123:0/3196067778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7b41020f0 0x7fd7b41000a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd7a400d950 tx=0x7fd7a400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:02:53.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.553+0000 7fd7b17fa700 1 -- 172.21.15.123:0/3196067778 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a40098e0 con 0x7fd7b41020f0 2024-06-02T04:02:53.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.553+0000 7fd7ba9fd700 1 -- 172.21.15.123:0/3196067778 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7ac009d00 con 0x7fd7b41020f0 2024-06-02T04:02:53.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.553+0000 7fd7b17fa700 1 -- 172.21.15.123:0/3196067778 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd7a4010460 con 0x7fd7b41020f0 2024-06-02T04:02:53.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.553+0000 7fd7b17fa700 1 -- 172.21.15.123:0/3196067778 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a400f620 con 0x7fd7b41020f0 2024-06-02T04:02:53.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.553+0000 7fd7ba9fd700 1 -- 172.21.15.123:0/3196067778 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b41a1530 con 0x7fd7b41020f0 2024-06-02T04:02:53.557 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.554+0000 7fd7ba9fd700 1 -- 172.21.15.123:0/3196067778 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7b4108380 con 0x7fd7b41020f0 2024-06-02T04:02:53.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.555+0000 7fd7b17fa700 1 -- 172.21.15.123:0/3196067778 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fd7a40108d0 con 0x7fd7b41020f0 2024-06-02T04:02:53.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.555+0000 7fd7b17fa700 1 --2- 172.21.15.123:0/3196067778 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd7a00a1120 0x7fd7a00a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:53.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.556+0000 7fd7b3fff700 1 --2- 172.21.15.123:0/3196067778 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd7a00a1120 0x7fd7a00a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:53.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.556+0000 7fd7b17fa700 1 -- 172.21.15.123:0/3196067778 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fd7a40cc290 con 0x7fd7b41020f0 2024-06-02T04:02:53.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.556+0000 7fd7b3fff700 1 --2- 172.21.15.123:0/3196067778 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd7a00a1120 0x7fd7a00a35e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4067df0 tx=0x7fd79c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:02:53.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.559+0000 7fd7b17fa700 1 -- 172.21.15.123:0/3196067778 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd7a4095ec0 con 0x7fd7b41020f0 2024-06-02T04:02:53.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.801+0000 7fd7ba9fd700 1 -- 172.21.15.123:0/3196067778 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7b4067380 con 0x7fd7b41020f0 2024-06-02T04:02:53.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.801+0000 7fd7b17fa700 1 -- 172.21.15.123:0/3196067778 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5054 (secure 0 0 0) 0x7fd7a40b9070 con 0x7fd7b41020f0 2024-06-02T04:02:53.801 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:02:53.801 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1940848601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1940848601},{"type":"v1","addr":"172.21.15.123:6835","nonce":1940848601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/54447879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":54447879},{"type":"v1","addr":"172.21.15.123:6837","nonce":54447879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/2006585076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2006585076},{"type":"v1","addr":"172.21.15.136:6833","nonce":2006585076}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3583622784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3583622784},{"type":"v1","addr":"172.21.15.162:6833","nonce":3583622784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2894031422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2894031422},{"type":"v1","addr":"172.21.15.136:6835","nonce":2894031422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2478943987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2478943987},{"type":"v1","addr":"172.21.15.162:6835","nonce":2478943987}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[]} 2024-06-02T04:02:53.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.803+0000 7fd7ba9fd700 1 -- 172.21.15.123:0/3196067778 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd7a00a1120 msgr2=0x7fd7a00a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:53.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.803+0000 7fd7ba9fd700 1 --2- 172.21.15.123:0/3196067778 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd7a00a1120 0x7fd7a00a35e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4067df0 tx=0x7fd79c009260 comp rx=0 tx=0).stop 2024-06-02T04:02:53.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.803+0000 7fd7ba9fd700 1 -- 172.21.15.123:0/3196067778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7b41020f0 msgr2=0x7fd7b41000a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:53.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.803+0000 7fd7ba9fd700 1 --2- 172.21.15.123:0/3196067778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7b41020f0 0x7fd7b41000a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd7a400d950 tx=0x7fd7a400dc60 comp rx=0 tx=0).stop 2024-06-02T04:02:53.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.803+0000 7fd7ba9fd700 1 -- 172.21.15.123:0/3196067778 shutdown_connections 2024-06-02T04:02:53.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.803+0000 7fd7ba9fd700 1 --2- 172.21.15.123:0/3196067778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7b4102a90 0x7fd7b41005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:53.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.803+0000 7fd7ba9fd700 1 --2- 172.21.15.123:0/3196067778 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd7a00a1120 0x7fd7a00a35e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:53.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.803+0000 7fd7ba9fd700 1 --2- 172.21.15.123:0/3196067778 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7b40ff120 0x7fd7b4101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:53.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.803+0000 7fd7ba9fd700 1 --2- 172.21.15.123:0/3196067778 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd7b41020f0 0x7fd7b41000a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:53.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.803+0000 7fd7ba9fd700 1 -- 172.21.15.123:0/3196067778 >> 172.21.15.123:0/3196067778 conn(0x7fd7b40faa70 msgr2=0x7fd7b41054c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:53.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.803+0000 7fd7ba9fd700 1 -- 172.21.15.123:0/3196067778 shutdown_connections 2024-06-02T04:02:53.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:53.803+0000 7fd7ba9fd700 1 -- 172.21.15.123:0/3196067778 wait complete. 2024-06-02T04:02:53.805 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 7 2024-06-02T04:02:54.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:54 smithi123 ceph-mon[42885]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:54.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:54 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:54.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:54 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:54.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:54 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:54.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:54 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:02:54.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:54 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:02:54.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:54 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:54.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:54 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/3196067778' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:02:54.210 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:54 smithi136 ceph-mon[47443]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:54.211 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:54 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:54.211 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:54 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:54.211 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:54 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:54.211 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:54 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:02:54.211 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:54 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:02:54.211 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:54 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:54.211 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:54 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/3196067778' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:02:54.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:54 smithi162 ceph-mon[47009]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:54.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:54 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:54.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:54 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:54.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:54 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:54.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:54 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:02:54.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:54 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:02:54.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:54 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:54.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:54 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/3196067778' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:02:54.788 INFO:journalctl@ceph.mds.h.smithi136.stdout:Jun 02 04:02:54 smithi136 systemd[1]: Starting Ceph mds.h for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:02:55.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:55 smithi162 ceph-mon[47009]: Deploying daemon mds.h on smithi136 2024-06-02T04:02:55.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:55 smithi162 ceph-mon[47009]: mds.? [v2:172.21.15.162:6836/3402138468,v1:172.21.15.162:6837/3402138468] up:boot 2024-06-02T04:02:55.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:55 smithi162 ceph-mon[47009]: fsmap 7 up:standby 2024-06-02T04:02:55.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:55 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-02T04:02:55.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:55 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:55.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:55 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:55.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:55 smithi123 ceph-mon[42885]: Deploying daemon mds.h on smithi136 2024-06-02T04:02:55.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:55 smithi123 ceph-mon[42885]: mds.? [v2:172.21.15.162:6836/3402138468,v1:172.21.15.162:6837/3402138468] up:boot 2024-06-02T04:02:55.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:55 smithi123 ceph-mon[42885]: fsmap 7 up:standby 2024-06-02T04:02:55.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:55 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-02T04:02:55.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:55 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:55.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:55 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:55.338 INFO:journalctl@ceph.mds.h.smithi136.stdout:Jun 02 04:02:54 smithi136 ceph-mds[84449]: -- 172.21.15.136:0/1193708594 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55cc067421a0 con 0x55cc06719000 2024-06-02T04:02:55.338 INFO:journalctl@ceph.mds.h.smithi136.stdout:Jun 02 04:02:54 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-h[84426]: starting mds.h at 2024-06-02T04:02:55.338 INFO:journalctl@ceph.mds.h.smithi136.stdout:Jun 02 04:02:54 smithi136 bash[84411]: ced0821ce708d3ef40cb6775a5d1d69f424abfc6ab4f097164ee0d12fb838b80 2024-06-02T04:02:55.338 INFO:journalctl@ceph.mds.h.smithi136.stdout:Jun 02 04:02:54 smithi136 systemd[1]: Started Ceph mds.h for 1b432ae0-2094-11ef-bc9b-c7b262605968. 2024-06-02T04:02:55.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:55 smithi136 ceph-mon[47443]: Deploying daemon mds.h on smithi136 2024-06-02T04:02:55.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:55 smithi136 ceph-mon[47443]: mds.? [v2:172.21.15.162:6836/3402138468,v1:172.21.15.162:6837/3402138468] up:boot 2024-06-02T04:02:55.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:55 smithi136 ceph-mon[47443]: fsmap 7 up:standby 2024-06-02T04:02:55.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:55 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-02T04:02:55.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:55 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:55.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:55 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:55.816 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:02:55.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.959+0000 7f569e707700 1 -- 172.21.15.123:0/3596905779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5698101940 msgr2=0x7f5698103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:55.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.959+0000 7f569e707700 1 --2- 172.21.15.123:0/3596905779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5698101940 0x7f5698103d30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f568c009990 tx=0x7f568c009ca0 comp rx=0 tx=0).stop 2024-06-02T04:02:55.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.959+0000 7f569e707700 1 -- 172.21.15.123:0/3596905779 shutdown_connections 2024-06-02T04:02:55.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.959+0000 7f569e707700 1 --2- 172.21.15.123:0/3596905779 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5698106ba0 0x7f5698108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:55.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.959+0000 7f569e707700 1 --2- 172.21.15.123:0/3596905779 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5698101940 0x7f5698103d30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:55.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.959+0000 7f569e707700 1 --2- 172.21.15.123:0/3596905779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5698104270 0x7f5698106660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:55.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.959+0000 7f569e707700 1 -- 172.21.15.123:0/3596905779 >> 172.21.15.123:0/3596905779 conn(0x7f56980fb2f0 msgr2=0x7f56980fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:55.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.959+0000 7f569e707700 1 -- 172.21.15.123:0/3596905779 shutdown_connections 2024-06-02T04:02:55.959 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.959+0000 7f569e707700 1 -- 172.21.15.123:0/3596905779 wait complete. 2024-06-02T04:02:55.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.959+0000 7f569e707700 1 Processor -- start 2024-06-02T04:02:55.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.959+0000 7f569e707700 1 -- start start 2024-06-02T04:02:55.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.960+0000 7f569e707700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5698101940 0x7f5698101260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:55.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.960+0000 7f569e707700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5698104270 0x7f56980ff8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:55.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.960+0000 7f569e707700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5698106ba0 0x7f56980ffe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:55.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.960+0000 7f569e707700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56981005d0 con 0x7f5698106ba0 2024-06-02T04:02:55.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.960+0000 7f569e707700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5698100740 con 0x7f5698104270 2024-06-02T04:02:55.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.960+0000 7f569e707700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56981a0e00 con 0x7f5698101940 2024-06-02T04:02:55.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.960+0000 7f569cca4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5698106ba0 0x7f56980ffe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:55.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.960+0000 7f569cca4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5698106ba0 0x7f56980ffe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33504/0 (socket says 172.21.15.123:33504) 2024-06-02T04:02:55.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.960+0000 7f569cca4700 1 -- 172.21.15.123:0/3296948615 learned_addr learned my addr 172.21.15.123:0/3296948615 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:02:55.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.960+0000 7f5697fff700 1 --2- 172.21.15.123:0/3296948615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5698101940 0x7f5698101260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:55.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.960+0000 7f56977fe700 1 --2- 172.21.15.123:0/3296948615 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5698104270 0x7f56980ff8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:55.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.960+0000 7f569cca4700 1 -- 172.21.15.123:0/3296948615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5698101940 msgr2=0x7f5698101260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:55.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.960+0000 7f569cca4700 1 --2- 172.21.15.123:0/3296948615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5698101940 0x7f5698101260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:55.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.960+0000 7f569cca4700 1 -- 172.21.15.123:0/3296948615 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5698104270 msgr2=0x7f56980ff8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:55.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.960+0000 7f569cca4700 1 --2- 172.21.15.123:0/3296948615 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5698104270 0x7f56980ff8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:55.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.960+0000 7f569cca4700 1 -- 172.21.15.123:0/3296948615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568c0095f0 con 0x7f5698106ba0 2024-06-02T04:02:55.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.960+0000 7f5697fff700 1 --2- 172.21.15.123:0/3296948615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5698101940 0x7f5698101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:02:55.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.960+0000 7f569cca4700 1 --2- 172.21.15.123:0/3296948615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5698106ba0 0x7f56980ffe30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5690007d70 tx=0x7f569000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:02:55.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.961+0000 7f56957fa700 1 -- 172.21.15.123:0/3296948615 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569000ad40 con 0x7f5698106ba0 2024-06-02T04:02:55.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.961+0000 7f56957fa700 1 -- 172.21.15.123:0/3296948615 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f56900128e0 con 0x7f5698106ba0 2024-06-02T04:02:55.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.961+0000 7f569e707700 1 -- 172.21.15.123:0/3296948615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56981a1090 con 0x7f5698106ba0 2024-06-02T04:02:55.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.961+0000 7f56957fa700 1 -- 172.21.15.123:0/3296948615 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56900116f0 con 0x7f5698106ba0 2024-06-02T04:02:55.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.961+0000 7f569e707700 1 -- 172.21.15.123:0/3296948615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56981a15a0 con 0x7f5698106ba0 2024-06-02T04:02:55.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.962+0000 7f569e707700 1 -- 172.21.15.123:0/3296948615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56980fce70 con 0x7f5698106ba0 2024-06-02T04:02:55.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.963+0000 7f56957fa700 1 -- 172.21.15.123:0/3296948615 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f5690012420 con 0x7f5698106ba0 2024-06-02T04:02:55.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.963+0000 7f56957fa700 1 --2- 172.21.15.123:0/3296948615 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f56800a11a0 0x7f56800a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:55.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.963+0000 7f5697fff700 1 --2- 172.21.15.123:0/3296948615 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f56800a11a0 0x7f56800a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:55.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.963+0000 7f56957fa700 1 -- 172.21.15.123:0/3296948615 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f56900ccc00 con 0x7f5698106ba0 2024-06-02T04:02:55.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.964+0000 7f5697fff700 1 --2- 172.21.15.123:0/3296948615 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f56800a11a0 0x7f56800a3660 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f568c00b2e0 tx=0x7f568c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:02:55.966 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:55.967+0000 7f56957fa700 1 -- 172.21.15.123:0/3296948615 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5690096830 con 0x7f5698106ba0 2024-06-02T04:02:56.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:56.212+0000 7f569e707700 1 -- 172.21.15.123:0/3296948615 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5698067c10 con 0x7f5698106ba0 2024-06-02T04:02:56.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:56.212+0000 7f56957fa700 1 -- 172.21.15.123:0/3296948615 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6574 (secure 0 0 0) 0x7f5690099e50 con 0x7f5698106ba0 2024-06-02T04:02:56.212 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:02:56.213 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1940848601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1940848601},{"type":"v1","addr":"172.21.15.123:6835","nonce":1940848601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/54447879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":54447879},{"type":"v1","addr":"172.21.15.123:6837","nonce":54447879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/2006585076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2006585076},{"type":"v1","addr":"172.21.15.136:6833","nonce":2006585076}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3583622784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3583622784},{"type":"v1","addr":"172.21.15.162:6833","nonce":3583622784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2894031422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2894031422},{"type":"v1","addr":"172.21.15.136:6835","nonce":2894031422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2478943987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2478943987},{"type":"v1","addr":"172.21.15.162:6835","nonce":2478943987}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24469,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3402138468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3402138468},{"type":"v1","addr":"172.21.15.162:6837","nonce":3402138468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24473,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/2572418263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2572418263},{"type":"v1","addr":"172.21.15.136:6837","nonce":2572418263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2024-06-02T04:02:56.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:56.215+0000 7f569e707700 1 -- 172.21.15.123:0/3296948615 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f56800a11a0 msgr2=0x7f56800a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:56.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:56.215+0000 7f569e707700 1 --2- 172.21.15.123:0/3296948615 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f56800a11a0 0x7f56800a3660 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f568c00b2e0 tx=0x7f568c005fb0 comp rx=0 tx=0).stop 2024-06-02T04:02:56.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:56.215+0000 7f569e707700 1 -- 172.21.15.123:0/3296948615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5698106ba0 msgr2=0x7f56980ffe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:56.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:56.215+0000 7f569e707700 1 --2- 172.21.15.123:0/3296948615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5698106ba0 0x7f56980ffe30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5690007d70 tx=0x7f569000a340 comp rx=0 tx=0).stop 2024-06-02T04:02:56.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:56.215+0000 7f569e707700 1 -- 172.21.15.123:0/3296948615 shutdown_connections 2024-06-02T04:02:56.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:56.215+0000 7f569e707700 1 --2- 172.21.15.123:0/3296948615 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5698106ba0 0x7f56980ffe30 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:56.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:56.215+0000 7f569e707700 1 --2- 172.21.15.123:0/3296948615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5698101940 0x7f5698101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:56.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:56.215+0000 7f569e707700 1 --2- 172.21.15.123:0/3296948615 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f56800a11a0 0x7f56800a3660 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:56.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:56.215+0000 7f569e707700 1 --2- 172.21.15.123:0/3296948615 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5698104270 0x7f56980ff8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:56.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:56.215+0000 7f569e707700 1 -- 172.21.15.123:0/3296948615 >> 172.21.15.123:0/3296948615 conn(0x7f56980fb2f0 msgr2=0x7f5698102280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:56.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:56.215+0000 7f569e707700 1 -- 172.21.15.123:0/3296948615 shutdown_connections 2024-06-02T04:02:56.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:56.215+0000 7f569e707700 1 -- 172.21.15.123:0/3296948615 wait complete. 2024-06-02T04:02:56.216 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 9 2024-06-02T04:02:56.225 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:56 smithi123 ceph-mon[42885]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:56.226 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:56 smithi123 ceph-mon[42885]: mds.? [v2:172.21.15.136:6836/2572418263,v1:172.21.15.136:6837/2572418263] up:boot 2024-06-02T04:02:56.226 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:56 smithi123 ceph-mon[42885]: fsmap 8 up:standby 2024-06-02T04:02:56.226 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:56 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-02T04:02:56.226 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:56 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:56.226 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:56 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:02:56.226 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:56 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:02:56.226 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:56 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:56.226 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:56 smithi123 ceph-mon[42885]: Deploying daemon mds.i on smithi162 2024-06-02T04:02:56.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:56 smithi162 ceph-mon[47009]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:56.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:56 smithi162 ceph-mon[47009]: mds.? [v2:172.21.15.136:6836/2572418263,v1:172.21.15.136:6837/2572418263] up:boot 2024-06-02T04:02:56.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:56 smithi162 ceph-mon[47009]: fsmap 8 up:standby 2024-06-02T04:02:56.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:56 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-02T04:02:56.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:56 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:56.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:56 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:02:56.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:56 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:02:56.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:56 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:56.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:56 smithi162 ceph-mon[47009]: Deploying daemon mds.i on smithi162 2024-06-02T04:02:56.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:56 smithi136 ceph-mon[47443]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:56.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:56 smithi136 ceph-mon[47443]: mds.? [v2:172.21.15.136:6836/2572418263,v1:172.21.15.136:6837/2572418263] up:boot 2024-06-02T04:02:56.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:56 smithi136 ceph-mon[47443]: fsmap 8 up:standby 2024-06-02T04:02:56.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:56 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-02T04:02:56.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:56 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:56.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:56 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:02:56.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:56 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:02:56.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:56 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:56.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:56 smithi136 ceph-mon[47443]: Deploying daemon mds.i on smithi162 2024-06-02T04:02:56.604 INFO:journalctl@ceph.mds.i.smithi162.stdout:Jun 02 04:02:56 smithi162 systemd[1]: Starting Ceph mds.i for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:02:57.017 INFO:journalctl@ceph.mds.i.smithi162.stdout:Jun 02 04:02:56 smithi162 ceph-mds[83652]: -- 172.21.15.162:0/3572764294 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56115b6401a0 con 0x56115b616c00 2024-06-02T04:02:57.017 INFO:journalctl@ceph.mds.i.smithi162.stdout:Jun 02 04:02:56 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-i[83629]: starting mds.i at 2024-06-02T04:02:57.018 INFO:journalctl@ceph.mds.i.smithi162.stdout:Jun 02 04:02:56 smithi162 bash[83614]: 5726bba71024a8c32ca828e429cb9eb32f0a3f7dbbba2780c5c61072b9b7b2f3 2024-06-02T04:02:57.018 INFO:journalctl@ceph.mds.i.smithi162.stdout:Jun 02 04:02:56 smithi162 systemd[1]: Started Ceph mds.i for 1b432ae0-2094-11ef-bc9b-c7b262605968. 2024-06-02T04:02:57.270 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:57 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/3296948615' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:02:57.270 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:57 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:57.270 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:57 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:57.270 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:57 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:57.271 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:57 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:02:57.271 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:57 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:02:57.271 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:57 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:57.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:57 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/3296948615' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:02:57.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:57 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:57.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:57 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:57.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:57 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:57.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:57 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:02:57.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:57 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:02:57.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:57 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:57.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:57 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/3296948615' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:02:57.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:57 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:57.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:57 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:57.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:57 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:57.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:57 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:02:57.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:57 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:02:57.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:57 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:58.228 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:02:58.256 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:58 smithi123 ceph-mon[42885]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:58.256 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:58 smithi123 ceph-mon[42885]: Deploying daemon mds.g on smithi123 2024-06-02T04:02:58.256 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:58 smithi123 ceph-mon[42885]: mds.? [v2:172.21.15.162:6838/2588884232,v1:172.21.15.162:6839/2588884232] up:boot 2024-06-02T04:02:58.256 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:58 smithi123 ceph-mon[42885]: fsmap 9 up:standby 2024-06-02T04:02:58.256 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:58 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-02T04:02:58.257 INFO:journalctl@ceph.mds.g.smithi123.stdout:Jun 02 04:02:58 smithi123 systemd[1]: Starting Ceph mds.g for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:02:58.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:58 smithi162 ceph-mon[47009]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:58.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:58 smithi162 ceph-mon[47009]: Deploying daemon mds.g on smithi123 2024-06-02T04:02:58.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:58 smithi162 ceph-mon[47009]: mds.? [v2:172.21.15.162:6838/2588884232,v1:172.21.15.162:6839/2588884232] up:boot 2024-06-02T04:02:58.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:58 smithi162 ceph-mon[47009]: fsmap 9 up:standby 2024-06-02T04:02:58.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:58 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-02T04:02:58.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:58 smithi136 ceph-mon[47443]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:58.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:58 smithi136 ceph-mon[47443]: Deploying daemon mds.g on smithi123 2024-06-02T04:02:58.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:58 smithi136 ceph-mon[47443]: mds.? [v2:172.21.15.162:6838/2588884232,v1:172.21.15.162:6839/2588884232] up:boot 2024-06-02T04:02:58.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:58 smithi136 ceph-mon[47443]: fsmap 9 up:standby 2024-06-02T04:02:58.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:58 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-02T04:02:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.369+0000 7fc2dcd54700 1 -- 172.21.15.123:0/2864029736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2d80ff120 msgr2=0x7fc2d80ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.369+0000 7fc2dcd54700 1 --2- 172.21.15.123:0/2864029736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2d80ff120 0x7fc2d80ff540 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc009990 tx=0x7fc2cc009ca0 comp rx=0 tx=0).stop 2024-06-02T04:02:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.369+0000 7fc2dcd54700 1 -- 172.21.15.123:0/2864029736 shutdown_connections 2024-06-02T04:02:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.369+0000 7fc2dcd54700 1 --2- 172.21.15.123:0/2864029736 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2d8102a90 0x7fc2d8109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.369+0000 7fc2dcd54700 1 --2- 172.21.15.123:0/2864029736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2d80ff120 0x7fc2d80ff540 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.369+0000 7fc2dcd54700 1 --2- 172.21.15.123:0/2864029736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2d81020f0 0x7fc2d8102550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.369+0000 7fc2dcd54700 1 -- 172.21.15.123:0/2864029736 >> 172.21.15.123:0/2864029736 conn(0x7fc2d80faa70 msgr2=0x7fc2d80fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.369+0000 7fc2dcd54700 1 -- 172.21.15.123:0/2864029736 shutdown_connections 2024-06-02T04:02:58.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.369+0000 7fc2dcd54700 1 -- 172.21.15.123:0/2864029736 wait complete. 2024-06-02T04:02:58.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.369+0000 7fc2dcd54700 1 Processor -- start 2024-06-02T04:02:58.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.369+0000 7fc2dcd54700 1 -- start start 2024-06-02T04:02:58.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.370+0000 7fc2dcd54700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2d80ff120 0x7fc2d8101a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:58.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.370+0000 7fc2dcd54700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2d81020f0 0x7fc2d81000a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:58.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.370+0000 7fc2dcd54700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2d8102a90 0x7fc2d81005e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:58.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.370+0000 7fc2dcd54700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d8100d80 con 0x7fc2d8102a90 2024-06-02T04:02:58.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.370+0000 7fc2dcd54700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d8100ef0 con 0x7fc2d81020f0 2024-06-02T04:02:58.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.370+0000 7fc2dcd54700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d81a0e80 con 0x7fc2d80ff120 2024-06-02T04:02:58.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.370+0000 7fc2d6d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2d8102a90 0x7fc2d81005e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:58.371 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.370+0000 7fc2d6d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2d8102a90 0x7fc2d81005e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33530/0 (socket says 172.21.15.123:33530) 2024-06-02T04:02:58.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.370+0000 7fc2d6d9d700 1 -- 172.21.15.123:0/3009898862 learned_addr learned my addr 172.21.15.123:0/3009898862 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:02:58.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.370+0000 7fc2d5d9b700 1 --2- 172.21.15.123:0/3009898862 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2d81020f0 0x7fc2d81000a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:58.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.370+0000 7fc2d659c700 1 --2- 172.21.15.123:0/3009898862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2d80ff120 0x7fc2d8101a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:58.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.370+0000 7fc2d6d9d700 1 -- 172.21.15.123:0/3009898862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2d80ff120 msgr2=0x7fc2d8101a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:58.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.370+0000 7fc2d6d9d700 1 --2- 172.21.15.123:0/3009898862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2d80ff120 0x7fc2d8101a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:58.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.370+0000 7fc2d6d9d700 1 -- 172.21.15.123:0/3009898862 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2d81020f0 msgr2=0x7fc2d81000a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:58.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.370+0000 7fc2d6d9d700 1 --2- 172.21.15.123:0/3009898862 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2d81020f0 0x7fc2d81000a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:58.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.370+0000 7fc2d6d9d700 1 -- 172.21.15.123:0/3009898862 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2cc0095f0 con 0x7fc2d8102a90 2024-06-02T04:02:58.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.370+0000 7fc2d6d9d700 1 --2- 172.21.15.123:0/3009898862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2d8102a90 0x7fc2d81005e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc2d000ef30 tx=0x7fc2d000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:02:58.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.370+0000 7fc2c77fe700 1 -- 172.21.15.123:0/3009898862 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0018070 con 0x7fc2d8102a90 2024-06-02T04:02:58.372 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.370+0000 7fc2c77fe700 1 -- 172.21.15.123:0/3009898862 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc2d000f040 con 0x7fc2d8102a90 2024-06-02T04:02:58.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.370+0000 7fc2dcd54700 1 -- 172.21.15.123:0/3009898862 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d81a10b0 con 0x7fc2d8102a90 2024-06-02T04:02:58.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.370+0000 7fc2c77fe700 1 -- 172.21.15.123:0/3009898862 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d000cca0 con 0x7fc2d8102a90 2024-06-02T04:02:58.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.370+0000 7fc2dcd54700 1 -- 172.21.15.123:0/3009898862 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d81a1570 con 0x7fc2d8102a90 2024-06-02T04:02:58.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.371+0000 7fc2dcd54700 1 -- 172.21.15.123:0/3009898862 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d8108420 con 0x7fc2d8102a90 2024-06-02T04:02:58.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.373+0000 7fc2c77fe700 1 -- 172.21.15.123:0/3009898862 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fc2d0003a00 con 0x7fc2d8102a90 2024-06-02T04:02:58.373 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.373+0000 7fc2c77fe700 1 --2- 172.21.15.123:0/3009898862 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc2c00a1120 0x7fc2c00a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:02:58.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.373+0000 7fc2d659c700 1 --2- 172.21.15.123:0/3009898862 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc2c00a1120 0x7fc2c00a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:02:58.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.373+0000 7fc2c77fe700 1 -- 172.21.15.123:0/3009898862 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc2d00cc9d0 con 0x7fc2d8102a90 2024-06-02T04:02:58.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.373+0000 7fc2d659c700 1 --2- 172.21.15.123:0/3009898862 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc2c00a1120 0x7fc2c00a35e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc000c00 tx=0x7fc2cc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:02:58.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.377+0000 7fc2c77fe700 1 -- 172.21.15.123:0/3009898862 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc2d0096690 con 0x7fc2d8102a90 2024-06-02T04:02:58.519 INFO:journalctl@ceph.mds.g.smithi123.stdout:Jun 02 04:02:58 smithi123 ceph-mds[93284]: -- 172.21.15.123:0/273766970 <== mon.0 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e21dca61a0 con 0x55e21dc7c800 2024-06-02T04:02:58.634 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.636+0000 7fc2dcd54700 1 -- 172.21.15.123:0/3009898862 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2d8067380 con 0x7fc2d8102a90 2024-06-02T04:02:58.635 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.636+0000 7fc2c77fe700 1 -- 172.21.15.123:0/3009898862 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7336 (secure 0 0 0) 0x7fc2d0099cb0 con 0x7fc2d8102a90 2024-06-02T04:02:58.635 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:02:58.635 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1940848601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1940848601},{"type":"v1","addr":"172.21.15.123:6835","nonce":1940848601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/54447879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":54447879},{"type":"v1","addr":"172.21.15.123:6837","nonce":54447879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/2006585076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2006585076},{"type":"v1","addr":"172.21.15.136:6833","nonce":2006585076}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3583622784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3583622784},{"type":"v1","addr":"172.21.15.162:6833","nonce":3583622784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2894031422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2894031422},{"type":"v1","addr":"172.21.15.136:6835","nonce":2894031422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2478943987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2478943987},{"type":"v1","addr":"172.21.15.162:6835","nonce":2478943987}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24469,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3402138468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3402138468},{"type":"v1","addr":"172.21.15.162:6837","nonce":3402138468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24473,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/2572418263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2572418263},{"type":"v1","addr":"172.21.15.136:6837","nonce":2572418263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24490,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/2588884232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2588884232},{"type":"v1","addr":"172.21.15.162:6839","nonce":2588884232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2024-06-02T04:02:58.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.638+0000 7fc2dcd54700 1 -- 172.21.15.123:0/3009898862 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc2c00a1120 msgr2=0x7fc2c00a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:58.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.638+0000 7fc2dcd54700 1 --2- 172.21.15.123:0/3009898862 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc2c00a1120 0x7fc2c00a35e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc000c00 tx=0x7fc2cc005fb0 comp rx=0 tx=0).stop 2024-06-02T04:02:58.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.638+0000 7fc2dcd54700 1 -- 172.21.15.123:0/3009898862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2d8102a90 msgr2=0x7fc2d81005e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:02:58.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.638+0000 7fc2dcd54700 1 --2- 172.21.15.123:0/3009898862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2d8102a90 0x7fc2d81005e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc2d000ef30 tx=0x7fc2d000c3a0 comp rx=0 tx=0).stop 2024-06-02T04:02:58.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.638+0000 7fc2dcd54700 1 -- 172.21.15.123:0/3009898862 shutdown_connections 2024-06-02T04:02:58.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.638+0000 7fc2dcd54700 1 --2- 172.21.15.123:0/3009898862 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc2d8102a90 0x7fc2d81005e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:58.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.638+0000 7fc2dcd54700 1 --2- 172.21.15.123:0/3009898862 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2d80ff120 0x7fc2d8101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:58.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.638+0000 7fc2dcd54700 1 --2- 172.21.15.123:0/3009898862 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc2c00a1120 0x7fc2c00a35e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:58.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.638+0000 7fc2dcd54700 1 --2- 172.21.15.123:0/3009898862 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2d81020f0 0x7fc2d81000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:02:58.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.638+0000 7fc2dcd54700 1 -- 172.21.15.123:0/3009898862 >> 172.21.15.123:0/3009898862 conn(0x7fc2d80faa70 msgr2=0x7fc2d8105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:02:58.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.638+0000 7fc2dcd54700 1 -- 172.21.15.123:0/3009898862 shutdown_connections 2024-06-02T04:02:58.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:02:58.638+0000 7fc2dcd54700 1 -- 172.21.15.123:0/3009898862 wait complete. 2024-06-02T04:02:58.638 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 10 2024-06-02T04:02:58.822 INFO:journalctl@ceph.mds.g.smithi123.stdout:Jun 02 04:02:58 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-g[93241]: starting mds.g at 2024-06-02T04:02:58.822 INFO:journalctl@ceph.mds.g.smithi123.stdout:Jun 02 04:02:58 smithi123 bash[93203]: 78d9983c43e492e06d06a8c4b850eb8dbbf127b1e706cff10f28d064fb4fec09 2024-06-02T04:02:58.823 INFO:journalctl@ceph.mds.g.smithi123.stdout:Jun 02 04:02:58 smithi123 systemd[1]: Started Ceph mds.g for 1b432ae0-2094-11ef-bc9b-c7b262605968. 2024-06-02T04:02:59.872 INFO:journalctl@ceph.mds.a.smithi123.stdout:Jun 02 04:02:59 smithi123 systemd[1]: Starting Ceph mds.a for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:02:59.873 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:59 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:59.873 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:59 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:59.873 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:59 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:02:59.873 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:59 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:02:59.873 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:59 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:02:59.873 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:59 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:02:59.873 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:59 smithi123 ceph-mon[42885]: Deploying daemon mds.a on smithi123 2024-06-02T04:02:59.873 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:59 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/3009898862' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:02:59.874 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:59 smithi123 ceph-mon[42885]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:02:59.874 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:59 smithi123 ceph-mon[42885]: mds.? [v2:172.21.15.123:6838/3806973328,v1:172.21.15.123:6839/3806973328] up:boot 2024-06-02T04:02:59.874 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:59 smithi123 ceph-mon[42885]: fsmap 10 up:standby 2024-06-02T04:02:59.874 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:02:59 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-02T04:03:00.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:59 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:00.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:59 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:00.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:59 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:00.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:59 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:03:00.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:59 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:03:00.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:59 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:03:00.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:59 smithi162 ceph-mon[47009]: Deploying daemon mds.a on smithi123 2024-06-02T04:03:00.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:59 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/3009898862' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:03:00.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:59 smithi162 ceph-mon[47009]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:03:00.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:59 smithi162 ceph-mon[47009]: mds.? [v2:172.21.15.123:6838/3806973328,v1:172.21.15.123:6839/3806973328] up:boot 2024-06-02T04:03:00.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:59 smithi162 ceph-mon[47009]: fsmap 10 up:standby 2024-06-02T04:03:00.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:02:59 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-02T04:03:00.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:59 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:00.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:59 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:00.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:59 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:00.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:59 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:03:00.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:59 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:03:00.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:59 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:03:00.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:59 smithi136 ceph-mon[47443]: Deploying daemon mds.a on smithi123 2024-06-02T04:03:00.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:59 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/3009898862' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:03:00.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:59 smithi136 ceph-mon[47443]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:03:00.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:59 smithi136 ceph-mon[47443]: mds.? [v2:172.21.15.123:6838/3806973328,v1:172.21.15.123:6839/3806973328] up:boot 2024-06-02T04:03:00.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:59 smithi136 ceph-mon[47443]: fsmap 10 up:standby 2024-06-02T04:03:00.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:02:59 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-02T04:03:00.572 INFO:journalctl@ceph.mds.a.smithi123.stdout:Jun 02 04:03:00 smithi123 ceph-mds[93636]: -- 172.21.15.123:0/3229358557 <== mon.0 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f6ef3001a0 con 0x55f6ef2d6800 2024-06-02T04:03:00.572 INFO:journalctl@ceph.mds.a.smithi123.stdout:Jun 02 04:03:00 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-a[93605]: starting mds.a at 2024-06-02T04:03:00.572 INFO:journalctl@ceph.mds.a.smithi123.stdout:Jun 02 04:03:00 smithi123 bash[93590]: 39356571bbaec1d478704d4ea7c231a3e8b3b7827f0b64927466a387a8fcb19f 2024-06-02T04:03:00.572 INFO:journalctl@ceph.mds.a.smithi123.stdout:Jun 02 04:03:00 smithi123 systemd[1]: Started Ceph mds.a for 1b432ae0-2094-11ef-bc9b-c7b262605968. 2024-06-02T04:03:00.653 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:03:00.783 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.782+0000 7f3a34542700 1 -- 172.21.15.123:0/2537968163 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a2c101fd0 msgr2=0x7f3a2c102450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:00.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.782+0000 7f3a34542700 1 --2- 172.21.15.123:0/2537968163 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a2c101fd0 0x7f3a2c102450 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009990 tx=0x7f3a1c009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:00.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.782+0000 7f3a34542700 1 -- 172.21.15.123:0/2537968163 shutdown_connections 2024-06-02T04:03:00.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.782+0000 7f3a34542700 1 --2- 172.21.15.123:0/2537968163 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a2c102990 0x7f3a2c1092b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:00.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.782+0000 7f3a34542700 1 --2- 172.21.15.123:0/2537968163 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a2c100e80 0x7f3a2c1012a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:00.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.782+0000 7f3a34542700 1 --2- 172.21.15.123:0/2537968163 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a2c101fd0 0x7f3a2c102450 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:00.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.782+0000 7f3a34542700 1 -- 172.21.15.123:0/2537968163 >> 172.21.15.123:0/2537968163 conn(0x7f3a2c0fc410 msgr2=0x7f3a2c0fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:00.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.782+0000 7f3a34542700 1 -- 172.21.15.123:0/2537968163 shutdown_connections 2024-06-02T04:03:00.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.782+0000 7f3a34542700 1 -- 172.21.15.123:0/2537968163 wait complete. 2024-06-02T04:03:00.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.783+0000 7f3a34542700 1 Processor -- start 2024-06-02T04:03:00.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.783+0000 7f3a34542700 1 -- start start 2024-06-02T04:03:00.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.783+0000 7f3a34542700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a2c100e80 0x7f3a2c196e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:00.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.783+0000 7f3a34542700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a2c101fd0 0x7f3a2c197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:00.784 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.783+0000 7f3a34542700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a2c102990 0x7f3a2c19e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:00.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.783+0000 7f3a34542700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c19e900 con 0x7f3a2c100e80 2024-06-02T04:03:00.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.783+0000 7f3a34542700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c19ea70 con 0x7f3a2c101fd0 2024-06-02T04:03:00.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.783+0000 7f3a34542700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2c19ec30 con 0x7f3a2c102990 2024-06-02T04:03:00.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.783+0000 7f3a322de700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a2c100e80 0x7f3a2c196e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:00.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.783+0000 7f3a322de700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a2c100e80 0x7f3a2c196e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33586/0 (socket says 172.21.15.123:33586) 2024-06-02T04:03:00.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.783+0000 7f3a322de700 1 -- 172.21.15.123:0/4275037953 learned_addr learned my addr 172.21.15.123:0/4275037953 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:00.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.783+0000 7f3a31add700 1 --2- 172.21.15.123:0/4275037953 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a2c101fd0 0x7f3a2c197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:00.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.783+0000 7f3a32adf700 1 --2- 172.21.15.123:0/4275037953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a2c102990 0x7f3a2c19e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:00.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.784+0000 7f3a322de700 1 -- 172.21.15.123:0/4275037953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a2c102990 msgr2=0x7f3a2c19e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:00.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.784+0000 7f3a322de700 1 --2- 172.21.15.123:0/4275037953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a2c102990 0x7f3a2c19e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:00.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.784+0000 7f3a322de700 1 -- 172.21.15.123:0/4275037953 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a2c101fd0 msgr2=0x7f3a2c197350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:00.785 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.784+0000 7f3a322de700 1 --2- 172.21.15.123:0/4275037953 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a2c101fd0 0x7f3a2c197350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:00.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.784+0000 7f3a322de700 1 -- 172.21.15.123:0/4275037953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1c0095f0 con 0x7f3a2c100e80 2024-06-02T04:03:00.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.784+0000 7f3a322de700 1 --2- 172.21.15.123:0/4275037953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a2c100e80 0x7f3a2c196e10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3a2800e9a0 tx=0x7f3a2800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:00.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.784+0000 7f3a237fe700 1 -- 172.21.15.123:0/4275037953 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a28009790 con 0x7f3a2c100e80 2024-06-02T04:03:00.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.784+0000 7f3a237fe700 1 -- 172.21.15.123:0/4275037953 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a28010430 con 0x7f3a2c100e80 2024-06-02T04:03:00.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.784+0000 7f3a34542700 1 -- 172.21.15.123:0/4275037953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a2c19ef10 con 0x7f3a2c100e80 2024-06-02T04:03:00.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.784+0000 7f3a237fe700 1 -- 172.21.15.123:0/4275037953 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a28018680 con 0x7f3a2c100e80 2024-06-02T04:03:00.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.784+0000 7f3a34542700 1 -- 172.21.15.123:0/4275037953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a2c19f330 con 0x7f3a2c100e80 2024-06-02T04:03:00.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.785+0000 7f3a34542700 1 -- 172.21.15.123:0/4275037953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a2c1082a0 con 0x7f3a2c100e80 2024-06-02T04:03:00.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.786+0000 7f3a237fe700 1 -- 172.21.15.123:0/4275037953 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f3a280105a0 con 0x7f3a2c100e80 2024-06-02T04:03:00.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.786+0000 7f3a237fe700 1 --2- 172.21.15.123:0/4275037953 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3a180a11a0 0x7f3a180a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:00.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.786+0000 7f3a31add700 1 --2- 172.21.15.123:0/4275037953 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3a180a11a0 0x7f3a180a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:00.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.787+0000 7f3a237fe700 1 -- 172.21.15.123:0/4275037953 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f3a28014070 con 0x7f3a2c100e80 2024-06-02T04:03:00.787 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.787+0000 7f3a31add700 1 --2- 172.21.15.123:0/4275037953 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3a180a11a0 0x7f3a180a3660 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00b2e0 tx=0x7f3a1c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:00.789 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:00.790+0000 7f3a237fe700 1 -- 172.21.15.123:0/4275037953 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3a28096410 con 0x7f3a2c100e80 2024-06-02T04:03:01.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:01.029+0000 7f3a34542700 1 -- 172.21.15.123:0/4275037953 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a2c067c10 con 0x7f3a2c100e80 2024-06-02T04:03:01.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:01.030+0000 7f3a237fe700 1 -- 172.21.15.123:0/4275037953 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+8858 (secure 0 0 0) 0x7f3a28099a30 con 0x7f3a2c100e80 2024-06-02T04:03:01.028 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:03:01.029 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1940848601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1940848601},{"type":"v1","addr":"172.21.15.123:6835","nonce":1940848601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/54447879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":54447879},{"type":"v1","addr":"172.21.15.123:6837","nonce":54447879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/3806973328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":3806973328},{"type":"v1","addr":"172.21.15.123:6839","nonce":3806973328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/4032992994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":4032992994},{"type":"v1","addr":"172.21.15.123:6841","nonce":4032992994}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/2006585076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2006585076},{"type":"v1","addr":"172.21.15.136:6833","nonce":2006585076}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3583622784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3583622784},{"type":"v1","addr":"172.21.15.162:6833","nonce":3583622784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2894031422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2894031422},{"type":"v1","addr":"172.21.15.136:6835","nonce":2894031422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2478943987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2478943987},{"type":"v1","addr":"172.21.15.162:6835","nonce":2478943987}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24469,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3402138468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3402138468},{"type":"v1","addr":"172.21.15.162:6837","nonce":3402138468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24473,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/2572418263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2572418263},{"type":"v1","addr":"172.21.15.136:6837","nonce":2572418263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24490,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/2588884232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2588884232},{"type":"v1","addr":"172.21.15.162:6839","nonce":2588884232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2024-06-02T04:03:01.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:01.032+0000 7f3a34542700 1 -- 172.21.15.123:0/4275037953 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3a180a11a0 msgr2=0x7f3a180a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:01.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:01.032+0000 7f3a34542700 1 --2- 172.21.15.123:0/4275037953 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3a180a11a0 0x7f3a180a3660 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00b2e0 tx=0x7f3a1c005fb0 comp rx=0 tx=0).stop 2024-06-02T04:03:01.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:01.032+0000 7f3a34542700 1 -- 172.21.15.123:0/4275037953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a2c100e80 msgr2=0x7f3a2c196e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:01.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:01.032+0000 7f3a34542700 1 --2- 172.21.15.123:0/4275037953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a2c100e80 0x7f3a2c196e10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3a2800e9a0 tx=0x7f3a2800ecb0 comp rx=0 tx=0).stop 2024-06-02T04:03:01.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:01.032+0000 7f3a34542700 1 -- 172.21.15.123:0/4275037953 shutdown_connections 2024-06-02T04:03:01.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:01.032+0000 7f3a34542700 1 --2- 172.21.15.123:0/4275037953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a2c102990 0x7f3a2c19e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:01.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:01.032+0000 7f3a34542700 1 --2- 172.21.15.123:0/4275037953 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3a2c100e80 0x7f3a2c196e10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:01.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:01.032+0000 7f3a34542700 1 --2- 172.21.15.123:0/4275037953 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3a180a11a0 0x7f3a180a3660 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:01.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:01.032+0000 7f3a34542700 1 --2- 172.21.15.123:0/4275037953 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3a2c101fd0 0x7f3a2c197350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:01.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:01.032+0000 7f3a34542700 1 -- 172.21.15.123:0/4275037953 >> 172.21.15.123:0/4275037953 conn(0x7f3a2c0fc410 msgr2=0x7f3a2c1053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:01.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:01.032+0000 7f3a34542700 1 -- 172.21.15.123:0/4275037953 shutdown_connections 2024-06-02T04:03:01.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:01.032+0000 7f3a34542700 1 -- 172.21.15.123:0/4275037953 wait complete. 2024-06-02T04:03:01.033 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 12 2024-06-02T04:03:01.539 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:01.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:01.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:01.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:03:01.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:03:01.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:03:01.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:01 smithi136 ceph-mon[47443]: Deploying daemon mds.b on smithi136 2024-06-02T04:03:01.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:01 smithi136 ceph-mon[47443]: mds.? [v2:172.21.15.123:6840/4032992994,v1:172.21.15.123:6841/4032992994] up:boot 2024-06-02T04:03:01.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:01 smithi136 ceph-mon[47443]: fsmap 11 up:standby 2024-06-02T04:03:01.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:01 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-02T04:03:01.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:01 smithi136 ceph-mon[47443]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:03:01.540 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:01 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/4275037953' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:03:01.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:01.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:01.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:01.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:03:01.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:03:01.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:03:01.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:01 smithi162 ceph-mon[47009]: Deploying daemon mds.b on smithi136 2024-06-02T04:03:01.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:01 smithi162 ceph-mon[47009]: mds.? [v2:172.21.15.123:6840/4032992994,v1:172.21.15.123:6841/4032992994] up:boot 2024-06-02T04:03:01.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:01 smithi162 ceph-mon[47009]: fsmap 11 up:standby 2024-06-02T04:03:01.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:01 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-02T04:03:01.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:01 smithi162 ceph-mon[47009]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:03:01.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:01 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/4275037953' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:03:01.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:01.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:01.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:01.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-06-02T04:03:01.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-06-02T04:03:01.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:03:01.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:01 smithi123 ceph-mon[42885]: Deploying daemon mds.b on smithi136 2024-06-02T04:03:01.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:01 smithi123 ceph-mon[42885]: mds.? [v2:172.21.15.123:6840/4032992994,v1:172.21.15.123:6841/4032992994] up:boot 2024-06-02T04:03:01.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:01 smithi123 ceph-mon[42885]: fsmap 11 up:standby 2024-06-02T04:03:01.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:01 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-02T04:03:01.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:01 smithi123 ceph-mon[42885]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:03:01.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:01 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/4275037953' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:03:02.088 INFO:journalctl@ceph.mds.b.smithi136.stdout:Jun 02 04:03:01 smithi136 systemd[1]: Starting Ceph mds.b for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:03:02.588 INFO:journalctl@ceph.mds.b.smithi136.stdout:Jun 02 04:03:02 smithi136 ceph-mds[84790]: -- 172.21.15.136:0/3000845361 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55dafa6cc1a0 con 0x55dafa6a2800 2024-06-02T04:03:02.588 INFO:journalctl@ceph.mds.b.smithi136.stdout:Jun 02 04:03:02 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-b[84767]: starting mds.b at 2024-06-02T04:03:02.588 INFO:journalctl@ceph.mds.b.smithi136.stdout:Jun 02 04:03:02 smithi136 bash[84753]: e98c99a69da7e51c8dc309a028afa650ba29961f2e0757a07a67eacc62645bd9 2024-06-02T04:03:02.588 INFO:journalctl@ceph.mds.b.smithi136.stdout:Jun 02 04:03:02 smithi136 systemd[1]: Started Ceph mds.b for 1b432ae0-2094-11ef-bc9b-c7b262605968. 2024-06-02T04:03:03.045 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:03:03.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.177+0000 7ff372f78700 1 -- 172.21.15.123:0/4203124686 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff36c0ffd90 msgr2=0x7ff36c1001b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:03.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.177+0000 7ff372f78700 1 --2- 172.21.15.123:0/4203124686 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff36c0ffd90 0x7ff36c1001b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff360009920 tx=0x7ff360009c30 comp rx=0 tx=0).stop 2024-06-02T04:03:03.178 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.177+0000 7ff372f78700 1 -- 172.21.15.123:0/4203124686 shutdown_connections 2024-06-02T04:03:03.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.177+0000 7ff372f78700 1 --2- 172.21.15.123:0/4203124686 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff36c101920 0x7ff36c1081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:03.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.177+0000 7ff372f78700 1 --2- 172.21.15.123:0/4203124686 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff36c0ffd90 0x7ff36c1001b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:03.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.177+0000 7ff372f78700 1 --2- 172.21.15.123:0/4203124686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff36c100f80 0x7ff36c1013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:03.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.177+0000 7ff372f78700 1 -- 172.21.15.123:0/4203124686 >> 172.21.15.123:0/4203124686 conn(0x7ff36c0fb300 msgr2=0x7ff36c0fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:03.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.177+0000 7ff372f78700 1 -- 172.21.15.123:0/4203124686 shutdown_connections 2024-06-02T04:03:03.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.177+0000 7ff372f78700 1 -- 172.21.15.123:0/4203124686 wait complete. 2024-06-02T04:03:03.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.178+0000 7ff372f78700 1 Processor -- start 2024-06-02T04:03:03.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.178+0000 7ff372f78700 1 -- start start 2024-06-02T04:03:03.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.178+0000 7ff372f78700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff36c0ffd90 0x7ff36c069ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:03.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.178+0000 7ff372f78700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff36c100f80 0x7ff36c19e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:03.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.178+0000 7ff372f78700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff36c101920 0x7ff36c1a05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:03.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.178+0000 7ff372f78700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c1a0bd0 con 0x7ff36c101920 2024-06-02T04:03:03.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.178+0000 7ff372f78700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c1a0d10 con 0x7ff36c100f80 2024-06-02T04:03:03.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.178+0000 7ff372f78700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c1a0ed0 con 0x7ff36c0ffd90 2024-06-02T04:03:03.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.178+0000 7ff371515700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff36c101920 0x7ff36c1a05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:03.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.178+0000 7ff371515700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff36c101920 0x7ff36c1a05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33600/0 (socket says 172.21.15.123:33600) 2024-06-02T04:03:03.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.178+0000 7ff371515700 1 -- 172.21.15.123:0/3714589550 learned_addr learned my addr 172.21.15.123:0/3714589550 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:03.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.178+0000 7ff36bfff700 1 --2- 172.21.15.123:0/3714589550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff36c100f80 0x7ff36c19e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:03.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.178+0000 7ff370d14700 1 --2- 172.21.15.123:0/3714589550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff36c0ffd90 0x7ff36c069ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:03.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.178+0000 7ff371515700 1 -- 172.21.15.123:0/3714589550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff36c0ffd90 msgr2=0x7ff36c069ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:03.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.178+0000 7ff371515700 1 --2- 172.21.15.123:0/3714589550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff36c0ffd90 0x7ff36c069ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:03.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.178+0000 7ff371515700 1 -- 172.21.15.123:0/3714589550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff36c100f80 msgr2=0x7ff36c19e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:03.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.178+0000 7ff371515700 1 --2- 172.21.15.123:0/3714589550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff36c100f80 0x7ff36c19e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:03.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.178+0000 7ff371515700 1 -- 172.21.15.123:0/3714589550 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff364009d00 con 0x7ff36c101920 2024-06-02T04:03:03.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.179+0000 7ff371515700 1 --2- 172.21.15.123:0/3714589550 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff36c101920 0x7ff36c1a05c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff36400e3c0 tx=0x7ff36400e6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:03.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.179+0000 7ff369ffb700 1 -- 172.21.15.123:0/3714589550 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3640092d0 con 0x7ff36c101920 2024-06-02T04:03:03.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.179+0000 7ff369ffb700 1 -- 172.21.15.123:0/3714589550 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff36400f040 con 0x7ff36c101920 2024-06-02T04:03:03.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.179+0000 7ff372f78700 1 -- 172.21.15.123:0/3714589550 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff360009520 con 0x7ff36c101920 2024-06-02T04:03:03.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.179+0000 7ff369ffb700 1 -- 172.21.15.123:0/3714589550 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff364007cc0 con 0x7ff36c101920 2024-06-02T04:03:03.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.179+0000 7ff372f78700 1 -- 172.21.15.123:0/3714589550 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff36c1a1530 con 0x7ff36c101920 2024-06-02T04:03:03.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.180+0000 7ff372f78700 1 -- 172.21.15.123:0/3714589550 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff36c1072b0 con 0x7ff36c101920 2024-06-02T04:03:03.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.181+0000 7ff369ffb700 1 -- 172.21.15.123:0/3714589550 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7ff364004ad0 con 0x7ff36c101920 2024-06-02T04:03:03.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.182+0000 7ff369ffb700 1 --2- 172.21.15.123:0/3714589550 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff35c0a1120 0x7ff35c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:03.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.182+0000 7ff370d14700 1 --2- 172.21.15.123:0/3714589550 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff35c0a1120 0x7ff35c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:03.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.182+0000 7ff369ffb700 1 -- 172.21.15.123:0/3714589550 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff3640cc5a0 con 0x7ff36c101920 2024-06-02T04:03:03.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.182+0000 7ff370d14700 1 --2- 172.21.15.123:0/3714589550 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff35c0a1120 0x7ff35c0a35e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff3600098f0 tx=0x7ff360019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:03.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.186+0000 7ff369ffb700 1 -- 172.21.15.123:0/3714589550 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff3640961c0 con 0x7ff36c101920 2024-06-02T04:03:03.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:03 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:03.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:03 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:03.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:03 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:03.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:03 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:03.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:03 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:03.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:03 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:03:03.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:03 smithi123 ceph-mon[42885]: mds.? [v2:172.21.15.136:6838/952830191,v1:172.21.15.136:6839/952830191] up:boot 2024-06-02T04:03:03.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:03 smithi123 ceph-mon[42885]: fsmap 12 up:standby 2024-06-02T04:03:03.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:03 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-02T04:03:03.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:03 smithi123 ceph-mon[42885]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:03:03.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.484+0000 7ff372f78700 1 -- 172.21.15.123:0/3714589550 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff36c068060 con 0x7ff36c101920 2024-06-02T04:03:03.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.485+0000 7ff369ffb700 1 -- 172.21.15.123:0/3714589550 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+9616 (secure 0 0 0) 0x7ff3640997e0 con 0x7ff36c101920 2024-06-02T04:03:03.484 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:03:03.484 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1940848601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1940848601},{"type":"v1","addr":"172.21.15.123:6835","nonce":1940848601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/54447879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":54447879},{"type":"v1","addr":"172.21.15.123:6837","nonce":54447879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14613,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6839/3806973328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":3806973328},{"type":"v1","addr":"172.21.15.123:6839","nonce":3806973328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6841/4032992994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":4032992994},{"type":"v1","addr":"172.21.15.123:6841","nonce":4032992994}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24437,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6833/2006585076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2006585076},{"type":"v1","addr":"172.21.15.136:6833","nonce":2006585076}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24439,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6833/3583622784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3583622784},{"type":"v1","addr":"172.21.15.162:6833","nonce":3583622784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2894031422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2894031422},{"type":"v1","addr":"172.21.15.136:6835","nonce":2894031422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2478943987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2478943987},{"type":"v1","addr":"172.21.15.162:6835","nonce":2478943987}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24469,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3402138468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3402138468},{"type":"v1","addr":"172.21.15.162:6837","nonce":3402138468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24473,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/2572418263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2572418263},{"type":"v1","addr":"172.21.15.136:6837","nonce":2572418263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24490,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/2588884232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2588884232},{"type":"v1","addr":"172.21.15.162:6839","nonce":2588884232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24509,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6839/952830191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":952830191},{"type":"v1","addr":"172.21.15.136:6839","nonce":952830191}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[]} 2024-06-02T04:03:03.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.487+0000 7ff372f78700 1 -- 172.21.15.123:0/3714589550 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff35c0a1120 msgr2=0x7ff35c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:03.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.487+0000 7ff372f78700 1 --2- 172.21.15.123:0/3714589550 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff35c0a1120 0x7ff35c0a35e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff3600098f0 tx=0x7ff360019040 comp rx=0 tx=0).stop 2024-06-02T04:03:03.486 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.487+0000 7ff372f78700 1 -- 172.21.15.123:0/3714589550 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff36c101920 msgr2=0x7ff36c1a05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:03.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.487+0000 7ff372f78700 1 --2- 172.21.15.123:0/3714589550 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff36c101920 0x7ff36c1a05c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff36400e3c0 tx=0x7ff36400e6d0 comp rx=0 tx=0).stop 2024-06-02T04:03:03.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.487+0000 7ff372f78700 1 -- 172.21.15.123:0/3714589550 shutdown_connections 2024-06-02T04:03:03.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.487+0000 7ff372f78700 1 --2- 172.21.15.123:0/3714589550 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff36c101920 0x7ff36c1a05c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:03.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.487+0000 7ff372f78700 1 --2- 172.21.15.123:0/3714589550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff36c0ffd90 0x7ff36c069ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:03.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.487+0000 7ff372f78700 1 --2- 172.21.15.123:0/3714589550 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff35c0a1120 0x7ff35c0a35e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:03.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.487+0000 7ff372f78700 1 --2- 172.21.15.123:0/3714589550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff36c100f80 0x7ff36c19e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:03.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.487+0000 7ff372f78700 1 -- 172.21.15.123:0/3714589550 >> 172.21.15.123:0/3714589550 conn(0x7ff36c0fb300 msgr2=0x7ff36c1043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:03.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.487+0000 7ff372f78700 1 -- 172.21.15.123:0/3714589550 shutdown_connections 2024-06-02T04:03:03.487 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.487+0000 7ff372f78700 1 -- 172.21.15.123:0/3714589550 wait complete. 2024-06-02T04:03:03.487 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 13 2024-06-02T04:03:03.501 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:03:03.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:03 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:03.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:03 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:03.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:03 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:03.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:03 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:03.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:03 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:03.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:03 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:03:03.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:03 smithi162 ceph-mon[47009]: mds.? [v2:172.21.15.136:6838/952830191,v1:172.21.15.136:6839/952830191] up:boot 2024-06-02T04:03:03.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:03 smithi162 ceph-mon[47009]: fsmap 12 up:standby 2024-06-02T04:03:03.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:03 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-02T04:03:03.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:03 smithi162 ceph-mon[47009]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:03:03.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:03 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:03.672 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:03 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:03.672 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:03 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:03.672 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:03 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:03.672 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:03 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:03.672 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:03 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:03:03.672 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:03 smithi136 ceph-mon[47443]: mds.? [v2:172.21.15.136:6838/952830191,v1:172.21.15.136:6839/952830191] up:boot 2024-06-02T04:03:03.672 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:03 smithi136 ceph-mon[47443]: fsmap 12 up:standby 2024-06-02T04:03:03.672 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:03 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-02T04:03:03.672 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:03 smithi136 ceph-mon[47443]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:03:03.675 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.632+0000 7f1098f39700 1 -- 172.21.15.123:0/2421484791 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1094101070 msgr2=0x7f1094107920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.632+0000 7f1098f39700 1 --2- 172.21.15.123:0/2421484791 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1094101070 0x7f1094107920 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f108c00c240 tx=0x7f108c00c550 comp rx=0 tx=0).stop 2024-06-02T04:03:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.632+0000 7f1098f39700 1 -- 172.21.15.123:0/2421484791 shutdown_connections 2024-06-02T04:03:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.632+0000 7f1098f39700 1 --2- 172.21.15.123:0/2421484791 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1094101070 0x7f1094107920 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.632+0000 7f1098f39700 1 --2- 172.21.15.123:0/2421484791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10940ff4e0 0x7f10940ff900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.632+0000 7f1098f39700 1 --2- 172.21.15.123:0/2421484791 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10941006d0 0x7f1094100b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.632+0000 7f1098f39700 1 -- 172.21.15.123:0/2421484791 >> 172.21.15.123:0/2421484791 conn(0x7f10940faa70 msgr2=0x7f10940fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.632+0000 7f1098f39700 1 -- 172.21.15.123:0/2421484791 shutdown_connections 2024-06-02T04:03:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.632+0000 7f1098f39700 1 -- 172.21.15.123:0/2421484791 wait complete. 2024-06-02T04:03:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.633+0000 7f1098f39700 1 Processor -- start 2024-06-02T04:03:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.633+0000 7f1098f39700 1 -- start start 2024-06-02T04:03:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.633+0000 7f1098f39700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10940ff4e0 0x7f1094196ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:03.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.633+0000 7f1098f39700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10941006d0 0x7f1094197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:03.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.633+0000 7f1098f39700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1094101070 0x7f109419e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:03.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.633+0000 7f1098f39700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109419ea10 con 0x7f10941006d0 2024-06-02T04:03:03.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.633+0000 7f1098f39700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109419eb50 con 0x7f1094101070 2024-06-02T04:03:03.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.633+0000 7f1098f39700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109419ece0 con 0x7f10940ff4e0 2024-06-02T04:03:03.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.633+0000 7f1091d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10941006d0 0x7f1094197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:03.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.633+0000 7f1091d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10941006d0 0x7f1094197420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33608/0 (socket says 172.21.15.123:33608) 2024-06-02T04:03:03.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.633+0000 7f1091d9b700 1 -- 172.21.15.123:0/869066117 learned_addr learned my addr 172.21.15.123:0/869066117 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:03.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.633+0000 7f109259c700 1 --2- 172.21.15.123:0/869066117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10940ff4e0 0x7f1094196ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:03.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.633+0000 7f1092d9d700 1 --2- 172.21.15.123:0/869066117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1094101070 0x7f109419e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:03.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.633+0000 7f1091d9b700 1 -- 172.21.15.123:0/869066117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10940ff4e0 msgr2=0x7f1094196ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:03.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.633+0000 7f1091d9b700 1 --2- 172.21.15.123:0/869066117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10940ff4e0 0x7f1094196ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:03.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.633+0000 7f1091d9b700 1 -- 172.21.15.123:0/869066117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1094101070 msgr2=0x7f109419e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:03.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.633+0000 7f1091d9b700 1 --2- 172.21.15.123:0/869066117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1094101070 0x7f109419e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:03.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.633+0000 7f1091d9b700 1 -- 172.21.15.123:0/869066117 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108c00ae10 con 0x7f10941006d0 2024-06-02T04:03:03.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.633+0000 7f109259c700 1 --2- 172.21.15.123:0/869066117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10940ff4e0 0x7f1094196ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:03:03.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.633+0000 7f1092d9d700 1 --2- 172.21.15.123:0/869066117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1094101070 0x7f109419e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:03:03.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.634+0000 7f1091d9b700 1 --2- 172.21.15.123:0/869066117 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10941006d0 0x7f1094197420 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f108800e9a0 tx=0x7f108800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:03.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.634+0000 7f10837fe700 1 -- 172.21.15.123:0/869066117 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1088009790 con 0x7f10941006d0 2024-06-02T04:03:03.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.634+0000 7f1098f39700 1 -- 172.21.15.123:0/869066117 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f109419efc0 con 0x7f10941006d0 2024-06-02T04:03:03.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.634+0000 7f10837fe700 1 -- 172.21.15.123:0/869066117 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f108800cbd0 con 0x7f10941006d0 2024-06-02T04:03:03.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.634+0000 7f10837fe700 1 -- 172.21.15.123:0/869066117 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1088018680 con 0x7f10941006d0 2024-06-02T04:03:03.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.634+0000 7f1098f39700 1 -- 172.21.15.123:0/869066117 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f109419f490 con 0x7f10941006d0 2024-06-02T04:03:03.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.635+0000 7f1098f39700 1 -- 172.21.15.123:0/869066117 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1094106890 con 0x7f10941006d0 2024-06-02T04:03:03.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.636+0000 7f10837fe700 1 -- 172.21.15.123:0/869066117 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f108800cd40 con 0x7f10941006d0 2024-06-02T04:03:03.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.636+0000 7f10837fe700 1 --2- 172.21.15.123:0/869066117 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f107c0a11a0 0x7f107c0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:03.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.637+0000 7f109259c700 1 --2- 172.21.15.123:0/869066117 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f107c0a11a0 0x7f107c0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:03.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.637+0000 7f10837fe700 1 -- 172.21.15.123:0/869066117 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f1088014070 con 0x7f10941006d0 2024-06-02T04:03:03.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.637+0000 7f109259c700 1 --2- 172.21.15.123:0/869066117 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f107c0a11a0 0x7f107c0a3660 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1094100530 tx=0x7f1084009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:03.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.640+0000 7f10837fe700 1 -- 172.21.15.123:0/869066117 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1088096850 con 0x7f10941006d0 2024-06-02T04:03:03.843 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.844+0000 7f1098f39700 1 -- 172.21.15.123:0/869066117 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1094067380 con 0x7f10941006d0 2024-06-02T04:03:03.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.845+0000 7f10837fe700 1 -- 172.21.15.123:0/869066117 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+18478 (secure 0 0 0) 0x7f1088099e70 con 0x7f10941006d0 2024-06-02T04:03:03.844 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:03:03.844 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":78,"fsid":"1b432ae0-2094-11ef-bc9b-c7b262605968","created":"2024-06-02T03:57:17.383774+0000","modified":"2024-06-02T04:02:35.537597+0000","last_up_change":"2024-06-02T04:02:34.535591+0000","last_in_change":"2024-06-02T04:02:18.346560+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T03:59:57.079448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d9d8fb5a-dac5-4b14-98e5-665bdbc696ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6803","nonce":2763421276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6805","nonce":2763421276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6809","nonce":2763421276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6807","nonce":2763421276}]},"public_addr":"172.21.15.123:6803/2763421276","cluster_addr":"172.21.15.123:6805/2763421276","heartbeat_back_addr":"172.21.15.123:6809/2763421276","heartbeat_front_addr":"172.21.15.123:6807/2763421276","state":["exists","up"]},{"osd":1,"uuid":"121bbe3c-bb76-4ec4-9596-37db68fbf1ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6801","nonce":956325510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6803","nonce":956325510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6807","nonce":956325510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6805","nonce":956325510}]},"public_addr":"172.21.15.136:6801/956325510","cluster_addr":"172.21.15.136:6803/956325510","heartbeat_back_addr":"172.21.15.136:6807/956325510","heartbeat_front_addr":"172.21.15.136:6805/956325510","state":["exists","up"]},{"osd":2,"uuid":"df9edf0d-f9f0-4699-a6ed-bbcf2dfb1b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6801","nonce":2915749676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6803","nonce":2915749676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6807","nonce":2915749676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6805","nonce":2915749676}]},"public_addr":"172.21.15.162:6801/2915749676","cluster_addr":"172.21.15.162:6803/2915749676","heartbeat_back_addr":"172.21.15.162:6807/2915749676","heartbeat_front_addr":"172.21.15.162:6805/2915749676","state":["exists","up"]},{"osd":3,"uuid":"3e070364-12c6-4780-b2be-f6e933e65773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6811","nonce":1403773143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6813","nonce":1403773143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6817","nonce":1403773143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6815","nonce":1403773143}]},"public_addr":"172.21.15.123:6811/1403773143","cluster_addr":"172.21.15.123:6813/1403773143","heartbeat_back_addr":"172.21.15.123:6817/1403773143","heartbeat_front_addr":"172.21.15.123:6815/1403773143","state":["exists","up"]},{"osd":4,"uuid":"87dd92dd-73c8-4785-bf8a-3756d79dee90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6809","nonce":1403526782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6811","nonce":1403526782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6815","nonce":1403526782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6813","nonce":1403526782}]},"public_addr":"172.21.15.136:6809/1403526782","cluster_addr":"172.21.15.136:6811/1403526782","heartbeat_back_addr":"172.21.15.136:6815/1403526782","heartbeat_front_addr":"172.21.15.136:6813/1403526782","state":["exists","up"]},{"osd":5,"uuid":"1a730863-6b56-43b7-a115-c80d3c8f3ee3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6809","nonce":3094256489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6811","nonce":3094256489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6815","nonce":3094256489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6813","nonce":3094256489}]},"public_addr":"172.21.15.162:6809/3094256489","cluster_addr":"172.21.15.162:6811/3094256489","heartbeat_back_addr":"172.21.15.162:6815/3094256489","heartbeat_front_addr":"172.21.15.162:6813/3094256489","state":["exists","up"]},{"osd":6,"uuid":"6f170b85-6c47-49ff-ba5b-7fe0596a4ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6819","nonce":3025820432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6821","nonce":3025820432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6825","nonce":3025820432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6823","nonce":3025820432}]},"public_addr":"172.21.15.123:6819/3025820432","cluster_addr":"172.21.15.123:6821/3025820432","heartbeat_back_addr":"172.21.15.123:6825/3025820432","heartbeat_front_addr":"172.21.15.123:6823/3025820432","state":["exists","up"]},{"osd":7,"uuid":"ee66bb7a-6c0d-4e5a-b717-258a39f93a87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6817","nonce":1948829505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6819","nonce":1948829505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6823","nonce":1948829505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6821","nonce":1948829505}]},"public_addr":"172.21.15.136:6817/1948829505","cluster_addr":"172.21.15.136:6819/1948829505","heartbeat_back_addr":"172.21.15.136:6823/1948829505","heartbeat_front_addr":"172.21.15.136:6821/1948829505","state":["exists","up"]},{"osd":8,"uuid":"0ff77e33-53a5-43ef-85da-2036a1fcdb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6817","nonce":1590839230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6819","nonce":1590839230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6823","nonce":1590839230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6821","nonce":1590839230}]},"public_addr":"172.21.15.162:6817/1590839230","cluster_addr":"172.21.15.162:6819/1590839230","heartbeat_back_addr":"172.21.15.162:6823/1590839230","heartbeat_front_addr":"172.21.15.162:6821/1590839230","state":["exists","up"]},{"osd":9,"uuid":"1670731c-5e8f-4cbc-8f35-6aeb14ea3075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6827","nonce":608720685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6829","nonce":608720685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6833","nonce":608720685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6831","nonce":608720685}]},"public_addr":"172.21.15.123:6827/608720685","cluster_addr":"172.21.15.123:6829/608720685","heartbeat_back_addr":"172.21.15.123:6833/608720685","heartbeat_front_addr":"172.21.15.123:6831/608720685","state":["exists","up"]},{"osd":10,"uuid":"ae138b96-13e7-46ac-9d4d-48308132465d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6825","nonce":3777263126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6827","nonce":3777263126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6831","nonce":3777263126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6829","nonce":3777263126}]},"public_addr":"172.21.15.136:6825/3777263126","cluster_addr":"172.21.15.136:6827/3777263126","heartbeat_back_addr":"172.21.15.136:6831/3777263126","heartbeat_front_addr":"172.21.15.136:6829/3777263126","state":["exists","up"]},{"osd":11,"uuid":"69f4ede0-7e9b-4edb-be54-01f74f002a06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6825","nonce":704809754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6827","nonce":704809754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6831","nonce":704809754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6829","nonce":704809754}]},"public_addr":"172.21.15.162:6825/704809754","cluster_addr":"172.21.15.162:6827/704809754","heartbeat_back_addr":"172.21.15.162:6831/704809754","heartbeat_front_addr":"172.21.15.162:6829/704809754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:19.188506+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:36.535261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:54.242294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:11.815314+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:29.512086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:46.874319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:04.437358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:22.312520+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:39.917998+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:57.340043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:15.252797+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:32.898924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:0/69783025":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/10165744":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/2081407856":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/4026642298":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/1442330765":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/1595718606":"2024-06-03T03:57:45.611046+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:03:03.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.847+0000 7f1098f39700 1 -- 172.21.15.123:0/869066117 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f107c0a11a0 msgr2=0x7f107c0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:03.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.847+0000 7f1098f39700 1 --2- 172.21.15.123:0/869066117 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f107c0a11a0 0x7f107c0a3660 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1094100530 tx=0x7f1084009260 comp rx=0 tx=0).stop 2024-06-02T04:03:03.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.847+0000 7f1098f39700 1 -- 172.21.15.123:0/869066117 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10941006d0 msgr2=0x7f1094197420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:03.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.847+0000 7f1098f39700 1 --2- 172.21.15.123:0/869066117 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10941006d0 0x7f1094197420 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f108800e9a0 tx=0x7f108800ed60 comp rx=0 tx=0).stop 2024-06-02T04:03:03.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.847+0000 7f1098f39700 1 -- 172.21.15.123:0/869066117 shutdown_connections 2024-06-02T04:03:03.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.847+0000 7f1098f39700 1 --2- 172.21.15.123:0/869066117 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f107c0a11a0 0x7f107c0a3660 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:03.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.847+0000 7f1098f39700 1 --2- 172.21.15.123:0/869066117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1094101070 0x7f109419e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:03.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.847+0000 7f1098f39700 1 --2- 172.21.15.123:0/869066117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10940ff4e0 0x7f1094196ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:03.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.847+0000 7f1098f39700 1 --2- 172.21.15.123:0/869066117 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10941006d0 0x7f1094197420 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:03.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.847+0000 7f1098f39700 1 -- 172.21.15.123:0/869066117 >> 172.21.15.123:0/869066117 conn(0x7f10940faa70 msgr2=0x7f10941039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:03.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.847+0000 7f1098f39700 1 -- 172.21.15.123:0/869066117 shutdown_connections 2024-06-02T04:03:03.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.847+0000 7f1098f39700 1 -- 172.21.15.123:0/869066117 wait complete. 2024-06-02T04:03:03.859 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T03:59:57.079448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-02T04:03:03.859 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-02T04:03:03.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.986+0000 7f31fab66700 1 -- 172.21.15.123:0/1700734770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f31f4101970 msgr2=0x7f31f4108290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:03.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.986+0000 7f31fab66700 1 --2- 172.21.15.123:0/1700734770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f31f4101970 0x7f31f4108290 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f31ec00b0a0 tx=0x7f31ec00b3b0 comp rx=0 tx=0).stop 2024-06-02T04:03:03.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.986+0000 7f31fab66700 1 -- 172.21.15.123:0/1700734770 shutdown_connections 2024-06-02T04:03:03.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.986+0000 7f31fab66700 1 --2- 172.21.15.123:0/1700734770 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f31f4101970 0x7f31f4108290 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:03.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.986+0000 7f31fab66700 1 --2- 172.21.15.123:0/1700734770 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31f40ffe60 0x7f31f4100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:03.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.986+0000 7f31fab66700 1 --2- 172.21.15.123:0/1700734770 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31f4100fb0 0x7f31f4101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:03.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.986+0000 7f31fab66700 1 -- 172.21.15.123:0/1700734770 >> 172.21.15.123:0/1700734770 conn(0x7f31f40fb3f0 msgr2=0x7f31f40fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:03.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.986+0000 7f31fab66700 1 -- 172.21.15.123:0/1700734770 shutdown_connections 2024-06-02T04:03:03.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.986+0000 7f31fab66700 1 -- 172.21.15.123:0/1700734770 wait complete. 2024-06-02T04:03:03.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.987+0000 7f31fab66700 1 Processor -- start 2024-06-02T04:03:03.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.987+0000 7f31fab66700 1 -- start start 2024-06-02T04:03:03.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.987+0000 7f31fab66700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31f40ffe60 0x7f31f4195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:03.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.987+0000 7f31fab66700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f31f4100fb0 0x7f31f4196400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:03.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.987+0000 7f31fab66700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31f4101970 0x7f31f419d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:03.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.987+0000 7f31fab66700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f419d9f0 con 0x7f31f4100fb0 2024-06-02T04:03:03.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.987+0000 7f31fab66700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f419db30 con 0x7f31f4101970 2024-06-02T04:03:03.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.987+0000 7f31fab66700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f419dcc0 con 0x7f31f40ffe60 2024-06-02T04:03:03.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.987+0000 7f31f3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f31f4100fb0 0x7f31f4196400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:03.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.987+0000 7f31f3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f31f4100fb0 0x7f31f4196400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33628/0 (socket says 172.21.15.123:33628) 2024-06-02T04:03:03.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.987+0000 7f31f3fff700 1 -- 172.21.15.123:0/3408764722 learned_addr learned my addr 172.21.15.123:0/3408764722 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:03.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.987+0000 7f31f9103700 1 --2- 172.21.15.123:0/3408764722 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31f4101970 0x7f31f419d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:03.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.987+0000 7f31f8902700 1 --2- 172.21.15.123:0/3408764722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31f40ffe60 0x7f31f4195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:03.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.988+0000 7f31f3fff700 1 -- 172.21.15.123:0/3408764722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31f40ffe60 msgr2=0x7f31f4195ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:03.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.988+0000 7f31f3fff700 1 --2- 172.21.15.123:0/3408764722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31f40ffe60 0x7f31f4195ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:03.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.988+0000 7f31f3fff700 1 -- 172.21.15.123:0/3408764722 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31f4101970 msgr2=0x7f31f419d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:03.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.988+0000 7f31f3fff700 1 --2- 172.21.15.123:0/3408764722 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31f4101970 0x7f31f419d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:03.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.988+0000 7f31f3fff700 1 -- 172.21.15.123:0/3408764722 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ec009d00 con 0x7f31f4100fb0 2024-06-02T04:03:03.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.988+0000 7f31f9103700 1 --2- 172.21.15.123:0/3408764722 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31f4101970 0x7f31f419d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:03:03.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.988+0000 7f31f3fff700 1 --2- 172.21.15.123:0/3408764722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f31f4100fb0 0x7f31f4196400 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f31e000d980 tx=0x7f31e000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:03.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.988+0000 7f31f1ffb700 1 -- 172.21.15.123:0/3408764722 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e0004220 con 0x7f31f4100fb0 2024-06-02T04:03:03.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.988+0000 7f31f1ffb700 1 -- 172.21.15.123:0/3408764722 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f31e0007640 con 0x7f31f4100fb0 2024-06-02T04:03:03.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.988+0000 7f31fab66700 1 -- 172.21.15.123:0/3408764722 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f419dfa0 con 0x7f31f4100fb0 2024-06-02T04:03:03.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.988+0000 7f31f1ffb700 1 -- 172.21.15.123:0/3408764722 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e0005610 con 0x7f31f4100fb0 2024-06-02T04:03:03.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.988+0000 7f31fab66700 1 -- 172.21.15.123:0/3408764722 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f419e420 con 0x7f31f4100fb0 2024-06-02T04:03:03.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.989+0000 7f31fab66700 1 -- 172.21.15.123:0/3408764722 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f4107200 con 0x7f31f4100fb0 2024-06-02T04:03:03.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.991+0000 7f31f1ffb700 1 -- 172.21.15.123:0/3408764722 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f31e0004750 con 0x7f31f4100fb0 2024-06-02T04:03:03.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.992+0000 7f31f1ffb700 1 --2- 172.21.15.123:0/3408764722 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f31e40a1120 0x7f31e40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:03.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.992+0000 7f31f8902700 1 --2- 172.21.15.123:0/3408764722 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f31e40a1120 0x7f31e40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:03.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.992+0000 7f31f1ffb700 1 -- 172.21.15.123:0/3408764722 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f31e00cc1f0 con 0x7f31f4100fb0 2024-06-02T04:03:03.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.992+0000 7f31f8902700 1 --2- 172.21.15.123:0/3408764722 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f31e40a1120 0x7f31e40a35e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f31e800bbd0 tx=0x7f31e800b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:03.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:03.996+0000 7f31f1ffb700 1 -- 172.21.15.123:0/3408764722 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f31e0095e20 con 0x7f31f4100fb0 2024-06-02T04:03:04.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.210+0000 7f31fab66700 1 -- 172.21.15.123:0/3408764722 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f31f410b660 con 0x7f31f4100fb0 2024-06-02T04:03:04.209 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.210+0000 7f31f1ffb700 1 -- 172.21.15.123:0/3408764722 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7f31e0099440 con 0x7f31f4100fb0 2024-06-02T04:03:04.209 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-06-02T04:03:04.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.212+0000 7f31fab66700 1 -- 172.21.15.123:0/3408764722 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f31e40a1120 msgr2=0x7f31e40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:04.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.212+0000 7f31fab66700 1 --2- 172.21.15.123:0/3408764722 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f31e40a1120 0x7f31e40a35e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f31e800bbd0 tx=0x7f31e800b5b0 comp rx=0 tx=0).stop 2024-06-02T04:03:04.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.212+0000 7f31fab66700 1 -- 172.21.15.123:0/3408764722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f31f4100fb0 msgr2=0x7f31f4196400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:04.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.212+0000 7f31fab66700 1 --2- 172.21.15.123:0/3408764722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f31f4100fb0 0x7f31f4196400 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f31e000d980 tx=0x7f31e000dc90 comp rx=0 tx=0).stop 2024-06-02T04:03:04.211 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.212+0000 7f31fab66700 1 -- 172.21.15.123:0/3408764722 shutdown_connections 2024-06-02T04:03:04.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.212+0000 7f31fab66700 1 --2- 172.21.15.123:0/3408764722 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f31e40a1120 0x7f31e40a35e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:04.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.212+0000 7f31fab66700 1 --2- 172.21.15.123:0/3408764722 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f31f4101970 0x7f31f419d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:04.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.212+0000 7f31fab66700 1 --2- 172.21.15.123:0/3408764722 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31f40ffe60 0x7f31f4195ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:04.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.212+0000 7f31fab66700 1 --2- 172.21.15.123:0/3408764722 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f31f4100fb0 0x7f31f4196400 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:04.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.212+0000 7f31fab66700 1 -- 172.21.15.123:0/3408764722 >> 172.21.15.123:0/3408764722 conn(0x7f31f40fb3f0 msgr2=0x7f31f4104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:04.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.213+0000 7f31fab66700 1 -- 172.21.15.123:0/3408764722 shutdown_connections 2024-06-02T04:03:04.212 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.213+0000 7f31fab66700 1 -- 172.21.15.123:0/3408764722 wait complete. 2024-06-02T04:03:04.225 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-06-02T04:03:04.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.351+0000 7f372b83a700 1 -- 172.21.15.123:0/617484817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3724100280 msgr2=0x7f37241006a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:04.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.351+0000 7f372b83a700 1 --2- 172.21.15.123:0/617484817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3724100280 0x7f37241006a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3720009990 tx=0x7f3720009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:04.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.351+0000 7f372b83a700 1 -- 172.21.15.123:0/617484817 shutdown_connections 2024-06-02T04:03:04.353 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.351+0000 7f372b83a700 1 --2- 172.21.15.123:0/617484817 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3724101950 0x7f37241081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:04.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.351+0000 7f372b83a700 1 --2- 172.21.15.123:0/617484817 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3724100280 0x7f37241006a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:04.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.351+0000 7f372b83a700 1 --2- 172.21.15.123:0/617484817 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3724100f90 0x7f3724101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:04.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.351+0000 7f372b83a700 1 -- 172.21.15.123:0/617484817 >> 172.21.15.123:0/617484817 conn(0x7f37240faa70 msgr2=0x7f37240fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:04.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.351+0000 7f372b83a700 1 -- 172.21.15.123:0/617484817 shutdown_connections 2024-06-02T04:03:04.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.351+0000 7f372b83a700 1 -- 172.21.15.123:0/617484817 wait complete. 2024-06-02T04:03:04.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.352+0000 7f372b83a700 1 Processor -- start 2024-06-02T04:03:04.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.352+0000 7f372b83a700 1 -- start start 2024-06-02T04:03:04.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.352+0000 7f372b83a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3724100280 0x7f3724195d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:04.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.352+0000 7f372b83a700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3724100f90 0x7f3724196280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:04.354 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.352+0000 7f372b83a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3724101950 0x7f372419d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:04.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.352+0000 7f372b83a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372419d830 con 0x7f3724101950 2024-06-02T04:03:04.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.352+0000 7f372b83a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372419d9a0 con 0x7f3724100280 2024-06-02T04:03:04.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.352+0000 7f372b83a700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372419db60 con 0x7f3724100f90 2024-06-02T04:03:04.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.352+0000 7f3729dd7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3724101950 0x7f372419d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:04.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.352+0000 7f3729dd7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3724101950 0x7f372419d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46978/0 (socket says 172.21.15.123:46978) 2024-06-02T04:03:04.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.352+0000 7f3729dd7700 1 -- 172.21.15.123:0/1215892787 learned_addr learned my addr 172.21.15.123:0/1215892787 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:04.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.352+0000 7f37295d6700 1 --2- 172.21.15.123:0/1215892787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3724100280 0x7f3724195d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:04.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.352+0000 7f3728dd5700 1 --2- 172.21.15.123:0/1215892787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3724100f90 0x7f3724196280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:04.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.352+0000 7f3729dd7700 1 -- 172.21.15.123:0/1215892787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3724100f90 msgr2=0x7f3724196280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:04.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.352+0000 7f3729dd7700 1 --2- 172.21.15.123:0/1215892787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3724100f90 0x7f3724196280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:04.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.352+0000 7f3729dd7700 1 -- 172.21.15.123:0/1215892787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3724100280 msgr2=0x7f3724195d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:04.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.352+0000 7f3729dd7700 1 --2- 172.21.15.123:0/1215892787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3724100280 0x7f3724195d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:04.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.352+0000 7f3729dd7700 1 -- 172.21.15.123:0/1215892787 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37200095f0 con 0x7f3724101950 2024-06-02T04:03:04.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.352+0000 7f37295d6700 1 --2- 172.21.15.123:0/1215892787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3724100280 0x7f3724195d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:03:04.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.352+0000 7f3728dd5700 1 --2- 172.21.15.123:0/1215892787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3724100f90 0x7f3724196280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:03:04.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.353+0000 7f3729dd7700 1 --2- 172.21.15.123:0/1215892787 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3724101950 0x7f372419d260 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f371c00e580 tx=0x7f371c00e890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:04.356 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.353+0000 7f371a7fc700 1 -- 172.21.15.123:0/1215892787 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c004db0 con 0x7f3724101950 2024-06-02T04:03:04.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.353+0000 7f372b83a700 1 -- 172.21.15.123:0/1215892787 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37240fee30 con 0x7f3724101950 2024-06-02T04:03:04.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.353+0000 7f371a7fc700 1 -- 172.21.15.123:0/1215892787 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f371c0090d0 con 0x7f3724101950 2024-06-02T04:03:04.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.353+0000 7f371a7fc700 1 -- 172.21.15.123:0/1215892787 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c0045f0 con 0x7f3724101950 2024-06-02T04:03:04.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.353+0000 7f372b83a700 1 -- 172.21.15.123:0/1215892787 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37240ff390 con 0x7f3724101950 2024-06-02T04:03:04.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.354+0000 7f372b83a700 1 -- 172.21.15.123:0/1215892787 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3724067380 con 0x7f3724101950 2024-06-02T04:03:04.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.356+0000 7f371a7fc700 1 -- 172.21.15.123:0/1215892787 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f371c009240 con 0x7f3724101950 2024-06-02T04:03:04.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.356+0000 7f371a7fc700 1 --2- 172.21.15.123:0/1215892787 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f37100a1120 0x7f37100a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:04.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.356+0000 7f37295d6700 1 --2- 172.21.15.123:0/1215892787 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f37100a1120 0x7f37100a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:04.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.356+0000 7f371a7fc700 1 -- 172.21.15.123:0/1215892787 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f371c016070 con 0x7f3724101950 2024-06-02T04:03:04.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.357+0000 7f37295d6700 1 --2- 172.21.15.123:0/1215892787 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f37100a1120 0x7f37100a35e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f37241971c0 tx=0x7f3720005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:04.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.359+0000 7f371a7fc700 1 -- 172.21.15.123:0/1215892787 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f371c0981d0 con 0x7f3724101950 2024-06-02T04:03:04.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:04 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/3714589550' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:03:04.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:04 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:04.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:04 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:04.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:04 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:04.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:04 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:04.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:04 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:04.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:04 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:04.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:04 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/869066117' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:03:04.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:04 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:03:04.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:04 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:03:04.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:04 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:04.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:04 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:03:04.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:04 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/3408764722' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:03:04.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:04 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/3714589550' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:03:04.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:04 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:04.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:04 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:04.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:04 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:04.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:04 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:04.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:04 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:04.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:04 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:04.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:04 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/869066117' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:03:04.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:04 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:03:04.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:04 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:03:04.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:04 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:04.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:04 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:03:04.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:04 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/3408764722' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:03:04.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:04 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/3714589550' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:03:04.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:04 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:04.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:04 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:04.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:04 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:04.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:04 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:04.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:04 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:04.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:04 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:04.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:04 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/869066117' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:03:04.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:04 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:03:04.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:04 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:03:04.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:04 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:04.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:04 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:03:04.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:04 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/3408764722' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:03:04.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.590+0000 7f372b83a700 1 -- 172.21.15.123:0/1215892787 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f372410b5e0 con 0x7f3724101950 2024-06-02T04:03:04.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.590+0000 7f371a7fc700 1 -- 172.21.15.123:0/1215892787 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v78) v1 ==== 84+0+65 (secure 0 0 0) 0x7f371c09b7f0 con 0x7f3724101950 2024-06-02T04:03:04.590 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:03:04.590 INFO:teuthology.orchestra.run.smithi123.stdout:[ 2024-06-02T04:03:04.590 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:03:04.590 INFO:teuthology.orchestra.run.smithi123.stdout: "poolnum": 1, 2024-06-02T04:03:04.590 INFO:teuthology.orchestra.run.smithi123.stdout: "poolname": ".mgr" 2024-06-02T04:03:04.590 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:03:04.590 INFO:teuthology.orchestra.run.smithi123.stdout:] 2024-06-02T04:03:04.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.593+0000 7f372b83a700 1 -- 172.21.15.123:0/1215892787 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f37100a1120 msgr2=0x7f37100a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:04.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.593+0000 7f372b83a700 1 --2- 172.21.15.123:0/1215892787 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f37100a1120 0x7f37100a35e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f37241971c0 tx=0x7f3720005fb0 comp rx=0 tx=0).stop 2024-06-02T04:03:04.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.593+0000 7f372b83a700 1 -- 172.21.15.123:0/1215892787 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3724101950 msgr2=0x7f372419d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:04.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.593+0000 7f372b83a700 1 --2- 172.21.15.123:0/1215892787 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3724101950 0x7f372419d260 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f371c00e580 tx=0x7f371c00e890 comp rx=0 tx=0).stop 2024-06-02T04:03:04.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.593+0000 7f372b83a700 1 -- 172.21.15.123:0/1215892787 shutdown_connections 2024-06-02T04:03:04.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.593+0000 7f372b83a700 1 --2- 172.21.15.123:0/1215892787 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3724101950 0x7f372419d260 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:04.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.593+0000 7f372b83a700 1 --2- 172.21.15.123:0/1215892787 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f37100a1120 0x7f37100a35e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:04.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.593+0000 7f372b83a700 1 --2- 172.21.15.123:0/1215892787 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3724100280 0x7f3724195d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:04.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.593+0000 7f372b83a700 1 --2- 172.21.15.123:0/1215892787 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3724100f90 0x7f3724196280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:04.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.593+0000 7f372b83a700 1 -- 172.21.15.123:0/1215892787 >> 172.21.15.123:0/1215892787 conn(0x7f37240faa70 msgr2=0x7f3724104300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:04.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.593+0000 7f372b83a700 1 -- 172.21.15.123:0/1215892787 shutdown_connections 2024-06-02T04:03:04.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.593+0000 7f372b83a700 1 -- 172.21.15.123:0/1215892787 wait complete. 2024-06-02T04:03:04.604 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-06-02T04:03:04.604 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-06-02T04:03:04.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.737+0000 7fc5a2a21700 1 -- 172.21.15.123:0/3252853013 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc59c101a40 msgr2=0x7fc59c103e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:04.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.737+0000 7fc5a2a21700 1 --2- 172.21.15.123:0/3252853013 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc59c101a40 0x7fc59c103e30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc58c009990 tx=0x7fc58c009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:04.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.737+0000 7fc5a2a21700 1 -- 172.21.15.123:0/3252853013 shutdown_connections 2024-06-02T04:03:04.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.737+0000 7fc5a2a21700 1 --2- 172.21.15.123:0/3252853013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc59c106ca0 0x7fc59c1090b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:04.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.737+0000 7fc5a2a21700 1 --2- 172.21.15.123:0/3252853013 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc59c101a40 0x7fc59c103e30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:04.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.737+0000 7fc5a2a21700 1 --2- 172.21.15.123:0/3252853013 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc59c104370 0x7fc59c106760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:04.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.737+0000 7fc5a2a21700 1 -- 172.21.15.123:0/3252853013 >> 172.21.15.123:0/3252853013 conn(0x7fc59c0fb3f0 msgr2=0x7fc59c0fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:04.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.737+0000 7fc5a2a21700 1 -- 172.21.15.123:0/3252853013 shutdown_connections 2024-06-02T04:03:04.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.737+0000 7fc5a2a21700 1 -- 172.21.15.123:0/3252853013 wait complete. 2024-06-02T04:03:04.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.737+0000 7fc5a2a21700 1 Processor -- start 2024-06-02T04:03:04.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.737+0000 7fc5a2a21700 1 -- start start 2024-06-02T04:03:04.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.738+0000 7fc5a2a21700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc59c101a40 0x7fc59c196ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:04.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.738+0000 7fc5a2a21700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc59c104370 0x7fc59c1973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:04.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.738+0000 7fc5a2a21700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc59c106ca0 0x7fc59c19e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:04.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.738+0000 7fc5a2a21700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c19e9d0 con 0x7fc59c104370 2024-06-02T04:03:04.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.738+0000 7fc5a2a21700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c19eb10 con 0x7fc59c106ca0 2024-06-02T04:03:04.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.738+0000 7fc5a2a21700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c19eca0 con 0x7fc59c101a40 2024-06-02T04:03:04.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.738+0000 7fc59b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc59c104370 0x7fc59c1973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:04.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.738+0000 7fc59b7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc59c104370 0x7fc59c1973e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46992/0 (socket says 172.21.15.123:46992) 2024-06-02T04:03:04.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.738+0000 7fc59bfff700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc59c101a40 0x7fc59c196ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:04.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.738+0000 7fc59b7fe700 1 -- 172.21.15.123:0/826558701 learned_addr learned my addr 172.21.15.123:0/826558701 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:04.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.738+0000 7fc5a0fbe700 1 --2- 172.21.15.123:0/826558701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc59c106ca0 0x7fc59c19e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:04.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.738+0000 7fc59b7fe700 1 -- 172.21.15.123:0/826558701 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc59c101a40 msgr2=0x7fc59c196ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:04.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.738+0000 7fc59b7fe700 1 --2- 172.21.15.123:0/826558701 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc59c101a40 0x7fc59c196ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:04.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.738+0000 7fc59b7fe700 1 -- 172.21.15.123:0/826558701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc59c106ca0 msgr2=0x7fc59c19e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:04.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.738+0000 7fc59b7fe700 1 --2- 172.21.15.123:0/826558701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc59c106ca0 0x7fc59c19e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:04.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.738+0000 7fc59b7fe700 1 -- 172.21.15.123:0/826558701 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58c0095f0 con 0x7fc59c104370 2024-06-02T04:03:04.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.738+0000 7fc59b7fe700 1 --2- 172.21.15.123:0/826558701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc59c104370 0x7fc59c1973e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc59000e9a0 tx=0x7fc59000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:04.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.738+0000 7fc5997fa700 1 -- 172.21.15.123:0/826558701 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc590009790 con 0x7fc59c104370 2024-06-02T04:03:04.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.739+0000 7fc5997fa700 1 -- 172.21.15.123:0/826558701 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc590010430 con 0x7fc59c104370 2024-06-02T04:03:04.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.739+0000 7fc5a2a21700 1 -- 172.21.15.123:0/826558701 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc59c19ef80 con 0x7fc59c104370 2024-06-02T04:03:04.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.739+0000 7fc5997fa700 1 -- 172.21.15.123:0/826558701 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc590018680 con 0x7fc59c104370 2024-06-02T04:03:04.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.739+0000 7fc5a2a21700 1 -- 172.21.15.123:0/826558701 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc59c19f450 con 0x7fc59c104370 2024-06-02T04:03:04.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.740+0000 7fc5a2a21700 1 -- 172.21.15.123:0/826558701 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc59c0fcf70 con 0x7fc59c104370 2024-06-02T04:03:04.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.741+0000 7fc5997fa700 1 -- 172.21.15.123:0/826558701 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fc5900105a0 con 0x7fc59c104370 2024-06-02T04:03:04.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.741+0000 7fc5997fa700 1 --2- 172.21.15.123:0/826558701 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc5840a11a0 0x7fc5840a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:04.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.742+0000 7fc59bfff700 1 --2- 172.21.15.123:0/826558701 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc5840a11a0 0x7fc5840a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:04.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.742+0000 7fc5997fa700 1 -- 172.21.15.123:0/826558701 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc590014070 con 0x7fc59c104370 2024-06-02T04:03:04.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.742+0000 7fc59bfff700 1 --2- 172.21.15.123:0/826558701 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc5840a11a0 0x7fc5840a3660 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc58c00b2e0 tx=0x7fc58c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:04.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.746+0000 7fc5997fa700 1 -- 172.21.15.123:0/826558701 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc590052d60 con 0x7fc59c104370 2024-06-02T04:03:04.953 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:04.954+0000 7fc5a2a21700 1 -- 172.21.15.123:0/826558701 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc59c10c850 con 0x7fc59c104370 2024-06-02T04:03:05.256 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.256+0000 7fc5997fa700 1 -- 172.21.15.123:0/826558701 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v79) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc590099c40 con 0x7fc59c104370 2024-06-02T04:03:05.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.264+0000 7fc5a2a21700 1 -- 172.21.15.123:0/826558701 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc5840a11a0 msgr2=0x7fc5840a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:05.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.264+0000 7fc5a2a21700 1 --2- 172.21.15.123:0/826558701 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc5840a11a0 0x7fc5840a3660 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc58c00b2e0 tx=0x7fc58c005fd0 comp rx=0 tx=0).stop 2024-06-02T04:03:05.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.264+0000 7fc5a2a21700 1 -- 172.21.15.123:0/826558701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc59c104370 msgr2=0x7fc59c1973e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:05.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.264+0000 7fc5a2a21700 1 --2- 172.21.15.123:0/826558701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc59c104370 0x7fc59c1973e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc59000e9a0 tx=0x7fc59000ecb0 comp rx=0 tx=0).stop 2024-06-02T04:03:05.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.264+0000 7fc5a2a21700 1 -- 172.21.15.123:0/826558701 shutdown_connections 2024-06-02T04:03:05.263 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.264+0000 7fc5a2a21700 1 --2- 172.21.15.123:0/826558701 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc5840a11a0 0x7fc5840a3660 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:05.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.264+0000 7fc5a2a21700 1 --2- 172.21.15.123:0/826558701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc59c106ca0 0x7fc59c19e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:05.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.264+0000 7fc5a2a21700 1 --2- 172.21.15.123:0/826558701 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc59c101a40 0x7fc59c196ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:05.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.264+0000 7fc5a2a21700 1 --2- 172.21.15.123:0/826558701 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc59c104370 0x7fc59c1973e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:05.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.264+0000 7fc5a2a21700 1 -- 172.21.15.123:0/826558701 >> 172.21.15.123:0/826558701 conn(0x7fc59c0fb3f0 msgr2=0x7fc59c1038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:05.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.264+0000 7fc5a2a21700 1 -- 172.21.15.123:0/826558701 shutdown_connections 2024-06-02T04:03:05.264 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.264+0000 7fc5a2a21700 1 -- 172.21.15.123:0/826558701 wait complete. 2024-06-02T04:03:05.264 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' created 2024-06-02T04:03:05.277 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-06-02T04:03:05.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.414+0000 7fc289ad8700 1 -- 172.21.15.123:0/1035437085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc284100fb0 msgr2=0x7fc284101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:05.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.414+0000 7fc289ad8700 1 --2- 172.21.15.123:0/1035437085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc284100fb0 0x7fc284101430 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc274009990 tx=0x7fc274009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:05.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.414+0000 7fc289ad8700 1 -- 172.21.15.123:0/1035437085 shutdown_connections 2024-06-02T04:03:05.415 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.414+0000 7fc289ad8700 1 --2- 172.21.15.123:0/1035437085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc284101970 0x7fc284108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:05.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.414+0000 7fc289ad8700 1 --2- 172.21.15.123:0/1035437085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc2840ffe60 0x7fc284100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:05.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.414+0000 7fc289ad8700 1 --2- 172.21.15.123:0/1035437085 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc284100fb0 0x7fc284101430 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:05.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.414+0000 7fc289ad8700 1 -- 172.21.15.123:0/1035437085 >> 172.21.15.123:0/1035437085 conn(0x7fc2840fb3f0 msgr2=0x7fc2840fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:05.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.414+0000 7fc289ad8700 1 -- 172.21.15.123:0/1035437085 shutdown_connections 2024-06-02T04:03:05.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.414+0000 7fc289ad8700 1 -- 172.21.15.123:0/1035437085 wait complete. 2024-06-02T04:03:05.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.415+0000 7fc289ad8700 1 Processor -- start 2024-06-02T04:03:05.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.415+0000 7fc289ad8700 1 -- start start 2024-06-02T04:03:05.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.415+0000 7fc289ad8700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2840ffe60 0x7fc284103d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:05.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.415+0000 7fc289ad8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc284100fb0 0x7fc284102420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:05.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.415+0000 7fc289ad8700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc284101970 0x7fc284102960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:05.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.415+0000 7fc289ad8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc284103060 con 0x7fc284100fb0 2024-06-02T04:03:05.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.415+0000 7fc289ad8700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2841031d0 con 0x7fc2840ffe60 2024-06-02T04:03:05.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.415+0000 7fc289ad8700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2841a0ee0 con 0x7fc284101970 2024-06-02T04:03:05.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.415+0000 7fc282ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc284100fb0 0x7fc284102420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:05.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.415+0000 7fc282ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc284100fb0 0x7fc284102420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47010/0 (socket says 172.21.15.123:47010) 2024-06-02T04:03:05.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.415+0000 7fc282ffd700 1 -- 172.21.15.123:0/3678425520 learned_addr learned my addr 172.21.15.123:0/3678425520 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:05.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.415+0000 7fc2837fe700 1 --2- 172.21.15.123:0/3678425520 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2840ffe60 0x7fc284103d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:05.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.415+0000 7fc283fff700 1 --2- 172.21.15.123:0/3678425520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc284101970 0x7fc284102960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:05.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.415+0000 7fc282ffd700 1 -- 172.21.15.123:0/3678425520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc284101970 msgr2=0x7fc284102960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:05.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.415+0000 7fc282ffd700 1 --2- 172.21.15.123:0/3678425520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc284101970 0x7fc284102960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:05.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.415+0000 7fc282ffd700 1 -- 172.21.15.123:0/3678425520 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2840ffe60 msgr2=0x7fc284103d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:05.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.415+0000 7fc282ffd700 1 --2- 172.21.15.123:0/3678425520 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2840ffe60 0x7fc284103d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:05.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.415+0000 7fc282ffd700 1 -- 172.21.15.123:0/3678425520 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2740095f0 con 0x7fc284100fb0 2024-06-02T04:03:05.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.415+0000 7fc283fff700 1 --2- 172.21.15.123:0/3678425520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc284101970 0x7fc284102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:03:05.417 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.415+0000 7fc2837fe700 1 --2- 172.21.15.123:0/3678425520 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2840ffe60 0x7fc284103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:03:05.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.416+0000 7fc282ffd700 1 --2- 172.21.15.123:0/3678425520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc284100fb0 0x7fc284102420 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc27400c010 tx=0x7fc274004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:05.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.416+0000 7fc280ff9700 1 -- 172.21.15.123:0/3678425520 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27401d070 con 0x7fc284100fb0 2024-06-02T04:03:05.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.416+0000 7fc280ff9700 1 -- 172.21.15.123:0/3678425520 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc2740054f0 con 0x7fc284100fb0 2024-06-02T04:03:05.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.416+0000 7fc289ad8700 1 -- 172.21.15.123:0/3678425520 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2841a10e0 con 0x7fc284100fb0 2024-06-02T04:03:05.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.416+0000 7fc280ff9700 1 -- 172.21.15.123:0/3678425520 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc274004d10 con 0x7fc284100fb0 2024-06-02T04:03:05.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.416+0000 7fc289ad8700 1 -- 172.21.15.123:0/3678425520 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2841a14a0 con 0x7fc284100fb0 2024-06-02T04:03:05.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.417+0000 7fc289ad8700 1 -- 172.21.15.123:0/3678425520 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc284067cf0 con 0x7fc284100fb0 2024-06-02T04:03:05.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.418+0000 7fc280ff9700 1 -- 172.21.15.123:0/3678425520 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fc27400fc50 con 0x7fc284100fb0 2024-06-02T04:03:05.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.418+0000 7fc280ff9700 1 --2- 172.21.15.123:0/3678425520 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc26c0a1120 0x7fc26c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:05.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.419+0000 7fc2837fe700 1 --2- 172.21.15.123:0/3678425520 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc26c0a1120 0x7fc26c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:05.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.419+0000 7fc280ff9700 1 -- 172.21.15.123:0/3678425520 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7497+0+0 (secure 0 0 0) 0x7fc2740cd9a0 con 0x7fc284100fb0 2024-06-02T04:03:05.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.419+0000 7fc2837fe700 1 --2- 172.21.15.123:0/3678425520 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc26c0a1120 0x7fc26c0a35e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc27800afd0 tx=0x7fc27800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:05.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.423+0000 7fc280ff9700 1 -- 172.21.15.123:0/3678425520 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc2740974f0 con 0x7fc284100fb0 2024-06-02T04:03:05.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:05 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/1215892787' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-06-02T04:03:05.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:05 smithi162 ceph-mon[47009]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:03:05.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:05 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/826558701' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-02T04:03:05.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:05 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:05.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:05 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:05.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:05 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:05.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:05 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:05.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:05 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1215892787' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-06-02T04:03:05.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:05 smithi123 ceph-mon[42885]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:03:05.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:05 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/826558701' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-02T04:03:05.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:05 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:05.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:05 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:05.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:05 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:05.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:05 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:05.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:05 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/1215892787' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-06-02T04:03:05.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:05 smithi136 ceph-mon[47443]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:03:05.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:05 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/826558701' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-06-02T04:03:05.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:05 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:05.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:05 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:05.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:05 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:05.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:05 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:05.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:05.626+0000 7fc289ad8700 1 -- 172.21.15.123:0/3678425520 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc28410b750 con 0x7fc284100fb0 2024-06-02T04:03:06.257 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.257+0000 7fc280ff9700 1 -- 172.21.15.123:0/3678425520 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v80) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc27409ab10 con 0x7fc284100fb0 2024-06-02T04:03:06.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.265+0000 7fc289ad8700 1 -- 172.21.15.123:0/3678425520 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc26c0a1120 msgr2=0x7fc26c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:06.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.265+0000 7fc289ad8700 1 --2- 172.21.15.123:0/3678425520 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc26c0a1120 0x7fc26c0a35e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc27800afd0 tx=0x7fc27800a380 comp rx=0 tx=0).stop 2024-06-02T04:03:06.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.266+0000 7fc289ad8700 1 -- 172.21.15.123:0/3678425520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc284100fb0 msgr2=0x7fc284102420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:06.267 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.266+0000 7fc289ad8700 1 --2- 172.21.15.123:0/3678425520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc284100fb0 0x7fc284102420 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc27400c010 tx=0x7fc274004730 comp rx=0 tx=0).stop 2024-06-02T04:03:06.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.271+0000 7fc289ad8700 1 -- 172.21.15.123:0/3678425520 shutdown_connections 2024-06-02T04:03:06.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.271+0000 7fc289ad8700 1 --2- 172.21.15.123:0/3678425520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc284101970 0x7fc284102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:06.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.271+0000 7fc289ad8700 1 --2- 172.21.15.123:0/3678425520 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc26c0a1120 0x7fc26c0a35e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:06.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.271+0000 7fc289ad8700 1 --2- 172.21.15.123:0/3678425520 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2840ffe60 0x7fc284103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:06.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.271+0000 7fc289ad8700 1 --2- 172.21.15.123:0/3678425520 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc284100fb0 0x7fc284102420 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:06.272 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.271+0000 7fc289ad8700 1 -- 172.21.15.123:0/3678425520 >> 172.21.15.123:0/3678425520 conn(0x7fc2840fb3f0 msgr2=0x7fc2840fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:06.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.276+0000 7fc289ad8700 1 -- 172.21.15.123:0/3678425520 shutdown_connections 2024-06-02T04:03:06.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.276+0000 7fc289ad8700 1 -- 172.21.15.123:0/3678425520 wait complete. 2024-06-02T04:03:06.278 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' created 2024-06-02T04:03:06.290 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-06-02T04:03:06.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.416+0000 7f896155e700 1 -- 172.21.15.123:0/582083472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f895c101a50 msgr2=0x7f895c108370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:06.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.416+0000 7f896155e700 1 --2- 172.21.15.123:0/582083472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f895c101a50 0x7f895c108370 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f895400b0a0 tx=0x7f895400b3b0 comp rx=0 tx=0).stop 2024-06-02T04:03:06.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.416+0000 7f896155e700 1 -- 172.21.15.123:0/582083472 shutdown_connections 2024-06-02T04:03:06.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.416+0000 7f896155e700 1 --2- 172.21.15.123:0/582083472 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f895c101a50 0x7f895c108370 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:06.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.416+0000 7f896155e700 1 --2- 172.21.15.123:0/582083472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f895c0ffeb0 0x7f895c1002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:06.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.416+0000 7f896155e700 1 --2- 172.21.15.123:0/582083472 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f895c101090 0x7f895c101510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:06.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.416+0000 7f896155e700 1 -- 172.21.15.123:0/582083472 >> 172.21.15.123:0/582083472 conn(0x7f895c0fb490 msgr2=0x7f895c0fd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:06.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.416+0000 7f896155e700 1 -- 172.21.15.123:0/582083472 shutdown_connections 2024-06-02T04:03:06.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.416+0000 7f896155e700 1 -- 172.21.15.123:0/582083472 wait complete. 2024-06-02T04:03:06.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.417+0000 7f896155e700 1 Processor -- start 2024-06-02T04:03:06.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.417+0000 7f896155e700 1 -- start start 2024-06-02T04:03:06.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.417+0000 7f896155e700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f895c0ffeb0 0x7f895c069ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:06.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.417+0000 7f896155e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f895c101090 0x7f895c19bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:06.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.417+0000 7f896155e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f895c101a50 0x7f895c19e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:06.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.417+0000 7f896155e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895c19eab0 con 0x7f895c101090 2024-06-02T04:03:06.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.417+0000 7f896155e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895c19ec20 con 0x7f895c101a50 2024-06-02T04:03:06.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.417+0000 7f896155e700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895c19ede0 con 0x7f895c0ffeb0 2024-06-02T04:03:06.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.417+0000 7f895a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f895c101090 0x7f895c19bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:06.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.417+0000 7f895a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f895c101090 0x7f895c19bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47034/0 (socket says 172.21.15.123:47034) 2024-06-02T04:03:06.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.417+0000 7f895a7fc700 1 -- 172.21.15.123:0/3970504809 learned_addr learned my addr 172.21.15.123:0/3970504809 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:06.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.417+0000 7f895b7fe700 1 --2- 172.21.15.123:0/3970504809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f895c101a50 0x7f895c19e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:06.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.417+0000 7f895affd700 1 --2- 172.21.15.123:0/3970504809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f895c0ffeb0 0x7f895c069ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:06.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.417+0000 7f895a7fc700 1 -- 172.21.15.123:0/3970504809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f895c0ffeb0 msgr2=0x7f895c069ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:06.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.417+0000 7f895a7fc700 1 --2- 172.21.15.123:0/3970504809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f895c0ffeb0 0x7f895c069ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:06.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.417+0000 7f895a7fc700 1 -- 172.21.15.123:0/3970504809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f895c101a50 msgr2=0x7f895c19e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:06.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.417+0000 7f895a7fc700 1 --2- 172.21.15.123:0/3970504809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f895c101a50 0x7f895c19e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:06.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.417+0000 7f895a7fc700 1 -- 172.21.15.123:0/3970504809 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8954009d00 con 0x7f895c101090 2024-06-02T04:03:06.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.418+0000 7f895a7fc700 1 --2- 172.21.15.123:0/3970504809 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f895c101090 0x7f895c19bd20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f894c00e970 tx=0x7f894c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:06.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.418+0000 7f8953fff700 1 -- 172.21.15.123:0/3970504809 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c009790 con 0x7f895c101090 2024-06-02T04:03:06.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.418+0000 7f896155e700 1 -- 172.21.15.123:0/3970504809 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f895c19f0c0 con 0x7f895c101090 2024-06-02T04:03:06.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.418+0000 7f8953fff700 1 -- 172.21.15.123:0/3970504809 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f894c00c7e0 con 0x7f895c101090 2024-06-02T04:03:06.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.418+0000 7f8953fff700 1 -- 172.21.15.123:0/3970504809 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c003c70 con 0x7f895c101090 2024-06-02T04:03:06.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.418+0000 7f896155e700 1 -- 172.21.15.123:0/3970504809 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f895c19f5d0 con 0x7f895c101090 2024-06-02T04:03:06.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.419+0000 7f896155e700 1 -- 172.21.15.123:0/3970504809 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f895c1072e0 con 0x7f895c101090 2024-06-02T04:03:06.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.420+0000 7f8953fff700 1 -- 172.21.15.123:0/3970504809 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f894c00cc50 con 0x7f895c101090 2024-06-02T04:03:06.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.420+0000 7f8953fff700 1 --2- 172.21.15.123:0/3970504809 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f89480a11a0 0x7f89480a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:06.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.421+0000 7f8953fff700 1 -- 172.21.15.123:0/3970504809 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f894c014070 con 0x7f895c101090 2024-06-02T04:03:06.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.421+0000 7f895affd700 1 --2- 172.21.15.123:0/3970504809 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f89480a11a0 0x7f89480a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:06.422 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.421+0000 7f895affd700 1 --2- 172.21.15.123:0/3970504809 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f89480a11a0 0x7f89480a3660 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f895c100c00 tx=0x7f894400a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:06.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.424+0000 7f8953fff700 1 -- 172.21.15.123:0/3970504809 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f894c0963b0 con 0x7f895c101090 2024-06-02T04:03:06.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:06 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/826558701' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-06-02T04:03:06.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:06 smithi162 ceph-mon[47009]: osdmap e79: 12 total, 12 up, 12 in 2024-06-02T04:03:06.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:06 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:06.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:06 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:06.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:06 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:03:06.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:06 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:03:06.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:06 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:06.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:06 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/3678425520' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-02T04:03:06.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:06 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/826558701' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-06-02T04:03:06.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:06 smithi123 ceph-mon[42885]: osdmap e79: 12 total, 12 up, 12 in 2024-06-02T04:03:06.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:06 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:06.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:06 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:06.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:06 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:03:06.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:06 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:03:06.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:06 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:06.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:06 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/3678425520' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-02T04:03:06.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:06 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/826558701' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-06-02T04:03:06.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:06 smithi136 ceph-mon[47443]: osdmap e79: 12 total, 12 up, 12 in 2024-06-02T04:03:06.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:06 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:06.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:06 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:06.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:06 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:03:06.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:06 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:03:06.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:06 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:06.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:06 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/3678425520' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-06-02T04:03:06.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.665+0000 7f896155e700 1 -- 172.21.15.123:0/3970504809 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f895c10b950 con 0x7f895c101090 2024-06-02T04:03:06.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.677+0000 7f8953fff700 1 -- 172.21.15.123:0/3970504809 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f894c003dd0 con 0x7f895c101090 2024-06-02T04:03:06.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.686+0000 7f896155e700 1 -- 172.21.15.123:0/3970504809 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f89480a11a0 msgr2=0x7f89480a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:06.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.686+0000 7f896155e700 1 --2- 172.21.15.123:0/3970504809 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f89480a11a0 0x7f89480a3660 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f895c100c00 tx=0x7f894400a3b0 comp rx=0 tx=0).stop 2024-06-02T04:03:06.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.686+0000 7f896155e700 1 -- 172.21.15.123:0/3970504809 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f895c101090 msgr2=0x7f895c19bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:06.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.686+0000 7f896155e700 1 --2- 172.21.15.123:0/3970504809 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f895c101090 0x7f895c19bd20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f894c00e970 tx=0x7f894c00ec80 comp rx=0 tx=0).stop 2024-06-02T04:03:06.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.689+0000 7f896155e700 1 -- 172.21.15.123:0/3970504809 shutdown_connections 2024-06-02T04:03:06.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.689+0000 7f896155e700 1 --2- 172.21.15.123:0/3970504809 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f89480a11a0 0x7f89480a3660 secure :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f895c100c00 tx=0x7f894400a3b0 comp rx=0 tx=0).stop 2024-06-02T04:03:06.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.689+0000 7f896155e700 1 --2- 172.21.15.123:0/3970504809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f895c101a50 0x7f895c19e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:06.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.689+0000 7f896155e700 1 --2- 172.21.15.123:0/3970504809 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f895c0ffeb0 0x7f895c069ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:06.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.689+0000 7f896155e700 1 --2- 172.21.15.123:0/3970504809 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f895c101090 0x7f895c19bd20 secure :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f894c00e970 tx=0x7f894c00ec80 comp rx=0 tx=0).stop 2024-06-02T04:03:06.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.689+0000 7f896155e700 1 -- 172.21.15.123:0/3970504809 >> 172.21.15.123:0/3970504809 conn(0x7f895c0fb490 msgr2=0x7f895c104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:06.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.692+0000 7f896155e700 1 -- 172.21.15.123:0/3970504809 shutdown_connections 2024-06-02T04:03:06.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.692+0000 7f896155e700 1 -- 172.21.15.123:0/3970504809 wait complete. 2024-06-02T04:03:06.696 INFO:teuthology.orchestra.run.smithi123.stderr:new fs with metadata pool 2 and data pool 3 2024-06-02T04:03:06.710 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:03:06.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.832+0000 7f44cec9e700 1 -- 172.21.15.123:0/2750751910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c8108d60 msgr2=0x7f44c810b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:06.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.832+0000 7f44cec9e700 1 --2- 172.21.15.123:0/2750751910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c8108d60 0x7f44c810b1d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f44c000b0a0 tx=0x7f44c000b3b0 comp rx=0 tx=0).stop 2024-06-02T04:03:06.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.832+0000 7f44cec9e700 1 -- 172.21.15.123:0/2750751910 shutdown_connections 2024-06-02T04:03:06.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.832+0000 7f44cec9e700 1 --2- 172.21.15.123:0/2750751910 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c8108d60 0x7f44c810b1d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:06.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.832+0000 7f44cec9e700 1 --2- 172.21.15.123:0/2750751910 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f44c8074f80 0x7f44c80733d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:06.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.832+0000 7f44cec9e700 1 --2- 172.21.15.123:0/2750751910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44c80739a0 0x7f44c8073e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:06.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.832+0000 7f44cec9e700 1 -- 172.21.15.123:0/2750751910 >> 172.21.15.123:0/2750751910 conn(0x7f44c80fc400 msgr2=0x7f44c80fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:06.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.832+0000 7f44cec9e700 1 -- 172.21.15.123:0/2750751910 shutdown_connections 2024-06-02T04:03:06.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.832+0000 7f44cec9e700 1 -- 172.21.15.123:0/2750751910 wait complete. 2024-06-02T04:03:06.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.833+0000 7f44cec9e700 1 Processor -- start 2024-06-02T04:03:06.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.833+0000 7f44cec9e700 1 -- start start 2024-06-02T04:03:06.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.833+0000 7f44cec9e700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44c80739a0 0x7f44c8199060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:06.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.833+0000 7f44cec9e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c8074f80 0x7f44c81995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:06.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.833+0000 7f44cec9e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f44c8108d60 0x7f44c81a05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:06.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.833+0000 7f44cec9e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c81a0b90 con 0x7f44c8074f80 2024-06-02T04:03:06.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.833+0000 7f44cec9e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c81a0cd0 con 0x7f44c8108d60 2024-06-02T04:03:06.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.833+0000 7f44cec9e700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c81a0e60 con 0x7f44c80739a0 2024-06-02T04:03:06.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.833+0000 7f44c7fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c8074f80 0x7f44c81995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:06.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.833+0000 7f44c7fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c8074f80 0x7f44c81995a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47048/0 (socket says 172.21.15.123:47048) 2024-06-02T04:03:06.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.833+0000 7f44c7fff700 1 -- 172.21.15.123:0/454690492 learned_addr learned my addr 172.21.15.123:0/454690492 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:06.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.833+0000 7f44cca3a700 1 --2- 172.21.15.123:0/454690492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44c80739a0 0x7f44c8199060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:06.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.833+0000 7f44cd23b700 1 --2- 172.21.15.123:0/454690492 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f44c8108d60 0x7f44c81a05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:06.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.834+0000 7f44c7fff700 1 -- 172.21.15.123:0/454690492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44c80739a0 msgr2=0x7f44c8199060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:06.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.834+0000 7f44c7fff700 1 --2- 172.21.15.123:0/454690492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44c80739a0 0x7f44c8199060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:06.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.834+0000 7f44c7fff700 1 -- 172.21.15.123:0/454690492 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f44c8108d60 msgr2=0x7f44c81a05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:06.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.834+0000 7f44c7fff700 1 --2- 172.21.15.123:0/454690492 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f44c8108d60 0x7f44c81a05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:06.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.834+0000 7f44c7fff700 1 -- 172.21.15.123:0/454690492 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c0009d00 con 0x7f44c8074f80 2024-06-02T04:03:06.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.834+0000 7f44c7fff700 1 --2- 172.21.15.123:0/454690492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c8074f80 0x7f44c81995a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f44b400e9c0 tx=0x7f44b400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:06.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.834+0000 7f44c5ffb700 1 -- 172.21.15.123:0/454690492 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b40097b0 con 0x7f44c8074f80 2024-06-02T04:03:06.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.834+0000 7f44c5ffb700 1 -- 172.21.15.123:0/454690492 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f44b400ee60 con 0x7f44c8074f80 2024-06-02T04:03:06.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.834+0000 7f44cec9e700 1 -- 172.21.15.123:0/454690492 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c81a1140 con 0x7f44c8074f80 2024-06-02T04:03:06.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.834+0000 7f44c5ffb700 1 -- 172.21.15.123:0/454690492 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b40054f0 con 0x7f44c8074f80 2024-06-02T04:03:06.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.834+0000 7f44cec9e700 1 -- 172.21.15.123:0/454690492 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c81a1650 con 0x7f44c8074f80 2024-06-02T04:03:06.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.835+0000 7f44cec9e700 1 -- 172.21.15.123:0/454690492 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c8107b70 con 0x7f44c8074f80 2024-06-02T04:03:06.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.836+0000 7f44c5ffb700 1 -- 172.21.15.123:0/454690492 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f44b4004750 con 0x7f44c8074f80 2024-06-02T04:03:06.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.837+0000 7f44c5ffb700 1 --2- 172.21.15.123:0/454690492 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f44b80a11a0 0x7f44b80a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:06.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.837+0000 7f44cca3a700 1 --2- 172.21.15.123:0/454690492 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f44b80a11a0 0x7f44b80a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:06.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.837+0000 7f44c5ffb700 1 -- 172.21.15.123:0/454690492 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f44b4014070 con 0x7f44c8074f80 2024-06-02T04:03:06.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.837+0000 7f44cca3a700 1 --2- 172.21.15.123:0/454690492 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f44b80a11a0 0x7f44b80a3660 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f44bc005950 tx=0x7f44bc00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:06.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:06.841+0000 7f44c5ffb700 1 -- 172.21.15.123:0/454690492 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f44b4096220 con 0x7f44c8074f80 2024-06-02T04:03:07.042 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.042+0000 7f44cec9e700 1 -- 172.21.15.123:0/454690492 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44c810e890 con 0x7f44c8074f80 2024-06-02T04:03:07.043 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.043+0000 7f44c5ffb700 1 -- 172.21.15.123:0/454690492 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+22188 (secure 0 0 0) 0x7f44b4099840 con 0x7f44c8074f80 2024-06-02T04:03:07.043 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:03:07.044 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":81,"fsid":"1b432ae0-2094-11ef-bc9b-c7b262605968","created":"2024-06-02T03:57:17.383774+0000","modified":"2024-06-02T04:03:06.667516+0000","last_up_change":"2024-06-02T04:02:34.535591+0000","last_in_change":"2024-06-02T04:02:18.346560+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T03:59:57.079448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:03:05.199881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:03:05.853741+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d9d8fb5a-dac5-4b14-98e5-665bdbc696ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6803","nonce":2763421276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6805","nonce":2763421276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6809","nonce":2763421276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6807","nonce":2763421276}]},"public_addr":"172.21.15.123:6803/2763421276","cluster_addr":"172.21.15.123:6805/2763421276","heartbeat_back_addr":"172.21.15.123:6809/2763421276","heartbeat_front_addr":"172.21.15.123:6807/2763421276","state":["exists","up"]},{"osd":1,"uuid":"121bbe3c-bb76-4ec4-9596-37db68fbf1ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6801","nonce":956325510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6803","nonce":956325510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6807","nonce":956325510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6805","nonce":956325510}]},"public_addr":"172.21.15.136:6801/956325510","cluster_addr":"172.21.15.136:6803/956325510","heartbeat_back_addr":"172.21.15.136:6807/956325510","heartbeat_front_addr":"172.21.15.136:6805/956325510","state":["exists","up"]},{"osd":2,"uuid":"df9edf0d-f9f0-4699-a6ed-bbcf2dfb1b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6801","nonce":2915749676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6803","nonce":2915749676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6807","nonce":2915749676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6805","nonce":2915749676}]},"public_addr":"172.21.15.162:6801/2915749676","cluster_addr":"172.21.15.162:6803/2915749676","heartbeat_back_addr":"172.21.15.162:6807/2915749676","heartbeat_front_addr":"172.21.15.162:6805/2915749676","state":["exists","up"]},{"osd":3,"uuid":"3e070364-12c6-4780-b2be-f6e933e65773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6811","nonce":1403773143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6813","nonce":1403773143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6817","nonce":1403773143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6815","nonce":1403773143}]},"public_addr":"172.21.15.123:6811/1403773143","cluster_addr":"172.21.15.123:6813/1403773143","heartbeat_back_addr":"172.21.15.123:6817/1403773143","heartbeat_front_addr":"172.21.15.123:6815/1403773143","state":["exists","up"]},{"osd":4,"uuid":"87dd92dd-73c8-4785-bf8a-3756d79dee90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6809","nonce":1403526782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6811","nonce":1403526782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6815","nonce":1403526782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6813","nonce":1403526782}]},"public_addr":"172.21.15.136:6809/1403526782","cluster_addr":"172.21.15.136:6811/1403526782","heartbeat_back_addr":"172.21.15.136:6815/1403526782","heartbeat_front_addr":"172.21.15.136:6813/1403526782","state":["exists","up"]},{"osd":5,"uuid":"1a730863-6b56-43b7-a115-c80d3c8f3ee3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6809","nonce":3094256489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6811","nonce":3094256489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6815","nonce":3094256489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6813","nonce":3094256489}]},"public_addr":"172.21.15.162:6809/3094256489","cluster_addr":"172.21.15.162:6811/3094256489","heartbeat_back_addr":"172.21.15.162:6815/3094256489","heartbeat_front_addr":"172.21.15.162:6813/3094256489","state":["exists","up"]},{"osd":6,"uuid":"6f170b85-6c47-49ff-ba5b-7fe0596a4ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6819","nonce":3025820432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6821","nonce":3025820432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6825","nonce":3025820432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6823","nonce":3025820432}]},"public_addr":"172.21.15.123:6819/3025820432","cluster_addr":"172.21.15.123:6821/3025820432","heartbeat_back_addr":"172.21.15.123:6825/3025820432","heartbeat_front_addr":"172.21.15.123:6823/3025820432","state":["exists","up"]},{"osd":7,"uuid":"ee66bb7a-6c0d-4e5a-b717-258a39f93a87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6817","nonce":1948829505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6819","nonce":1948829505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6823","nonce":1948829505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6821","nonce":1948829505}]},"public_addr":"172.21.15.136:6817/1948829505","cluster_addr":"172.21.15.136:6819/1948829505","heartbeat_back_addr":"172.21.15.136:6823/1948829505","heartbeat_front_addr":"172.21.15.136:6821/1948829505","state":["exists","up"]},{"osd":8,"uuid":"0ff77e33-53a5-43ef-85da-2036a1fcdb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6817","nonce":1590839230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6819","nonce":1590839230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6823","nonce":1590839230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6821","nonce":1590839230}]},"public_addr":"172.21.15.162:6817/1590839230","cluster_addr":"172.21.15.162:6819/1590839230","heartbeat_back_addr":"172.21.15.162:6823/1590839230","heartbeat_front_addr":"172.21.15.162:6821/1590839230","state":["exists","up"]},{"osd":9,"uuid":"1670731c-5e8f-4cbc-8f35-6aeb14ea3075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6827","nonce":608720685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6829","nonce":608720685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6833","nonce":608720685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6831","nonce":608720685}]},"public_addr":"172.21.15.123:6827/608720685","cluster_addr":"172.21.15.123:6829/608720685","heartbeat_back_addr":"172.21.15.123:6833/608720685","heartbeat_front_addr":"172.21.15.123:6831/608720685","state":["exists","up"]},{"osd":10,"uuid":"ae138b96-13e7-46ac-9d4d-48308132465d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6825","nonce":3777263126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6827","nonce":3777263126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6831","nonce":3777263126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6829","nonce":3777263126}]},"public_addr":"172.21.15.136:6825/3777263126","cluster_addr":"172.21.15.136:6827/3777263126","heartbeat_back_addr":"172.21.15.136:6831/3777263126","heartbeat_front_addr":"172.21.15.136:6829/3777263126","state":["exists","up"]},{"osd":11,"uuid":"69f4ede0-7e9b-4edb-be54-01f74f002a06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6825","nonce":704809754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6827","nonce":704809754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6831","nonce":704809754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6829","nonce":704809754}]},"public_addr":"172.21.15.162:6825/704809754","cluster_addr":"172.21.15.162:6827/704809754","heartbeat_back_addr":"172.21.15.162:6831/704809754","heartbeat_front_addr":"172.21.15.162:6829/704809754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:19.188506+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:36.535261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:54.242294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:11.815314+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:29.512086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:46.874319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:04.437358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:22.312520+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:39.917998+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:57.340043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:15.252797+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:32.898924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:0/69783025":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/10165744":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/2081407856":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/4026642298":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/1442330765":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/1595718606":"2024-06-03T03:57:45.611046+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:03:07.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.046+0000 7f44cec9e700 1 -- 172.21.15.123:0/454690492 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f44b80a11a0 msgr2=0x7f44b80a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:07.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.046+0000 7f44cec9e700 1 --2- 172.21.15.123:0/454690492 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f44b80a11a0 0x7f44b80a3660 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f44bc005950 tx=0x7f44bc00a300 comp rx=0 tx=0).stop 2024-06-02T04:03:07.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.046+0000 7f44cec9e700 1 -- 172.21.15.123:0/454690492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c8074f80 msgr2=0x7f44c81995a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:07.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.046+0000 7f44cec9e700 1 --2- 172.21.15.123:0/454690492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c8074f80 0x7f44c81995a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f44b400e9c0 tx=0x7f44b400ecd0 comp rx=0 tx=0).stop 2024-06-02T04:03:07.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.046+0000 7f44cec9e700 1 -- 172.21.15.123:0/454690492 shutdown_connections 2024-06-02T04:03:07.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.046+0000 7f44cec9e700 1 --2- 172.21.15.123:0/454690492 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f44b80a11a0 0x7f44b80a3660 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:07.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.046+0000 7f44cec9e700 1 --2- 172.21.15.123:0/454690492 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f44c8108d60 0x7f44c81a05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:07.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.046+0000 7f44cec9e700 1 --2- 172.21.15.123:0/454690492 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44c80739a0 0x7f44c8199060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:07.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.046+0000 7f44cec9e700 1 --2- 172.21.15.123:0/454690492 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f44c8074f80 0x7f44c81995a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:07.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.046+0000 7f44cec9e700 1 -- 172.21.15.123:0/454690492 >> 172.21.15.123:0/454690492 conn(0x7f44c80fc400 msgr2=0x7f44c8104cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:07.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.046+0000 7f44cec9e700 1 -- 172.21.15.123:0/454690492 shutdown_connections 2024-06-02T04:03:07.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.046+0000 7f44cec9e700 1 -- 172.21.15.123:0/454690492 wait complete. 2024-06-02T04:03:07.058 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:03:07.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.180+0000 7ff01ad59700 1 -- 172.21.15.123:0/1017795447 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0140ffd60 msgr2=0x7ff014100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:07.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.180+0000 7ff01ad59700 1 --2- 172.21.15.123:0/1017795447 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0140ffd60 0x7ff014100180 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff0080099c0 tx=0x7ff008009cd0 comp rx=0 tx=0).stop 2024-06-02T04:03:07.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.181+0000 7ff01ad59700 1 -- 172.21.15.123:0/1017795447 shutdown_connections 2024-06-02T04:03:07.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.181+0000 7ff01ad59700 1 --2- 172.21.15.123:0/1017795447 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0141018f0 0x7ff0141081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:07.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.181+0000 7ff01ad59700 1 --2- 172.21.15.123:0/1017795447 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff0140ffd60 0x7ff014100180 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:07.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.181+0000 7ff01ad59700 1 --2- 172.21.15.123:0/1017795447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff014100f50 0x7ff0141013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:07.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.181+0000 7ff01ad59700 1 -- 172.21.15.123:0/1017795447 >> 172.21.15.123:0/1017795447 conn(0x7ff0140fb2f0 msgr2=0x7ff0140fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:07.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.181+0000 7ff01ad59700 1 -- 172.21.15.123:0/1017795447 shutdown_connections 2024-06-02T04:03:07.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.181+0000 7ff01ad59700 1 -- 172.21.15.123:0/1017795447 wait complete. 2024-06-02T04:03:07.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.181+0000 7ff01ad59700 1 Processor -- start 2024-06-02T04:03:07.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.181+0000 7ff01ad59700 1 -- start start 2024-06-02T04:03:07.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.181+0000 7ff01ad59700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0140ffd60 0x7ff014103ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:07.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.181+0000 7ff01ad59700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff014100f50 0x7ff014102330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:07.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.181+0000 7ff01ad59700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0141018f0 0x7ff014102870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:07.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.181+0000 7ff01ad59700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff014103010 con 0x7ff014100f50 2024-06-02T04:03:07.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.181+0000 7ff01ad59700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff014103180 con 0x7ff0141018f0 2024-06-02T04:03:07.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.181+0000 7ff01ad59700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0141a0e90 con 0x7ff0140ffd60 2024-06-02T04:03:07.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.181+0000 7ff013fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff014100f50 0x7ff014102330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:07.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.181+0000 7ff013fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff014100f50 0x7ff014102330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47064/0 (socket says 172.21.15.123:47064) 2024-06-02T04:03:07.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.181+0000 7ff013fff700 1 -- 172.21.15.123:0/475026659 learned_addr learned my addr 172.21.15.123:0/475026659 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:07.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.182+0000 7ff018af5700 1 --2- 172.21.15.123:0/475026659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0140ffd60 0x7ff014103ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:07.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.182+0000 7ff0192f6700 1 --2- 172.21.15.123:0/475026659 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0141018f0 0x7ff014102870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:07.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.182+0000 7ff013fff700 1 -- 172.21.15.123:0/475026659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0140ffd60 msgr2=0x7ff014103ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:07.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.182+0000 7ff013fff700 1 --2- 172.21.15.123:0/475026659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0140ffd60 0x7ff014103ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:07.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.182+0000 7ff013fff700 1 -- 172.21.15.123:0/475026659 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0141018f0 msgr2=0x7ff014102870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:07.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.182+0000 7ff013fff700 1 --2- 172.21.15.123:0/475026659 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0141018f0 0x7ff014102870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:07.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.182+0000 7ff013fff700 1 -- 172.21.15.123:0/475026659 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0080095f0 con 0x7ff014100f50 2024-06-02T04:03:07.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.182+0000 7ff013fff700 1 --2- 172.21.15.123:0/475026659 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff014100f50 0x7ff014102330 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff00000c920 tx=0x7ff00000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:07.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.182+0000 7ff011ffb700 1 -- 172.21.15.123:0/475026659 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff000007aa0 con 0x7ff014100f50 2024-06-02T04:03:07.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.182+0000 7ff011ffb700 1 -- 172.21.15.123:0/475026659 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff00000ce70 con 0x7ff014100f50 2024-06-02T04:03:07.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.182+0000 7ff01ad59700 1 -- 172.21.15.123:0/475026659 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0141a1120 con 0x7ff014100f50 2024-06-02T04:03:07.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.182+0000 7ff011ffb700 1 -- 172.21.15.123:0/475026659 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff000005440 con 0x7ff014100f50 2024-06-02T04:03:07.185 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.182+0000 7ff01ad59700 1 -- 172.21.15.123:0/475026659 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0141a1630 con 0x7ff014100f50 2024-06-02T04:03:07.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.183+0000 7ff01ad59700 1 -- 172.21.15.123:0/475026659 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff014067c10 con 0x7ff014100f50 2024-06-02T04:03:07.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.184+0000 7ff011ffb700 1 -- 172.21.15.123:0/475026659 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7ff000004750 con 0x7ff014100f50 2024-06-02T04:03:07.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.185+0000 7ff011ffb700 1 --2- 172.21.15.123:0/475026659 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff0040a11a0 0x7ff0040a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:07.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.185+0000 7ff018af5700 1 --2- 172.21.15.123:0/475026659 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff0040a11a0 0x7ff0040a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:07.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.185+0000 7ff011ffb700 1 -- 172.21.15.123:0/475026659 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff0000cc3e0 con 0x7ff014100f50 2024-06-02T04:03:07.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.185+0000 7ff018af5700 1 --2- 172.21.15.123:0/475026659 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff0040a11a0 0x7ff0040a3660 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff008009f50 tx=0x7ff008005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:07.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.189+0000 7ff011ffb700 1 -- 172.21.15.123:0/475026659 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff000095c20 con 0x7ff014100f50 2024-06-02T04:03:07.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:07 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/3678425520' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-06-02T04:03:07.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:07 smithi123 ceph-mon[42885]: osdmap e80: 12 total, 12 up, 12 in 2024-06-02T04:03:07.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:07 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/3970504809' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-02T04:03:07.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:07 smithi123 ceph-mon[42885]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-06-02T04:03:07.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:07 smithi123 ceph-mon[42885]: osdmap e81: 12 total, 12 up, 12 in 2024-06-02T04:03:07.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:07 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/3970504809' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-06-02T04:03:07.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:07 smithi123 ceph-mon[42885]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-06-02T04:03:07.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:07 smithi123 ceph-mon[42885]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-06-02T04:03:07.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:07 smithi123 ceph-mon[42885]: pgmap v221: 97 pgs: 12 creating+peering, 4 active+clean, 81 unknown; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:03:07.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:07 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:07.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:07 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/454690492' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:03:07.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.391+0000 7ff01ad59700 1 -- 172.21.15.123:0/475026659 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff01410b790 con 0x7ff014100f50 2024-06-02T04:03:07.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.392+0000 7ff011ffb700 1 -- 172.21.15.123:0/475026659 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+22188 (secure 0 0 0) 0x7ff000099240 con 0x7ff014100f50 2024-06-02T04:03:07.392 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:03:07.392 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":81,"fsid":"1b432ae0-2094-11ef-bc9b-c7b262605968","created":"2024-06-02T03:57:17.383774+0000","modified":"2024-06-02T04:03:06.667516+0000","last_up_change":"2024-06-02T04:02:34.535591+0000","last_in_change":"2024-06-02T04:02:18.346560+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T03:59:57.079448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:03:05.199881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:03:05.853741+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d9d8fb5a-dac5-4b14-98e5-665bdbc696ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6803","nonce":2763421276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6805","nonce":2763421276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6809","nonce":2763421276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6807","nonce":2763421276}]},"public_addr":"172.21.15.123:6803/2763421276","cluster_addr":"172.21.15.123:6805/2763421276","heartbeat_back_addr":"172.21.15.123:6809/2763421276","heartbeat_front_addr":"172.21.15.123:6807/2763421276","state":["exists","up"]},{"osd":1,"uuid":"121bbe3c-bb76-4ec4-9596-37db68fbf1ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6801","nonce":956325510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6803","nonce":956325510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6807","nonce":956325510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6805","nonce":956325510}]},"public_addr":"172.21.15.136:6801/956325510","cluster_addr":"172.21.15.136:6803/956325510","heartbeat_back_addr":"172.21.15.136:6807/956325510","heartbeat_front_addr":"172.21.15.136:6805/956325510","state":["exists","up"]},{"osd":2,"uuid":"df9edf0d-f9f0-4699-a6ed-bbcf2dfb1b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6801","nonce":2915749676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6803","nonce":2915749676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6807","nonce":2915749676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6805","nonce":2915749676}]},"public_addr":"172.21.15.162:6801/2915749676","cluster_addr":"172.21.15.162:6803/2915749676","heartbeat_back_addr":"172.21.15.162:6807/2915749676","heartbeat_front_addr":"172.21.15.162:6805/2915749676","state":["exists","up"]},{"osd":3,"uuid":"3e070364-12c6-4780-b2be-f6e933e65773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6811","nonce":1403773143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6813","nonce":1403773143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6817","nonce":1403773143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6815","nonce":1403773143}]},"public_addr":"172.21.15.123:6811/1403773143","cluster_addr":"172.21.15.123:6813/1403773143","heartbeat_back_addr":"172.21.15.123:6817/1403773143","heartbeat_front_addr":"172.21.15.123:6815/1403773143","state":["exists","up"]},{"osd":4,"uuid":"87dd92dd-73c8-4785-bf8a-3756d79dee90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6809","nonce":1403526782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6811","nonce":1403526782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6815","nonce":1403526782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6813","nonce":1403526782}]},"public_addr":"172.21.15.136:6809/1403526782","cluster_addr":"172.21.15.136:6811/1403526782","heartbeat_back_addr":"172.21.15.136:6815/1403526782","heartbeat_front_addr":"172.21.15.136:6813/1403526782","state":["exists","up"]},{"osd":5,"uuid":"1a730863-6b56-43b7-a115-c80d3c8f3ee3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6809","nonce":3094256489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6811","nonce":3094256489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6815","nonce":3094256489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6813","nonce":3094256489}]},"public_addr":"172.21.15.162:6809/3094256489","cluster_addr":"172.21.15.162:6811/3094256489","heartbeat_back_addr":"172.21.15.162:6815/3094256489","heartbeat_front_addr":"172.21.15.162:6813/3094256489","state":["exists","up"]},{"osd":6,"uuid":"6f170b85-6c47-49ff-ba5b-7fe0596a4ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6819","nonce":3025820432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6821","nonce":3025820432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6825","nonce":3025820432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6823","nonce":3025820432}]},"public_addr":"172.21.15.123:6819/3025820432","cluster_addr":"172.21.15.123:6821/3025820432","heartbeat_back_addr":"172.21.15.123:6825/3025820432","heartbeat_front_addr":"172.21.15.123:6823/3025820432","state":["exists","up"]},{"osd":7,"uuid":"ee66bb7a-6c0d-4e5a-b717-258a39f93a87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6817","nonce":1948829505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6819","nonce":1948829505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6823","nonce":1948829505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6821","nonce":1948829505}]},"public_addr":"172.21.15.136:6817/1948829505","cluster_addr":"172.21.15.136:6819/1948829505","heartbeat_back_addr":"172.21.15.136:6823/1948829505","heartbeat_front_addr":"172.21.15.136:6821/1948829505","state":["exists","up"]},{"osd":8,"uuid":"0ff77e33-53a5-43ef-85da-2036a1fcdb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6817","nonce":1590839230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6819","nonce":1590839230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6823","nonce":1590839230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6821","nonce":1590839230}]},"public_addr":"172.21.15.162:6817/1590839230","cluster_addr":"172.21.15.162:6819/1590839230","heartbeat_back_addr":"172.21.15.162:6823/1590839230","heartbeat_front_addr":"172.21.15.162:6821/1590839230","state":["exists","up"]},{"osd":9,"uuid":"1670731c-5e8f-4cbc-8f35-6aeb14ea3075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6827","nonce":608720685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6829","nonce":608720685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6833","nonce":608720685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6831","nonce":608720685}]},"public_addr":"172.21.15.123:6827/608720685","cluster_addr":"172.21.15.123:6829/608720685","heartbeat_back_addr":"172.21.15.123:6833/608720685","heartbeat_front_addr":"172.21.15.123:6831/608720685","state":["exists","up"]},{"osd":10,"uuid":"ae138b96-13e7-46ac-9d4d-48308132465d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6825","nonce":3777263126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6827","nonce":3777263126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6831","nonce":3777263126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6829","nonce":3777263126}]},"public_addr":"172.21.15.136:6825/3777263126","cluster_addr":"172.21.15.136:6827/3777263126","heartbeat_back_addr":"172.21.15.136:6831/3777263126","heartbeat_front_addr":"172.21.15.136:6829/3777263126","state":["exists","up"]},{"osd":11,"uuid":"69f4ede0-7e9b-4edb-be54-01f74f002a06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6825","nonce":704809754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6827","nonce":704809754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6831","nonce":704809754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6829","nonce":704809754}]},"public_addr":"172.21.15.162:6825/704809754","cluster_addr":"172.21.15.162:6827/704809754","heartbeat_back_addr":"172.21.15.162:6831/704809754","heartbeat_front_addr":"172.21.15.162:6829/704809754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:19.188506+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:36.535261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:54.242294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:11.815314+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:29.512086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:46.874319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:04.437358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:22.312520+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:39.917998+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:57.340043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:15.252797+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:32.898924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:0/69783025":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/10165744":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/2081407856":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/4026642298":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/1442330765":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/1595718606":"2024-06-03T03:57:45.611046+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:03:07.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.394+0000 7ff01ad59700 1 -- 172.21.15.123:0/475026659 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff0040a11a0 msgr2=0x7ff0040a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:07.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.394+0000 7ff01ad59700 1 --2- 172.21.15.123:0/475026659 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff0040a11a0 0x7ff0040a3660 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff008009f50 tx=0x7ff008005ea0 comp rx=0 tx=0).stop 2024-06-02T04:03:07.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.394+0000 7ff01ad59700 1 -- 172.21.15.123:0/475026659 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff014100f50 msgr2=0x7ff014102330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:07.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.394+0000 7ff01ad59700 1 --2- 172.21.15.123:0/475026659 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff014100f50 0x7ff014102330 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff00000c920 tx=0x7ff00000cc30 comp rx=0 tx=0).stop 2024-06-02T04:03:07.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.394+0000 7ff01ad59700 1 -- 172.21.15.123:0/475026659 shutdown_connections 2024-06-02T04:03:07.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.394+0000 7ff01ad59700 1 --2- 172.21.15.123:0/475026659 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff0040a11a0 0x7ff0040a3660 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:07.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.394+0000 7ff01ad59700 1 --2- 172.21.15.123:0/475026659 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0141018f0 0x7ff014102870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:07.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.394+0000 7ff01ad59700 1 --2- 172.21.15.123:0/475026659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0140ffd60 0x7ff014103ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:07.395 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.394+0000 7ff01ad59700 1 --2- 172.21.15.123:0/475026659 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff014100f50 0x7ff014102330 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:07.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.394+0000 7ff01ad59700 1 -- 172.21.15.123:0/475026659 >> 172.21.15.123:0/475026659 conn(0x7ff0140fb2f0 msgr2=0x7ff014068040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:07.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.394+0000 7ff01ad59700 1 -- 172.21.15.123:0/475026659 shutdown_connections 2024-06-02T04:03:07.396 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.394+0000 7ff01ad59700 1 -- 172.21.15.123:0/475026659 wait complete. 2024-06-02T04:03:07.407 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-06-02T04:03:07.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.531+0000 7f6869225700 1 -- 172.21.15.123:0/1012868870 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6864104320 msgr2=0x7f6864106710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:07.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.531+0000 7f6869225700 1 --2- 172.21.15.123:0/1012868870 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6864104320 0x7f6864106710 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6854009990 tx=0x7f6854009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:07.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.531+0000 7f6869225700 1 -- 172.21.15.123:0/1012868870 shutdown_connections 2024-06-02T04:03:07.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.531+0000 7f6869225700 1 --2- 172.21.15.123:0/1012868870 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6864106c50 0x7f68641090c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:07.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.531+0000 7f6869225700 1 --2- 172.21.15.123:0/1012868870 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68641019f0 0x7f6864103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:07.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.531+0000 7f6869225700 1 --2- 172.21.15.123:0/1012868870 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6864104320 0x7f6864106710 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:07.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.531+0000 7f6869225700 1 -- 172.21.15.123:0/1012868870 >> 172.21.15.123:0/1012868870 conn(0x7f68640fb3e0 msgr2=0x7f68640fd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:07.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.531+0000 7f6869225700 1 -- 172.21.15.123:0/1012868870 shutdown_connections 2024-06-02T04:03:07.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.532+0000 7f6869225700 1 -- 172.21.15.123:0/1012868870 wait complete. 2024-06-02T04:03:07.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.532+0000 7f6869225700 1 Processor -- start 2024-06-02T04:03:07.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.532+0000 7f6869225700 1 -- start start 2024-06-02T04:03:07.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.533+0000 7f6869225700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68641019f0 0x7f6864196f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:07.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.533+0000 7f6869225700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6864104320 0x7f6864197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:07.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.533+0000 7f6869225700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6864106c50 0x7f686419e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:07.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.533+0000 7f6869225700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686419ea50 con 0x7f6864106c50 2024-06-02T04:03:07.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.533+0000 7f6869225700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686419eb90 con 0x7f6864104320 2024-06-02T04:03:07.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.533+0000 7f6869225700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686419ed20 con 0x7f68641019f0 2024-06-02T04:03:07.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.533+0000 7f686359e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6864106c50 0x7f686419e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:07.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.533+0000 7f686359e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6864106c50 0x7f686419e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47072/0 (socket says 172.21.15.123:47072) 2024-06-02T04:03:07.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.533+0000 7f686359e700 1 -- 172.21.15.123:0/219180564 learned_addr learned my addr 172.21.15.123:0/219180564 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:07.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.533+0000 7f686259c700 1 --2- 172.21.15.123:0/219180564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6864104320 0x7f6864197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:07.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.533+0000 7f6862d9d700 1 --2- 172.21.15.123:0/219180564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68641019f0 0x7f6864196f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:07.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.533+0000 7f686359e700 1 -- 172.21.15.123:0/219180564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68641019f0 msgr2=0x7f6864196f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:07.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.533+0000 7f686359e700 1 --2- 172.21.15.123:0/219180564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68641019f0 0x7f6864196f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:07.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.533+0000 7f686359e700 1 -- 172.21.15.123:0/219180564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6864104320 msgr2=0x7f6864197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:07.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.533+0000 7f686359e700 1 --2- 172.21.15.123:0/219180564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6864104320 0x7f6864197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:07.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.533+0000 7f686359e700 1 -- 172.21.15.123:0/219180564 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68540095f0 con 0x7f6864106c50 2024-06-02T04:03:07.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.533+0000 7f686359e700 1 --2- 172.21.15.123:0/219180564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6864106c50 0x7f686419e480 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f685c00ada0 tx=0x7f685c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:07.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.533+0000 7f684bfff700 1 -- 172.21.15.123:0/219180564 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c00f070 con 0x7f6864106c50 2024-06-02T04:03:07.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.533+0000 7f684bfff700 1 -- 172.21.15.123:0/219180564 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f685c007b30 con 0x7f6864106c50 2024-06-02T04:03:07.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.533+0000 7f6869225700 1 -- 172.21.15.123:0/219180564 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f686419efa0 con 0x7f6864106c50 2024-06-02T04:03:07.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.533+0000 7f684bfff700 1 -- 172.21.15.123:0/219180564 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c005280 con 0x7f6864106c50 2024-06-02T04:03:07.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.533+0000 7f6869225700 1 -- 172.21.15.123:0/219180564 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f686419f430 con 0x7f6864106c50 2024-06-02T04:03:07.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.534+0000 7f6869225700 1 -- 172.21.15.123:0/219180564 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68640fcf60 con 0x7f6864106c50 2024-06-02T04:03:07.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.535+0000 7f684bfff700 1 -- 172.21.15.123:0/219180564 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f685c00c8d0 con 0x7f6864106c50 2024-06-02T04:03:07.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.536+0000 7f684bfff700 1 --2- 172.21.15.123:0/219180564 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f684c0a1120 0x7f684c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:07.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.536+0000 7f6862d9d700 1 --2- 172.21.15.123:0/219180564 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f684c0a1120 0x7f684c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:07.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.536+0000 7f684bfff700 1 -- 172.21.15.123:0/219180564 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f685c0cbcf0 con 0x7f6864106c50 2024-06-02T04:03:07.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.536+0000 7f6862d9d700 1 --2- 172.21.15.123:0/219180564 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f684c0a1120 0x7f684c0a35e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6858005950 tx=0x7f685800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:07.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.540+0000 7f684bfff700 1 -- 172.21.15.123:0/219180564 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f685c0d0070 con 0x7f6864106c50 2024-06-02T04:03:07.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:07 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/3678425520' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-06-02T04:03:07.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:07 smithi162 ceph-mon[47009]: osdmap e80: 12 total, 12 up, 12 in 2024-06-02T04:03:07.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:07 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/3970504809' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-02T04:03:07.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:07 smithi162 ceph-mon[47009]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-06-02T04:03:07.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:07 smithi162 ceph-mon[47009]: osdmap e81: 12 total, 12 up, 12 in 2024-06-02T04:03:07.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:07 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/3970504809' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-06-02T04:03:07.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:07 smithi162 ceph-mon[47009]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-06-02T04:03:07.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:07 smithi162 ceph-mon[47009]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-06-02T04:03:07.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:07 smithi162 ceph-mon[47009]: pgmap v221: 97 pgs: 12 creating+peering, 4 active+clean, 81 unknown; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:03:07.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:07 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:07.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:07 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/454690492' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:03:07.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:07 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/3678425520' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-06-02T04:03:07.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:07 smithi136 ceph-mon[47443]: osdmap e80: 12 total, 12 up, 12 in 2024-06-02T04:03:07.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:07 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/3970504809' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-06-02T04:03:07.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:07 smithi136 ceph-mon[47443]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-06-02T04:03:07.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:07 smithi136 ceph-mon[47443]: osdmap e81: 12 total, 12 up, 12 in 2024-06-02T04:03:07.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:07 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/3970504809' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-06-02T04:03:07.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:07 smithi136 ceph-mon[47443]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-06-02T04:03:07.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:07 smithi136 ceph-mon[47443]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-06-02T04:03:07.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:07 smithi136 ceph-mon[47443]: pgmap v221: 97 pgs: 12 creating+peering, 4 active+clean, 81 unknown; 577 KiB data, 350 MiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:03:07.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:07 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:03:07.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:07 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/454690492' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:03:07.786 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:07.787+0000 7f6869225700 1 -- 172.21.15.123:0/219180564 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6864068140 con 0x7f6864106c50 2024-06-02T04:03:08.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:08 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/475026659' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:03:08.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:08 smithi162 ceph-mon[47009]: mds.? [v2:172.21.15.136:6838/952830191,v1:172.21.15.136:6839/952830191] up:active 2024-06-02T04:03:08.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:08 smithi162 ceph-mon[47009]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-02T04:03:08.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:08 smithi162 ceph-mon[47009]: osdmap e82: 12 total, 12 up, 12 in 2024-06-02T04:03:08.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:08 smithi162 ceph-mon[47009]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-02T04:03:08.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:08 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/219180564' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-02T04:03:08.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:08 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/475026659' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:03:08.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:08 smithi123 ceph-mon[42885]: mds.? [v2:172.21.15.136:6838/952830191,v1:172.21.15.136:6839/952830191] up:active 2024-06-02T04:03:08.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:08 smithi123 ceph-mon[42885]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-02T04:03:08.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:08 smithi123 ceph-mon[42885]: osdmap e82: 12 total, 12 up, 12 in 2024-06-02T04:03:08.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:08 smithi123 ceph-mon[42885]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-02T04:03:08.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:08 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/219180564' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-02T04:03:08.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:08 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/475026659' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:03:08.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:08 smithi136 ceph-mon[47443]: mds.? [v2:172.21.15.136:6838/952830191,v1:172.21.15.136:6839/952830191] up:active 2024-06-02T04:03:08.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:08 smithi136 ceph-mon[47443]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-02T04:03:08.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:08 smithi136 ceph-mon[47443]: osdmap e82: 12 total, 12 up, 12 in 2024-06-02T04:03:08.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:08 smithi136 ceph-mon[47443]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-02T04:03:08.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:08 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/219180564' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-06-02T04:03:08.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.684+0000 7f684bfff700 1 -- 172.21.15.123:0/219180564 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6864068140 con 0x7f6864106c50 2024-06-02T04:03:08.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.687+0000 7f6869225700 1 -- 172.21.15.123:0/219180564 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f684c0a1120 msgr2=0x7f684c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:08.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.687+0000 7f6869225700 1 --2- 172.21.15.123:0/219180564 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f684c0a1120 0x7f684c0a35e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6858005950 tx=0x7f685800b410 comp rx=0 tx=0).stop 2024-06-02T04:03:08.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.687+0000 7f6869225700 1 -- 172.21.15.123:0/219180564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6864106c50 msgr2=0x7f686419e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:08.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.687+0000 7f6869225700 1 --2- 172.21.15.123:0/219180564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6864106c50 0x7f686419e480 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f685c00ada0 tx=0x7f685c00c330 comp rx=0 tx=0).stop 2024-06-02T04:03:08.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.687+0000 7f6869225700 1 -- 172.21.15.123:0/219180564 shutdown_connections 2024-06-02T04:03:08.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.687+0000 7f6869225700 1 --2- 172.21.15.123:0/219180564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6864106c50 0x7f686419e480 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:08.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.687+0000 7f6869225700 1 --2- 172.21.15.123:0/219180564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68641019f0 0x7f6864196f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:08.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.687+0000 7f6869225700 1 --2- 172.21.15.123:0/219180564 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f684c0a1120 0x7f684c0a35e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:08.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.687+0000 7f6869225700 1 --2- 172.21.15.123:0/219180564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6864104320 0x7f6864197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:08.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.687+0000 7f6869225700 1 -- 172.21.15.123:0/219180564 >> 172.21.15.123:0/219180564 conn(0x7f68640fb3e0 msgr2=0x7f6864102430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:08.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.687+0000 7f6869225700 1 -- 172.21.15.123:0/219180564 shutdown_connections 2024-06-02T04:03:08.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.687+0000 7f6869225700 1 -- 172.21.15.123:0/219180564 wait complete. 2024-06-02T04:03:08.702 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-06-02T04:03:08.702 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-06-02T04:03:08.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.833+0000 7f2d5739d700 1 -- 172.21.15.123:0/2401730554 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d50101990 msgr2=0x7f2d501082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:08.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.833+0000 7f2d5739d700 1 --2- 172.21.15.123:0/2401730554 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d50101990 0x7f2d501082b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2d4800b0a0 tx=0x7f2d4800b3b0 comp rx=0 tx=0).stop 2024-06-02T04:03:08.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.833+0000 7f2d5739d700 1 -- 172.21.15.123:0/2401730554 shutdown_connections 2024-06-02T04:03:08.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.833+0000 7f2d5739d700 1 --2- 172.21.15.123:0/2401730554 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d50101990 0x7f2d501082b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:08.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.833+0000 7f2d5739d700 1 --2- 172.21.15.123:0/2401730554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d500ffe80 0x7f2d501002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:08.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.833+0000 7f2d5739d700 1 --2- 172.21.15.123:0/2401730554 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d50100fd0 0x7f2d50101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:08.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.833+0000 7f2d5739d700 1 -- 172.21.15.123:0/2401730554 >> 172.21.15.123:0/2401730554 conn(0x7f2d500fb3f0 msgr2=0x7f2d500fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:08.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.833+0000 7f2d5739d700 1 -- 172.21.15.123:0/2401730554 shutdown_connections 2024-06-02T04:03:08.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.833+0000 7f2d5739d700 1 -- 172.21.15.123:0/2401730554 wait complete. 2024-06-02T04:03:08.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.834+0000 7f2d5739d700 1 Processor -- start 2024-06-02T04:03:08.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.834+0000 7f2d5739d700 1 -- start start 2024-06-02T04:03:08.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.834+0000 7f2d5739d700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d500ffe80 0x7f2d50103db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:08.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.834+0000 7f2d5739d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d50100fd0 0x7f2d50102440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:08.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.834+0000 7f2d5739d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d50101990 0x7f2d50102980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:08.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.834+0000 7f2d5739d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d50103120 con 0x7f2d50101990 2024-06-02T04:03:08.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.834+0000 7f2d5739d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d50103290 con 0x7f2d50100fd0 2024-06-02T04:03:08.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.834+0000 7f2d5739d700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d501a1190 con 0x7f2d500ffe80 2024-06-02T04:03:08.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.834+0000 7f2d5593a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d50101990 0x7f2d50102980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:08.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.834+0000 7f2d5593a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d50101990 0x7f2d50102980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47098/0 (socket says 172.21.15.123:47098) 2024-06-02T04:03:08.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.834+0000 7f2d5593a700 1 -- 172.21.15.123:0/1175089558 learned_addr learned my addr 172.21.15.123:0/1175089558 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:08.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.834+0000 7f2d54938700 1 --2- 172.21.15.123:0/1175089558 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d50100fd0 0x7f2d50102440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:08.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.834+0000 7f2d55139700 1 --2- 172.21.15.123:0/1175089558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d500ffe80 0x7f2d50103db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:08.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.834+0000 7f2d5593a700 1 -- 172.21.15.123:0/1175089558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d500ffe80 msgr2=0x7f2d50103db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:08.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.834+0000 7f2d5593a700 1 --2- 172.21.15.123:0/1175089558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d500ffe80 0x7f2d50103db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:08.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.834+0000 7f2d5593a700 1 -- 172.21.15.123:0/1175089558 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d50100fd0 msgr2=0x7f2d50102440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:08.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.834+0000 7f2d5593a700 1 --2- 172.21.15.123:0/1175089558 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d50100fd0 0x7f2d50102440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:08.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.834+0000 7f2d5593a700 1 -- 172.21.15.123:0/1175089558 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d48009d00 con 0x7f2d50101990 2024-06-02T04:03:08.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.834+0000 7f2d55139700 1 --2- 172.21.15.123:0/1175089558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d500ffe80 0x7f2d50103db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:03:08.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.834+0000 7f2d5593a700 1 --2- 172.21.15.123:0/1175089558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d50101990 0x7f2d50102980 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2d480062a0 tx=0x7f2d48004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:08.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.835+0000 7f2d427fc700 1 -- 172.21.15.123:0/1175089558 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4800e040 con 0x7f2d50101990 2024-06-02T04:03:08.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.835+0000 7f2d427fc700 1 -- 172.21.15.123:0/1175089558 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d4801d690 con 0x7f2d50101990 2024-06-02T04:03:08.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.835+0000 7f2d5739d700 1 -- 172.21.15.123:0/1175089558 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d501a13c0 con 0x7f2d50101990 2024-06-02T04:03:08.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.835+0000 7f2d427fc700 1 -- 172.21.15.123:0/1175089558 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d48004280 con 0x7f2d50101990 2024-06-02T04:03:08.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.835+0000 7f2d5739d700 1 -- 172.21.15.123:0/1175089558 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d501a1840 con 0x7f2d50101990 2024-06-02T04:03:08.838 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.836+0000 7f2d5739d700 1 -- 172.21.15.123:0/1175089558 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d50067460 con 0x7f2d50101990 2024-06-02T04:03:08.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.837+0000 7f2d427fc700 1 -- 172.21.15.123:0/1175089558 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f2d4801da90 con 0x7f2d50101990 2024-06-02T04:03:08.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.837+0000 7f2d427fc700 1 --2- 172.21.15.123:0/1175089558 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2d3c0a11a0 0x7f2d3c0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:08.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.837+0000 7f2d55139700 1 --2- 172.21.15.123:0/1175089558 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2d3c0a11a0 0x7f2d3c0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:08.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.837+0000 7f2d427fc700 1 -- 172.21.15.123:0/1175089558 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2d480ce040 con 0x7f2d50101990 2024-06-02T04:03:08.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.838+0000 7f2d55139700 1 --2- 172.21.15.123:0/1175089558 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2d3c0a11a0 0x7f2d3c0a3660 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2d44007900 tx=0x7f2d44008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:08.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:08.842+0000 7f2d427fc700 1 -- 172.21.15.123:0/1175089558 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2d480979b0 con 0x7f2d50101990 2024-06-02T04:03:09.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.084+0000 7f2d5739d700 1 -- 172.21.15.123:0/1175089558 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7f2d5010ba20 con 0x7f2d50101990 2024-06-02T04:03:09.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.693+0000 7f2d427fc700 1 -- 172.21.15.123:0/1175089558 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) v1 ==== 105+0+0 (secure 0 0 0) 0x7f2d4809afd0 con 0x7f2d50101990 2024-06-02T04:03:09.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.696+0000 7f2d5739d700 1 -- 172.21.15.123:0/1175089558 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2d3c0a11a0 msgr2=0x7f2d3c0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:09.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.696+0000 7f2d5739d700 1 --2- 172.21.15.123:0/1175089558 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2d3c0a11a0 0x7f2d3c0a3660 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2d44007900 tx=0x7f2d44008040 comp rx=0 tx=0).stop 2024-06-02T04:03:09.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.696+0000 7f2d5739d700 1 -- 172.21.15.123:0/1175089558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d50101990 msgr2=0x7f2d50102980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:09.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.696+0000 7f2d5739d700 1 --2- 172.21.15.123:0/1175089558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d50101990 0x7f2d50102980 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2d480062a0 tx=0x7f2d48004d30 comp rx=0 tx=0).stop 2024-06-02T04:03:09.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.696+0000 7f2d5739d700 1 -- 172.21.15.123:0/1175089558 shutdown_connections 2024-06-02T04:03:09.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.696+0000 7f2d5739d700 1 --2- 172.21.15.123:0/1175089558 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2d50101990 0x7f2d50102980 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:09.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.696+0000 7f2d5739d700 1 --2- 172.21.15.123:0/1175089558 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2d500ffe80 0x7f2d50103db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:09.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.696+0000 7f2d5739d700 1 --2- 172.21.15.123:0/1175089558 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2d3c0a11a0 0x7f2d3c0a3660 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:09.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.696+0000 7f2d5739d700 1 --2- 172.21.15.123:0/1175089558 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2d50100fd0 0x7f2d50102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:09.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.696+0000 7f2d5739d700 1 -- 172.21.15.123:0/1175089558 >> 172.21.15.123:0/1175089558 conn(0x7f2d500fb3f0 msgr2=0x7f2d500fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:09.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.696+0000 7f2d5739d700 1 -- 172.21.15.123:0/1175089558 shutdown_connections 2024-06-02T04:03:09.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.696+0000 7f2d5739d700 1 -- 172.21.15.123:0/1175089558 wait complete. 2024-06-02T04:03:09.713 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-06-02T04:03:09.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.840+0000 7f88a47f8700 1 -- 172.21.15.123:0/2289051230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f889c100f80 msgr2=0x7f889c1013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:09.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.840+0000 7f88a47f8700 1 --2- 172.21.15.123:0/2289051230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f889c100f80 0x7f889c1013a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f88980099c0 tx=0x7f8898009cd0 comp rx=0 tx=0).stop 2024-06-02T04:03:09.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.840+0000 7f88a47f8700 1 -- 172.21.15.123:0/2289051230 shutdown_connections 2024-06-02T04:03:09.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.840+0000 7f88a47f8700 1 --2- 172.21.15.123:0/2289051230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f889c102b10 0x7f889c1093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:09.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.840+0000 7f88a47f8700 1 --2- 172.21.15.123:0/2289051230 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f889c100f80 0x7f889c1013a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:09.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.840+0000 7f88a47f8700 1 --2- 172.21.15.123:0/2289051230 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f889c102170 0x7f889c1025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:09.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.840+0000 7f88a47f8700 1 -- 172.21.15.123:0/2289051230 >> 172.21.15.123:0/2289051230 conn(0x7f889c0fc4f0 msgr2=0x7f889c0fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:09.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.841+0000 7f88a47f8700 1 -- 172.21.15.123:0/2289051230 shutdown_connections 2024-06-02T04:03:09.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.841+0000 7f88a47f8700 1 -- 172.21.15.123:0/2289051230 wait complete. 2024-06-02T04:03:09.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.841+0000 7f88a47f8700 1 Processor -- start 2024-06-02T04:03:09.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.841+0000 7f88a47f8700 1 -- start start 2024-06-02T04:03:09.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.841+0000 7f88a47f8700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f889c100f80 0x7f889c196fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:09.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.841+0000 7f88a47f8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f889c102170 0x7f889c1974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:09.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.841+0000 7f88a47f8700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f889c102b10 0x7f889c19e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:09.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.841+0000 7f88a47f8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c19eae0 con 0x7f889c102170 2024-06-02T04:03:09.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.841+0000 7f88a47f8700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c19ec20 con 0x7f889c100f80 2024-06-02T04:03:09.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.841+0000 7f88a47f8700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c19edb0 con 0x7f889c102b10 2024-06-02T04:03:09.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.841+0000 7f88a1d93700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f889c102170 0x7f889c1974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:09.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.841+0000 7f88a1d93700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f889c102170 0x7f889c1974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47112/0 (socket says 172.21.15.123:47112) 2024-06-02T04:03:09.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.841+0000 7f88a1d93700 1 -- 172.21.15.123:0/1880873243 learned_addr learned my addr 172.21.15.123:0/1880873243 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:09.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.841+0000 7f88a2594700 1 --2- 172.21.15.123:0/1880873243 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f889c100f80 0x7f889c196fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:09.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.842+0000 7f88a2d95700 1 --2- 172.21.15.123:0/1880873243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f889c102b10 0x7f889c19e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:09.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.842+0000 7f88a1d93700 1 -- 172.21.15.123:0/1880873243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f889c102b10 msgr2=0x7f889c19e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:09.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.842+0000 7f88a1d93700 1 --2- 172.21.15.123:0/1880873243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f889c102b10 0x7f889c19e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:09.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.842+0000 7f88a1d93700 1 -- 172.21.15.123:0/1880873243 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f889c100f80 msgr2=0x7f889c196fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:09.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.842+0000 7f88a1d93700 1 --2- 172.21.15.123:0/1880873243 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f889c100f80 0x7f889c196fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:09.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.842+0000 7f88a1d93700 1 -- 172.21.15.123:0/1880873243 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88980095f0 con 0x7f889c102170 2024-06-02T04:03:09.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.842+0000 7f88a1d93700 1 --2- 172.21.15.123:0/1880873243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f889c102170 0x7f889c1974f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f888c00c920 tx=0x7f888c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:09.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.842+0000 7f88937fe700 1 -- 172.21.15.123:0/1880873243 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c007b00 con 0x7f889c102170 2024-06-02T04:03:09.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.842+0000 7f88937fe700 1 -- 172.21.15.123:0/1880873243 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f888c00ce70 con 0x7f889c102170 2024-06-02T04:03:09.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.842+0000 7f88a47f8700 1 -- 172.21.15.123:0/1880873243 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f889c19f090 con 0x7f889c102170 2024-06-02T04:03:09.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.842+0000 7f88937fe700 1 -- 172.21.15.123:0/1880873243 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c0054e0 con 0x7f889c102170 2024-06-02T04:03:09.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.842+0000 7f88a47f8700 1 -- 172.21.15.123:0/1880873243 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f889c19f5a0 con 0x7f889c102170 2024-06-02T04:03:09.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.843+0000 7f88a47f8700 1 -- 172.21.15.123:0/1880873243 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f889c108450 con 0x7f889c102170 2024-06-02T04:03:09.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.845+0000 7f88937fe700 1 -- 172.21.15.123:0/1880873243 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f888c004750 con 0x7f889c102170 2024-06-02T04:03:09.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.845+0000 7f88937fe700 1 --2- 172.21.15.123:0/1880873243 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f88880a1120 0x7f88880a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:09.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.845+0000 7f88a2594700 1 --2- 172.21.15.123:0/1880873243 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f88880a1120 0x7f88880a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:09.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.845+0000 7f88937fe700 1 -- 172.21.15.123:0/1880873243 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f888c0cc720 con 0x7f889c102170 2024-06-02T04:03:09.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.846+0000 7f88a2594700 1 --2- 172.21.15.123:0/1880873243 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f88880a1120 0x7f88880a35e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8898009f50 tx=0x7f88980037c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:09.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:09.849+0000 7f88937fe700 1 -- 172.21.15.123:0/1880873243 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f888c096000 con 0x7f889c102170 2024-06-02T04:03:10.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:09 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/219180564' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-06-02T04:03:10.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:09 smithi162 ceph-mon[47009]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-02T04:03:10.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:09 smithi162 ceph-mon[47009]: pgmap v223: 97 pgs: 12 creating+peering, 35 active+clean, 50 unknown; 578 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 7 op/s 2024-06-02T04:03:10.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:09 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/1175089558' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-06-02T04:03:10.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:09 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/219180564' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-06-02T04:03:10.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:09 smithi123 ceph-mon[42885]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-02T04:03:10.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:09 smithi123 ceph-mon[42885]: pgmap v223: 97 pgs: 12 creating+peering, 35 active+clean, 50 unknown; 578 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 7 op/s 2024-06-02T04:03:10.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:09 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1175089558' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-06-02T04:03:10.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:09 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/219180564' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-06-02T04:03:10.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:09 smithi136 ceph-mon[47443]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-02T04:03:10.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:09 smithi136 ceph-mon[47443]: pgmap v223: 97 pgs: 12 creating+peering, 35 active+clean, 50 unknown; 578 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s wr, 7 op/s 2024-06-02T04:03:10.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:09 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/1175089558' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-06-02T04:03:10.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.099+0000 7f88a47f8700 1 -- 172.21.15.123:0/1880873243 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f889c067cf0 con 0x7f889c102170 2024-06-02T04:03:10.702 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.702+0000 7f88937fe700 1 -- 172.21.15.123:0/1880873243 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v20) v1 ==== 121+0+0 (secure 0 0 0) 0x7f888c01d020 con 0x7f889c102170 2024-06-02T04:03:10.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.704+0000 7f88a47f8700 1 -- 172.21.15.123:0/1880873243 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f88880a1120 msgr2=0x7f88880a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:10.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.704+0000 7f88a47f8700 1 --2- 172.21.15.123:0/1880873243 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f88880a1120 0x7f88880a35e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8898009f50 tx=0x7f88980037c0 comp rx=0 tx=0).stop 2024-06-02T04:03:10.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.704+0000 7f88a47f8700 1 -- 172.21.15.123:0/1880873243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f889c102170 msgr2=0x7f889c1974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:10.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.704+0000 7f88a47f8700 1 --2- 172.21.15.123:0/1880873243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f889c102170 0x7f889c1974f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f888c00c920 tx=0x7f888c00cc30 comp rx=0 tx=0).stop 2024-06-02T04:03:10.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.705+0000 7f88a47f8700 1 -- 172.21.15.123:0/1880873243 shutdown_connections 2024-06-02T04:03:10.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.705+0000 7f88a47f8700 1 --2- 172.21.15.123:0/1880873243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f889c102b10 0x7f889c19e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:10.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.705+0000 7f88a47f8700 1 --2- 172.21.15.123:0/1880873243 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f88880a1120 0x7f88880a35e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:10.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.705+0000 7f88a47f8700 1 --2- 172.21.15.123:0/1880873243 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f889c100f80 0x7f889c196fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:10.705 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.705+0000 7f88a47f8700 1 --2- 172.21.15.123:0/1880873243 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f889c102170 0x7f889c1974f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:10.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.705+0000 7f88a47f8700 1 -- 172.21.15.123:0/1880873243 >> 172.21.15.123:0/1880873243 conn(0x7f889c0fc4f0 msgr2=0x7f889c105590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:10.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.705+0000 7f88a47f8700 1 -- 172.21.15.123:0/1880873243 shutdown_connections 2024-06-02T04:03:10.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.705+0000 7f88a47f8700 1 -- 172.21.15.123:0/1880873243 wait complete. 2024-06-02T04:03:10.722 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-06-02T04:03:10.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.849+0000 7f41cd416700 1 -- 172.21.15.123:0/726625265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41c8101500 msgr2=0x7f41c8101920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:10.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.849+0000 7f41cd416700 1 --2- 172.21.15.123:0/726625265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41c8101500 0x7f41c8101920 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f41b0009990 tx=0x7f41b0009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:10.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.849+0000 7f41cd416700 1 -- 172.21.15.123:0/726625265 shutdown_connections 2024-06-02T04:03:10.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.849+0000 7f41cd416700 1 --2- 172.21.15.123:0/726625265 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41c8100a80 0x7f41c8108320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:10.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.849+0000 7f41cd416700 1 --2- 172.21.15.123:0/726625265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41c8101500 0x7f41c8101920 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:10.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.849+0000 7f41cd416700 1 --2- 172.21.15.123:0/726625265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41c81000c0 0x7f41c8100540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:10.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.849+0000 7f41cd416700 1 -- 172.21.15.123:0/726625265 >> 172.21.15.123:0/726625265 conn(0x7f41c80fab70 msgr2=0x7f41c80fcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:10.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.849+0000 7f41cd416700 1 -- 172.21.15.123:0/726625265 shutdown_connections 2024-06-02T04:03:10.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.849+0000 7f41cd416700 1 -- 172.21.15.123:0/726625265 wait complete. 2024-06-02T04:03:10.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.850+0000 7f41cd416700 1 Processor -- start 2024-06-02T04:03:10.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.850+0000 7f41cd416700 1 -- start start 2024-06-02T04:03:10.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.850+0000 7f41cd416700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41c81000c0 0x7f41c8103e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:10.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.850+0000 7f41cd416700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41c8100a80 0x7f41c81024b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:10.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.850+0000 7f41cd416700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41c8101500 0x7f41c81029f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:10.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.850+0000 7f41cd416700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c8103190 con 0x7f41c8101500 2024-06-02T04:03:10.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.850+0000 7f41cd416700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c8103300 con 0x7f41c81000c0 2024-06-02T04:03:10.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.850+0000 7f41cd416700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c81a0fb0 con 0x7f41c8100a80 2024-06-02T04:03:10.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.850+0000 7f41c77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41c8101500 0x7f41c81029f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:10.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.850+0000 7f41c77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41c8101500 0x7f41c81029f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47134/0 (socket says 172.21.15.123:47134) 2024-06-02T04:03:10.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.850+0000 7f41c77fe700 1 -- 172.21.15.123:0/1974231498 learned_addr learned my addr 172.21.15.123:0/1974231498 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:10.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.850+0000 7f41c6ffd700 1 --2- 172.21.15.123:0/1974231498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41c81000c0 0x7f41c8103e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:10.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.850+0000 7f41c67fc700 1 --2- 172.21.15.123:0/1974231498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41c8100a80 0x7f41c81024b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:10.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.850+0000 7f41c77fe700 1 -- 172.21.15.123:0/1974231498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41c8100a80 msgr2=0x7f41c81024b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:10.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.850+0000 7f41c77fe700 1 --2- 172.21.15.123:0/1974231498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41c8100a80 0x7f41c81024b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:10.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.850+0000 7f41c77fe700 1 -- 172.21.15.123:0/1974231498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41c81000c0 msgr2=0x7f41c8103e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:10.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.850+0000 7f41c77fe700 1 --2- 172.21.15.123:0/1974231498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41c81000c0 0x7f41c8103e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:10.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.850+0000 7f41c77fe700 1 -- 172.21.15.123:0/1974231498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b00095f0 con 0x7f41c8101500 2024-06-02T04:03:10.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.850+0000 7f41c77fe700 1 --2- 172.21.15.123:0/1974231498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41c8101500 0x7f41c81029f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f41c0007ee0 tx=0x7f41c000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:10.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.851+0000 7f41bffff700 1 -- 172.21.15.123:0/1974231498 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c0017070 con 0x7f41c8101500 2024-06-02T04:03:10.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.851+0000 7f41bffff700 1 -- 172.21.15.123:0/1974231498 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f41c000f040 con 0x7f41c8101500 2024-06-02T04:03:10.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.851+0000 7f41cd416700 1 -- 172.21.15.123:0/1974231498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c81a1240 con 0x7f41c8101500 2024-06-02T04:03:10.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.851+0000 7f41bffff700 1 -- 172.21.15.123:0/1974231498 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c0005740 con 0x7f41c8101500 2024-06-02T04:03:10.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.851+0000 7f41cd416700 1 -- 172.21.15.123:0/1974231498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c81a1700 con 0x7f41c8101500 2024-06-02T04:03:10.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.851+0000 7f41cd416700 1 -- 172.21.15.123:0/1974231498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c8068140 con 0x7f41c8101500 2024-06-02T04:03:10.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.853+0000 7f41bffff700 1 -- 172.21.15.123:0/1974231498 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f41c0004c40 con 0x7f41c8101500 2024-06-02T04:03:10.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.853+0000 7f41bffff700 1 --2- 172.21.15.123:0/1974231498 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f41b40a1120 0x7f41b40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:10.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.853+0000 7f41c6ffd700 1 --2- 172.21.15.123:0/1974231498 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f41b40a1120 0x7f41b40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:10.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.853+0000 7f41bffff700 1 -- 172.21.15.123:0/1974231498 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f41c00cc600 con 0x7f41c8101500 2024-06-02T04:03:10.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.854+0000 7f41c6ffd700 1 --2- 172.21.15.123:0/1974231498 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f41b40a1120 0x7f41b40a35e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f41b000b5c0 tx=0x7f41b0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:10.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:10.857+0000 7f41bffff700 1 -- 172.21.15.123:0/1974231498 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f41c0095ee0 con 0x7f41c8101500 2024-06-02T04:03:11.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:10 smithi162 ceph-mon[47009]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-06-02T04:03:11.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:10 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/1175089558' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-06-02T04:03:11.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:10 smithi162 ceph-mon[47009]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-06-02T04:03:11.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:10 smithi162 ceph-mon[47009]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-02T04:03:11.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:10 smithi162 ceph-mon[47009]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-06-02T04:03:11.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:10 smithi162 ceph-mon[47009]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-06-02T04:03:11.051 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:10 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/1880873243' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-02T04:03:11.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:10 smithi123 ceph-mon[42885]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-06-02T04:03:11.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:10 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1175089558' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-06-02T04:03:11.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:10 smithi123 ceph-mon[42885]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-06-02T04:03:11.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:10 smithi123 ceph-mon[42885]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-02T04:03:11.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:10 smithi123 ceph-mon[42885]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-06-02T04:03:11.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:10 smithi123 ceph-mon[42885]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-06-02T04:03:11.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:10 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1880873243' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-02T04:03:11.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:10 smithi136 ceph-mon[47443]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-06-02T04:03:11.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:10 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/1175089558' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-06-02T04:03:11.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:10 smithi136 ceph-mon[47443]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-06-02T04:03:11.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:10 smithi136 ceph-mon[47443]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-06-02T04:03:11.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:10 smithi136 ceph-mon[47443]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-06-02T04:03:11.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:10 smithi136 ceph-mon[47443]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-06-02T04:03:11.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:10 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/1880873243' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-06-02T04:03:11.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:11.105+0000 7f41cd416700 1 -- 172.21.15.123:0/1974231498 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f41c810b6c0 con 0x7f41c8101500 2024-06-02T04:03:12.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:11 smithi162 ceph-mon[47009]: mds.? [v2:172.21.15.162:6838/2588884232,v1:172.21.15.162:6839/2588884232] up:active 2024-06-02T04:03:12.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:11 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/1880873243' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-06-02T04:03:12.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:11 smithi162 ceph-mon[47009]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-06-02T04:03:12.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:11 smithi162 ceph-mon[47009]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-06-02T04:03:12.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:11 smithi162 ceph-mon[47009]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-06-02T04:03:12.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:11 smithi162 ceph-mon[47009]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-06-02T04:03:12.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:11 smithi162 ceph-mon[47009]: pgmap v224: 97 pgs: 12 creating+peering, 85 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 7 op/s 2024-06-02T04:03:12.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:11 smithi162 ceph-mon[47009]: mds.? [v2:172.21.15.136:6836/2572418263,v1:172.21.15.136:6837/2572418263] up:active 2024-06-02T04:03:12.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:11 smithi162 ceph-mon[47009]: daemon mds.l assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-06-02T04:03:12.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:11 smithi162 ceph-mon[47009]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:03:12.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:11 smithi162 ceph-mon[47009]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=l=up:creating} 3 up:standby-replay 5 up:standby 2024-06-02T04:03:12.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:11 smithi162 ceph-mon[47009]: daemon mds.l is now active in filesystem cephfs as rank 3 2024-06-02T04:03:12.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:11 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/1974231498' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-02T04:03:12.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:11 smithi123 ceph-mon[42885]: mds.? [v2:172.21.15.162:6838/2588884232,v1:172.21.15.162:6839/2588884232] up:active 2024-06-02T04:03:12.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:11 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1880873243' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-06-02T04:03:12.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:11 smithi123 ceph-mon[42885]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-06-02T04:03:12.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:11 smithi123 ceph-mon[42885]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-06-02T04:03:12.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:11 smithi123 ceph-mon[42885]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-06-02T04:03:12.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:11 smithi123 ceph-mon[42885]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-06-02T04:03:12.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:11 smithi123 ceph-mon[42885]: pgmap v224: 97 pgs: 12 creating+peering, 85 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 7 op/s 2024-06-02T04:03:12.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:11 smithi123 ceph-mon[42885]: mds.? [v2:172.21.15.136:6836/2572418263,v1:172.21.15.136:6837/2572418263] up:active 2024-06-02T04:03:12.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:11 smithi123 ceph-mon[42885]: daemon mds.l assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-06-02T04:03:12.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:11 smithi123 ceph-mon[42885]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:03:12.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:11 smithi123 ceph-mon[42885]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=l=up:creating} 3 up:standby-replay 5 up:standby 2024-06-02T04:03:12.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:11 smithi123 ceph-mon[42885]: daemon mds.l is now active in filesystem cephfs as rank 3 2024-06-02T04:03:12.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:11 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1974231498' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-02T04:03:12.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.080+0000 7f41bffff700 1 -- 172.21.15.123:0/1974231498 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) v1 ==== 115+0+0 (secure 0 0 0) 0x7f41c0099500 con 0x7f41c8101500 2024-06-02T04:03:12.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.083+0000 7f41cd416700 1 -- 172.21.15.123:0/1974231498 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f41b40a1120 msgr2=0x7f41b40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:12.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.083+0000 7f41cd416700 1 --2- 172.21.15.123:0/1974231498 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f41b40a1120 0x7f41b40a35e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f41b000b5c0 tx=0x7f41b0005fd0 comp rx=0 tx=0).stop 2024-06-02T04:03:12.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.083+0000 7f41cd416700 1 -- 172.21.15.123:0/1974231498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41c8101500 msgr2=0x7f41c81029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:12.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.083+0000 7f41cd416700 1 --2- 172.21.15.123:0/1974231498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41c8101500 0x7f41c81029f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f41c0007ee0 tx=0x7f41c000d3b0 comp rx=0 tx=0).stop 2024-06-02T04:03:12.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.083+0000 7f41cd416700 1 -- 172.21.15.123:0/1974231498 shutdown_connections 2024-06-02T04:03:12.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.083+0000 7f41cd416700 1 --2- 172.21.15.123:0/1974231498 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f41c8101500 0x7f41c81029f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:12.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.083+0000 7f41cd416700 1 --2- 172.21.15.123:0/1974231498 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f41b40a1120 0x7f41b40a35e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:12.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.083+0000 7f41cd416700 1 --2- 172.21.15.123:0/1974231498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41c81000c0 0x7f41c8103e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:12.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.083+0000 7f41cd416700 1 --2- 172.21.15.123:0/1974231498 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41c8100a80 0x7f41c81024b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:12.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.083+0000 7f41cd416700 1 -- 172.21.15.123:0/1974231498 >> 172.21.15.123:0/1974231498 conn(0x7f41c80fab70 msgr2=0x7f41c80fefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:12.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.083+0000 7f41cd416700 1 -- 172.21.15.123:0/1974231498 shutdown_connections 2024-06-02T04:03:12.084 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.083+0000 7f41cd416700 1 -- 172.21.15.123:0/1974231498 wait complete. 2024-06-02T04:03:12.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:11 smithi136 ceph-mon[47443]: mds.? [v2:172.21.15.162:6838/2588884232,v1:172.21.15.162:6839/2588884232] up:active 2024-06-02T04:03:12.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:11 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/1880873243' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-06-02T04:03:12.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:11 smithi136 ceph-mon[47443]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-06-02T04:03:12.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:11 smithi136 ceph-mon[47443]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-06-02T04:03:12.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:11 smithi136 ceph-mon[47443]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-06-02T04:03:12.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:11 smithi136 ceph-mon[47443]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-06-02T04:03:12.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:11 smithi136 ceph-mon[47443]: pgmap v224: 97 pgs: 12 creating+peering, 85 active+clean; 579 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 7 op/s 2024-06-02T04:03:12.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:11 smithi136 ceph-mon[47443]: mds.? [v2:172.21.15.136:6836/2572418263,v1:172.21.15.136:6837/2572418263] up:active 2024-06-02T04:03:12.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:11 smithi136 ceph-mon[47443]: daemon mds.l assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-06-02T04:03:12.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:11 smithi136 ceph-mon[47443]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-06-02T04:03:12.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:11 smithi136 ceph-mon[47443]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=l=up:creating} 3 up:standby-replay 5 up:standby 2024-06-02T04:03:12.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:11 smithi136 ceph-mon[47443]: daemon mds.l is now active in filesystem cephfs as rank 3 2024-06-02T04:03:12.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:11 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/1974231498' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-06-02T04:03:12.101 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-06-02T04:03:12.102 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-06-02T04:03:12.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.232+0000 7fe258414700 1 -- 172.21.15.123:0/3960086398 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe250101990 msgr2=0x7fe2501082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:12.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.232+0000 7fe258414700 1 --2- 172.21.15.123:0/3960086398 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe250101990 0x7fe2501082b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe24800b0a0 tx=0x7fe24800b3b0 comp rx=0 tx=0).stop 2024-06-02T04:03:12.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.232+0000 7fe258414700 1 -- 172.21.15.123:0/3960086398 shutdown_connections 2024-06-02T04:03:12.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.232+0000 7fe258414700 1 --2- 172.21.15.123:0/3960086398 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe250101990 0x7fe2501082b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:12.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.232+0000 7fe258414700 1 --2- 172.21.15.123:0/3960086398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2500ffe80 0x7fe2501002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:12.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.232+0000 7fe258414700 1 --2- 172.21.15.123:0/3960086398 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe250100fd0 0x7fe250101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:12.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.232+0000 7fe258414700 1 -- 172.21.15.123:0/3960086398 >> 172.21.15.123:0/3960086398 conn(0x7fe2500fb3f0 msgr2=0x7fe2500fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:12.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.232+0000 7fe258414700 1 -- 172.21.15.123:0/3960086398 shutdown_connections 2024-06-02T04:03:12.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.232+0000 7fe258414700 1 -- 172.21.15.123:0/3960086398 wait complete. 2024-06-02T04:03:12.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.232+0000 7fe258414700 1 Processor -- start 2024-06-02T04:03:12.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.233+0000 7fe258414700 1 -- start start 2024-06-02T04:03:12.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.233+0000 7fe258414700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2500ffe80 0x7fe250103d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:12.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.233+0000 7fe258414700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe250100fd0 0x7fe250102440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:12.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.233+0000 7fe258414700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe250101990 0x7fe250102980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:12.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.233+0000 7fe258414700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe250103080 con 0x7fe2500ffe80 2024-06-02T04:03:12.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.233+0000 7fe258414700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2501031f0 con 0x7fe250101990 2024-06-02T04:03:12.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.233+0000 7fe258414700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2501a1030 con 0x7fe250100fd0 2024-06-02T04:03:12.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.233+0000 7fe2561b0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2500ffe80 0x7fe250103d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:12.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.233+0000 7fe2561b0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2500ffe80 0x7fe250103d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47164/0 (socket says 172.21.15.123:47164) 2024-06-02T04:03:12.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.233+0000 7fe2561b0700 1 -- 172.21.15.123:0/1366048741 learned_addr learned my addr 172.21.15.123:0/1366048741 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:12.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.233+0000 7fe2559af700 1 --2- 172.21.15.123:0/1366048741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe250100fd0 0x7fe250102440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:12.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.233+0000 7fe2561b0700 1 -- 172.21.15.123:0/1366048741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe250100fd0 msgr2=0x7fe250102440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:12.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.233+0000 7fe2561b0700 1 --2- 172.21.15.123:0/1366048741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe250100fd0 0x7fe250102440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:12.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.233+0000 7fe2561b0700 1 -- 172.21.15.123:0/1366048741 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe250101990 msgr2=0x7fe250102980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:12.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.233+0000 7fe2561b0700 1 --2- 172.21.15.123:0/1366048741 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe250101990 0x7fe250102980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:12.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.233+0000 7fe2561b0700 1 -- 172.21.15.123:0/1366048741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe248009d00 con 0x7fe2500ffe80 2024-06-02T04:03:12.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.233+0000 7fe2559af700 1 --2- 172.21.15.123:0/1366048741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe250100fd0 0x7fe250102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:03:12.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.233+0000 7fe2561b0700 1 --2- 172.21.15.123:0/1366048741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2500ffe80 0x7fe250103d60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe24c00d950 tx=0x7fe24c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:12.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.233+0000 7fe2437fe700 1 -- 172.21.15.123:0/1366048741 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c009b40 con 0x7fe2500ffe80 2024-06-02T04:03:12.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.233+0000 7fe2437fe700 1 -- 172.21.15.123:0/1366048741 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe24c009ca0 con 0x7fe2500ffe80 2024-06-02T04:03:12.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.233+0000 7fe258414700 1 -- 172.21.15.123:0/1366048741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2501a1290 con 0x7fe2500ffe80 2024-06-02T04:03:12.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.233+0000 7fe2437fe700 1 -- 172.21.15.123:0/1366048741 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c00f620 con 0x7fe2500ffe80 2024-06-02T04:03:12.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.233+0000 7fe258414700 1 -- 172.21.15.123:0/1366048741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2501a17f0 con 0x7fe2500ffe80 2024-06-02T04:03:12.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.234+0000 7fe258414700 1 -- 172.21.15.123:0/1366048741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe250068140 con 0x7fe2500ffe80 2024-06-02T04:03:12.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.235+0000 7fe2437fe700 1 -- 172.21.15.123:0/1366048741 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fe24c010460 con 0x7fe2500ffe80 2024-06-02T04:03:12.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.236+0000 7fe2437fe700 1 --2- 172.21.15.123:0/1366048741 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe23c0a11a0 0x7fe23c0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:12.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.236+0000 7fe2559af700 1 --2- 172.21.15.123:0/1366048741 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe23c0a11a0 0x7fe23c0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:12.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.236+0000 7fe2437fe700 1 -- 172.21.15.123:0/1366048741 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe24c0ccad0 con 0x7fe2500ffe80 2024-06-02T04:03:12.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.236+0000 7fe2559af700 1 --2- 172.21.15.123:0/1366048741 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe23c0a11a0 0x7fe23c0a3660 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe244005fd0 tx=0x7fe244005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:12.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.241+0000 7fe2437fe700 1 -- 172.21.15.123:0/1366048741 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe24c0963b0 con 0x7fe2500ffe80 2024-06-02T04:03:12.471 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.472+0000 7fe258414700 1 -- 172.21.15.123:0/1366048741 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2500fd580 con 0x7fe23c0a11a0 2024-06-02T04:03:12.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.497+0000 7fe2437fe700 1 -- 172.21.15.123:0/1366048741 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe2500fd580 con 0x7fe23c0a11a0 2024-06-02T04:03:12.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.499+0000 7fe258414700 1 -- 172.21.15.123:0/1366048741 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe23c0a11a0 msgr2=0x7fe23c0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:12.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.499+0000 7fe258414700 1 --2- 172.21.15.123:0/1366048741 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe23c0a11a0 0x7fe23c0a3660 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe244005fd0 tx=0x7fe244005e30 comp rx=0 tx=0).stop 2024-06-02T04:03:12.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.499+0000 7fe258414700 1 -- 172.21.15.123:0/1366048741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2500ffe80 msgr2=0x7fe250103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:12.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.499+0000 7fe258414700 1 --2- 172.21.15.123:0/1366048741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2500ffe80 0x7fe250103d60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe24c00d950 tx=0x7fe24c00dd10 comp rx=0 tx=0).stop 2024-06-02T04:03:12.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.499+0000 7fe258414700 1 -- 172.21.15.123:0/1366048741 shutdown_connections 2024-06-02T04:03:12.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.499+0000 7fe258414700 1 --2- 172.21.15.123:0/1366048741 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe23c0a11a0 0x7fe23c0a3660 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:12.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.499+0000 7fe258414700 1 --2- 172.21.15.123:0/1366048741 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe250101990 0x7fe250102980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:12.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.499+0000 7fe258414700 1 --2- 172.21.15.123:0/1366048741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe2500ffe80 0x7fe250103d60 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:12.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.499+0000 7fe258414700 1 --2- 172.21.15.123:0/1366048741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe250100fd0 0x7fe250102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:12.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.499+0000 7fe258414700 1 -- 172.21.15.123:0/1366048741 >> 172.21.15.123:0/1366048741 conn(0x7fe2500fb3f0 msgr2=0x7fe2500fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:12.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.499+0000 7fe258414700 1 -- 172.21.15.123:0/1366048741 shutdown_connections 2024-06-02T04:03:12.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.499+0000 7fe258414700 1 -- 172.21.15.123:0/1366048741 wait complete. 2024-06-02T04:03:12.512 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-06-02T04:03:12.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.639+0000 7f2a5c976700 1 -- 172.21.15.123:0/703286408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a58100fb0 msgr2=0x7f2a58101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:12.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.639+0000 7f2a5c976700 1 --2- 172.21.15.123:0/703286408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a58100fb0 0x7f2a58101430 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2a48009990 tx=0x7f2a48009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:12.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.639+0000 7f2a5c976700 1 -- 172.21.15.123:0/703286408 shutdown_connections 2024-06-02T04:03:12.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.639+0000 7f2a5c976700 1 --2- 172.21.15.123:0/703286408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a58101970 0x7f2a58108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:12.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.639+0000 7f2a5c976700 1 --2- 172.21.15.123:0/703286408 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a580ffe60 0x7f2a58100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:12.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.639+0000 7f2a5c976700 1 --2- 172.21.15.123:0/703286408 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a58100fb0 0x7f2a58101430 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:12.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.639+0000 7f2a5c976700 1 -- 172.21.15.123:0/703286408 >> 172.21.15.123:0/703286408 conn(0x7f2a580fb3f0 msgr2=0x7f2a580fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:12.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.639+0000 7f2a5c976700 1 -- 172.21.15.123:0/703286408 shutdown_connections 2024-06-02T04:03:12.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.639+0000 7f2a5c976700 1 -- 172.21.15.123:0/703286408 wait complete. 2024-06-02T04:03:12.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.641+0000 7f2a5c976700 1 Processor -- start 2024-06-02T04:03:12.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.641+0000 7f2a5c976700 1 -- start start 2024-06-02T04:03:12.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.641+0000 7f2a5c976700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a580ffe60 0x7f2a58195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:12.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.641+0000 7f2a5c976700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a58100fb0 0x7f2a581962f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:12.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.641+0000 7f2a5c976700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a58101970 0x7f2a5819d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:12.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.641+0000 7f2a5c976700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5819d8e0 con 0x7f2a58100fb0 2024-06-02T04:03:12.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.641+0000 7f2a5c976700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5819da20 con 0x7f2a58101970 2024-06-02T04:03:12.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.641+0000 7f2a5c976700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5819dbb0 con 0x7f2a580ffe60 2024-06-02T04:03:12.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.641+0000 7f2a55d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a58100fb0 0x7f2a581962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:12.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.641+0000 7f2a55d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a58100fb0 0x7f2a581962f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47216/0 (socket says 172.21.15.123:47216) 2024-06-02T04:03:12.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.641+0000 7f2a55d9b700 1 -- 172.21.15.123:0/3008660996 learned_addr learned my addr 172.21.15.123:0/3008660996 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:12.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.641+0000 7f2a56d9d700 1 --2- 172.21.15.123:0/3008660996 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a58101970 0x7f2a5819d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:12.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.641+0000 7f2a55d9b700 1 -- 172.21.15.123:0/3008660996 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a580ffe60 msgr2=0x7f2a58195db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:12.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.641+0000 7f2a5659c700 1 --2- 172.21.15.123:0/3008660996 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a580ffe60 0x7f2a58195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:12.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.641+0000 7f2a55d9b700 1 --2- 172.21.15.123:0/3008660996 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a580ffe60 0x7f2a58195db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:12.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.641+0000 7f2a55d9b700 1 -- 172.21.15.123:0/3008660996 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a58101970 msgr2=0x7f2a5819d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:12.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.641+0000 7f2a55d9b700 1 --2- 172.21.15.123:0/3008660996 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a58101970 0x7f2a5819d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:12.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.641+0000 7f2a55d9b700 1 -- 172.21.15.123:0/3008660996 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a480095f0 con 0x7f2a58100fb0 2024-06-02T04:03:12.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.641+0000 7f2a5659c700 1 --2- 172.21.15.123:0/3008660996 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a580ffe60 0x7f2a58195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:03:12.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.642+0000 7f2a55d9b700 1 --2- 172.21.15.123:0/3008660996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a58100fb0 0x7f2a581962f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800c010 tx=0x7f2a48004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:12.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.642+0000 7f2a477fe700 1 -- 172.21.15.123:0/3008660996 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4801d070 con 0x7f2a58100fb0 2024-06-02T04:03:12.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.642+0000 7f2a5c976700 1 -- 172.21.15.123:0/3008660996 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a5819de30 con 0x7f2a58100fb0 2024-06-02T04:03:12.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.642+0000 7f2a477fe700 1 -- 172.21.15.123:0/3008660996 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2a480054f0 con 0x7f2a58100fb0 2024-06-02T04:03:12.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.642+0000 7f2a477fe700 1 -- 172.21.15.123:0/3008660996 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a48004d10 con 0x7f2a58100fb0 2024-06-02T04:03:12.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.642+0000 7f2a5c976700 1 -- 172.21.15.123:0/3008660996 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a5819e1a0 con 0x7f2a58100fb0 2024-06-02T04:03:12.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.643+0000 7f2a5c976700 1 -- 172.21.15.123:0/3008660996 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a581072d0 con 0x7f2a58100fb0 2024-06-02T04:03:12.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.644+0000 7f2a477fe700 1 -- 172.21.15.123:0/3008660996 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f2a4800fc50 con 0x7f2a58100fb0 2024-06-02T04:03:12.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.644+0000 7f2a477fe700 1 --2- 172.21.15.123:0/3008660996 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2a400a1120 0x7f2a400a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:12.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.644+0000 7f2a5659c700 1 --2- 172.21.15.123:0/3008660996 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2a400a1120 0x7f2a400a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:12.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.644+0000 7f2a477fe700 1 -- 172.21.15.123:0/3008660996 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2a480cd970 con 0x7f2a58100fb0 2024-06-02T04:03:12.646 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.645+0000 7f2a5659c700 1 --2- 172.21.15.123:0/3008660996 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2a400a1120 0x7f2a400a35e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009be0 tx=0x7f2a4c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:12.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.649+0000 7f2a477fe700 1 -- 172.21.15.123:0/3008660996 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2a480972e0 con 0x7f2a58100fb0 2024-06-02T04:03:12.822 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 04:03:12 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T04:03:12.476+0000 7fbae6d24700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T04:03:12.822 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 04:03:12 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T04:03:12.476+0000 7fbae6d24700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T04:03:12.822 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 04:03:12 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T04:03:12.476+0000 7fbae6d24700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T04:03:12.823 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 04:03:12 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T04:03:12.476+0000 7fbae6d24700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T04:03:12.823 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 04:03:12 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T04:03:12.476+0000 7fbae6d24700 -1 client.0 error registering admin socket command: (17) File exists 2024-06-02T04:03:12.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.880+0000 7f2a5c976700 1 -- 172.21.15.123:0/3008660996 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a58067cc0 con 0x7f2a400a1120 2024-06-02T04:03:12.901 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.901+0000 7f2a477fe700 1 -- 172.21.15.123:0/3008660996 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2a58067cc0 con 0x7f2a400a1120 2024-06-02T04:03:12.903 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.903+0000 7f2a5c976700 1 -- 172.21.15.123:0/3008660996 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2a400a1120 msgr2=0x7f2a400a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:12.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.903+0000 7f2a5c976700 1 --2- 172.21.15.123:0/3008660996 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2a400a1120 0x7f2a400a35e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009be0 tx=0x7f2a4c009260 comp rx=0 tx=0).stop 2024-06-02T04:03:12.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.903+0000 7f2a5c976700 1 -- 172.21.15.123:0/3008660996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a58100fb0 msgr2=0x7f2a581962f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:12.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.903+0000 7f2a5c976700 1 --2- 172.21.15.123:0/3008660996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a58100fb0 0x7f2a581962f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800c010 tx=0x7f2a48004730 comp rx=0 tx=0).stop 2024-06-02T04:03:12.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.903+0000 7f2a5c976700 1 -- 172.21.15.123:0/3008660996 shutdown_connections 2024-06-02T04:03:12.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.903+0000 7f2a5c976700 1 --2- 172.21.15.123:0/3008660996 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2a400a1120 0x7f2a400a35e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:12.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.903+0000 7f2a5c976700 1 --2- 172.21.15.123:0/3008660996 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a58101970 0x7f2a5819d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:12.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.903+0000 7f2a5c976700 1 --2- 172.21.15.123:0/3008660996 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a580ffe60 0x7f2a58195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:12.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.903+0000 7f2a5c976700 1 --2- 172.21.15.123:0/3008660996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a58100fb0 0x7f2a581962f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:12.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.903+0000 7f2a5c976700 1 -- 172.21.15.123:0/3008660996 >> 172.21.15.123:0/3008660996 conn(0x7f2a580fb3f0 msgr2=0x7f2a58104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:12.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.903+0000 7f2a5c976700 1 -- 172.21.15.123:0/3008660996 shutdown_connections 2024-06-02T04:03:12.904 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:12.904+0000 7f2a5c976700 1 -- 172.21.15.123:0/3008660996 wait complete. 2024-06-02T04:03:12.915 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-06-02T04:03:13.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.043+0000 7fad69ccd700 1 -- 172.21.15.123:0/3173259064 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad640ffe60 msgr2=0x7fad64100280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:13.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.043+0000 7fad69ccd700 1 --2- 172.21.15.123:0/3173259064 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad640ffe60 0x7fad64100280 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fad58009990 tx=0x7fad58009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:13.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.043+0000 7fad69ccd700 1 -- 172.21.15.123:0/3173259064 shutdown_connections 2024-06-02T04:03:13.045 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.043+0000 7fad69ccd700 1 --2- 172.21.15.123:0/3173259064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad64101970 0x7fad64108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:13.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.043+0000 7fad69ccd700 1 --2- 172.21.15.123:0/3173259064 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad640ffe60 0x7fad64100280 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:13.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.043+0000 7fad69ccd700 1 --2- 172.21.15.123:0/3173259064 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fad64100fb0 0x7fad64101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:13.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.043+0000 7fad69ccd700 1 -- 172.21.15.123:0/3173259064 >> 172.21.15.123:0/3173259064 conn(0x7fad640fb3f0 msgr2=0x7fad640fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:13.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.043+0000 7fad69ccd700 1 -- 172.21.15.123:0/3173259064 shutdown_connections 2024-06-02T04:03:13.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.043+0000 7fad69ccd700 1 -- 172.21.15.123:0/3173259064 wait complete. 2024-06-02T04:03:13.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.043+0000 7fad69ccd700 1 Processor -- start 2024-06-02T04:03:13.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.044+0000 7fad69ccd700 1 -- start start 2024-06-02T04:03:13.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.044+0000 7fad69ccd700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad640ffe60 0x7fad64195d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:13.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.044+0000 7fad69ccd700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fad64100fb0 0x7fad641962b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:13.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.044+0000 7fad69ccd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad64101970 0x7fad6419d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:13.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.044+0000 7fad69ccd700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6419d860 con 0x7fad64101970 2024-06-02T04:03:13.046 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.044+0000 7fad69ccd700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6419d9d0 con 0x7fad64100fb0 2024-06-02T04:03:13.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.044+0000 7fad69ccd700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6419db90 con 0x7fad640ffe60 2024-06-02T04:03:13.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.044+0000 7fad63fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad64101970 0x7fad6419d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:13.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.044+0000 7fad63fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad64101970 0x7fad6419d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47224/0 (socket says 172.21.15.123:47224) 2024-06-02T04:03:13.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.044+0000 7fad63fff700 1 -- 172.21.15.123:0/3849865906 learned_addr learned my addr 172.21.15.123:0/3849865906 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:13.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.044+0000 7fad637fe700 1 --2- 172.21.15.123:0/3849865906 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad640ffe60 0x7fad64195d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:13.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.044+0000 7fad62ffd700 1 --2- 172.21.15.123:0/3849865906 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fad64100fb0 0x7fad641962b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:13.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.044+0000 7fad63fff700 1 -- 172.21.15.123:0/3849865906 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad640ffe60 msgr2=0x7fad64195d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:13.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.044+0000 7fad63fff700 1 --2- 172.21.15.123:0/3849865906 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad640ffe60 0x7fad64195d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:13.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.044+0000 7fad63fff700 1 -- 172.21.15.123:0/3849865906 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fad64100fb0 msgr2=0x7fad641962b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:13.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.044+0000 7fad63fff700 1 --2- 172.21.15.123:0/3849865906 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fad64100fb0 0x7fad641962b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:13.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.044+0000 7fad63fff700 1 -- 172.21.15.123:0/3849865906 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad580095f0 con 0x7fad64101970 2024-06-02T04:03:13.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.044+0000 7fad63fff700 1 --2- 172.21.15.123:0/3849865906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad64101970 0x7fad6419d290 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fad5c00ef30 tx=0x7fad5c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:13.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.044+0000 7fad60ff9700 1 -- 172.21.15.123:0/3849865906 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c018070 con 0x7fad64101970 2024-06-02T04:03:13.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.045+0000 7fad60ff9700 1 -- 172.21.15.123:0/3849865906 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad5c00f040 con 0x7fad64101970 2024-06-02T04:03:13.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.045+0000 7fad69ccd700 1 -- 172.21.15.123:0/3849865906 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad6419de10 con 0x7fad64101970 2024-06-02T04:03:13.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.045+0000 7fad60ff9700 1 -- 172.21.15.123:0/3849865906 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c00cd00 con 0x7fad64101970 2024-06-02T04:03:13.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.045+0000 7fad69ccd700 1 -- 172.21.15.123:0/3849865906 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad6419e230 con 0x7fad64101970 2024-06-02T04:03:13.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.045+0000 7fad69ccd700 1 -- 172.21.15.123:0/3849865906 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad64107200 con 0x7fad64101970 2024-06-02T04:03:13.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.047+0000 7fad60ff9700 1 -- 172.21.15.123:0/3849865906 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 16) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fad5c003a00 con 0x7fad64101970 2024-06-02T04:03:13.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.047+0000 7fad60ff9700 1 --2- 172.21.15.123:0/3849865906 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fad4c0a1120 0x7fad4c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:13.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.047+0000 7fad637fe700 1 --2- 172.21.15.123:0/3849865906 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fad4c0a1120 0x7fad4c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:13.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.047+0000 7fad60ff9700 1 -- 172.21.15.123:0/3849865906 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fad5c0ccc50 con 0x7fad64101970 2024-06-02T04:03:13.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.048+0000 7fad637fe700 1 --2- 172.21.15.123:0/3849865906 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fad4c0a1120 0x7fad4c0a35e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fad58000c00 tx=0x7fad58005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:13.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.051+0000 7fad60ff9700 1 -- 172.21.15.123:0/3849865906 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fad5c0965c0 con 0x7fad64101970 2024-06-02T04:03:13.079 INFO:journalctl@ceph.mds.b.smithi136.stdout:Jun 02 04:03:12 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-b[84767]: 2024-06-02T04:03:12.640+0000 7effd0224700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-06-02T04:03:13.079 INFO:journalctl@ceph.mds.b.smithi136.stdout:Jun 02 04:03:12 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-b[84767]: 2024-06-02T04:03:12.640+0000 7effd0224700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-06-02T04:03:13.079 INFO:journalctl@ceph.mds.b.smithi136.stdout:Jun 02 04:03:12 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-b[84767]: 2024-06-02T04:03:12.640+0000 7effd0224700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-06-02T04:03:13.079 INFO:journalctl@ceph.mds.b.smithi136.stdout:Jun 02 04:03:12 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-b[84767]: 2024-06-02T04:03:12.640+0000 7effd0224700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-06-02T04:03:13.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.097+0000 7fad60ff9700 1 -- 172.21.15.123:0/3849865906 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fad5c003cb0 con 0x7fad64101970 2024-06-02T04:03:13.290 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.290+0000 7fad69ccd700 1 -- 172.21.15.123:0/3849865906 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7fad640613e0 con 0x7fad4c0a1120 2024-06-02T04:03:13.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.294+0000 7fad60ff9700 1 -- 172.21.15.123:0/3849865906 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7fad640613e0 con 0x7fad4c0a1120 2024-06-02T04:03:13.294 INFO:teuthology.orchestra.run.smithi123.stdout:/volumes/qa/sv_0/3bd713cb-3286-46de-a130-02328be12655 2024-06-02T04:03:13.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.296+0000 7fad69ccd700 1 -- 172.21.15.123:0/3849865906 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fad4c0a1120 msgr2=0x7fad4c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:13.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.296+0000 7fad69ccd700 1 --2- 172.21.15.123:0/3849865906 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fad4c0a1120 0x7fad4c0a35e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fad58000c00 tx=0x7fad58005fb0 comp rx=0 tx=0).stop 2024-06-02T04:03:13.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.296+0000 7fad69ccd700 1 -- 172.21.15.123:0/3849865906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad64101970 msgr2=0x7fad6419d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:13.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.296+0000 7fad69ccd700 1 --2- 172.21.15.123:0/3849865906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad64101970 0x7fad6419d290 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fad5c00ef30 tx=0x7fad5c00c3a0 comp rx=0 tx=0).stop 2024-06-02T04:03:13.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.296+0000 7fad69ccd700 1 -- 172.21.15.123:0/3849865906 shutdown_connections 2024-06-02T04:03:13.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.296+0000 7fad69ccd700 1 --2- 172.21.15.123:0/3849865906 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fad64101970 0x7fad6419d290 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:13.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.296+0000 7fad69ccd700 1 --2- 172.21.15.123:0/3849865906 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad640ffe60 0x7fad64195d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:13.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.296+0000 7fad69ccd700 1 --2- 172.21.15.123:0/3849865906 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fad4c0a1120 0x7fad4c0a35e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:13.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.296+0000 7fad69ccd700 1 --2- 172.21.15.123:0/3849865906 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fad64100fb0 0x7fad641962b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:13.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.296+0000 7fad69ccd700 1 -- 172.21.15.123:0/3849865906 >> 172.21.15.123:0/3849865906 conn(0x7fad640fb3f0 msgr2=0x7fad64104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:13.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.296+0000 7fad69ccd700 1 -- 172.21.15.123:0/3849865906 shutdown_connections 2024-06-02T04:03:13.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.296+0000 7fad69ccd700 1 -- 172.21.15.123:0/3849865906 wait complete. 2024-06-02T04:03:13.308 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:13 smithi123 ceph-mon[42885]: mds.? [v2:172.21.15.162:6832/3583622784,v1:172.21.15.162:6833/3583622784] up:active 2024-06-02T04:03:13.308 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:13 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1974231498' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-06-02T04:03:13.308 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:13 smithi123 ceph-mon[42885]: daemon mds.k assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-06-02T04:03:13.308 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:13 smithi123 ceph-mon[42885]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-06-02T04:03:13.308 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:13 smithi123 ceph-mon[42885]: Cluster is now healthy 2024-06-02T04:03:13.308 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:13 smithi123 ceph-mon[42885]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=l=up:active} 3 up:standby-replay 5 up:standby 2024-06-02T04:03:13.308 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:13 smithi123 ceph-mon[42885]: fsmap cephfs:5 3 up:standby-replay 1 up:creating 4 up:standby 4 up:active 2024-06-02T04:03:13.308 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:13 smithi123 ceph-mon[42885]: daemon mds.k is now active in filesystem cephfs as rank 4 2024-06-02T04:03:13.308 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:13 smithi123 ceph-mon[42885]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:03:13.308 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:13 smithi123 ceph-mon[42885]: pgmap v225: 97 pgs: 97 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 4.1 KiB/s wr, 13 op/s 2024-06-02T04:03:13.309 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:13 smithi123 ceph-mon[42885]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:03:13.310 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-06-02T04:03:13.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:13 smithi136 ceph-mon[47443]: mds.? [v2:172.21.15.162:6832/3583622784,v1:172.21.15.162:6833/3583622784] up:active 2024-06-02T04:03:13.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:13 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/1974231498' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-06-02T04:03:13.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:13 smithi136 ceph-mon[47443]: daemon mds.k assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-06-02T04:03:13.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:13 smithi136 ceph-mon[47443]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-06-02T04:03:13.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:13 smithi136 ceph-mon[47443]: Cluster is now healthy 2024-06-02T04:03:13.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:13 smithi136 ceph-mon[47443]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=l=up:active} 3 up:standby-replay 5 up:standby 2024-06-02T04:03:13.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:13 smithi136 ceph-mon[47443]: fsmap cephfs:5 3 up:standby-replay 1 up:creating 4 up:standby 4 up:active 2024-06-02T04:03:13.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:13 smithi136 ceph-mon[47443]: daemon mds.k is now active in filesystem cephfs as rank 4 2024-06-02T04:03:13.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:13 smithi136 ceph-mon[47443]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:03:13.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:13 smithi136 ceph-mon[47443]: pgmap v225: 97 pgs: 97 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 4.1 KiB/s wr, 13 op/s 2024-06-02T04:03:13.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:13 smithi136 ceph-mon[47443]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:03:13.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.437+0000 7f7fdcb51700 1 -- 172.21.15.123:0/3188696311 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fd8101990 msgr2=0x7f7fd81082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:13.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.437+0000 7f7fdcb51700 1 --2- 172.21.15.123:0/3188696311 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fd8101990 0x7f7fd81082b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7fd000b0a0 tx=0x7f7fd000b3b0 comp rx=0 tx=0).stop 2024-06-02T04:03:13.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.437+0000 7f7fdcb51700 1 -- 172.21.15.123:0/3188696311 shutdown_connections 2024-06-02T04:03:13.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.437+0000 7f7fdcb51700 1 --2- 172.21.15.123:0/3188696311 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fd8101990 0x7f7fd81082b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:13.437 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.437+0000 7f7fdcb51700 1 --2- 172.21.15.123:0/3188696311 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fd80ffe80 0x7f7fd81002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:13.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.437+0000 7f7fdcb51700 1 --2- 172.21.15.123:0/3188696311 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7fd8100fd0 0x7f7fd8101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:13.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.437+0000 7f7fdcb51700 1 -- 172.21.15.123:0/3188696311 >> 172.21.15.123:0/3188696311 conn(0x7f7fd80fb3f0 msgr2=0x7f7fd80fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:13.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.437+0000 7f7fdcb51700 1 -- 172.21.15.123:0/3188696311 shutdown_connections 2024-06-02T04:03:13.438 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.437+0000 7f7fdcb51700 1 -- 172.21.15.123:0/3188696311 wait complete. 2024-06-02T04:03:13.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.438+0000 7f7fdcb51700 1 Processor -- start 2024-06-02T04:03:13.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.438+0000 7f7fdcb51700 1 -- start start 2024-06-02T04:03:13.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.438+0000 7f7fdcb51700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7fd80ffe80 0x7f7fd8195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:13.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.438+0000 7f7fdcb51700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fd8100fd0 0x7f7fd8196400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:13.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.438+0000 7f7fdcb51700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fd8101990 0x7f7fd819d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:13.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.438+0000 7f7fdcb51700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd819d9f0 con 0x7f7fd8101990 2024-06-02T04:03:13.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.438+0000 7f7fdcb51700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd819db30 con 0x7f7fd80ffe80 2024-06-02T04:03:13.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.438+0000 7f7fdcb51700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd819dcc0 con 0x7f7fd8100fd0 2024-06-02T04:03:13.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.438+0000 7f7fd6d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fd8101990 0x7f7fd819d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:13.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.438+0000 7f7fd6d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fd8101990 0x7f7fd819d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47238/0 (socket says 172.21.15.123:47238) 2024-06-02T04:03:13.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.438+0000 7f7fd6d9d700 1 -- 172.21.15.123:0/2504033847 learned_addr learned my addr 172.21.15.123:0/2504033847 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:13.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.439+0000 7f7fd659c700 1 --2- 172.21.15.123:0/2504033847 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7fd80ffe80 0x7f7fd8195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:13.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.439+0000 7f7fd5d9b700 1 --2- 172.21.15.123:0/2504033847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fd8100fd0 0x7f7fd8196400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:13.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.439+0000 7f7fd6d9d700 1 -- 172.21.15.123:0/2504033847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fd8100fd0 msgr2=0x7f7fd8196400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:13.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.439+0000 7f7fd6d9d700 1 --2- 172.21.15.123:0/2504033847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fd8100fd0 0x7f7fd8196400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:13.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.439+0000 7f7fd6d9d700 1 -- 172.21.15.123:0/2504033847 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7fd80ffe80 msgr2=0x7f7fd8195ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:13.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.439+0000 7f7fd6d9d700 1 --2- 172.21.15.123:0/2504033847 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7fd80ffe80 0x7f7fd8195ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:13.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.439+0000 7f7fd6d9d700 1 -- 172.21.15.123:0/2504033847 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd0009d00 con 0x7f7fd8101990 2024-06-02T04:03:13.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.439+0000 7f7fd5d9b700 1 --2- 172.21.15.123:0/2504033847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fd8100fd0 0x7f7fd8196400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:03:13.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.439+0000 7f7fd6d9d700 1 --2- 172.21.15.123:0/2504033847 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fd8101990 0x7f7fd819d420 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0006070 tx=0x7f7fd000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:13.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.439+0000 7f7fc77fe700 1 -- 172.21.15.123:0/2504033847 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd000e040 con 0x7f7fd8101990 2024-06-02T04:03:13.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.439+0000 7f7fc77fe700 1 -- 172.21.15.123:0/2504033847 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7fd0003c00 con 0x7f7fd8101990 2024-06-02T04:03:13.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.439+0000 7f7fdcb51700 1 -- 172.21.15.123:0/2504033847 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd819df40 con 0x7f7fd8101990 2024-06-02T04:03:13.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.439+0000 7f7fc77fe700 1 -- 172.21.15.123:0/2504033847 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd001b690 con 0x7f7fd8101990 2024-06-02T04:03:13.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.439+0000 7f7fdcb51700 1 -- 172.21.15.123:0/2504033847 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd819e360 con 0x7f7fd8101990 2024-06-02T04:03:13.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.440+0000 7f7fdcb51700 1 -- 172.21.15.123:0/2504033847 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd81071c0 con 0x7f7fd8101990 2024-06-02T04:03:13.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.442+0000 7f7fc77fe700 1 -- 172.21.15.123:0/2504033847 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f7fd001b7f0 con 0x7f7fd8101990 2024-06-02T04:03:13.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.442+0000 7f7fc77fe700 1 --2- 172.21.15.123:0/2504033847 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7fc00a11b0 0x7f7fc00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:13.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.442+0000 7f7fc77fe700 1 -- 172.21.15.123:0/2504033847 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7fd00ce1a0 con 0x7f7fd8101990 2024-06-02T04:03:13.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.442+0000 7f7fd659c700 1 --2- 172.21.15.123:0/2504033847 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7fc00a11b0 0x7f7fc00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:13.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.443+0000 7f7fd659c700 1 --2- 172.21.15.123:0/2504033847 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7fc00a11b0 0x7f7fc00a3670 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc00ac50 tx=0x7f7fcc00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:13.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.446+0000 7f7fc77fe700 1 -- 172.21.15.123:0/2504033847 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7fd0097a10 con 0x7f7fd8101990 2024-06-02T04:03:13.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:13 smithi162 ceph-mon[47009]: mds.? [v2:172.21.15.162:6832/3583622784,v1:172.21.15.162:6833/3583622784] up:active 2024-06-02T04:03:13.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:13 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/1974231498' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-06-02T04:03:13.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:13 smithi162 ceph-mon[47009]: daemon mds.k assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-06-02T04:03:13.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:13 smithi162 ceph-mon[47009]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-06-02T04:03:13.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:13 smithi162 ceph-mon[47009]: Cluster is now healthy 2024-06-02T04:03:13.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:13 smithi162 ceph-mon[47009]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=l=up:active} 3 up:standby-replay 5 up:standby 2024-06-02T04:03:13.550 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:13 smithi162 ceph-mon[47009]: fsmap cephfs:5 3 up:standby-replay 1 up:creating 4 up:standby 4 up:active 2024-06-02T04:03:13.550 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:13 smithi162 ceph-mon[47009]: daemon mds.k is now active in filesystem cephfs as rank 4 2024-06-02T04:03:13.550 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:13 smithi162 ceph-mon[47009]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:03:13.550 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:13 smithi162 ceph-mon[47009]: pgmap v225: 97 pgs: 97 active+clean; 581 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 4.1 KiB/s wr, 13 op/s 2024-06-02T04:03:13.550 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:13 smithi162 ceph-mon[47009]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:03:13.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.677+0000 7f7fdcb51700 1 -- 172.21.15.123:0/2504033847 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f7fd80613e0 con 0x7f7fc00a11b0 2024-06-02T04:03:13.699 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.700+0000 7f7fc77fe700 1 -- 172.21.15.123:0/2504033847 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f7fd80613e0 con 0x7f7fc00a11b0 2024-06-02T04:03:13.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.702+0000 7f7fdcb51700 1 -- 172.21.15.123:0/2504033847 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7fc00a11b0 msgr2=0x7f7fc00a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:13.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.702+0000 7f7fdcb51700 1 --2- 172.21.15.123:0/2504033847 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7fc00a11b0 0x7f7fc00a3670 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc00ac50 tx=0x7f7fcc00a380 comp rx=0 tx=0).stop 2024-06-02T04:03:13.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.702+0000 7f7fdcb51700 1 -- 172.21.15.123:0/2504033847 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fd8101990 msgr2=0x7f7fd819d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:13.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.702+0000 7f7fdcb51700 1 --2- 172.21.15.123:0/2504033847 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fd8101990 0x7f7fd819d420 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0006070 tx=0x7f7fd000ba50 comp rx=0 tx=0).stop 2024-06-02T04:03:13.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.702+0000 7f7fdcb51700 1 -- 172.21.15.123:0/2504033847 shutdown_connections 2024-06-02T04:03:13.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.702+0000 7f7fdcb51700 1 --2- 172.21.15.123:0/2504033847 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7fd8101990 0x7f7fd819d420 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:13.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.702+0000 7f7fdcb51700 1 --2- 172.21.15.123:0/2504033847 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7fc00a11b0 0x7f7fc00a3670 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:13.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.702+0000 7f7fdcb51700 1 --2- 172.21.15.123:0/2504033847 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7fd80ffe80 0x7f7fd8195ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:13.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.702+0000 7f7fdcb51700 1 --2- 172.21.15.123:0/2504033847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fd8100fd0 0x7f7fd8196400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:13.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.702+0000 7f7fdcb51700 1 -- 172.21.15.123:0/2504033847 >> 172.21.15.123:0/2504033847 conn(0x7f7fd80fb3f0 msgr2=0x7f7fd8104300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:13.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.702+0000 7f7fdcb51700 1 -- 172.21.15.123:0/2504033847 shutdown_connections 2024-06-02T04:03:13.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.702+0000 7f7fdcb51700 1 -- 172.21.15.123:0/2504033847 wait complete. 2024-06-02T04:03:13.715 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-06-02T04:03:13.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.841+0000 7f87273d4700 1 -- 172.21.15.123:0/3876977942 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8720106ce0 msgr2=0x7f87201090d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:13.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.841+0000 7f87273d4700 1 --2- 172.21.15.123:0/3876977942 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8720106ce0 0x7f87201090d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f871800b0a0 tx=0x7f871800b3b0 comp rx=0 tx=0).stop 2024-06-02T04:03:13.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.841+0000 7f87273d4700 1 -- 172.21.15.123:0/3876977942 shutdown_connections 2024-06-02T04:03:13.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.841+0000 7f87273d4700 1 --2- 172.21.15.123:0/3876977942 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8720106ce0 0x7f87201090d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:13.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.841+0000 7f87273d4700 1 --2- 172.21.15.123:0/3876977942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8720101a80 0x7f8720103e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:13.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.841+0000 7f87273d4700 1 --2- 172.21.15.123:0/3876977942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87201043b0 0x7f87201067a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:13.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.841+0000 7f87273d4700 1 -- 172.21.15.123:0/3876977942 >> 172.21.15.123:0/3876977942 conn(0x7f87200fb3f0 msgr2=0x7f87200fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:13.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.841+0000 7f87273d4700 1 -- 172.21.15.123:0/3876977942 shutdown_connections 2024-06-02T04:03:13.842 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.841+0000 7f87273d4700 1 -- 172.21.15.123:0/3876977942 wait complete. 2024-06-02T04:03:13.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.842+0000 7f87273d4700 1 Processor -- start 2024-06-02T04:03:13.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.842+0000 7f87273d4700 1 -- start start 2024-06-02T04:03:13.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.842+0000 7f87273d4700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8720101a80 0x7f8720196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:13.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.842+0000 7f87273d4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87201043b0 0x7f8720197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:13.844 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.842+0000 7f87273d4700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8720106ce0 0x7f872019e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:13.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.842+0000 7f87273d4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872019eab0 con 0x7f87201043b0 2024-06-02T04:03:13.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.842+0000 7f87273d4700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872019ebf0 con 0x7f8720101a80 2024-06-02T04:03:13.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.842+0000 7f87273d4700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872019ed80 con 0x7f8720106ce0 2024-06-02T04:03:13.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.842+0000 7f872496f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87201043b0 0x7f8720197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:13.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.842+0000 7f872496f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87201043b0 0x7f8720197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47248/0 (socket says 172.21.15.123:47248) 2024-06-02T04:03:13.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.842+0000 7f872496f700 1 -- 172.21.15.123:0/1495267738 learned_addr learned my addr 172.21.15.123:0/1495267738 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:13.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.842+0000 7f8725170700 1 --2- 172.21.15.123:0/1495267738 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8720101a80 0x7f8720196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:13.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.842+0000 7f8725971700 1 --2- 172.21.15.123:0/1495267738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8720106ce0 0x7f872019e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:13.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.843+0000 7f872496f700 1 -- 172.21.15.123:0/1495267738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8720106ce0 msgr2=0x7f872019e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:13.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.843+0000 7f872496f700 1 --2- 172.21.15.123:0/1495267738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8720106ce0 0x7f872019e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:13.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.843+0000 7f872496f700 1 -- 172.21.15.123:0/1495267738 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8720101a80 msgr2=0x7f8720196fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:13.845 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.843+0000 7f872496f700 1 --2- 172.21.15.123:0/1495267738 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8720101a80 0x7f8720196fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:13.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.843+0000 7f872496f700 1 -- 172.21.15.123:0/1495267738 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8718009d00 con 0x7f87201043b0 2024-06-02T04:03:13.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.843+0000 7f872496f700 1 --2- 172.21.15.123:0/1495267738 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87201043b0 0x7f8720197510 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f871c00e9a0 tx=0x7f871c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:13.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.843+0000 7f87167fc700 1 -- 172.21.15.123:0/1495267738 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c009790 con 0x7f87201043b0 2024-06-02T04:03:13.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.843+0000 7f87167fc700 1 -- 172.21.15.123:0/1495267738 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f871c00cbd0 con 0x7f87201043b0 2024-06-02T04:03:13.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.843+0000 7f87273d4700 1 -- 172.21.15.123:0/1495267738 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f872019f060 con 0x7f87201043b0 2024-06-02T04:03:13.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.843+0000 7f87167fc700 1 -- 172.21.15.123:0/1495267738 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871c018680 con 0x7f87201043b0 2024-06-02T04:03:13.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.843+0000 7f87273d4700 1 -- 172.21.15.123:0/1495267738 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f872019f570 con 0x7f87201043b0 2024-06-02T04:03:13.846 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.844+0000 7f87273d4700 1 -- 172.21.15.123:0/1495267738 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87200fcf70 con 0x7f87201043b0 2024-06-02T04:03:13.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.845+0000 7f87167fc700 1 -- 172.21.15.123:0/1495267738 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f871c00cd40 con 0x7f87201043b0 2024-06-02T04:03:13.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.845+0000 7f87167fc700 1 --2- 172.21.15.123:0/1495267738 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f870c0a11b0 0x7f870c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:13.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.845+0000 7f8725170700 1 --2- 172.21.15.123:0/1495267738 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f870c0a11b0 0x7f870c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:13.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.845+0000 7f87167fc700 1 -- 172.21.15.123:0/1495267738 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f871c014070 con 0x7f87201043b0 2024-06-02T04:03:13.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.846+0000 7f8725170700 1 --2- 172.21.15.123:0/1495267738 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f870c0a11b0 0x7f870c0a3670 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8710005950 tx=0x7f871000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:13.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:13.849+0000 7f87167fc700 1 -- 172.21.15.123:0/1495267738 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f871c096620 con 0x7f87201043b0 2024-06-02T04:03:14.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.086+0000 7f87273d4700 1 -- 172.21.15.123:0/1495267738 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f8720067cc0 con 0x7f870c0a11b0 2024-06-02T04:03:14.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.090+0000 7f87167fc700 1 -- 172.21.15.123:0/1495267738 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7f8720067cc0 con 0x7f870c0a11b0 2024-06-02T04:03:14.090 INFO:teuthology.orchestra.run.smithi123.stdout:/volumes/qa/sv_1/52776420-9bb3-4c52-8627-060b8738590d 2024-06-02T04:03:14.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.092+0000 7f87273d4700 1 -- 172.21.15.123:0/1495267738 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f870c0a11b0 msgr2=0x7f870c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:14.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.092+0000 7f87273d4700 1 --2- 172.21.15.123:0/1495267738 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f870c0a11b0 0x7f870c0a3670 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8710005950 tx=0x7f871000b410 comp rx=0 tx=0).stop 2024-06-02T04:03:14.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.092+0000 7f87273d4700 1 -- 172.21.15.123:0/1495267738 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87201043b0 msgr2=0x7f8720197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:14.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.092+0000 7f87273d4700 1 --2- 172.21.15.123:0/1495267738 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87201043b0 0x7f8720197510 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f871c00e9a0 tx=0x7f871c00ecb0 comp rx=0 tx=0).stop 2024-06-02T04:03:14.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.092+0000 7f87273d4700 1 -- 172.21.15.123:0/1495267738 shutdown_connections 2024-06-02T04:03:14.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.092+0000 7f87273d4700 1 --2- 172.21.15.123:0/1495267738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8720106ce0 0x7f872019e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:14.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.092+0000 7f87273d4700 1 --2- 172.21.15.123:0/1495267738 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f870c0a11b0 0x7f870c0a3670 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:14.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.092+0000 7f87273d4700 1 --2- 172.21.15.123:0/1495267738 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8720101a80 0x7f8720196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:14.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.092+0000 7f87273d4700 1 --2- 172.21.15.123:0/1495267738 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f87201043b0 0x7f8720197510 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:14.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.092+0000 7f87273d4700 1 -- 172.21.15.123:0/1495267738 >> 172.21.15.123:0/1495267738 conn(0x7f87200fb3f0 msgr2=0x7f87201024a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:14.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.092+0000 7f87273d4700 1 -- 172.21.15.123:0/1495267738 shutdown_connections 2024-06-02T04:03:14.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.092+0000 7f87273d4700 1 -- 172.21.15.123:0/1495267738 wait complete. 2024-06-02T04:03:14.104 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:03:14.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.228+0000 7f2708325700 1 -- 172.21.15.123:0/1765652045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2700101fc0 msgr2=0x7f2700102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:14.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.228+0000 7f2708325700 1 --2- 172.21.15.123:0/1765652045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2700101fc0 0x7f2700102440 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f26fc009990 tx=0x7f26fc009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:14.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.228+0000 7f2708325700 1 -- 172.21.15.123:0/1765652045 shutdown_connections 2024-06-02T04:03:14.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.228+0000 7f2708325700 1 --2- 172.21.15.123:0/1765652045 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2700102980 0x7f27001092a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:14.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.228+0000 7f2708325700 1 --2- 172.21.15.123:0/1765652045 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2700100e70 0x7f2700101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:14.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.228+0000 7f2708325700 1 --2- 172.21.15.123:0/1765652045 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2700101fc0 0x7f2700102440 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:14.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.228+0000 7f2708325700 1 -- 172.21.15.123:0/1765652045 >> 172.21.15.123:0/1765652045 conn(0x7f27000fc400 msgr2=0x7f27000fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:14.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.228+0000 7f2708325700 1 -- 172.21.15.123:0/1765652045 shutdown_connections 2024-06-02T04:03:14.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.228+0000 7f2708325700 1 -- 172.21.15.123:0/1765652045 wait complete. 2024-06-02T04:03:14.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.228+0000 7f2708325700 1 Processor -- start 2024-06-02T04:03:14.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.228+0000 7f2708325700 1 -- start start 2024-06-02T04:03:14.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.229+0000 7f2708325700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2700100e70 0x7f2700074d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:14.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.229+0000 7f2708325700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2700101fc0 0x7f2700073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:14.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.229+0000 7f2708325700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2700102980 0x7f27000738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:14.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.229+0000 7f2708325700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2700074070 con 0x7f2700102980 2024-06-02T04:03:14.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.229+0000 7f2708325700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27000741e0 con 0x7f2700101fc0 2024-06-02T04:03:14.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.229+0000 7f2708325700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27001a0e70 con 0x7f2700100e70 2024-06-02T04:03:14.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.229+0000 7f27068c2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2700102980 0x7f27000738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:14.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.229+0000 7f27068c2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2700102980 0x7f27000738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:47260/0 (socket says 172.21.15.123:47260) 2024-06-02T04:03:14.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.229+0000 7f27068c2700 1 -- 172.21.15.123:0/1793865389 learned_addr learned my addr 172.21.15.123:0/1793865389 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:14.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.229+0000 7f27060c1700 1 --2- 172.21.15.123:0/1793865389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2700100e70 0x7f2700074d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:14.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.229+0000 7f27068c2700 1 -- 172.21.15.123:0/1793865389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2700100e70 msgr2=0x7f2700074d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:14.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.229+0000 7f27068c2700 1 --2- 172.21.15.123:0/1793865389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2700100e70 0x7f2700074d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:14.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.229+0000 7f27068c2700 1 -- 172.21.15.123:0/1793865389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2700101fc0 msgr2=0x7f2700073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:14.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.229+0000 7f27068c2700 1 --2- 172.21.15.123:0/1793865389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2700101fc0 0x7f2700073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:14.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.229+0000 7f27068c2700 1 -- 172.21.15.123:0/1793865389 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26fc0095f0 con 0x7f2700102980 2024-06-02T04:03:14.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.229+0000 7f27068c2700 1 --2- 172.21.15.123:0/1793865389 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2700102980 0x7f27000738d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f26f800ada0 tx=0x7f26f800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:14.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.229+0000 7f26f77fe700 1 -- 172.21.15.123:0/1793865389 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f800f070 con 0x7f2700102980 2024-06-02T04:03:14.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.229+0000 7f26f77fe700 1 -- 172.21.15.123:0/1793865389 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f26f8007b30 con 0x7f2700102980 2024-06-02T04:03:14.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.229+0000 7f26f77fe700 1 -- 172.21.15.123:0/1793865389 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f8005310 con 0x7f2700102980 2024-06-02T04:03:14.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.229+0000 7f2708325700 1 -- 172.21.15.123:0/1793865389 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27001a1100 con 0x7f2700102980 2024-06-02T04:03:14.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.229+0000 7f2708325700 1 -- 172.21.15.123:0/1793865389 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27001a15c0 con 0x7f2700102980 2024-06-02T04:03:14.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.230+0000 7f2708325700 1 -- 172.21.15.123:0/1793865389 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27001082e0 con 0x7f2700102980 2024-06-02T04:03:14.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.231+0000 7f26f77fe700 1 -- 172.21.15.123:0/1793865389 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f26f800c920 con 0x7f2700102980 2024-06-02T04:03:14.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.232+0000 7f26f77fe700 1 --2- 172.21.15.123:0/1793865389 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f26ec0a11b0 0x7f26ec0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:14.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.232+0000 7f27060c1700 1 --2- 172.21.15.123:0/1793865389 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f26ec0a11b0 0x7f26ec0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:14.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.232+0000 7f26f77fe700 1 -- 172.21.15.123:0/1793865389 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f26f80cc460 con 0x7f2700102980 2024-06-02T04:03:14.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.232+0000 7f27060c1700 1 --2- 172.21.15.123:0/1793865389 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f26ec0a11b0 0x7f26ec0a3670 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f26f0005950 tx=0x7f26f000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:14.235 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.236+0000 7f26f77fe700 1 -- 172.21.15.123:0/1793865389 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f26f8095cd0 con 0x7f2700102980 2024-06-02T04:03:14.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.480+0000 7f2708325700 1 -- 172.21.15.123:0/1793865389 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2700067380 con 0x7f2700102980 2024-06-02T04:03:14.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.480+0000 7f26f77fe700 1 -- 172.21.15.123:0/1793865389 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10930 (secure 0 0 0) 0x7f26f80992f0 con 0x7f2700102980 2024-06-02T04:03:14.480 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:03:14.481 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1940848601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1940848601},{"type":"v1","addr":"172.21.15.123:6835","nonce":1940848601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/54447879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":54447879},{"type":"v1","addr":"172.21.15.123:6837","nonce":54447879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T04:03:06.667888+0000","modified":"2024-06-02T04:03:13.099282+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24490,"mds_2":24473,"mds_3":24439,"mds_4":24437},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6839/3806973328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":3806973328},{"type":"v1","addr":"172.21.15.123:6839","nonce":3806973328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14619":{"gid":14619,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6841/4032992994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":4032992994},{"type":"v1","addr":"172.21.15.123:6841","nonce":4032992994}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24437":{"gid":24437,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6833/2006585076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2006585076},{"type":"v1","addr":"172.21.15.136:6833","nonce":2006585076}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.162:6833/3583622784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3583622784},{"type":"v1","addr":"172.21.15.162:6833","nonce":3583622784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/2894031422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2894031422},{"type":"v1","addr":"172.21.15.136:6835","nonce":2894031422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24463":{"gid":24463,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2478943987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2478943987},{"type":"v1","addr":"172.21.15.162:6835","nonce":2478943987}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3402138468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3402138468},{"type":"v1","addr":"172.21.15.162:6837","nonce":3402138468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.136:6837/2572418263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2572418263},{"type":"v1","addr":"172.21.15.136:6837","nonce":2572418263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/2588884232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2588884232},{"type":"v1","addr":"172.21.15.162:6839","nonce":2588884232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6839/952830191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":952830191},{"type":"v1","addr":"172.21.15.136:6839","nonce":952830191}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-06-02T04:03:14.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.483+0000 7f2708325700 1 -- 172.21.15.123:0/1793865389 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f26ec0a11b0 msgr2=0x7f26ec0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:14.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.483+0000 7f2708325700 1 --2- 172.21.15.123:0/1793865389 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f26ec0a11b0 0x7f26ec0a3670 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f26f0005950 tx=0x7f26f000b410 comp rx=0 tx=0).stop 2024-06-02T04:03:14.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.483+0000 7f2708325700 1 -- 172.21.15.123:0/1793865389 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2700102980 msgr2=0x7f27000738d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:14.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.483+0000 7f2708325700 1 --2- 172.21.15.123:0/1793865389 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2700102980 0x7f27000738d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f26f800ada0 tx=0x7f26f800c330 comp rx=0 tx=0).stop 2024-06-02T04:03:14.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.483+0000 7f2708325700 1 -- 172.21.15.123:0/1793865389 shutdown_connections 2024-06-02T04:03:14.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.483+0000 7f2708325700 1 --2- 172.21.15.123:0/1793865389 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2700102980 0x7f27000738d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:14.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.483+0000 7f2708325700 1 --2- 172.21.15.123:0/1793865389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2700100e70 0x7f2700074d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:14.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.483+0000 7f2708325700 1 --2- 172.21.15.123:0/1793865389 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f26ec0a11b0 0x7f26ec0a3670 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:14.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.483+0000 7f2708325700 1 --2- 172.21.15.123:0/1793865389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2700101fc0 0x7f2700073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:14.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.483+0000 7f2708325700 1 -- 172.21.15.123:0/1793865389 >> 172.21.15.123:0/1793865389 conn(0x7f27000fc400 msgr2=0x7f2700105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:14.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.483+0000 7f2708325700 1 -- 172.21.15.123:0/1793865389 shutdown_connections 2024-06-02T04:03:14.484 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.483+0000 7f2708325700 1 -- 172.21.15.123:0/1793865389 wait complete. 2024-06-02T04:03:14.484 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 27 2024-06-02T04:03:14.493 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:14 smithi123 ceph-mon[42885]: mds.? [v2:172.21.15.136:6832/2006585076,v1:172.21.15.136:6833/2006585076] up:active 2024-06-02T04:03:14.494 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:14 smithi123 ceph-mon[42885]: fsmap cephfs:5 3 up:standby-replay 4 up:standby 5 up:active 2024-06-02T04:03:14.494 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:14 smithi123 ceph-mon[42885]: mgrmap e17: x(active, since 5m), standbys: z, y 2024-06-02T04:03:14.494 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:14 smithi123 ceph-mon[42885]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-02T04:03:14.494 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:14 smithi123 ceph-mon[42885]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:03:14.494 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:14 smithi123 ceph-mon[42885]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:03:14.495 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:03:14.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:14 smithi162 ceph-mon[47009]: mds.? [v2:172.21.15.136:6832/2006585076,v1:172.21.15.136:6833/2006585076] up:active 2024-06-02T04:03:14.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:14 smithi162 ceph-mon[47009]: fsmap cephfs:5 3 up:standby-replay 4 up:standby 5 up:active 2024-06-02T04:03:14.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:14 smithi162 ceph-mon[47009]: mgrmap e17: x(active, since 5m), standbys: z, y 2024-06-02T04:03:14.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:14 smithi162 ceph-mon[47009]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-02T04:03:14.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:14 smithi162 ceph-mon[47009]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:03:14.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:14 smithi162 ceph-mon[47009]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:03:14.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:14 smithi136 ceph-mon[47443]: mds.? [v2:172.21.15.136:6832/2006585076,v1:172.21.15.136:6833/2006585076] up:active 2024-06-02T04:03:14.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:14 smithi136 ceph-mon[47443]: fsmap cephfs:5 3 up:standby-replay 4 up:standby 5 up:active 2024-06-02T04:03:14.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:14 smithi136 ceph-mon[47443]: mgrmap e17: x(active, since 5m), standbys: z, y 2024-06-02T04:03:14.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:14 smithi136 ceph-mon[47443]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-02T04:03:14.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:14 smithi136 ceph-mon[47443]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:03:14.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:14 smithi136 ceph-mon[47443]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:03:14.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.617+0000 7f2ac1b8d700 1 -- 172.21.15.123:0/3884638102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2abc100e90 msgr2=0x7f2abc1012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:14.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.617+0000 7f2ac1b8d700 1 --2- 172.21.15.123:0/3884638102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2abc100e90 0x7f2abc1012b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2aac009990 tx=0x7f2aac009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:14.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.617+0000 7f2ac1b8d700 1 -- 172.21.15.123:0/3884638102 shutdown_connections 2024-06-02T04:03:14.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.617+0000 7f2ac1b8d700 1 --2- 172.21.15.123:0/3884638102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2abc1029a0 0x7f2abc1092c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:14.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.617+0000 7f2ac1b8d700 1 --2- 172.21.15.123:0/3884638102 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2abc100e90 0x7f2abc1012b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:14.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.617+0000 7f2ac1b8d700 1 --2- 172.21.15.123:0/3884638102 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2abc101fe0 0x7f2abc102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:14.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.617+0000 7f2ac1b8d700 1 -- 172.21.15.123:0/3884638102 >> 172.21.15.123:0/3884638102 conn(0x7f2abc0fc400 msgr2=0x7f2abc0fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:14.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.617+0000 7f2ac1b8d700 1 -- 172.21.15.123:0/3884638102 shutdown_connections 2024-06-02T04:03:14.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.617+0000 7f2ac1b8d700 1 -- 172.21.15.123:0/3884638102 wait complete. 2024-06-02T04:03:14.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.618+0000 7f2ac1b8d700 1 Processor -- start 2024-06-02T04:03:14.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.618+0000 7f2ac1b8d700 1 -- start start 2024-06-02T04:03:14.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.618+0000 7f2ac1b8d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2abc100e90 0x7f2abc196d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:14.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.618+0000 7f2ac1b8d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2abc101fe0 0x7f2abc1972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:14.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.618+0000 7f2ac1b8d700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2abc1029a0 0x7f2abc19e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:14.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.618+0000 7f2ac1b8d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc19e8c0 con 0x7f2abc101fe0 2024-06-02T04:03:14.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.618+0000 7f2ac1b8d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc19ea00 con 0x7f2abc100e90 2024-06-02T04:03:14.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.618+0000 7f2ac1b8d700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc19eb90 con 0x7f2abc1029a0 2024-06-02T04:03:14.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.618+0000 7f2abaffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2abc101fe0 0x7f2abc1972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:14.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.618+0000 7f2abaffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2abc101fe0 0x7f2abc1972d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42290/0 (socket says 172.21.15.123:42290) 2024-06-02T04:03:14.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.618+0000 7f2abaffd700 1 -- 172.21.15.123:0/1192681461 learned_addr learned my addr 172.21.15.123:0/1192681461 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:14.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.619+0000 7f2abbfff700 1 --2- 172.21.15.123:0/1192681461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2abc1029a0 0x7f2abc19e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:14.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.619+0000 7f2abb7fe700 1 --2- 172.21.15.123:0/1192681461 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2abc100e90 0x7f2abc196d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:14.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.619+0000 7f2abaffd700 1 -- 172.21.15.123:0/1192681461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2abc1029a0 msgr2=0x7f2abc19e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:14.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.619+0000 7f2abaffd700 1 --2- 172.21.15.123:0/1192681461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2abc1029a0 0x7f2abc19e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:14.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.619+0000 7f2abaffd700 1 -- 172.21.15.123:0/1192681461 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2abc100e90 msgr2=0x7f2abc196d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:14.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.619+0000 7f2abaffd700 1 --2- 172.21.15.123:0/1192681461 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2abc100e90 0x7f2abc196d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:14.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.619+0000 7f2abaffd700 1 -- 172.21.15.123:0/1192681461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aac0095f0 con 0x7f2abc101fe0 2024-06-02T04:03:14.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.619+0000 7f2abb7fe700 1 --2- 172.21.15.123:0/1192681461 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2abc100e90 0x7f2abc196d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:03:14.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.619+0000 7f2abaffd700 1 --2- 172.21.15.123:0/1192681461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2abc101fe0 0x7f2abc1972d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2ab000c9b0 tx=0x7f2ab000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:14.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.619+0000 7f2ab8ff9700 1 -- 172.21.15.123:0/1192681461 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab0007b00 con 0x7f2abc101fe0 2024-06-02T04:03:14.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.619+0000 7f2ab8ff9700 1 -- 172.21.15.123:0/1192681461 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ab0007c60 con 0x7f2abc101fe0 2024-06-02T04:03:14.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.619+0000 7f2ac1b8d700 1 -- 172.21.15.123:0/1192681461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2abc19ee70 con 0x7f2abc101fe0 2024-06-02T04:03:14.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.619+0000 7f2ab8ff9700 1 -- 172.21.15.123:0/1192681461 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab0018660 con 0x7f2abc101fe0 2024-06-02T04:03:14.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.619+0000 7f2ac1b8d700 1 -- 172.21.15.123:0/1192681461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2abc19f370 con 0x7f2abc101fe0 2024-06-02T04:03:14.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.620+0000 7f2ac1b8d700 1 -- 172.21.15.123:0/1192681461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2abc108230 con 0x7f2abc101fe0 2024-06-02T04:03:14.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.621+0000 7f2ab8ff9700 1 -- 172.21.15.123:0/1192681461 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f2ab0018880 con 0x7f2abc101fe0 2024-06-02T04:03:14.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.622+0000 7f2ab8ff9700 1 --2- 172.21.15.123:0/1192681461 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2aa40a11b0 0x7f2aa40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:14.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.622+0000 7f2abb7fe700 1 --2- 172.21.15.123:0/1192681461 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2aa40a11b0 0x7f2aa40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:14.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.622+0000 7f2ab8ff9700 1 -- 172.21.15.123:0/1192681461 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2ab00cca50 con 0x7f2abc101fe0 2024-06-02T04:03:14.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.622+0000 7f2abb7fe700 1 --2- 172.21.15.123:0/1192681461 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2aa40a11b0 0x7f2aa40a3670 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2aac000c00 tx=0x7f2aac005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:14.626 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.626+0000 7f2ab8ff9700 1 -- 172.21.15.123:0/1192681461 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2ab0096130 con 0x7f2abc101fe0 2024-06-02T04:03:14.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.831+0000 7f2ac1b8d700 1 -- 172.21.15.123:0/1192681461 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2abc10c760 con 0x7f2abc101fe0 2024-06-02T04:03:14.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.832+0000 7f2ab8ff9700 1 -- 172.21.15.123:0/1192681461 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22175 (secure 0 0 0) 0x7f2ab0099750 con 0x7f2abc101fe0 2024-06-02T04:03:14.832 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:03:14.833 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":82,"fsid":"1b432ae0-2094-11ef-bc9b-c7b262605968","created":"2024-06-02T03:57:17.383774+0000","modified":"2024-06-02T04:03:07.669997+0000","last_up_change":"2024-06-02T04:02:34.535591+0000","last_in_change":"2024-06-02T04:02:18.346560+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T03:59:57.079448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:03:05.199881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:03:05.853741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d9d8fb5a-dac5-4b14-98e5-665bdbc696ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6803","nonce":2763421276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6805","nonce":2763421276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6809","nonce":2763421276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6807","nonce":2763421276}]},"public_addr":"172.21.15.123:6803/2763421276","cluster_addr":"172.21.15.123:6805/2763421276","heartbeat_back_addr":"172.21.15.123:6809/2763421276","heartbeat_front_addr":"172.21.15.123:6807/2763421276","state":["exists","up"]},{"osd":1,"uuid":"121bbe3c-bb76-4ec4-9596-37db68fbf1ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6801","nonce":956325510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6803","nonce":956325510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6807","nonce":956325510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6805","nonce":956325510}]},"public_addr":"172.21.15.136:6801/956325510","cluster_addr":"172.21.15.136:6803/956325510","heartbeat_back_addr":"172.21.15.136:6807/956325510","heartbeat_front_addr":"172.21.15.136:6805/956325510","state":["exists","up"]},{"osd":2,"uuid":"df9edf0d-f9f0-4699-a6ed-bbcf2dfb1b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6801","nonce":2915749676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6803","nonce":2915749676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6807","nonce":2915749676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6805","nonce":2915749676}]},"public_addr":"172.21.15.162:6801/2915749676","cluster_addr":"172.21.15.162:6803/2915749676","heartbeat_back_addr":"172.21.15.162:6807/2915749676","heartbeat_front_addr":"172.21.15.162:6805/2915749676","state":["exists","up"]},{"osd":3,"uuid":"3e070364-12c6-4780-b2be-f6e933e65773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6811","nonce":1403773143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6813","nonce":1403773143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6817","nonce":1403773143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6815","nonce":1403773143}]},"public_addr":"172.21.15.123:6811/1403773143","cluster_addr":"172.21.15.123:6813/1403773143","heartbeat_back_addr":"172.21.15.123:6817/1403773143","heartbeat_front_addr":"172.21.15.123:6815/1403773143","state":["exists","up"]},{"osd":4,"uuid":"87dd92dd-73c8-4785-bf8a-3756d79dee90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6809","nonce":1403526782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6811","nonce":1403526782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6815","nonce":1403526782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6813","nonce":1403526782}]},"public_addr":"172.21.15.136:6809/1403526782","cluster_addr":"172.21.15.136:6811/1403526782","heartbeat_back_addr":"172.21.15.136:6815/1403526782","heartbeat_front_addr":"172.21.15.136:6813/1403526782","state":["exists","up"]},{"osd":5,"uuid":"1a730863-6b56-43b7-a115-c80d3c8f3ee3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6809","nonce":3094256489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6811","nonce":3094256489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6815","nonce":3094256489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6813","nonce":3094256489}]},"public_addr":"172.21.15.162:6809/3094256489","cluster_addr":"172.21.15.162:6811/3094256489","heartbeat_back_addr":"172.21.15.162:6815/3094256489","heartbeat_front_addr":"172.21.15.162:6813/3094256489","state":["exists","up"]},{"osd":6,"uuid":"6f170b85-6c47-49ff-ba5b-7fe0596a4ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6819","nonce":3025820432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6821","nonce":3025820432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6825","nonce":3025820432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6823","nonce":3025820432}]},"public_addr":"172.21.15.123:6819/3025820432","cluster_addr":"172.21.15.123:6821/3025820432","heartbeat_back_addr":"172.21.15.123:6825/3025820432","heartbeat_front_addr":"172.21.15.123:6823/3025820432","state":["exists","up"]},{"osd":7,"uuid":"ee66bb7a-6c0d-4e5a-b717-258a39f93a87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6817","nonce":1948829505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6819","nonce":1948829505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6823","nonce":1948829505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6821","nonce":1948829505}]},"public_addr":"172.21.15.136:6817/1948829505","cluster_addr":"172.21.15.136:6819/1948829505","heartbeat_back_addr":"172.21.15.136:6823/1948829505","heartbeat_front_addr":"172.21.15.136:6821/1948829505","state":["exists","up"]},{"osd":8,"uuid":"0ff77e33-53a5-43ef-85da-2036a1fcdb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6817","nonce":1590839230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6819","nonce":1590839230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6823","nonce":1590839230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6821","nonce":1590839230}]},"public_addr":"172.21.15.162:6817/1590839230","cluster_addr":"172.21.15.162:6819/1590839230","heartbeat_back_addr":"172.21.15.162:6823/1590839230","heartbeat_front_addr":"172.21.15.162:6821/1590839230","state":["exists","up"]},{"osd":9,"uuid":"1670731c-5e8f-4cbc-8f35-6aeb14ea3075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6827","nonce":608720685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6829","nonce":608720685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6833","nonce":608720685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6831","nonce":608720685}]},"public_addr":"172.21.15.123:6827/608720685","cluster_addr":"172.21.15.123:6829/608720685","heartbeat_back_addr":"172.21.15.123:6833/608720685","heartbeat_front_addr":"172.21.15.123:6831/608720685","state":["exists","up"]},{"osd":10,"uuid":"ae138b96-13e7-46ac-9d4d-48308132465d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6825","nonce":3777263126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6827","nonce":3777263126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6831","nonce":3777263126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6829","nonce":3777263126}]},"public_addr":"172.21.15.136:6825/3777263126","cluster_addr":"172.21.15.136:6827/3777263126","heartbeat_back_addr":"172.21.15.136:6831/3777263126","heartbeat_front_addr":"172.21.15.136:6829/3777263126","state":["exists","up"]},{"osd":11,"uuid":"69f4ede0-7e9b-4edb-be54-01f74f002a06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6825","nonce":704809754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6827","nonce":704809754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6831","nonce":704809754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6829","nonce":704809754}]},"public_addr":"172.21.15.162:6825/704809754","cluster_addr":"172.21.15.162:6827/704809754","heartbeat_back_addr":"172.21.15.162:6831/704809754","heartbeat_front_addr":"172.21.15.162:6829/704809754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:19.188506+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:36.535261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:54.242294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:11.815314+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:29.512086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:46.874319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:04.437358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:22.312520+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:39.917998+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:57.340043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:15.252797+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:32.898924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:0/69783025":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/10165744":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/2081407856":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/4026642298":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/1442330765":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/1595718606":"2024-06-03T03:57:45.611046+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:03:14.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.834+0000 7f2ac1b8d700 1 -- 172.21.15.123:0/1192681461 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2aa40a11b0 msgr2=0x7f2aa40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:14.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.834+0000 7f2ac1b8d700 1 --2- 172.21.15.123:0/1192681461 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2aa40a11b0 0x7f2aa40a3670 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2aac000c00 tx=0x7f2aac005fb0 comp rx=0 tx=0).stop 2024-06-02T04:03:14.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.834+0000 7f2ac1b8d700 1 -- 172.21.15.123:0/1192681461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2abc101fe0 msgr2=0x7f2abc1972d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:14.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.834+0000 7f2ac1b8d700 1 --2- 172.21.15.123:0/1192681461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2abc101fe0 0x7f2abc1972d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2ab000c9b0 tx=0x7f2ab000cd70 comp rx=0 tx=0).stop 2024-06-02T04:03:14.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.834+0000 7f2ac1b8d700 1 -- 172.21.15.123:0/1192681461 shutdown_connections 2024-06-02T04:03:14.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.834+0000 7f2ac1b8d700 1 --2- 172.21.15.123:0/1192681461 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2abc1029a0 0x7f2abc19e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:14.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.834+0000 7f2ac1b8d700 1 --2- 172.21.15.123:0/1192681461 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2aa40a11b0 0x7f2aa40a3670 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:14.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.834+0000 7f2ac1b8d700 1 --2- 172.21.15.123:0/1192681461 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2abc100e90 0x7f2abc196d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:14.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.834+0000 7f2ac1b8d700 1 --2- 172.21.15.123:0/1192681461 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2abc101fe0 0x7f2abc1972d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:14.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.834+0000 7f2ac1b8d700 1 -- 172.21.15.123:0/1192681461 >> 172.21.15.123:0/1192681461 conn(0x7f2abc0fc400 msgr2=0x7f2abc105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:14.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.834+0000 7f2ac1b8d700 1 -- 172.21.15.123:0/1192681461 shutdown_connections 2024-06-02T04:03:14.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.835+0000 7f2ac1b8d700 1 -- 172.21.15.123:0/1192681461 wait complete. 2024-06-02T04:03:14.847 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-06-02T04:03:14.847 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T04:03:14.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.969+0000 7f7e9872c700 1 -- 172.21.15.123:0/625328692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e900ffd60 msgr2=0x7f7e90100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:14.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.969+0000 7f7e9872c700 1 --2- 172.21.15.123:0/625328692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e900ffd60 0x7f7e90100180 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c0099c0 tx=0x7f7e8c009cd0 comp rx=0 tx=0).stop 2024-06-02T04:03:14.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.969+0000 7f7e9872c700 1 -- 172.21.15.123:0/625328692 shutdown_connections 2024-06-02T04:03:14.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.969+0000 7f7e9872c700 1 --2- 172.21.15.123:0/625328692 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e901018f0 0x7f7e901081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:14.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.969+0000 7f7e9872c700 1 --2- 172.21.15.123:0/625328692 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e900ffd60 0x7f7e90100180 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:14.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.969+0000 7f7e9872c700 1 --2- 172.21.15.123:0/625328692 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e90100f50 0x7f7e901013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:14.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.969+0000 7f7e9872c700 1 -- 172.21.15.123:0/625328692 >> 172.21.15.123:0/625328692 conn(0x7f7e900fb2f0 msgr2=0x7f7e900fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:14.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.969+0000 7f7e9872c700 1 -- 172.21.15.123:0/625328692 shutdown_connections 2024-06-02T04:03:14.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.969+0000 7f7e9872c700 1 -- 172.21.15.123:0/625328692 wait complete. 2024-06-02T04:03:14.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.970+0000 7f7e9872c700 1 Processor -- start 2024-06-02T04:03:14.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.970+0000 7f7e9872c700 1 -- start start 2024-06-02T04:03:14.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.970+0000 7f7e9872c700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e900ffd60 0x7f7e90068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:14.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.970+0000 7f7e9872c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e90100f50 0x7f7e9019bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:14.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.970+0000 7f7e9872c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e901018f0 0x7f7e9019e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:14.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.970+0000 7f7e9872c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9019e930 con 0x7f7e901018f0 2024-06-02T04:03:14.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.970+0000 7f7e9872c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9019eaa0 con 0x7f7e90100f50 2024-06-02T04:03:14.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.970+0000 7f7e9872c700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9019ec60 con 0x7f7e900ffd60 2024-06-02T04:03:14.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.970+0000 7f7e96cc9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e901018f0 0x7f7e9019e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:14.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.970+0000 7f7e96cc9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e901018f0 0x7f7e9019e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42304/0 (socket says 172.21.15.123:42304) 2024-06-02T04:03:14.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.970+0000 7f7e96cc9700 1 -- 172.21.15.123:0/2531105855 learned_addr learned my addr 172.21.15.123:0/2531105855 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:14.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.970+0000 7f7e964c8700 1 --2- 172.21.15.123:0/2531105855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e900ffd60 0x7f7e90068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:14.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.970+0000 7f7e95cc7700 1 --2- 172.21.15.123:0/2531105855 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e90100f50 0x7f7e9019bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:14.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.970+0000 7f7e96cc9700 1 -- 172.21.15.123:0/2531105855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e900ffd60 msgr2=0x7f7e90068b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:14.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.970+0000 7f7e96cc9700 1 --2- 172.21.15.123:0/2531105855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e900ffd60 0x7f7e90068b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:14.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.970+0000 7f7e96cc9700 1 -- 172.21.15.123:0/2531105855 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e90100f50 msgr2=0x7f7e9019bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:14.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.970+0000 7f7e96cc9700 1 --2- 172.21.15.123:0/2531105855 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e90100f50 0x7f7e9019bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:14.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.970+0000 7f7e96cc9700 1 -- 172.21.15.123:0/2531105855 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8c0095f0 con 0x7f7e901018f0 2024-06-02T04:03:14.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.970+0000 7f7e96cc9700 1 --2- 172.21.15.123:0/2531105855 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e901018f0 0x7f7e9019e140 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7e88007ee0 tx=0x7f7e8800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:14.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.970+0000 7f7e837fe700 1 -- 172.21.15.123:0/2531105855 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8800ddd0 con 0x7f7e901018f0 2024-06-02T04:03:14.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.971+0000 7f7e837fe700 1 -- 172.21.15.123:0/2531105855 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e8800f040 con 0x7f7e901018f0 2024-06-02T04:03:14.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.971+0000 7f7e9872c700 1 -- 172.21.15.123:0/2531105855 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e9019eee0 con 0x7f7e901018f0 2024-06-02T04:03:14.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.971+0000 7f7e837fe700 1 -- 172.21.15.123:0/2531105855 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e880048e0 con 0x7f7e901018f0 2024-06-02T04:03:14.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.971+0000 7f7e9872c700 1 -- 172.21.15.123:0/2531105855 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e9019f360 con 0x7f7e901018f0 2024-06-02T04:03:14.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.972+0000 7f7e9872c700 1 -- 172.21.15.123:0/2531105855 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e90107230 con 0x7f7e901018f0 2024-06-02T04:03:14.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.973+0000 7f7e837fe700 1 -- 172.21.15.123:0/2531105855 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f7e88003a00 con 0x7f7e901018f0 2024-06-02T04:03:14.974 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.974+0000 7f7e837fe700 1 --2- 172.21.15.123:0/2531105855 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7e7c0a11b0 0x7f7e7c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:14.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.974+0000 7f7e964c8700 1 --2- 172.21.15.123:0/2531105855 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7e7c0a11b0 0x7f7e7c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:14.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.974+0000 7f7e837fe700 1 -- 172.21.15.123:0/2531105855 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7e880cc9b0 con 0x7f7e901018f0 2024-06-02T04:03:14.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.974+0000 7f7e964c8700 1 --2- 172.21.15.123:0/2531105855 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7e7c0a11b0 0x7f7e7c0a3670 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c003820 tx=0x7f7e8c005920 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:14.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:14.977+0000 7f7e837fe700 1 -- 172.21.15.123:0/2531105855 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7e88096190 con 0x7f7e901018f0 2024-06-02T04:03:15.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.173+0000 7f7e9872c700 1 -- 172.21.15.123:0/2531105855 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7e9002ceb0 con 0x7f7e7c0a11b0 2024-06-02T04:03:15.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.183+0000 7f7e837fe700 1 -- 172.21.15.123:0/2531105855 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+328500 (secure 0 0 0) 0x7f7e9002ceb0 con 0x7f7e7c0a11b0 2024-06-02T04:03:15.188 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:03:15.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.187+0000 7f7e9872c700 1 -- 172.21.15.123:0/2531105855 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7e7c0a11b0 msgr2=0x7f7e7c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:15.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.187+0000 7f7e9872c700 1 --2- 172.21.15.123:0/2531105855 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7e7c0a11b0 0x7f7e7c0a3670 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c003820 tx=0x7f7e8c005920 comp rx=0 tx=0).stop 2024-06-02T04:03:15.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.187+0000 7f7e9872c700 1 -- 172.21.15.123:0/2531105855 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e901018f0 msgr2=0x7f7e9019e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:15.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.187+0000 7f7e9872c700 1 --2- 172.21.15.123:0/2531105855 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e901018f0 0x7f7e9019e140 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7e88007ee0 tx=0x7f7e8800d3b0 comp rx=0 tx=0).stop 2024-06-02T04:03:15.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.187+0000 7f7e9872c700 1 -- 172.21.15.123:0/2531105855 shutdown_connections 2024-06-02T04:03:15.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.187+0000 7f7e9872c700 1 --2- 172.21.15.123:0/2531105855 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7e901018f0 0x7f7e9019e140 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:15.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.187+0000 7f7e9872c700 1 --2- 172.21.15.123:0/2531105855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7e900ffd60 0x7f7e90068b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:15.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.187+0000 7f7e9872c700 1 --2- 172.21.15.123:0/2531105855 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7e7c0a11b0 0x7f7e7c0a3670 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:15.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.187+0000 7f7e9872c700 1 --2- 172.21.15.123:0/2531105855 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7e90100f50 0x7f7e9019bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:15.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.187+0000 7f7e9872c700 1 -- 172.21.15.123:0/2531105855 >> 172.21.15.123:0/2531105855 conn(0x7f7e900fb2f0 msgr2=0x7f7e90104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:15.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.187+0000 7f7e9872c700 1 -- 172.21.15.123:0/2531105855 shutdown_connections 2024-06-02T04:03:15.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.187+0000 7f7e9872c700 1 -- 172.21.15.123:0/2531105855 wait complete. 2024-06-02T04:03:15.192 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-06-02T04:03:15.198 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:15 smithi123 ceph-mon[42885]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:03:15.198 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:15 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1793865389' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:03:15.198 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:15 smithi123 ceph-mon[42885]: pgmap v226: 97 pgs: 97 active+clean; 603 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 9.4 KiB/s wr, 28 op/s 2024-06-02T04:03:15.198 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:15 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1192681461' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:03:15.199 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":226,"stamp":"2024-06-02T04:03:14.827650+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":617625,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":165,"num_read_kb":140,"num_write":378,"num_write_kb":3015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":312,"ondisk_log_size":312,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":283,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359616,"kb_used_data":10840,"kb_used_omap":18,"kb_used_meta":348653,"kb_avail":1124582208,"statfs":{"total":1151940427776,"available":1151572180992,"internally_reserved":0,"allocated":11100160,"data_stored":6930157,"data_compressed":110256,"data_compressed_allocated":139264,"data_compressed_original":1777664,"omap_allocated":19129,"internal_metadata":357020999},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":27257,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":39,"num_read_kb":31,"num_write":197,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.155551"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.001512+0000","last_change":"2024-06-02T04:03:06.690548+0000","last_active":"2024-06-02T04:03:08.001512+0000","last_peered":"2024-06-02T04:03:08.001512+0000","last_clean":"2024-06-02T04:03:08.001512+0000","last_became_active":"2024-06-02T04:03:06.690003+0000","last_became_peered":"2024-06-02T04:03:06.690003+0000","last_unstale":"2024-06-02T04:03:08.001512+0000","last_undegraded":"2024-06-02T04:03:08.001512+0000","last_fullsized":"2024-06-02T04:03:08.001512+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:36:23.875017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.695899+0000","last_change":"2024-06-02T04:03:06.694664+0000","last_active":"2024-06-02T04:03:06.695899+0000","last_peered":"2024-06-02T04:03:06.695899+0000","last_clean":"2024-06-02T04:03:06.695899+0000","last_became_active":"2024-06-02T04:03:06.692173+0000","last_became_peered":"2024-06-02T04:03:06.692173+0000","last_unstale":"2024-06-02T04:03:06.695899+0000","last_undegraded":"2024-06-02T04:03:06.695899+0000","last_fullsized":"2024-06-02T04:03:06.695899+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:28:07.252793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.692106+0000","last_change":"2024-06-02T04:03:06.691118+0000","last_active":"2024-06-02T04:03:06.692106+0000","last_peered":"2024-06-02T04:03:06.692106+0000","last_clean":"2024-06-02T04:03:06.692106+0000","last_became_active":"2024-06-02T04:03:06.690782+0000","last_became_peered":"2024-06-02T04:03:06.690782+0000","last_unstale":"2024-06-02T04:03:06.692106+0000","last_undegraded":"2024-06-02T04:03:06.692106+0000","last_fullsized":"2024-06-02T04:03:06.692106+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:30:02.876432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.828784+0000","last_change":"2024-06-02T04:03:06.692716+0000","last_active":"2024-06-02T04:03:06.828784+0000","last_peered":"2024-06-02T04:03:06.828784+0000","last_clean":"2024-06-02T04:03:06.828784+0000","last_became_active":"2024-06-02T04:03:06.692084+0000","last_became_peered":"2024-06-02T04:03:06.692084+0000","last_unstale":"2024-06-02T04:03:06.828784+0000","last_undegraded":"2024-06-02T04:03:06.828784+0000","last_fullsized":"2024-06-02T04:03:06.828784+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:32:20.191118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.885799+0000","last_change":"2024-06-02T04:03:06.685966+0000","last_active":"2024-06-02T04:03:07.885799+0000","last_peered":"2024-06-02T04:03:07.885799+0000","last_clean":"2024-06-02T04:03:07.885799+0000","last_became_active":"2024-06-02T04:03:06.685622+0000","last_became_peered":"2024-06-02T04:03:06.685622+0000","last_unstale":"2024-06-02T04:03:07.885799+0000","last_undegraded":"2024-06-02T04:03:07.885799+0000","last_fullsized":"2024-06-02T04:03:07.885799+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:37:11.472602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.043587+0000","last_change":"2024-06-02T04:03:06.687067+0000","last_active":"2024-06-02T04:03:08.043587+0000","last_peered":"2024-06-02T04:03:08.043587+0000","last_clean":"2024-06-02T04:03:08.043587+0000","last_became_active":"2024-06-02T04:03:06.686746+0000","last_became_peered":"2024-06-02T04:03:06.686746+0000","last_unstale":"2024-06-02T04:03:08.043587+0000","last_undegraded":"2024-06-02T04:03:08.043587+0000","last_fullsized":"2024-06-02T04:03:08.043587+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:18:28.240961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.644681+0000","last_change":"2024-06-02T04:03:06.685437+0000","last_active":"2024-06-02T04:03:08.644681+0000","last_peered":"2024-06-02T04:03:08.644681+0000","last_clean":"2024-06-02T04:03:08.644681+0000","last_became_active":"2024-06-02T04:03:06.685127+0000","last_became_peered":"2024-06-02T04:03:06.685127+0000","last_unstale":"2024-06-02T04:03:08.644681+0000","last_undegraded":"2024-06-02T04:03:08.644681+0000","last_fullsized":"2024-06-02T04:03:08.644681+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:45:08.746351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676297+0000","last_change":"2024-06-02T04:03:06.688091+0000","last_active":"2024-06-02T04:03:07.676297+0000","last_peered":"2024-06-02T04:03:07.676297+0000","last_clean":"2024-06-02T04:03:07.676297+0000","last_became_active":"2024-06-02T04:03:06.687827+0000","last_became_peered":"2024-06-02T04:03:06.687827+0000","last_unstale":"2024-06-02T04:03:07.676297+0000","last_undegraded":"2024-06-02T04:03:07.676297+0000","last_fullsized":"2024-06-02T04:03:07.676297+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:44:10.968199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.717204+0000","last_change":"2024-06-02T04:03:06.699748+0000","last_active":"2024-06-02T04:03:08.717204+0000","last_peered":"2024-06-02T04:03:08.717204+0000","last_clean":"2024-06-02T04:03:08.717204+0000","last_became_active":"2024-06-02T04:03:06.699442+0000","last_became_peered":"2024-06-02T04:03:06.699442+0000","last_unstale":"2024-06-02T04:03:08.717204+0000","last_undegraded":"2024-06-02T04:03:08.717204+0000","last_fullsized":"2024-06-02T04:03:08.717204+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:00:40.165226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.043690+0000","last_change":"2024-06-02T04:03:06.691914+0000","last_active":"2024-06-02T04:03:08.043690+0000","last_peered":"2024-06-02T04:03:08.043690+0000","last_clean":"2024-06-02T04:03:08.043690+0000","last_became_active":"2024-06-02T04:03:06.691250+0000","last_became_peered":"2024-06-02T04:03:06.691250+0000","last_unstale":"2024-06-02T04:03:08.043690+0000","last_undegraded":"2024-06-02T04:03:08.043690+0000","last_fullsized":"2024-06-02T04:03:08.043690+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:21:17.201134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.644985+0000","last_change":"2024-06-02T04:03:06.700359+0000","last_active":"2024-06-02T04:03:08.644985+0000","last_peered":"2024-06-02T04:03:08.644985+0000","last_clean":"2024-06-02T04:03:08.644985+0000","last_became_active":"2024-06-02T04:03:06.699829+0000","last_became_peered":"2024-06-02T04:03:06.699829+0000","last_unstale":"2024-06-02T04:03:08.644985+0000","last_undegraded":"2024-06-02T04:03:08.644985+0000","last_fullsized":"2024-06-02T04:03:08.644985+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:00:48.645655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.828757+0000","last_change":"2024-06-02T04:03:06.693172+0000","last_active":"2024-06-02T04:03:06.828757+0000","last_peered":"2024-06-02T04:03:06.828757+0000","last_clean":"2024-06-02T04:03:06.828757+0000","last_became_active":"2024-06-02T04:03:06.692859+0000","last_became_peered":"2024-06-02T04:03:06.692859+0000","last_unstale":"2024-06-02T04:03:06.828757+0000","last_undegraded":"2024-06-02T04:03:06.828757+0000","last_fullsized":"2024-06-02T04:03:06.828757+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:34:56.027760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.967731+0000","last_change":"2024-06-02T04:03:06.688171+0000","last_active":"2024-06-02T04:03:06.967731+0000","last_peered":"2024-06-02T04:03:06.967731+0000","last_clean":"2024-06-02T04:03:06.967731+0000","last_became_active":"2024-06-02T04:03:06.687476+0000","last_became_peered":"2024-06-02T04:03:06.687476+0000","last_unstale":"2024-06-02T04:03:06.967731+0000","last_undegraded":"2024-06-02T04:03:06.967731+0000","last_fullsized":"2024-06-02T04:03:06.967731+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:03:49.023726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.698675+0000","last_change":"2024-06-02T04:03:06.697507+0000","last_active":"2024-06-02T04:03:06.698675+0000","last_peered":"2024-06-02T04:03:06.698675+0000","last_clean":"2024-06-02T04:03:06.698675+0000","last_became_active":"2024-06-02T04:03:06.697201+0000","last_became_peered":"2024-06-02T04:03:06.697201+0000","last_unstale":"2024-06-02T04:03:06.698675+0000","last_undegraded":"2024-06-02T04:03:06.698675+0000","last_fullsized":"2024-06-02T04:03:06.698675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:33:08.883076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.691982+0000","last_change":"2024-06-02T04:03:06.690488+0000","last_active":"2024-06-02T04:03:06.691982+0000","last_peered":"2024-06-02T04:03:06.691982+0000","last_clean":"2024-06-02T04:03:06.691982+0000","last_became_active":"2024-06-02T04:03:06.690186+0000","last_became_peered":"2024-06-02T04:03:06.690186+0000","last_unstale":"2024-06-02T04:03:06.691982+0000","last_undegraded":"2024-06-02T04:03:06.691982+0000","last_fullsized":"2024-06-02T04:03:06.691982+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:55:44.408427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.716746+0000","last_change":"2024-06-02T04:03:06.693950+0000","last_active":"2024-06-02T04:03:08.716746+0000","last_peered":"2024-06-02T04:03:08.716746+0000","last_clean":"2024-06-02T04:03:08.716746+0000","last_became_active":"2024-06-02T04:03:06.693656+0000","last_became_peered":"2024-06-02T04:03:06.693656+0000","last_unstale":"2024-06-02T04:03:08.716746+0000","last_undegraded":"2024-06-02T04:03:08.716746+0000","last_fullsized":"2024-06-02T04:03:08.716746+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:14:24.687129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.001599+0000","last_change":"2024-06-02T04:03:06.690325+0000","last_active":"2024-06-02T04:03:08.001599+0000","last_peered":"2024-06-02T04:03:08.001599+0000","last_clean":"2024-06-02T04:03:08.001599+0000","last_became_active":"2024-06-02T04:03:06.689579+0000","last_became_peered":"2024-06-02T04:03:06.689579+0000","last_unstale":"2024-06-02T04:03:08.001599+0000","last_undegraded":"2024-06-02T04:03:08.001599+0000","last_fullsized":"2024-06-02T04:03:08.001599+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:46:49.709737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:09.706673+0000","last_change":"2024-06-02T04:03:06.691817+0000","last_active":"2024-06-02T04:03:09.706673+0000","last_peered":"2024-06-02T04:03:09.706673+0000","last_clean":"2024-06-02T04:03:09.706673+0000","last_became_active":"2024-06-02T04:03:06.691487+0000","last_became_peered":"2024-06-02T04:03:06.691487+0000","last_unstale":"2024-06-02T04:03:09.706673+0000","last_undegraded":"2024-06-02T04:03:09.706673+0000","last_fullsized":"2024-06-02T04:03:09.706673+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:32:29.983404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.689707+0000","last_change":"2024-06-02T04:03:06.687928+0000","last_active":"2024-06-02T04:03:06.689707+0000","last_peered":"2024-06-02T04:03:06.689707+0000","last_clean":"2024-06-02T04:03:06.689707+0000","last_became_active":"2024-06-02T04:03:06.687626+0000","last_became_peered":"2024-06-02T04:03:06.687626+0000","last_unstale":"2024-06-02T04:03:06.689707+0000","last_undegraded":"2024-06-02T04:03:06.689707+0000","last_fullsized":"2024-06-02T04:03:06.689707+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:00:49.112152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"82'13","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:13.108904+0000","last_change":"2024-06-02T04:03:06.278393+0000","last_active":"2024-06-02T04:03:13.108904+0000","last_peered":"2024-06-02T04:03:13.108904+0000","last_clean":"2024-06-02T04:03:13.108904+0000","last_became_active":"2024-06-02T04:03:06.278033+0000","last_became_peered":"2024-06-02T04:03:06.278033+0000","last_unstale":"2024-06-02T04:03:13.108904+0000","last_undegraded":"2024-06-02T04:03:13.108904+0000","last_fullsized":"2024-06-02T04:03:13.108904+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:34:01.806795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676615+0000","last_change":"2024-06-02T04:03:06.693074+0000","last_active":"2024-06-02T04:03:07.676615+0000","last_peered":"2024-06-02T04:03:07.676615+0000","last_clean":"2024-06-02T04:03:07.676615+0000","last_became_active":"2024-06-02T04:03:06.689257+0000","last_became_peered":"2024-06-02T04:03:06.689257+0000","last_unstale":"2024-06-02T04:03:07.676615+0000","last_undegraded":"2024-06-02T04:03:07.676615+0000","last_fullsized":"2024-06-02T04:03:07.676615+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:36:48.346723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.882169+0000","last_change":"2024-06-02T04:03:06.275088+0000","last_active":"2024-06-02T04:03:08.882169+0000","last_peered":"2024-06-02T04:03:08.882169+0000","last_clean":"2024-06-02T04:03:08.882169+0000","last_became_active":"2024-06-02T04:03:06.274731+0000","last_became_peered":"2024-06-02T04:03:06.274731+0000","last_unstale":"2024-06-02T04:03:08.882169+0000","last_undegraded":"2024-06-02T04:03:08.882169+0000","last_fullsized":"2024-06-02T04:03:08.882169+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:41:01.298971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.693659+0000","last_change":"2024-06-02T04:03:06.691841+0000","last_active":"2024-06-02T04:03:06.693659+0000","last_peered":"2024-06-02T04:03:06.693659+0000","last_clean":"2024-06-02T04:03:06.693659+0000","last_became_active":"2024-06-02T04:03:06.690960+0000","last_became_peered":"2024-06-02T04:03:06.690960+0000","last_unstale":"2024-06-02T04:03:06.693659+0000","last_undegraded":"2024-06-02T04:03:06.693659+0000","last_fullsized":"2024-06-02T04:03:06.693659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:05:13.716189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"82'11","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:12.097731+0000","last_change":"2024-06-02T04:03:06.278745+0000","last_active":"2024-06-02T04:03:12.097731+0000","last_peered":"2024-06-02T04:03:12.097731+0000","last_clean":"2024-06-02T04:03:12.097731+0000","last_became_active":"2024-06-02T04:03:06.278449+0000","last_became_peered":"2024-06-02T04:03:06.278449+0000","last_unstale":"2024-06-02T04:03:12.097731+0000","last_undegraded":"2024-06-02T04:03:12.097731+0000","last_fullsized":"2024-06-02T04:03:12.097731+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:56:46.039492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.716762+0000","last_change":"2024-06-02T04:03:06.695832+0000","last_active":"2024-06-02T04:03:08.716762+0000","last_peered":"2024-06-02T04:03:08.716762+0000","last_clean":"2024-06-02T04:03:08.716762+0000","last_became_active":"2024-06-02T04:03:06.695266+0000","last_became_peered":"2024-06-02T04:03:06.695266+0000","last_unstale":"2024-06-02T04:03:08.716762+0000","last_undegraded":"2024-06-02T04:03:08.716762+0000","last_fullsized":"2024-06-02T04:03:08.716762+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:06:27.708914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:12.096043+0000","last_change":"2024-06-02T04:03:06.277846+0000","last_active":"2024-06-02T04:03:12.096043+0000","last_peered":"2024-06-02T04:03:12.096043+0000","last_clean":"2024-06-02T04:03:12.096043+0000","last_became_active":"2024-06-02T04:03:06.277514+0000","last_became_peered":"2024-06-02T04:03:06.277514+0000","last_unstale":"2024-06-02T04:03:12.096043+0000","last_undegraded":"2024-06-02T04:03:12.096043+0000","last_fullsized":"2024-06-02T04:03:12.096043+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:41:20.915468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.677279+0000","last_change":"2024-06-02T04:03:06.692309+0000","last_active":"2024-06-02T04:03:07.677279+0000","last_peered":"2024-06-02T04:03:07.677279+0000","last_clean":"2024-06-02T04:03:07.677279+0000","last_became_active":"2024-06-02T04:03:06.691988+0000","last_became_peered":"2024-06-02T04:03:06.691988+0000","last_unstale":"2024-06-02T04:03:07.677279+0000","last_undegraded":"2024-06-02T04:03:07.677279+0000","last_fullsized":"2024-06-02T04:03:07.677279+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:19:08.790807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:13.090191+0000","last_change":"2024-06-02T04:03:06.271789+0000","last_active":"2024-06-02T04:03:13.090191+0000","last_peered":"2024-06-02T04:03:13.090191+0000","last_clean":"2024-06-02T04:03:13.090191+0000","last_became_active":"2024-06-02T04:03:06.271482+0000","last_became_peered":"2024-06-02T04:03:06.271482+0000","last_unstale":"2024-06-02T04:03:13.090191+0000","last_undegraded":"2024-06-02T04:03:13.090191+0000","last_fullsized":"2024-06-02T04:03:13.090191+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:23:10.065847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.885786+0000","last_change":"2024-06-02T04:03:06.690544+0000","last_active":"2024-06-02T04:03:07.885786+0000","last_peered":"2024-06-02T04:03:07.885786+0000","last_clean":"2024-06-02T04:03:07.885786+0000","last_became_active":"2024-06-02T04:03:06.687225+0000","last_became_peered":"2024-06-02T04:03:06.687225+0000","last_unstale":"2024-06-02T04:03:07.885786+0000","last_undegraded":"2024-06-02T04:03:07.885786+0000","last_fullsized":"2024-06-02T04:03:07.885786+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:26:44.414575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.089094+0000","last_change":"2024-06-02T04:03:06.269559+0000","last_active":"2024-06-02T04:03:11.089094+0000","last_peered":"2024-06-02T04:03:11.089094+0000","last_clean":"2024-06-02T04:03:11.089094+0000","last_became_active":"2024-06-02T04:03:06.269211+0000","last_became_peered":"2024-06-02T04:03:06.269211+0000","last_unstale":"2024-06-02T04:03:11.089094+0000","last_undegraded":"2024-06-02T04:03:11.089094+0000","last_fullsized":"2024-06-02T04:03:11.089094+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:28:39.167267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.677438+0000","last_change":"2024-06-02T04:03:06.692224+0000","last_active":"2024-06-02T04:03:07.677438+0000","last_peered":"2024-06-02T04:03:07.677438+0000","last_clean":"2024-06-02T04:03:07.677438+0000","last_became_active":"2024-06-02T04:03:06.691664+0000","last_became_peered":"2024-06-02T04:03:06.691664+0000","last_unstale":"2024-06-02T04:03:07.677438+0000","last_undegraded":"2024-06-02T04:03:07.677438+0000","last_fullsized":"2024-06-02T04:03:07.677438+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:12:17.679245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:10.716951+0000","last_change":"2024-06-02T04:03:06.268602+0000","last_active":"2024-06-02T04:03:10.716951+0000","last_peered":"2024-06-02T04:03:10.716951+0000","last_clean":"2024-06-02T04:03:10.716951+0000","last_became_active":"2024-06-02T04:03:06.268268+0000","last_became_peered":"2024-06-02T04:03:06.268268+0000","last_unstale":"2024-06-02T04:03:10.716951+0000","last_undegraded":"2024-06-02T04:03:10.716951+0000","last_fullsized":"2024-06-02T04:03:10.716951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:29:40.033649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676424+0000","last_change":"2024-06-02T04:03:06.687534+0000","last_active":"2024-06-02T04:03:07.676424+0000","last_peered":"2024-06-02T04:03:07.676424+0000","last_clean":"2024-06-02T04:03:07.676424+0000","last_became_active":"2024-06-02T04:03:06.687210+0000","last_became_peered":"2024-06-02T04:03:06.687210+0000","last_unstale":"2024-06-02T04:03:07.676424+0000","last_undegraded":"2024-06-02T04:03:07.676424+0000","last_fullsized":"2024-06-02T04:03:07.676424+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:09:54.479287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:12.096635+0000","last_change":"2024-06-02T04:03:06.275477+0000","last_active":"2024-06-02T04:03:12.096635+0000","last_peered":"2024-06-02T04:03:12.096635+0000","last_clean":"2024-06-02T04:03:12.096635+0000","last_became_active":"2024-06-02T04:03:06.275091+0000","last_became_peered":"2024-06-02T04:03:06.275091+0000","last_unstale":"2024-06-02T04:03:12.096635+0000","last_undegraded":"2024-06-02T04:03:12.096635+0000","last_fullsized":"2024-06-02T04:03:12.096635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:30:49.126971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:09.706733+0000","last_change":"2024-06-02T04:03:06.685908+0000","last_active":"2024-06-02T04:03:09.706733+0000","last_peered":"2024-06-02T04:03:09.706733+0000","last_clean":"2024-06-02T04:03:09.706733+0000","last_became_active":"2024-06-02T04:03:06.685572+0000","last_became_peered":"2024-06-02T04:03:06.685572+0000","last_unstale":"2024-06-02T04:03:09.706733+0000","last_undegraded":"2024-06-02T04:03:09.706733+0000","last_fullsized":"2024-06-02T04:03:09.706733+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:31:35.685227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.087789+0000","last_change":"2024-06-02T04:03:06.274773+0000","last_active":"2024-06-02T04:03:11.087789+0000","last_peered":"2024-06-02T04:03:11.087789+0000","last_clean":"2024-06-02T04:03:11.087789+0000","last_became_active":"2024-06-02T04:03:06.274434+0000","last_became_peered":"2024-06-02T04:03:06.274434+0000","last_unstale":"2024-06-02T04:03:11.087789+0000","last_undegraded":"2024-06-02T04:03:11.087789+0000","last_fullsized":"2024-06-02T04:03:11.087789+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:46:41.681535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.717119+0000","last_change":"2024-06-02T04:03:06.702113+0000","last_active":"2024-06-02T04:03:08.717119+0000","last_peered":"2024-06-02T04:03:08.717119+0000","last_clean":"2024-06-02T04:03:08.717119+0000","last_became_active":"2024-06-02T04:03:06.701811+0000","last_became_peered":"2024-06-02T04:03:06.701811+0000","last_unstale":"2024-06-02T04:03:08.717119+0000","last_undegraded":"2024-06-02T04:03:08.717119+0000","last_fullsized":"2024-06-02T04:03:08.717119+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:04:28.772781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:12.096720+0000","last_change":"2024-06-02T04:03:06.278195+0000","last_active":"2024-06-02T04:03:12.096720+0000","last_peered":"2024-06-02T04:03:12.096720+0000","last_clean":"2024-06-02T04:03:12.096720+0000","last_became_active":"2024-06-02T04:03:06.277813+0000","last_became_peered":"2024-06-02T04:03:06.277813+0000","last_unstale":"2024-06-02T04:03:12.096720+0000","last_undegraded":"2024-06-02T04:03:12.096720+0000","last_fullsized":"2024-06-02T04:03:12.096720+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:50:31.381498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.693641+0000","last_change":"2024-06-02T04:03:06.691247+0000","last_active":"2024-06-02T04:03:06.693641+0000","last_peered":"2024-06-02T04:03:06.693641+0000","last_clean":"2024-06-02T04:03:06.693641+0000","last_became_active":"2024-06-02T04:03:06.689936+0000","last_became_peered":"2024-06-02T04:03:06.689936+0000","last_unstale":"2024-06-02T04:03:06.693641+0000","last_undegraded":"2024-06-02T04:03:06.693641+0000","last_fullsized":"2024-06-02T04:03:06.693641+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:47:36.577989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.082992+0000","last_change":"2024-06-02T04:03:06.271582+0000","last_active":"2024-06-02T04:03:11.082992+0000","last_peered":"2024-06-02T04:03:11.082992+0000","last_clean":"2024-06-02T04:03:11.082992+0000","last_became_active":"2024-06-02T04:03:06.271252+0000","last_became_peered":"2024-06-02T04:03:06.271252+0000","last_unstale":"2024-06-02T04:03:11.082992+0000","last_undegraded":"2024-06-02T04:03:11.082992+0000","last_fullsized":"2024-06-02T04:03:11.082992+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:21:30.861205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.716823+0000","last_change":"2024-06-02T04:03:06.698345+0000","last_active":"2024-06-02T04:03:08.716823+0000","last_peered":"2024-06-02T04:03:08.716823+0000","last_clean":"2024-06-02T04:03:08.716823+0000","last_became_active":"2024-06-02T04:03:06.698003+0000","last_became_peered":"2024-06-02T04:03:06.698003+0000","last_unstale":"2024-06-02T04:03:08.716823+0000","last_undegraded":"2024-06-02T04:03:08.716823+0000","last_fullsized":"2024-06-02T04:03:08.716823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:53:13.866319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'17","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:12.895157+0000","last_change":"2024-06-02T04:03:06.276367+0000","last_active":"2024-06-02T04:03:12.895157+0000","last_peered":"2024-06-02T04:03:12.895157+0000","last_clean":"2024-06-02T04:03:12.895157+0000","last_became_active":"2024-06-02T04:03:06.276006+0000","last_became_peered":"2024-06-02T04:03:06.276006+0000","last_unstale":"2024-06-02T04:03:12.895157+0000","last_undegraded":"2024-06-02T04:03:12.895157+0000","last_fullsized":"2024-06-02T04:03:12.895157+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:43:26.353155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20849,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":19,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.885854+0000","last_change":"2024-06-02T04:03:06.689688+0000","last_active":"2024-06-02T04:03:07.885854+0000","last_peered":"2024-06-02T04:03:07.885854+0000","last_clean":"2024-06-02T04:03:07.885854+0000","last_became_active":"2024-06-02T04:03:06.686870+0000","last_became_peered":"2024-06-02T04:03:06.686870+0000","last_unstale":"2024-06-02T04:03:07.885854+0000","last_undegraded":"2024-06-02T04:03:07.885854+0000","last_fullsized":"2024-06-02T04:03:07.885854+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:46:20.489444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'7","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.078128+0000","last_change":"2024-06-02T04:03:06.275950+0000","last_active":"2024-06-02T04:03:11.078128+0000","last_peered":"2024-06-02T04:03:11.078128+0000","last_clean":"2024-06-02T04:03:11.078128+0000","last_became_active":"2024-06-02T04:03:06.274800+0000","last_became_peered":"2024-06-02T04:03:06.274800+0000","last_unstale":"2024-06-02T04:03:11.078128+0000","last_undegraded":"2024-06-02T04:03:11.078128+0000","last_fullsized":"2024-06-02T04:03:11.078128+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:17:36.352933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.967722+0000","last_change":"2024-06-02T04:03:06.687332+0000","last_active":"2024-06-02T04:03:06.967722+0000","last_peered":"2024-06-02T04:03:06.967722+0000","last_clean":"2024-06-02T04:03:06.967722+0000","last_became_active":"2024-06-02T04:03:06.687056+0000","last_became_peered":"2024-06-02T04:03:06.687056+0000","last_unstale":"2024-06-02T04:03:06.967722+0000","last_undegraded":"2024-06-02T04:03:06.967722+0000","last_fullsized":"2024-06-02T04:03:06.967722+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:16:58.069559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:12.096615+0000","last_change":"2024-06-02T04:03:06.267618+0000","last_active":"2024-06-02T04:03:12.096615+0000","last_peered":"2024-06-02T04:03:12.096615+0000","last_clean":"2024-06-02T04:03:12.096615+0000","last_became_active":"2024-06-02T04:03:06.267326+0000","last_became_peered":"2024-06-02T04:03:06.267326+0000","last_unstale":"2024-06-02T04:03:12.096615+0000","last_undegraded":"2024-06-02T04:03:12.096615+0000","last_fullsized":"2024-06-02T04:03:12.096615+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:20:19.794922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.645046+0000","last_change":"2024-06-02T04:03:06.693973+0000","last_active":"2024-06-02T04:03:08.645046+0000","last_peered":"2024-06-02T04:03:08.645046+0000","last_clean":"2024-06-02T04:03:08.645046+0000","last_became_active":"2024-06-02T04:03:06.693628+0000","last_became_peered":"2024-06-02T04:03:06.693628+0000","last_unstale":"2024-06-02T04:03:08.645046+0000","last_undegraded":"2024-06-02T04:03:08.645046+0000","last_fullsized":"2024-06-02T04:03:08.645046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:03:52.865564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'5","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.088106+0000","last_change":"2024-06-02T04:03:06.279086+0000","last_active":"2024-06-02T04:03:11.088106+0000","last_peered":"2024-06-02T04:03:11.088106+0000","last_clean":"2024-06-02T04:03:11.088106+0000","last_became_active":"2024-06-02T04:03:06.278737+0000","last_became_peered":"2024-06-02T04:03:06.278737+0000","last_unstale":"2024-06-02T04:03:11.088106+0000","last_undegraded":"2024-06-02T04:03:11.088106+0000","last_fullsized":"2024-06-02T04:03:11.088106+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:13:49.888951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.644652+0000","last_change":"2024-06-02T04:03:06.691126+0000","last_active":"2024-06-02T04:03:08.644652+0000","last_peered":"2024-06-02T04:03:08.644652+0000","last_clean":"2024-06-02T04:03:08.644652+0000","last_became_active":"2024-06-02T04:03:06.690758+0000","last_became_peered":"2024-06-02T04:03:06.690758+0000","last_unstale":"2024-06-02T04:03:08.644652+0000","last_undegraded":"2024-06-02T04:03:08.644652+0000","last_fullsized":"2024-06-02T04:03:08.644652+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:51:27.524477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.089923+0000","last_change":"2024-06-02T04:03:06.271837+0000","last_active":"2024-06-02T04:03:11.089923+0000","last_peered":"2024-06-02T04:03:11.089923+0000","last_clean":"2024-06-02T04:03:11.089923+0000","last_became_active":"2024-06-02T04:03:06.271523+0000","last_became_peered":"2024-06-02T04:03:06.271523+0000","last_unstale":"2024-06-02T04:03:11.089923+0000","last_undegraded":"2024-06-02T04:03:11.089923+0000","last_fullsized":"2024-06-02T04:03:11.089923+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:55:14.738237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676954+0000","last_change":"2024-06-02T04:03:06.690646+0000","last_active":"2024-06-02T04:03:07.676954+0000","last_peered":"2024-06-02T04:03:07.676954+0000","last_clean":"2024-06-02T04:03:07.676954+0000","last_became_active":"2024-06-02T04:03:06.690333+0000","last_became_peered":"2024-06-02T04:03:06.690333+0000","last_unstale":"2024-06-02T04:03:07.676954+0000","last_undegraded":"2024-06-02T04:03:07.676954+0000","last_fullsized":"2024-06-02T04:03:07.676954+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:18:41.987031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:09.562594+0000","last_change":"2024-06-02T04:03:06.268892+0000","last_active":"2024-06-02T04:03:09.562594+0000","last_peered":"2024-06-02T04:03:09.562594+0000","last_clean":"2024-06-02T04:03:09.562594+0000","last_became_active":"2024-06-02T04:03:06.268559+0000","last_became_peered":"2024-06-02T04:03:06.268559+0000","last_unstale":"2024-06-02T04:03:09.562594+0000","last_undegraded":"2024-06-02T04:03:09.562594+0000","last_fullsized":"2024-06-02T04:03:09.562594+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:06:34.378769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.001506+0000","last_change":"2024-06-02T04:03:06.688371+0000","last_active":"2024-06-02T04:03:08.001506+0000","last_peered":"2024-06-02T04:03:08.001506+0000","last_clean":"2024-06-02T04:03:08.001506+0000","last_became_active":"2024-06-02T04:03:06.688046+0000","last_became_peered":"2024-06-02T04:03:06.688046+0000","last_unstale":"2024-06-02T04:03:08.001506+0000","last_undegraded":"2024-06-02T04:03:08.001506+0000","last_fullsized":"2024-06-02T04:03:08.001506+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:14:40.534799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:09.716112+0000","last_change":"2024-06-02T04:03:06.274055+0000","last_active":"2024-06-02T04:03:09.716112+0000","last_peered":"2024-06-02T04:03:09.716112+0000","last_clean":"2024-06-02T04:03:09.716112+0000","last_became_active":"2024-06-02T04:03:06.273709+0000","last_became_peered":"2024-06-02T04:03:06.273709+0000","last_unstale":"2024-06-02T04:03:09.716112+0000","last_undegraded":"2024-06-02T04:03:09.716112+0000","last_fullsized":"2024-06-02T04:03:09.716112+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:44:13.256272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:09.192257+0000","last_change":"2024-06-02T04:03:06.686391+0000","last_active":"2024-06-02T04:03:09.192257+0000","last_peered":"2024-06-02T04:03:09.192257+0000","last_clean":"2024-06-02T04:03:09.192257+0000","last_became_active":"2024-06-02T04:03:06.686086+0000","last_became_peered":"2024-06-02T04:03:06.686086+0000","last_unstale":"2024-06-02T04:03:09.192257+0000","last_undegraded":"2024-06-02T04:03:09.192257+0000","last_fullsized":"2024-06-02T04:03:09.192257+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:06:23.572438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:13.109745+0000","last_change":"2024-06-02T04:03:06.278278+0000","last_active":"2024-06-02T04:03:13.109745+0000","last_peered":"2024-06-02T04:03:13.109745+0000","last_clean":"2024-06-02T04:03:13.109745+0000","last_became_active":"2024-06-02T04:03:06.277736+0000","last_became_peered":"2024-06-02T04:03:06.277736+0000","last_unstale":"2024-06-02T04:03:13.109745+0000","last_undegraded":"2024-06-02T04:03:13.109745+0000","last_fullsized":"2024-06-02T04:03:13.109745+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:51:30.458708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.043607+0000","last_change":"2024-06-02T04:03:06.694551+0000","last_active":"2024-06-02T04:03:08.043607+0000","last_peered":"2024-06-02T04:03:08.043607+0000","last_clean":"2024-06-02T04:03:08.043607+0000","last_became_active":"2024-06-02T04:03:06.694265+0000","last_became_peered":"2024-06-02T04:03:06.694265+0000","last_unstale":"2024-06-02T04:03:08.043607+0000","last_undegraded":"2024-06-02T04:03:08.043607+0000","last_fullsized":"2024-06-02T04:03:08.043607+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:41:19.017514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.677003+0000","last_change":"2024-06-02T04:03:06.690869+0000","last_active":"2024-06-02T04:03:07.677003+0000","last_peered":"2024-06-02T04:03:07.677003+0000","last_clean":"2024-06-02T04:03:07.677003+0000","last_became_active":"2024-06-02T04:03:06.690302+0000","last_became_peered":"2024-06-02T04:03:06.690302+0000","last_unstale":"2024-06-02T04:03:07.677003+0000","last_undegraded":"2024-06-02T04:03:07.677003+0000","last_fullsized":"2024-06-02T04:03:07.677003+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:17:15.440309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:10.717511+0000","last_change":"2024-06-02T04:03:06.271968+0000","last_active":"2024-06-02T04:03:10.717511+0000","last_peered":"2024-06-02T04:03:10.717511+0000","last_clean":"2024-06-02T04:03:10.717511+0000","last_became_active":"2024-06-02T04:03:06.271669+0000","last_became_peered":"2024-06-02T04:03:06.271669+0000","last_unstale":"2024-06-02T04:03:10.717511+0000","last_undegraded":"2024-06-02T04:03:10.717511+0000","last_fullsized":"2024-06-02T04:03:10.717511+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:21:15.966330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676653+0000","last_change":"2024-06-02T04:03:06.694468+0000","last_active":"2024-06-02T04:03:07.676653+0000","last_peered":"2024-06-02T04:03:07.676653+0000","last_clean":"2024-06-02T04:03:07.676653+0000","last_became_active":"2024-06-02T04:03:06.693949+0000","last_became_peered":"2024-06-02T04:03:06.693949+0000","last_unstale":"2024-06-02T04:03:07.676653+0000","last_undegraded":"2024-06-02T04:03:07.676653+0000","last_fullsized":"2024-06-02T04:03:07.676653+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:30:25.539150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.088265+0000","last_change":"2024-06-02T04:03:06.271658+0000","last_active":"2024-06-02T04:03:11.088265+0000","last_peered":"2024-06-02T04:03:11.088265+0000","last_clean":"2024-06-02T04:03:11.088265+0000","last_became_active":"2024-06-02T04:03:06.271313+0000","last_became_peered":"2024-06-02T04:03:06.271313+0000","last_unstale":"2024-06-02T04:03:11.088265+0000","last_undegraded":"2024-06-02T04:03:11.088265+0000","last_fullsized":"2024-06-02T04:03:11.088265+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:44:48.552397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":325,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.677525+0000","last_change":"2024-06-02T04:02:20.359447+0000","last_active":"2024-06-02T04:03:06.677525+0000","last_peered":"2024-06-02T04:03:06.677525+0000","last_clean":"2024-06-02T04:03:06.677525+0000","last_became_active":"2024-06-02T04:02:20.359031+0000","last_became_peered":"2024-06-02T04:02:20.359031+0000","last_unstale":"2024-06-02T04:03:06.677525+0000","last_undegraded":"2024-06-02T04:03:06.677525+0000","last_fullsized":"2024-06-02T04:03:06.677525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T03:59:57.079508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T03:59:57.079508+0000","last_clean_scrub_stamp":"2024-06-02T03:59:57.079508+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:44:53.765578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.967686+0000","last_change":"2024-06-02T04:03:06.693309+0000","last_active":"2024-06-02T04:03:06.967686+0000","last_peered":"2024-06-02T04:03:06.967686+0000","last_clean":"2024-06-02T04:03:06.967686+0000","last_became_active":"2024-06-02T04:03:06.692961+0000","last_became_peered":"2024-06-02T04:03:06.692961+0000","last_unstale":"2024-06-02T04:03:06.967686+0000","last_undegraded":"2024-06-02T04:03:06.967686+0000","last_fullsized":"2024-06-02T04:03:06.967686+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:30:40.015091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:10.716861+0000","last_change":"2024-06-02T04:03:06.273144+0000","last_active":"2024-06-02T04:03:10.716861+0000","last_peered":"2024-06-02T04:03:10.716861+0000","last_clean":"2024-06-02T04:03:10.716861+0000","last_became_active":"2024-06-02T04:03:06.269431+0000","last_became_peered":"2024-06-02T04:03:06.269431+0000","last_unstale":"2024-06-02T04:03:10.716861+0000","last_undegraded":"2024-06-02T04:03:10.716861+0000","last_fullsized":"2024-06-02T04:03:10.716861+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:58:17.598214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.089622+0000","last_change":"2024-06-02T04:03:06.271914+0000","last_active":"2024-06-02T04:03:11.089622+0000","last_peered":"2024-06-02T04:03:11.089622+0000","last_clean":"2024-06-02T04:03:11.089622+0000","last_became_active":"2024-06-02T04:03:06.271590+0000","last_became_peered":"2024-06-02T04:03:06.271590+0000","last_unstale":"2024-06-02T04:03:11.089622+0000","last_undegraded":"2024-06-02T04:03:11.089622+0000","last_fullsized":"2024-06-02T04:03:11.089622+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:06:03.368086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.967766+0000","last_change":"2024-06-02T04:03:06.693154+0000","last_active":"2024-06-02T04:03:06.967766+0000","last_peered":"2024-06-02T04:03:06.967766+0000","last_clean":"2024-06-02T04:03:06.967766+0000","last_became_active":"2024-06-02T04:03:06.692873+0000","last_became_peered":"2024-06-02T04:03:06.692873+0000","last_unstale":"2024-06-02T04:03:06.967766+0000","last_undegraded":"2024-06-02T04:03:06.967766+0000","last_fullsized":"2024-06-02T04:03:06.967766+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:00:08.959850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'7","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.089339+0000","last_change":"2024-06-02T04:03:06.270804+0000","last_active":"2024-06-02T04:03:11.089339+0000","last_peered":"2024-06-02T04:03:11.089339+0000","last_clean":"2024-06-02T04:03:11.089339+0000","last_became_active":"2024-06-02T04:03:06.270479+0000","last_became_peered":"2024-06-02T04:03:06.270479+0000","last_unstale":"2024-06-02T04:03:11.089339+0000","last_undegraded":"2024-06-02T04:03:11.089339+0000","last_fullsized":"2024-06-02T04:03:11.089339+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:18:39.900900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676615+0000","last_change":"2024-06-02T04:03:06.685906+0000","last_active":"2024-06-02T04:03:07.676615+0000","last_peered":"2024-06-02T04:03:07.676615+0000","last_clean":"2024-06-02T04:03:07.676615+0000","last_became_active":"2024-06-02T04:03:06.685596+0000","last_became_peered":"2024-06-02T04:03:06.685596+0000","last_unstale":"2024-06-02T04:03:07.676615+0000","last_undegraded":"2024-06-02T04:03:07.676615+0000","last_fullsized":"2024-06-02T04:03:07.676615+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:06:13.456950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'5","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:09.713206+0000","last_change":"2024-06-02T04:03:06.275542+0000","last_active":"2024-06-02T04:03:09.713206+0000","last_peered":"2024-06-02T04:03:09.713206+0000","last_clean":"2024-06-02T04:03:09.713206+0000","last_became_active":"2024-06-02T04:03:06.275177+0000","last_became_peered":"2024-06-02T04:03:06.275177+0000","last_unstale":"2024-06-02T04:03:09.713206+0000","last_undegraded":"2024-06-02T04:03:09.713206+0000","last_fullsized":"2024-06-02T04:03:09.713206+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:58:35.587610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.695086+0000","last_change":"2024-06-02T04:03:06.692108+0000","last_active":"2024-06-02T04:03:06.695086+0000","last_peered":"2024-06-02T04:03:06.695086+0000","last_clean":"2024-06-02T04:03:06.695086+0000","last_became_active":"2024-06-02T04:03:06.691842+0000","last_became_peered":"2024-06-02T04:03:06.691842+0000","last_unstale":"2024-06-02T04:03:06.695086+0000","last_undegraded":"2024-06-02T04:03:06.695086+0000","last_fullsized":"2024-06-02T04:03:06.695086+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:35:10.885346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:09.713676+0000","last_change":"2024-06-02T04:03:06.278554+0000","last_active":"2024-06-02T04:03:09.713676+0000","last_peered":"2024-06-02T04:03:09.713676+0000","last_clean":"2024-06-02T04:03:09.713676+0000","last_became_active":"2024-06-02T04:03:06.278217+0000","last_became_peered":"2024-06-02T04:03:06.278217+0000","last_unstale":"2024-06-02T04:03:09.713676+0000","last_undegraded":"2024-06-02T04:03:09.713676+0000","last_fullsized":"2024-06-02T04:03:09.713676+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:04:37.653433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.885774+0000","last_change":"2024-06-02T04:03:06.682723+0000","last_active":"2024-06-02T04:03:07.885774+0000","last_peered":"2024-06-02T04:03:07.885774+0000","last_clean":"2024-06-02T04:03:07.885774+0000","last_became_active":"2024-06-02T04:03:06.682380+0000","last_became_peered":"2024-06-02T04:03:06.682380+0000","last_unstale":"2024-06-02T04:03:07.885774+0000","last_undegraded":"2024-06-02T04:03:07.885774+0000","last_fullsized":"2024-06-02T04:03:07.885774+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:07:56.566326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:12.096618+0000","last_change":"2024-06-02T04:03:06.271142+0000","last_active":"2024-06-02T04:03:12.096618+0000","last_peered":"2024-06-02T04:03:12.096618+0000","last_clean":"2024-06-02T04:03:12.096618+0000","last_became_active":"2024-06-02T04:03:06.270763+0000","last_became_peered":"2024-06-02T04:03:06.270763+0000","last_unstale":"2024-06-02T04:03:12.096618+0000","last_undegraded":"2024-06-02T04:03:12.096618+0000","last_fullsized":"2024-06-02T04:03:12.096618+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:23:12.842549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.001259+0000","last_change":"2024-06-02T04:03:06.690061+0000","last_active":"2024-06-02T04:03:08.001259+0000","last_peered":"2024-06-02T04:03:08.001259+0000","last_clean":"2024-06-02T04:03:08.001259+0000","last_became_active":"2024-06-02T04:03:06.689735+0000","last_became_peered":"2024-06-02T04:03:06.689735+0000","last_unstale":"2024-06-02T04:03:08.001259+0000","last_undegraded":"2024-06-02T04:03:08.001259+0000","last_fullsized":"2024-06-02T04:03:08.001259+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:14:29.096404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.875389+0000","last_change":"2024-06-02T04:03:06.273988+0000","last_active":"2024-06-02T04:03:08.875389+0000","last_peered":"2024-06-02T04:03:08.875389+0000","last_clean":"2024-06-02T04:03:08.875389+0000","last_became_active":"2024-06-02T04:03:06.273690+0000","last_became_peered":"2024-06-02T04:03:06.273690+0000","last_unstale":"2024-06-02T04:03:08.875389+0000","last_undegraded":"2024-06-02T04:03:08.875389+0000","last_fullsized":"2024-06-02T04:03:08.875389+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:55:13.758627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.677771+0000","last_change":"2024-06-02T04:03:06.697167+0000","last_active":"2024-06-02T04:03:07.677771+0000","last_peered":"2024-06-02T04:03:07.677771+0000","last_clean":"2024-06-02T04:03:07.677771+0000","last_became_active":"2024-06-02T04:03:06.696749+0000","last_became_peered":"2024-06-02T04:03:06.696749+0000","last_unstale":"2024-06-02T04:03:07.677771+0000","last_undegraded":"2024-06-02T04:03:07.677771+0000","last_fullsized":"2024-06-02T04:03:07.677771+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:20:06.736129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:09.709430+0000","last_change":"2024-06-02T04:03:06.271790+0000","last_active":"2024-06-02T04:03:09.709430+0000","last_peered":"2024-06-02T04:03:09.709430+0000","last_clean":"2024-06-02T04:03:09.709430+0000","last_became_active":"2024-06-02T04:03:06.271488+0000","last_became_peered":"2024-06-02T04:03:06.271488+0000","last_unstale":"2024-06-02T04:03:09.709430+0000","last_undegraded":"2024-06-02T04:03:09.709430+0000","last_fullsized":"2024-06-02T04:03:09.709430+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:45:55.514785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.644934+0000","last_change":"2024-06-02T04:03:06.700494+0000","last_active":"2024-06-02T04:03:08.644934+0000","last_peered":"2024-06-02T04:03:08.644934+0000","last_clean":"2024-06-02T04:03:08.644934+0000","last_became_active":"2024-06-02T04:03:06.700220+0000","last_became_peered":"2024-06-02T04:03:06.700220+0000","last_unstale":"2024-06-02T04:03:08.644934+0000","last_undegraded":"2024-06-02T04:03:08.644934+0000","last_fullsized":"2024-06-02T04:03:08.644934+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:25:32.547543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'5","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.088850+0000","last_change":"2024-06-02T04:03:06.273757+0000","last_active":"2024-06-02T04:03:11.088850+0000","last_peered":"2024-06-02T04:03:11.088850+0000","last_clean":"2024-06-02T04:03:11.088850+0000","last_became_active":"2024-06-02T04:03:06.273379+0000","last_became_peered":"2024-06-02T04:03:06.273379+0000","last_unstale":"2024-06-02T04:03:11.088850+0000","last_undegraded":"2024-06-02T04:03:11.088850+0000","last_fullsized":"2024-06-02T04:03:11.088850+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:23:09.207009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.645012+0000","last_change":"2024-06-02T04:03:06.700168+0000","last_active":"2024-06-02T04:03:08.645012+0000","last_peered":"2024-06-02T04:03:08.645012+0000","last_clean":"2024-06-02T04:03:08.645012+0000","last_became_active":"2024-06-02T04:03:06.699429+0000","last_became_peered":"2024-06-02T04:03:06.699429+0000","last_unstale":"2024-06-02T04:03:08.645012+0000","last_undegraded":"2024-06-02T04:03:08.645012+0000","last_fullsized":"2024-06-02T04:03:08.645012+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:29:08.397813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.088038+0000","last_change":"2024-06-02T04:03:06.275198+0000","last_active":"2024-06-02T04:03:11.088038+0000","last_peered":"2024-06-02T04:03:11.088038+0000","last_clean":"2024-06-02T04:03:11.088038+0000","last_became_active":"2024-06-02T04:03:06.274649+0000","last_became_peered":"2024-06-02T04:03:06.274649+0000","last_unstale":"2024-06-02T04:03:11.088038+0000","last_undegraded":"2024-06-02T04:03:11.088038+0000","last_fullsized":"2024-06-02T04:03:11.088038+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:37:45.091471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.936463+0000","last_change":"2024-06-02T04:03:06.690309+0000","last_active":"2024-06-02T04:03:08.936463+0000","last_peered":"2024-06-02T04:03:08.936463+0000","last_clean":"2024-06-02T04:03:08.936463+0000","last_became_active":"2024-06-02T04:03:06.689986+0000","last_became_peered":"2024-06-02T04:03:06.689986+0000","last_unstale":"2024-06-02T04:03:08.936463+0000","last_undegraded":"2024-06-02T04:03:08.936463+0000","last_fullsized":"2024-06-02T04:03:08.936463+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:12:18.237133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'3","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:09.706927+0000","last_change":"2024-06-02T04:03:06.272947+0000","last_active":"2024-06-02T04:03:09.706927+0000","last_peered":"2024-06-02T04:03:09.706927+0000","last_clean":"2024-06-02T04:03:09.706927+0000","last_became_active":"2024-06-02T04:03:06.272632+0000","last_became_peered":"2024-06-02T04:03:06.272632+0000","last_unstale":"2024-06-02T04:03:09.706927+0000","last_undegraded":"2024-06-02T04:03:09.706927+0000","last_fullsized":"2024-06-02T04:03:09.706927+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:01:16.085575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.645113+0000","last_change":"2024-06-02T04:03:06.701506+0000","last_active":"2024-06-02T04:03:08.645113+0000","last_peered":"2024-06-02T04:03:08.645113+0000","last_clean":"2024-06-02T04:03:08.645113+0000","last_became_active":"2024-06-02T04:03:06.701202+0000","last_became_peered":"2024-06-02T04:03:06.701202+0000","last_unstale":"2024-06-02T04:03:08.645113+0000","last_undegraded":"2024-06-02T04:03:08.645113+0000","last_fullsized":"2024-06-02T04:03:08.645113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:35:07.269775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.001325+0000","last_change":"2024-06-02T04:03:06.689400+0000","last_active":"2024-06-02T04:03:08.001325+0000","last_peered":"2024-06-02T04:03:08.001325+0000","last_clean":"2024-06-02T04:03:08.001325+0000","last_became_active":"2024-06-02T04:03:06.689044+0000","last_became_peered":"2024-06-02T04:03:06.689044+0000","last_unstale":"2024-06-02T04:03:08.001325+0000","last_undegraded":"2024-06-02T04:03:08.001325+0000","last_fullsized":"2024-06-02T04:03:08.001325+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:52:30.633358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.701754+0000","last_change":"2024-06-02T04:03:06.698863+0000","last_active":"2024-06-02T04:03:06.701754+0000","last_peered":"2024-06-02T04:03:06.701754+0000","last_clean":"2024-06-02T04:03:06.701754+0000","last_became_active":"2024-06-02T04:03:06.698580+0000","last_became_peered":"2024-06-02T04:03:06.698580+0000","last_unstale":"2024-06-02T04:03:06.701754+0000","last_undegraded":"2024-06-02T04:03:06.701754+0000","last_fullsized":"2024-06-02T04:03:06.701754+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:37:17.956746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.699107+0000","last_change":"2024-06-02T04:03:06.691634+0000","last_active":"2024-06-02T04:03:06.699107+0000","last_peered":"2024-06-02T04:03:06.699107+0000","last_clean":"2024-06-02T04:03:06.699107+0000","last_became_active":"2024-06-02T04:03:06.691270+0000","last_became_peered":"2024-06-02T04:03:06.691270+0000","last_unstale":"2024-06-02T04:03:06.699107+0000","last_undegraded":"2024-06-02T04:03:06.699107+0000","last_fullsized":"2024-06-02T04:03:06.699107+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:36:27.879519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.691816+0000","last_change":"2024-06-02T04:03:06.688290+0000","last_active":"2024-06-02T04:03:06.691816+0000","last_peered":"2024-06-02T04:03:06.691816+0000","last_clean":"2024-06-02T04:03:06.691816+0000","last_became_active":"2024-06-02T04:03:06.687970+0000","last_became_peered":"2024-06-02T04:03:06.687970+0000","last_unstale":"2024-06-02T04:03:06.691816+0000","last_undegraded":"2024-06-02T04:03:06.691816+0000","last_fullsized":"2024-06-02T04:03:06.691816+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:48:03.513694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.967775+0000","last_change":"2024-06-02T04:03:06.690498+0000","last_active":"2024-06-02T04:03:06.967775+0000","last_peered":"2024-06-02T04:03:06.967775+0000","last_clean":"2024-06-02T04:03:06.967775+0000","last_became_active":"2024-06-02T04:03:06.689698+0000","last_became_peered":"2024-06-02T04:03:06.689698+0000","last_unstale":"2024-06-02T04:03:06.967775+0000","last_undegraded":"2024-06-02T04:03:06.967775+0000","last_fullsized":"2024-06-02T04:03:06.967775+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:39:12.912589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.001349+0000","last_change":"2024-06-02T04:03:06.694551+0000","last_active":"2024-06-02T04:03:08.001349+0000","last_peered":"2024-06-02T04:03:08.001349+0000","last_clean":"2024-06-02T04:03:08.001349+0000","last_became_active":"2024-06-02T04:03:06.694266+0000","last_became_peered":"2024-06-02T04:03:06.694266+0000","last_unstale":"2024-06-02T04:03:08.001349+0000","last_undegraded":"2024-06-02T04:03:08.001349+0000","last_fullsized":"2024-06-02T04:03:08.001349+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:53:29.168620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.699460+0000","last_change":"2024-06-02T04:03:06.693639+0000","last_active":"2024-06-02T04:03:06.699460+0000","last_peered":"2024-06-02T04:03:06.699460+0000","last_clean":"2024-06-02T04:03:06.699460+0000","last_became_active":"2024-06-02T04:03:06.693283+0000","last_became_peered":"2024-06-02T04:03:06.693283+0000","last_unstale":"2024-06-02T04:03:06.699460+0000","last_undegraded":"2024-06-02T04:03:06.699460+0000","last_fullsized":"2024-06-02T04:03:06.699460+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:12:48.614632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676611+0000","last_change":"2024-06-02T04:03:06.689335+0000","last_active":"2024-06-02T04:03:07.676611+0000","last_peered":"2024-06-02T04:03:07.676611+0000","last_clean":"2024-06-02T04:03:07.676611+0000","last_became_active":"2024-06-02T04:03:06.688986+0000","last_became_peered":"2024-06-02T04:03:06.688986+0000","last_unstale":"2024-06-02T04:03:07.676611+0000","last_undegraded":"2024-06-02T04:03:07.676611+0000","last_fullsized":"2024-06-02T04:03:07.676611+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:16:44.138633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676833+0000","last_change":"2024-06-02T04:03:06.690694+0000","last_active":"2024-06-02T04:03:07.676833+0000","last_peered":"2024-06-02T04:03:07.676833+0000","last_clean":"2024-06-02T04:03:07.676833+0000","last_became_active":"2024-06-02T04:03:06.689684+0000","last_became_peered":"2024-06-02T04:03:06.689684+0000","last_unstale":"2024-06-02T04:03:07.676833+0000","last_undegraded":"2024-06-02T04:03:07.676833+0000","last_fullsized":"2024-06-02T04:03:07.676833+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:32:48.564501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676294+0000","last_change":"2024-06-02T04:03:06.692851+0000","last_active":"2024-06-02T04:03:07.676294+0000","last_peered":"2024-06-02T04:03:07.676294+0000","last_clean":"2024-06-02T04:03:07.676294+0000","last_became_active":"2024-06-02T04:03:06.688996+0000","last_became_peered":"2024-06-02T04:03:06.688996+0000","last_unstale":"2024-06-02T04:03:07.676294+0000","last_undegraded":"2024-06-02T04:03:07.676294+0000","last_fullsized":"2024-06-02T04:03:07.676294+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:21:54.779246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.716881+0000","last_change":"2024-06-02T04:03:06.704472+0000","last_active":"2024-06-02T04:03:08.716881+0000","last_peered":"2024-06-02T04:03:08.716881+0000","last_clean":"2024-06-02T04:03:08.716881+0000","last_became_active":"2024-06-02T04:03:06.704173+0000","last_became_peered":"2024-06-02T04:03:06.704173+0000","last_unstale":"2024-06-02T04:03:08.716881+0000","last_undegraded":"2024-06-02T04:03:08.716881+0000","last_fullsized":"2024-06-02T04:03:08.716881+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:48:26.362945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.967756+0000","last_change":"2024-06-02T04:03:06.688238+0000","last_active":"2024-06-02T04:03:06.967756+0000","last_peered":"2024-06-02T04:03:06.967756+0000","last_clean":"2024-06-02T04:03:06.967756+0000","last_became_active":"2024-06-02T04:03:06.687925+0000","last_became_peered":"2024-06-02T04:03:06.687925+0000","last_unstale":"2024-06-02T04:03:06.967756+0000","last_undegraded":"2024-06-02T04:03:06.967756+0000","last_fullsized":"2024-06-02T04:03:06.967756+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:15:19.314864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.001280+0000","last_change":"2024-06-02T04:03:06.685210+0000","last_active":"2024-06-02T04:03:08.001280+0000","last_peered":"2024-06-02T04:03:08.001280+0000","last_clean":"2024-06-02T04:03:08.001280+0000","last_became_active":"2024-06-02T04:03:06.684819+0000","last_became_peered":"2024-06-02T04:03:06.684819+0000","last_unstale":"2024-06-02T04:03:08.001280+0000","last_undegraded":"2024-06-02T04:03:08.001280+0000","last_fullsized":"2024-06-02T04:03:08.001280+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:05:55.275556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":284198,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":27023,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":39,"num_read_kb":31,"num_write":195,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":78184,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},"log_size":173,"ondisk_log_size":173,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481802,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31976,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713176,"statfs":{"total":95995035648,"available":95962292224,"internally_reserved":0,"allocated":880640,"data_stored":425116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]}]},{"osd":10,"up_from":70,"seq":300647710733,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":1018736,"data_compressed":36139,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]}]},{"osd":9,"up_from":64,"seq":274877906962,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":917504,"data_stored":426238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.309}]},{"osd":1,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.40500000000000003}]},{"osd":2,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.48599999999999999}]},{"osd":3,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.36899999999999999}]},{"osd":4,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.42999999999999999}]},{"osd":5,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.502}]},{"osd":6,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.51000000000000001}]},{"osd":7,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.52000000000000002}]},{"osd":8,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.54900000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]}]},{"osd":8,"up_from":57,"seq":244813135893,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":897024,"data_stored":425537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.48599999999999999}]},{"osd":1,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.69399999999999995}]},{"osd":2,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.51800000000000002}]},{"osd":3,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.60799999999999998}]},{"osd":4,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.77200000000000002}]},{"osd":5,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.624},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.71299999999999997}]},{"osd":6,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.57599999999999996}]},{"osd":7,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.746},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.79500000000000004}]},{"osd":9,"last update":"Sun Jun 2 04:03:00 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1,"5min":1,"15min":1},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.78500000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]}]},{"osd":7,"up_from":49,"seq":210453397528,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":1018992,"data_compressed":36139,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.312}]},{"osd":1,"last update":"Sun Jun 2 04:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.54500000000000004}]},{"osd":2,"last update":"Sun Jun 2 04:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.56299999999999994}]},{"osd":3,"last update":"Sun Jun 2 04:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.57599999999999996}]},{"osd":4,"last update":"Sun Jun 2 04:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.58699999999999997}]},{"osd":5,"last update":"Sun Jun 2 04:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.70999999999999996}]},{"osd":6,"last update":"Sun Jun 2 04:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.63200000000000001}]},{"osd":8,"last update":"Sun Jun 2 04:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.73399999999999999}]},{"osd":9,"last update":"Sun Jun 2 04:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.72299999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]}]},{"osd":6,"up_from":44,"seq":188978561051,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":888832,"data_stored":425228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:03:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.36699999999999999,"15min":0.36099999999999999},"min":{"1min":0.28399999999999997,"5min":0.246,"15min":0.246},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.38900000000000001,"15min":0.38300000000000001},"min":{"1min":0.28199999999999997,"5min":0.246,"15min":0.246},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.28199999999999997}]},{"osd":1,"last update":"Sun Jun 2 04:03:06 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.52700000000000002,"15min":0.51500000000000001},"min":{"1min":0.38700000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.46400000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.53200000000000003}]},{"osd":2,"last update":"Sun Jun 2 04:03:06 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.371,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72199999999999998,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.443},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.32700000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.61699999999999999}]},{"osd":3,"last update":"Sun Jun 2 04:03:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45400000000000001,"15min":0.45100000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.372},{"interface":"front","average":{"1min":0.495,"5min":0.46999999999999997,"15min":0.46600000000000003},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.40999999999999998}]},{"osd":4,"last update":"Sun Jun 2 04:03:06 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.39200000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77200000000000002,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.59999999999999998,"15min":0.58699999999999997},"min":{"1min":0.434,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.56699999999999995}]},{"osd":5,"last update":"Sun Jun 2 04:03:06 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.622,"15min":0.623},"min":{"1min":0.432,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.435},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.625,"15min":0.63200000000000001},"min":{"1min":0.42199999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85499999999999998,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.47399999999999998}]},{"osd":7,"last update":"Sun Jun 2 04:02:27 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.59199999999999997}]},{"osd":8,"last update":"Sun Jun 2 04:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.502},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.45700000000000002}]},{"osd":9,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1,"5min":1,"15min":1},"last":0.49199999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":937984,"data_stored":464967,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:02:47 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.47799999999999998,"15min":0.46600000000000003},"min":{"1min":0.32500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.49099999999999999,"15min":0.48099999999999998},"min":{"1min":0.36599999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.439}]},{"osd":2,"last update":"Sun Jun 2 04:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.52500000000000002,"15min":0.50700000000000001},"min":{"1min":0.375,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52000000000000002,"15min":0.51600000000000001},"min":{"1min":0.39300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.71499999999999997}]},{"osd":3,"last update":"Sun Jun 2 04:02:17 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.51800000000000002,"15min":0.51700000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.63},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.42699999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.67500000000000004}]},{"osd":4,"last update":"Sun Jun 2 04:02:37 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.57199999999999995,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.748},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40600000000000003,"15min":0.40799999999999997},"min":{"1min":0.308,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.56499999999999995,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.54200000000000004}]},{"osd":5,"last update":"Sun Jun 2 04:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.42499999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.36299999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.84499999999999997}]},{"osd":6,"last update":"Sun Jun 2 04:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.59399999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.81399999999999995}]},{"osd":7,"last update":"Sun Jun 2 04:02:27 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.78100000000000003}]},{"osd":8,"last update":"Sun Jun 2 04:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.90000000000000002}]},{"osd":9,"last update":"Sun Jun 2 04:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.80200000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]}]},{"osd":0,"up_from":8,"seq":34359738416,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":427134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jun 2 04:02:45 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52100000000000002,"15min":0.51500000000000001},"min":{"1min":0.30399999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.501,"15min":0.49199999999999999},"min":{"1min":0.36299999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.70099999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.48499999999999999}]},{"osd":2,"last update":"Sun Jun 2 04:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.624,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54800000000000004,"15min":0.54300000000000004},"min":{"1min":0.41099999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.65900000000000003,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.66400000000000003}]},{"osd":3,"last update":"Sun Jun 2 04:02:17 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.59599999999999997,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.41699999999999998,"15min":0.41399999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.65200000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.45300000000000001}]},{"osd":4,"last update":"Sun Jun 2 04:02:37 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56899999999999995,"15min":0.56299999999999994},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.752,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55100000000000005,"15min":0.54900000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.52500000000000002}]},{"osd":5,"last update":"Sun Jun 2 04:02:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60099999999999998,"15min":0.60199999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.82799999999999996,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57999999999999996,"15min":0.58299999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.76500000000000001}]},{"osd":6,"last update":"Sun Jun 2 04:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.39900000000000002}]},{"osd":7,"last update":"Sun Jun 2 04:02:27 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.51800000000000002}]},{"osd":8,"last update":"Sun Jun 2 04:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.53700000000000003}]},{"osd":9,"last update":"Sun Jun 2 04:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.42899999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]}]},{"osd":2,"up_from":18,"seq":77309411370,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":925696,"data_stored":428556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.49299999999999999,"15min":0.47299999999999998},"min":{"1min":0.34699999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.496,"15min":0.47199999999999998},"min":{"1min":0.39400000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.57699999999999996}]},{"osd":1,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.497,"15min":0.48999999999999999},"min":{"1min":0.34399999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.79700000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.505,"15min":0.5},"min":{"1min":0.33700000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.74299999999999999}]},{"osd":3,"last update":"Sun Jun 2 04:02:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.54100000000000004,"15min":0.53200000000000003},"min":{"1min":0.36699999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73799999999999999,"5min":0.747,"15min":0.747},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.55400000000000005,"15min":0.54500000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.63500000000000001}]},{"osd":4,"last update":"Sun Jun 2 04:02:33 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52300000000000002,"15min":0.51700000000000002},"min":{"1min":0.36099999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.52300000000000002,"15min":0.51400000000000001},"min":{"1min":0.442,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.77500000000000002}]},{"osd":5,"last update":"Sun Jun 2 04:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.441,"15min":0.437},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.501},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.501,"15min":0.496},"min":{"1min":0.36899999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.61699999999999999}]},{"osd":6,"last update":"Sun Jun 2 04:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.874,"5min":0.877,"15min":0.877},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63400000000000001,"15min":0.63700000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.66900000000000004}]},{"osd":7,"last update":"Sun Jun 2 04:02:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.48199999999999998}]},{"osd":8,"last update":"Sun Jun 2 04:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.72099999999999997}]},{"osd":9,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.75900000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]}]},{"osd":3,"up_from":25,"seq":107374182438,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":425663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:02:20 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.316,"15min":0.31},"min":{"1min":0.24299999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.34200000000000003,"15min":0.34000000000000002},"min":{"1min":0.251,"5min":0.249,"15min":0.249},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.55100000000000005}]},{"osd":1,"last update":"Sun Jun 2 04:02:20 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.50800000000000001,"15min":0.498},"min":{"1min":0.39300000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51000000000000001,"15min":0.50700000000000001},"min":{"1min":0.35399999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.60499999999999998}]},{"osd":2,"last update":"Sun Jun 2 04:02:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.52800000000000002,"15min":0.51700000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.52900000000000003,"15min":0.51500000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.59399999999999997}]},{"osd":4,"last update":"Sun Jun 2 04:02:35 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56899999999999995,"15min":0.56999999999999995},"min":{"1min":0.37,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71899999999999997,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.77100000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.63700000000000001}]},{"osd":5,"last update":"Sun Jun 2 04:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.51100000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77700000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.77500000000000002}]},{"osd":6,"last update":"Sun Jun 2 04:03:07 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.49399999999999999,"15min":0.496},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81699999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.69599999999999995}]},{"osd":7,"last update":"Sun Jun 2 04:02:26 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.81999999999999995}]},{"osd":8,"last update":"Sun Jun 2 04:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.44500000000000001}]},{"osd":9,"last update":"Sun Jun 2 04:03:00 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.74399999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":4,"up_from":32,"seq":137438953507,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":897024,"data_stored":425734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:02:31 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.47899999999999998,"15min":0.47499999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71799999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.379},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.50900000000000001,"15min":0.505},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.39100000000000001}]},{"osd":1,"last update":"Sun Jun 2 04:02:31 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.34399999999999997,"15min":0.33600000000000002},"min":{"1min":0.27800000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.372,"15min":0.35799999999999998},"min":{"1min":0.28699999999999998,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.41399999999999998}]},{"osd":2,"last update":"Sun Jun 2 04:02:31 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51500000000000001,"15min":0.51400000000000001},"min":{"1min":0.371,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.50800000000000001,"15min":0.499},"min":{"1min":0.39100000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.60199999999999998}]},{"osd":3,"last update":"Sun Jun 2 04:02:31 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.52700000000000002,"15min":0.51100000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67700000000000005,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.44800000000000001}]},{"osd":5,"last update":"Sun Jun 2 04:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54000000000000004,"15min":0.53300000000000003},"min":{"1min":0.40100000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.58299999999999996,"15min":0.57699999999999996},"min":{"1min":0.39800000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.71699999999999997}]},{"osd":6,"last update":"Sun Jun 2 04:02:10 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.54500000000000004}]},{"osd":7,"last update":"Sun Jun 2 04:02:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.66000000000000003}]},{"osd":8,"last update":"Sun Jun 2 04:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.68999999999999995}]},{"osd":9,"last update":"Sun Jun 2 04:03:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.63300000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]}]},{"osd":5,"up_from":37,"seq":158913789984,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":974848,"data_stored":1018256,"data_compressed":36139,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.503,"15min":0.502},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.443},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.36199999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.55800000000000005}]},{"osd":1,"last update":"Sun Jun 2 04:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54600000000000004,"15min":0.54800000000000004},"min":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70199999999999996,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55000000000000004,"15min":0.55400000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68300000000000005,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.51300000000000001}]},{"osd":2,"last update":"Sun Jun 2 04:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40100000000000002,"15min":0.39900000000000002},"min":{"1min":0.29499999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.42899999999999999,"15min":0.433},"min":{"1min":0.28899999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.33600000000000002}]},{"osd":3,"last update":"Sun Jun 2 04:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.55000000000000004,"15min":0.55800000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81399999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73499999999999999,"5min":0.751,"15min":0.751},"last":0.57799999999999996}]},{"osd":4,"last update":"Sun Jun 2 04:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59499999999999997,"15min":0.59599999999999997},"min":{"1min":0.433,"5min":0.372,"15min":0.372},"max":{"1min":0.80200000000000005,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.38600000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80100000000000005,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.58699999999999997}]},{"osd":6,"last update":"Sun Jun 2 04:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.61299999999999999,"15min":0.625},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83799999999999997,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.59299999999999997,"15min":0.60599999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77700000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.49099999999999999}]},{"osd":7,"last update":"Sun Jun 2 04:02:25 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.60899999999999999}]},{"osd":8,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.621}]},{"osd":9,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.53400000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34501,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34501,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34501,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36139,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36139,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36139,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36139,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36139,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":39851,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":22930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T04:03:15.206 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-06-02T04:03:15.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.362+0000 7f3c35826700 1 -- 172.21.15.123:0/1234086928 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c300ff160 msgr2=0x7f3c300ff580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:15.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.362+0000 7f3c35826700 1 --2- 172.21.15.123:0/1234086928 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c300ff160 0x7f3c300ff580 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3c20009990 tx=0x7f3c20009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:15.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.362+0000 7f3c35826700 1 -- 172.21.15.123:0/1234086928 shutdown_connections 2024-06-02T04:03:15.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.362+0000 7f3c35826700 1 --2- 172.21.15.123:0/1234086928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c30102ad0 0x7f3c30109380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:15.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.362+0000 7f3c35826700 1 --2- 172.21.15.123:0/1234086928 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c300ff160 0x7f3c300ff580 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:15.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.362+0000 7f3c35826700 1 --2- 172.21.15.123:0/1234086928 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c30102130 0x7f3c30102590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:15.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.362+0000 7f3c35826700 1 -- 172.21.15.123:0/1234086928 >> 172.21.15.123:0/1234086928 conn(0x7f3c300faab0 msgr2=0x7f3c300fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:15.365 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.362+0000 7f3c35826700 1 -- 172.21.15.123:0/1234086928 shutdown_connections 2024-06-02T04:03:15.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.362+0000 7f3c35826700 1 -- 172.21.15.123:0/1234086928 wait complete. 2024-06-02T04:03:15.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.363+0000 7f3c35826700 1 Processor -- start 2024-06-02T04:03:15.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.363+0000 7f3c35826700 1 -- start start 2024-06-02T04:03:15.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.363+0000 7f3c35826700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c300ff160 0x7f3c30196e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:15.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.363+0000 7f3c35826700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c30102130 0x7f3c30197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:15.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.363+0000 7f3c35826700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c30102ad0 0x7f3c3019e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:15.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.363+0000 7f3c35826700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3019e930 con 0x7f3c300ff160 2024-06-02T04:03:15.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.363+0000 7f3c35826700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3019ea70 con 0x7f3c30102130 2024-06-02T04:03:15.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.363+0000 7f3c35826700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3019ec00 con 0x7f3c30102ad0 2024-06-02T04:03:15.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.363+0000 7f3c2effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c300ff160 0x7f3c30196e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:15.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.363+0000 7f3c2effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c300ff160 0x7f3c30196e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42326/0 (socket says 172.21.15.123:42326) 2024-06-02T04:03:15.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.364+0000 7f3c2effd700 1 -- 172.21.15.123:0/2298005423 learned_addr learned my addr 172.21.15.123:0/2298005423 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:15.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.364+0000 7f3c2effd700 1 -- 172.21.15.123:0/2298005423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c30102ad0 msgr2=0x7f3c3019e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:15.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.364+0000 7f3c2effd700 1 --2- 172.21.15.123:0/2298005423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c30102ad0 0x7f3c3019e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:15.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.364+0000 7f3c2effd700 1 -- 172.21.15.123:0/2298005423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c30102130 msgr2=0x7f3c30197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:15.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.364+0000 7f3c2effd700 1 --2- 172.21.15.123:0/2298005423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c30102130 0x7f3c30197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:15.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.364+0000 7f3c2effd700 1 -- 172.21.15.123:0/2298005423 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c200095f0 con 0x7f3c300ff160 2024-06-02T04:03:15.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.364+0000 7f3c2effd700 1 --2- 172.21.15.123:0/2298005423 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c300ff160 0x7f3c30196e00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3c200098e0 tx=0x7f3c2000f7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:15.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.364+0000 7f3c34824700 1 -- 172.21.15.123:0/2298005423 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2001d070 con 0x7f3c300ff160 2024-06-02T04:03:15.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.364+0000 7f3c34824700 1 -- 172.21.15.123:0/2298005423 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3c2000fca0 con 0x7f3c300ff160 2024-06-02T04:03:15.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.364+0000 7f3c35826700 1 -- 172.21.15.123:0/2298005423 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c3019ee80 con 0x7f3c300ff160 2024-06-02T04:03:15.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.364+0000 7f3c34824700 1 -- 172.21.15.123:0/2298005423 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c20017730 con 0x7f3c300ff160 2024-06-02T04:03:15.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.364+0000 7f3c35826700 1 -- 172.21.15.123:0/2298005423 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c3019f240 con 0x7f3c300ff160 2024-06-02T04:03:15.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.365+0000 7f3c35826700 1 -- 172.21.15.123:0/2298005423 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c300680d0 con 0x7f3c300ff160 2024-06-02T04:03:15.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.366+0000 7f3c34824700 1 -- 172.21.15.123:0/2298005423 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f3c20022ac0 con 0x7f3c300ff160 2024-06-02T04:03:15.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.366+0000 7f3c34824700 1 --2- 172.21.15.123:0/2298005423 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3c180a11b0 0x7f3c180a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:15.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.367+0000 7f3c2e7fc700 1 --2- 172.21.15.123:0/2298005423 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3c180a11b0 0x7f3c180a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:15.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.367+0000 7f3c34824700 1 -- 172.21.15.123:0/2298005423 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3c200cdce0 con 0x7f3c300ff160 2024-06-02T04:03:15.368 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.367+0000 7f3c2e7fc700 1 --2- 172.21.15.123:0/2298005423 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3c180a11b0 0x7f3c180a3670 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3c24005fd0 tx=0x7f3c24005d00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:15.370 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.371+0000 7f3c34824700 1 -- 172.21.15.123:0/2298005423 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3c2005dd60 con 0x7f3c300ff160 2024-06-02T04:03:15.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:15 smithi162 ceph-mon[47009]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:03:15.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:15 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/1793865389' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:03:15.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:15 smithi162 ceph-mon[47009]: pgmap v226: 97 pgs: 97 active+clean; 603 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 9.4 KiB/s wr, 28 op/s 2024-06-02T04:03:15.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:15 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/1192681461' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:03:15.565 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.565+0000 7f3c35826700 1 -- 172.21.15.123:0/2298005423 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3c3002cf30 con 0x7f3c180a11b0 2024-06-02T04:03:15.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.575+0000 7f3c34824700 1 -- 172.21.15.123:0/2298005423 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+328500 (secure 0 0 0) 0x7f3c3002cf30 con 0x7f3c180a11b0 2024-06-02T04:03:15.579 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:03:15.581 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.579+0000 7f3c35826700 1 -- 172.21.15.123:0/2298005423 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3c180a11b0 msgr2=0x7f3c180a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:15.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.579+0000 7f3c35826700 1 --2- 172.21.15.123:0/2298005423 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3c180a11b0 0x7f3c180a3670 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3c24005fd0 tx=0x7f3c24005d00 comp rx=0 tx=0).stop 2024-06-02T04:03:15.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.579+0000 7f3c35826700 1 -- 172.21.15.123:0/2298005423 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c300ff160 msgr2=0x7f3c30196e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:15.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.579+0000 7f3c35826700 1 --2- 172.21.15.123:0/2298005423 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c300ff160 0x7f3c30196e00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3c200098e0 tx=0x7f3c2000f7b0 comp rx=0 tx=0).stop 2024-06-02T04:03:15.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.579+0000 7f3c35826700 1 -- 172.21.15.123:0/2298005423 shutdown_connections 2024-06-02T04:03:15.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.579+0000 7f3c35826700 1 --2- 172.21.15.123:0/2298005423 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c30102ad0 0x7f3c3019e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:15.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.579+0000 7f3c35826700 1 --2- 172.21.15.123:0/2298005423 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3c300ff160 0x7f3c30196e00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:15.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.579+0000 7f3c35826700 1 --2- 172.21.15.123:0/2298005423 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3c180a11b0 0x7f3c180a3670 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:15.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.579+0000 7f3c35826700 1 --2- 172.21.15.123:0/2298005423 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3c30102130 0x7f3c30197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:15.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.579+0000 7f3c35826700 1 -- 172.21.15.123:0/2298005423 >> 172.21.15.123:0/2298005423 conn(0x7f3c300faab0 msgr2=0x7f3c30105500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:15.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.579+0000 7f3c35826700 1 -- 172.21.15.123:0/2298005423 shutdown_connections 2024-06-02T04:03:15.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:15.579+0000 7f3c35826700 1 -- 172.21.15.123:0/2298005423 wait complete. 2024-06-02T04:03:15.583 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-06-02T04:03:15.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:15 smithi136 ceph-mon[47443]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:03:15.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:15 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/1793865389' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:03:15.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:15 smithi136 ceph-mon[47443]: pgmap v226: 97 pgs: 97 active+clean; 603 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 9.4 KiB/s wr, 28 op/s 2024-06-02T04:03:15.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:15 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/1192681461' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:03:15.591 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":226,"stamp":"2024-06-02T04:03:14.827650+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":617625,"num_objects":92,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":165,"num_read_kb":140,"num_write":378,"num_write_kb":3015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":312,"ondisk_log_size":312,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":283,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359616,"kb_used_data":10840,"kb_used_omap":18,"kb_used_meta":348653,"kb_avail":1124582208,"statfs":{"total":1151940427776,"available":1151572180992,"internally_reserved":0,"allocated":11100160,"data_stored":6930157,"data_compressed":110256,"data_compressed_allocated":139264,"data_compressed_original":1777664,"omap_allocated":19129,"internal_metadata":357020999},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":27257,"num_objects":90,"num_object_clones":0,"num_object_copies":270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":39,"num_read_kb":31,"num_write":197,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.155551"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.001512+0000","last_change":"2024-06-02T04:03:06.690548+0000","last_active":"2024-06-02T04:03:08.001512+0000","last_peered":"2024-06-02T04:03:08.001512+0000","last_clean":"2024-06-02T04:03:08.001512+0000","last_became_active":"2024-06-02T04:03:06.690003+0000","last_became_peered":"2024-06-02T04:03:06.690003+0000","last_unstale":"2024-06-02T04:03:08.001512+0000","last_undegraded":"2024-06-02T04:03:08.001512+0000","last_fullsized":"2024-06-02T04:03:08.001512+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:36:23.875017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.695899+0000","last_change":"2024-06-02T04:03:06.694664+0000","last_active":"2024-06-02T04:03:06.695899+0000","last_peered":"2024-06-02T04:03:06.695899+0000","last_clean":"2024-06-02T04:03:06.695899+0000","last_became_active":"2024-06-02T04:03:06.692173+0000","last_became_peered":"2024-06-02T04:03:06.692173+0000","last_unstale":"2024-06-02T04:03:06.695899+0000","last_undegraded":"2024-06-02T04:03:06.695899+0000","last_fullsized":"2024-06-02T04:03:06.695899+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:28:07.252793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.692106+0000","last_change":"2024-06-02T04:03:06.691118+0000","last_active":"2024-06-02T04:03:06.692106+0000","last_peered":"2024-06-02T04:03:06.692106+0000","last_clean":"2024-06-02T04:03:06.692106+0000","last_became_active":"2024-06-02T04:03:06.690782+0000","last_became_peered":"2024-06-02T04:03:06.690782+0000","last_unstale":"2024-06-02T04:03:06.692106+0000","last_undegraded":"2024-06-02T04:03:06.692106+0000","last_fullsized":"2024-06-02T04:03:06.692106+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:30:02.876432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.828784+0000","last_change":"2024-06-02T04:03:06.692716+0000","last_active":"2024-06-02T04:03:06.828784+0000","last_peered":"2024-06-02T04:03:06.828784+0000","last_clean":"2024-06-02T04:03:06.828784+0000","last_became_active":"2024-06-02T04:03:06.692084+0000","last_became_peered":"2024-06-02T04:03:06.692084+0000","last_unstale":"2024-06-02T04:03:06.828784+0000","last_undegraded":"2024-06-02T04:03:06.828784+0000","last_fullsized":"2024-06-02T04:03:06.828784+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:32:20.191118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.885799+0000","last_change":"2024-06-02T04:03:06.685966+0000","last_active":"2024-06-02T04:03:07.885799+0000","last_peered":"2024-06-02T04:03:07.885799+0000","last_clean":"2024-06-02T04:03:07.885799+0000","last_became_active":"2024-06-02T04:03:06.685622+0000","last_became_peered":"2024-06-02T04:03:06.685622+0000","last_unstale":"2024-06-02T04:03:07.885799+0000","last_undegraded":"2024-06-02T04:03:07.885799+0000","last_fullsized":"2024-06-02T04:03:07.885799+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:37:11.472602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.043587+0000","last_change":"2024-06-02T04:03:06.687067+0000","last_active":"2024-06-02T04:03:08.043587+0000","last_peered":"2024-06-02T04:03:08.043587+0000","last_clean":"2024-06-02T04:03:08.043587+0000","last_became_active":"2024-06-02T04:03:06.686746+0000","last_became_peered":"2024-06-02T04:03:06.686746+0000","last_unstale":"2024-06-02T04:03:08.043587+0000","last_undegraded":"2024-06-02T04:03:08.043587+0000","last_fullsized":"2024-06-02T04:03:08.043587+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:18:28.240961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.644681+0000","last_change":"2024-06-02T04:03:06.685437+0000","last_active":"2024-06-02T04:03:08.644681+0000","last_peered":"2024-06-02T04:03:08.644681+0000","last_clean":"2024-06-02T04:03:08.644681+0000","last_became_active":"2024-06-02T04:03:06.685127+0000","last_became_peered":"2024-06-02T04:03:06.685127+0000","last_unstale":"2024-06-02T04:03:08.644681+0000","last_undegraded":"2024-06-02T04:03:08.644681+0000","last_fullsized":"2024-06-02T04:03:08.644681+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:45:08.746351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676297+0000","last_change":"2024-06-02T04:03:06.688091+0000","last_active":"2024-06-02T04:03:07.676297+0000","last_peered":"2024-06-02T04:03:07.676297+0000","last_clean":"2024-06-02T04:03:07.676297+0000","last_became_active":"2024-06-02T04:03:06.687827+0000","last_became_peered":"2024-06-02T04:03:06.687827+0000","last_unstale":"2024-06-02T04:03:07.676297+0000","last_undegraded":"2024-06-02T04:03:07.676297+0000","last_fullsized":"2024-06-02T04:03:07.676297+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:44:10.968199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.717204+0000","last_change":"2024-06-02T04:03:06.699748+0000","last_active":"2024-06-02T04:03:08.717204+0000","last_peered":"2024-06-02T04:03:08.717204+0000","last_clean":"2024-06-02T04:03:08.717204+0000","last_became_active":"2024-06-02T04:03:06.699442+0000","last_became_peered":"2024-06-02T04:03:06.699442+0000","last_unstale":"2024-06-02T04:03:08.717204+0000","last_undegraded":"2024-06-02T04:03:08.717204+0000","last_fullsized":"2024-06-02T04:03:08.717204+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:00:40.165226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.043690+0000","last_change":"2024-06-02T04:03:06.691914+0000","last_active":"2024-06-02T04:03:08.043690+0000","last_peered":"2024-06-02T04:03:08.043690+0000","last_clean":"2024-06-02T04:03:08.043690+0000","last_became_active":"2024-06-02T04:03:06.691250+0000","last_became_peered":"2024-06-02T04:03:06.691250+0000","last_unstale":"2024-06-02T04:03:08.043690+0000","last_undegraded":"2024-06-02T04:03:08.043690+0000","last_fullsized":"2024-06-02T04:03:08.043690+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:21:17.201134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.644985+0000","last_change":"2024-06-02T04:03:06.700359+0000","last_active":"2024-06-02T04:03:08.644985+0000","last_peered":"2024-06-02T04:03:08.644985+0000","last_clean":"2024-06-02T04:03:08.644985+0000","last_became_active":"2024-06-02T04:03:06.699829+0000","last_became_peered":"2024-06-02T04:03:06.699829+0000","last_unstale":"2024-06-02T04:03:08.644985+0000","last_undegraded":"2024-06-02T04:03:08.644985+0000","last_fullsized":"2024-06-02T04:03:08.644985+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:00:48.645655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.828757+0000","last_change":"2024-06-02T04:03:06.693172+0000","last_active":"2024-06-02T04:03:06.828757+0000","last_peered":"2024-06-02T04:03:06.828757+0000","last_clean":"2024-06-02T04:03:06.828757+0000","last_became_active":"2024-06-02T04:03:06.692859+0000","last_became_peered":"2024-06-02T04:03:06.692859+0000","last_unstale":"2024-06-02T04:03:06.828757+0000","last_undegraded":"2024-06-02T04:03:06.828757+0000","last_fullsized":"2024-06-02T04:03:06.828757+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:34:56.027760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.967731+0000","last_change":"2024-06-02T04:03:06.688171+0000","last_active":"2024-06-02T04:03:06.967731+0000","last_peered":"2024-06-02T04:03:06.967731+0000","last_clean":"2024-06-02T04:03:06.967731+0000","last_became_active":"2024-06-02T04:03:06.687476+0000","last_became_peered":"2024-06-02T04:03:06.687476+0000","last_unstale":"2024-06-02T04:03:06.967731+0000","last_undegraded":"2024-06-02T04:03:06.967731+0000","last_fullsized":"2024-06-02T04:03:06.967731+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:03:49.023726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.698675+0000","last_change":"2024-06-02T04:03:06.697507+0000","last_active":"2024-06-02T04:03:06.698675+0000","last_peered":"2024-06-02T04:03:06.698675+0000","last_clean":"2024-06-02T04:03:06.698675+0000","last_became_active":"2024-06-02T04:03:06.697201+0000","last_became_peered":"2024-06-02T04:03:06.697201+0000","last_unstale":"2024-06-02T04:03:06.698675+0000","last_undegraded":"2024-06-02T04:03:06.698675+0000","last_fullsized":"2024-06-02T04:03:06.698675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:33:08.883076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.691982+0000","last_change":"2024-06-02T04:03:06.690488+0000","last_active":"2024-06-02T04:03:06.691982+0000","last_peered":"2024-06-02T04:03:06.691982+0000","last_clean":"2024-06-02T04:03:06.691982+0000","last_became_active":"2024-06-02T04:03:06.690186+0000","last_became_peered":"2024-06-02T04:03:06.690186+0000","last_unstale":"2024-06-02T04:03:06.691982+0000","last_undegraded":"2024-06-02T04:03:06.691982+0000","last_fullsized":"2024-06-02T04:03:06.691982+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:55:44.408427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.716746+0000","last_change":"2024-06-02T04:03:06.693950+0000","last_active":"2024-06-02T04:03:08.716746+0000","last_peered":"2024-06-02T04:03:08.716746+0000","last_clean":"2024-06-02T04:03:08.716746+0000","last_became_active":"2024-06-02T04:03:06.693656+0000","last_became_peered":"2024-06-02T04:03:06.693656+0000","last_unstale":"2024-06-02T04:03:08.716746+0000","last_undegraded":"2024-06-02T04:03:08.716746+0000","last_fullsized":"2024-06-02T04:03:08.716746+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:14:24.687129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.001599+0000","last_change":"2024-06-02T04:03:06.690325+0000","last_active":"2024-06-02T04:03:08.001599+0000","last_peered":"2024-06-02T04:03:08.001599+0000","last_clean":"2024-06-02T04:03:08.001599+0000","last_became_active":"2024-06-02T04:03:06.689579+0000","last_became_peered":"2024-06-02T04:03:06.689579+0000","last_unstale":"2024-06-02T04:03:08.001599+0000","last_undegraded":"2024-06-02T04:03:08.001599+0000","last_fullsized":"2024-06-02T04:03:08.001599+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:46:49.709737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:09.706673+0000","last_change":"2024-06-02T04:03:06.691817+0000","last_active":"2024-06-02T04:03:09.706673+0000","last_peered":"2024-06-02T04:03:09.706673+0000","last_clean":"2024-06-02T04:03:09.706673+0000","last_became_active":"2024-06-02T04:03:06.691487+0000","last_became_peered":"2024-06-02T04:03:06.691487+0000","last_unstale":"2024-06-02T04:03:09.706673+0000","last_undegraded":"2024-06-02T04:03:09.706673+0000","last_fullsized":"2024-06-02T04:03:09.706673+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:32:29.983404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.689707+0000","last_change":"2024-06-02T04:03:06.687928+0000","last_active":"2024-06-02T04:03:06.689707+0000","last_peered":"2024-06-02T04:03:06.689707+0000","last_clean":"2024-06-02T04:03:06.689707+0000","last_became_active":"2024-06-02T04:03:06.687626+0000","last_became_peered":"2024-06-02T04:03:06.687626+0000","last_unstale":"2024-06-02T04:03:06.689707+0000","last_undegraded":"2024-06-02T04:03:06.689707+0000","last_fullsized":"2024-06-02T04:03:06.689707+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:00:49.112152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"82'13","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:13.108904+0000","last_change":"2024-06-02T04:03:06.278393+0000","last_active":"2024-06-02T04:03:13.108904+0000","last_peered":"2024-06-02T04:03:13.108904+0000","last_clean":"2024-06-02T04:03:13.108904+0000","last_became_active":"2024-06-02T04:03:06.278033+0000","last_became_peered":"2024-06-02T04:03:06.278033+0000","last_unstale":"2024-06-02T04:03:13.108904+0000","last_undegraded":"2024-06-02T04:03:13.108904+0000","last_fullsized":"2024-06-02T04:03:13.108904+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:34:01.806795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676615+0000","last_change":"2024-06-02T04:03:06.693074+0000","last_active":"2024-06-02T04:03:07.676615+0000","last_peered":"2024-06-02T04:03:07.676615+0000","last_clean":"2024-06-02T04:03:07.676615+0000","last_became_active":"2024-06-02T04:03:06.689257+0000","last_became_peered":"2024-06-02T04:03:06.689257+0000","last_unstale":"2024-06-02T04:03:07.676615+0000","last_undegraded":"2024-06-02T04:03:07.676615+0000","last_fullsized":"2024-06-02T04:03:07.676615+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:36:48.346723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.882169+0000","last_change":"2024-06-02T04:03:06.275088+0000","last_active":"2024-06-02T04:03:08.882169+0000","last_peered":"2024-06-02T04:03:08.882169+0000","last_clean":"2024-06-02T04:03:08.882169+0000","last_became_active":"2024-06-02T04:03:06.274731+0000","last_became_peered":"2024-06-02T04:03:06.274731+0000","last_unstale":"2024-06-02T04:03:08.882169+0000","last_undegraded":"2024-06-02T04:03:08.882169+0000","last_fullsized":"2024-06-02T04:03:08.882169+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:41:01.298971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.693659+0000","last_change":"2024-06-02T04:03:06.691841+0000","last_active":"2024-06-02T04:03:06.693659+0000","last_peered":"2024-06-02T04:03:06.693659+0000","last_clean":"2024-06-02T04:03:06.693659+0000","last_became_active":"2024-06-02T04:03:06.690960+0000","last_became_peered":"2024-06-02T04:03:06.690960+0000","last_unstale":"2024-06-02T04:03:06.693659+0000","last_undegraded":"2024-06-02T04:03:06.693659+0000","last_fullsized":"2024-06-02T04:03:06.693659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:05:13.716189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"82'11","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:12.097731+0000","last_change":"2024-06-02T04:03:06.278745+0000","last_active":"2024-06-02T04:03:12.097731+0000","last_peered":"2024-06-02T04:03:12.097731+0000","last_clean":"2024-06-02T04:03:12.097731+0000","last_became_active":"2024-06-02T04:03:06.278449+0000","last_became_peered":"2024-06-02T04:03:06.278449+0000","last_unstale":"2024-06-02T04:03:12.097731+0000","last_undegraded":"2024-06-02T04:03:12.097731+0000","last_fullsized":"2024-06-02T04:03:12.097731+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:56:46.039492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.716762+0000","last_change":"2024-06-02T04:03:06.695832+0000","last_active":"2024-06-02T04:03:08.716762+0000","last_peered":"2024-06-02T04:03:08.716762+0000","last_clean":"2024-06-02T04:03:08.716762+0000","last_became_active":"2024-06-02T04:03:06.695266+0000","last_became_peered":"2024-06-02T04:03:06.695266+0000","last_unstale":"2024-06-02T04:03:08.716762+0000","last_undegraded":"2024-06-02T04:03:08.716762+0000","last_fullsized":"2024-06-02T04:03:08.716762+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:06:27.708914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:12.096043+0000","last_change":"2024-06-02T04:03:06.277846+0000","last_active":"2024-06-02T04:03:12.096043+0000","last_peered":"2024-06-02T04:03:12.096043+0000","last_clean":"2024-06-02T04:03:12.096043+0000","last_became_active":"2024-06-02T04:03:06.277514+0000","last_became_peered":"2024-06-02T04:03:06.277514+0000","last_unstale":"2024-06-02T04:03:12.096043+0000","last_undegraded":"2024-06-02T04:03:12.096043+0000","last_fullsized":"2024-06-02T04:03:12.096043+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:41:20.915468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.677279+0000","last_change":"2024-06-02T04:03:06.692309+0000","last_active":"2024-06-02T04:03:07.677279+0000","last_peered":"2024-06-02T04:03:07.677279+0000","last_clean":"2024-06-02T04:03:07.677279+0000","last_became_active":"2024-06-02T04:03:06.691988+0000","last_became_peered":"2024-06-02T04:03:06.691988+0000","last_unstale":"2024-06-02T04:03:07.677279+0000","last_undegraded":"2024-06-02T04:03:07.677279+0000","last_fullsized":"2024-06-02T04:03:07.677279+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:19:08.790807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:13.090191+0000","last_change":"2024-06-02T04:03:06.271789+0000","last_active":"2024-06-02T04:03:13.090191+0000","last_peered":"2024-06-02T04:03:13.090191+0000","last_clean":"2024-06-02T04:03:13.090191+0000","last_became_active":"2024-06-02T04:03:06.271482+0000","last_became_peered":"2024-06-02T04:03:06.271482+0000","last_unstale":"2024-06-02T04:03:13.090191+0000","last_undegraded":"2024-06-02T04:03:13.090191+0000","last_fullsized":"2024-06-02T04:03:13.090191+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:23:10.065847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.885786+0000","last_change":"2024-06-02T04:03:06.690544+0000","last_active":"2024-06-02T04:03:07.885786+0000","last_peered":"2024-06-02T04:03:07.885786+0000","last_clean":"2024-06-02T04:03:07.885786+0000","last_became_active":"2024-06-02T04:03:06.687225+0000","last_became_peered":"2024-06-02T04:03:06.687225+0000","last_unstale":"2024-06-02T04:03:07.885786+0000","last_undegraded":"2024-06-02T04:03:07.885786+0000","last_fullsized":"2024-06-02T04:03:07.885786+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:26:44.414575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.089094+0000","last_change":"2024-06-02T04:03:06.269559+0000","last_active":"2024-06-02T04:03:11.089094+0000","last_peered":"2024-06-02T04:03:11.089094+0000","last_clean":"2024-06-02T04:03:11.089094+0000","last_became_active":"2024-06-02T04:03:06.269211+0000","last_became_peered":"2024-06-02T04:03:06.269211+0000","last_unstale":"2024-06-02T04:03:11.089094+0000","last_undegraded":"2024-06-02T04:03:11.089094+0000","last_fullsized":"2024-06-02T04:03:11.089094+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:28:39.167267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.677438+0000","last_change":"2024-06-02T04:03:06.692224+0000","last_active":"2024-06-02T04:03:07.677438+0000","last_peered":"2024-06-02T04:03:07.677438+0000","last_clean":"2024-06-02T04:03:07.677438+0000","last_became_active":"2024-06-02T04:03:06.691664+0000","last_became_peered":"2024-06-02T04:03:06.691664+0000","last_unstale":"2024-06-02T04:03:07.677438+0000","last_undegraded":"2024-06-02T04:03:07.677438+0000","last_fullsized":"2024-06-02T04:03:07.677438+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:12:17.679245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"82'2","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:10.716951+0000","last_change":"2024-06-02T04:03:06.268602+0000","last_active":"2024-06-02T04:03:10.716951+0000","last_peered":"2024-06-02T04:03:10.716951+0000","last_clean":"2024-06-02T04:03:10.716951+0000","last_became_active":"2024-06-02T04:03:06.268268+0000","last_became_peered":"2024-06-02T04:03:06.268268+0000","last_unstale":"2024-06-02T04:03:10.716951+0000","last_undegraded":"2024-06-02T04:03:10.716951+0000","last_fullsized":"2024-06-02T04:03:10.716951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:29:40.033649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676424+0000","last_change":"2024-06-02T04:03:06.687534+0000","last_active":"2024-06-02T04:03:07.676424+0000","last_peered":"2024-06-02T04:03:07.676424+0000","last_clean":"2024-06-02T04:03:07.676424+0000","last_became_active":"2024-06-02T04:03:06.687210+0000","last_became_peered":"2024-06-02T04:03:06.687210+0000","last_unstale":"2024-06-02T04:03:07.676424+0000","last_undegraded":"2024-06-02T04:03:07.676424+0000","last_fullsized":"2024-06-02T04:03:07.676424+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:09:54.479287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:12.096635+0000","last_change":"2024-06-02T04:03:06.275477+0000","last_active":"2024-06-02T04:03:12.096635+0000","last_peered":"2024-06-02T04:03:12.096635+0000","last_clean":"2024-06-02T04:03:12.096635+0000","last_became_active":"2024-06-02T04:03:06.275091+0000","last_became_peered":"2024-06-02T04:03:06.275091+0000","last_unstale":"2024-06-02T04:03:12.096635+0000","last_undegraded":"2024-06-02T04:03:12.096635+0000","last_fullsized":"2024-06-02T04:03:12.096635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:30:49.126971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:09.706733+0000","last_change":"2024-06-02T04:03:06.685908+0000","last_active":"2024-06-02T04:03:09.706733+0000","last_peered":"2024-06-02T04:03:09.706733+0000","last_clean":"2024-06-02T04:03:09.706733+0000","last_became_active":"2024-06-02T04:03:06.685572+0000","last_became_peered":"2024-06-02T04:03:06.685572+0000","last_unstale":"2024-06-02T04:03:09.706733+0000","last_undegraded":"2024-06-02T04:03:09.706733+0000","last_fullsized":"2024-06-02T04:03:09.706733+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:31:35.685227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.087789+0000","last_change":"2024-06-02T04:03:06.274773+0000","last_active":"2024-06-02T04:03:11.087789+0000","last_peered":"2024-06-02T04:03:11.087789+0000","last_clean":"2024-06-02T04:03:11.087789+0000","last_became_active":"2024-06-02T04:03:06.274434+0000","last_became_peered":"2024-06-02T04:03:06.274434+0000","last_unstale":"2024-06-02T04:03:11.087789+0000","last_undegraded":"2024-06-02T04:03:11.087789+0000","last_fullsized":"2024-06-02T04:03:11.087789+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:46:41.681535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.717119+0000","last_change":"2024-06-02T04:03:06.702113+0000","last_active":"2024-06-02T04:03:08.717119+0000","last_peered":"2024-06-02T04:03:08.717119+0000","last_clean":"2024-06-02T04:03:08.717119+0000","last_became_active":"2024-06-02T04:03:06.701811+0000","last_became_peered":"2024-06-02T04:03:06.701811+0000","last_unstale":"2024-06-02T04:03:08.717119+0000","last_undegraded":"2024-06-02T04:03:08.717119+0000","last_fullsized":"2024-06-02T04:03:08.717119+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:04:28.772781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:12.096720+0000","last_change":"2024-06-02T04:03:06.278195+0000","last_active":"2024-06-02T04:03:12.096720+0000","last_peered":"2024-06-02T04:03:12.096720+0000","last_clean":"2024-06-02T04:03:12.096720+0000","last_became_active":"2024-06-02T04:03:06.277813+0000","last_became_peered":"2024-06-02T04:03:06.277813+0000","last_unstale":"2024-06-02T04:03:12.096720+0000","last_undegraded":"2024-06-02T04:03:12.096720+0000","last_fullsized":"2024-06-02T04:03:12.096720+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:50:31.381498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.693641+0000","last_change":"2024-06-02T04:03:06.691247+0000","last_active":"2024-06-02T04:03:06.693641+0000","last_peered":"2024-06-02T04:03:06.693641+0000","last_clean":"2024-06-02T04:03:06.693641+0000","last_became_active":"2024-06-02T04:03:06.689936+0000","last_became_peered":"2024-06-02T04:03:06.689936+0000","last_unstale":"2024-06-02T04:03:06.693641+0000","last_undegraded":"2024-06-02T04:03:06.693641+0000","last_fullsized":"2024-06-02T04:03:06.693641+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:47:36.577989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.082992+0000","last_change":"2024-06-02T04:03:06.271582+0000","last_active":"2024-06-02T04:03:11.082992+0000","last_peered":"2024-06-02T04:03:11.082992+0000","last_clean":"2024-06-02T04:03:11.082992+0000","last_became_active":"2024-06-02T04:03:06.271252+0000","last_became_peered":"2024-06-02T04:03:06.271252+0000","last_unstale":"2024-06-02T04:03:11.082992+0000","last_undegraded":"2024-06-02T04:03:11.082992+0000","last_fullsized":"2024-06-02T04:03:11.082992+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:21:30.861205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.716823+0000","last_change":"2024-06-02T04:03:06.698345+0000","last_active":"2024-06-02T04:03:08.716823+0000","last_peered":"2024-06-02T04:03:08.716823+0000","last_clean":"2024-06-02T04:03:08.716823+0000","last_became_active":"2024-06-02T04:03:06.698003+0000","last_became_peered":"2024-06-02T04:03:06.698003+0000","last_unstale":"2024-06-02T04:03:08.716823+0000","last_undegraded":"2024-06-02T04:03:08.716823+0000","last_fullsized":"2024-06-02T04:03:08.716823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:53:13.866319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'17","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:12.895157+0000","last_change":"2024-06-02T04:03:06.276367+0000","last_active":"2024-06-02T04:03:12.895157+0000","last_peered":"2024-06-02T04:03:12.895157+0000","last_clean":"2024-06-02T04:03:12.895157+0000","last_became_active":"2024-06-02T04:03:06.276006+0000","last_became_peered":"2024-06-02T04:03:06.276006+0000","last_unstale":"2024-06-02T04:03:12.895157+0000","last_undegraded":"2024-06-02T04:03:12.895157+0000","last_fullsized":"2024-06-02T04:03:12.895157+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:43:26.353155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20849,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":19,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.885854+0000","last_change":"2024-06-02T04:03:06.689688+0000","last_active":"2024-06-02T04:03:07.885854+0000","last_peered":"2024-06-02T04:03:07.885854+0000","last_clean":"2024-06-02T04:03:07.885854+0000","last_became_active":"2024-06-02T04:03:06.686870+0000","last_became_peered":"2024-06-02T04:03:06.686870+0000","last_unstale":"2024-06-02T04:03:07.885854+0000","last_undegraded":"2024-06-02T04:03:07.885854+0000","last_fullsized":"2024-06-02T04:03:07.885854+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:46:20.489444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'7","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.078128+0000","last_change":"2024-06-02T04:03:06.275950+0000","last_active":"2024-06-02T04:03:11.078128+0000","last_peered":"2024-06-02T04:03:11.078128+0000","last_clean":"2024-06-02T04:03:11.078128+0000","last_became_active":"2024-06-02T04:03:06.274800+0000","last_became_peered":"2024-06-02T04:03:06.274800+0000","last_unstale":"2024-06-02T04:03:11.078128+0000","last_undegraded":"2024-06-02T04:03:11.078128+0000","last_fullsized":"2024-06-02T04:03:11.078128+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:17:36.352933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.967722+0000","last_change":"2024-06-02T04:03:06.687332+0000","last_active":"2024-06-02T04:03:06.967722+0000","last_peered":"2024-06-02T04:03:06.967722+0000","last_clean":"2024-06-02T04:03:06.967722+0000","last_became_active":"2024-06-02T04:03:06.687056+0000","last_became_peered":"2024-06-02T04:03:06.687056+0000","last_unstale":"2024-06-02T04:03:06.967722+0000","last_undegraded":"2024-06-02T04:03:06.967722+0000","last_fullsized":"2024-06-02T04:03:06.967722+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:16:58.069559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:12.096615+0000","last_change":"2024-06-02T04:03:06.267618+0000","last_active":"2024-06-02T04:03:12.096615+0000","last_peered":"2024-06-02T04:03:12.096615+0000","last_clean":"2024-06-02T04:03:12.096615+0000","last_became_active":"2024-06-02T04:03:06.267326+0000","last_became_peered":"2024-06-02T04:03:06.267326+0000","last_unstale":"2024-06-02T04:03:12.096615+0000","last_undegraded":"2024-06-02T04:03:12.096615+0000","last_fullsized":"2024-06-02T04:03:12.096615+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:20:19.794922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.645046+0000","last_change":"2024-06-02T04:03:06.693973+0000","last_active":"2024-06-02T04:03:08.645046+0000","last_peered":"2024-06-02T04:03:08.645046+0000","last_clean":"2024-06-02T04:03:08.645046+0000","last_became_active":"2024-06-02T04:03:06.693628+0000","last_became_peered":"2024-06-02T04:03:06.693628+0000","last_unstale":"2024-06-02T04:03:08.645046+0000","last_undegraded":"2024-06-02T04:03:08.645046+0000","last_fullsized":"2024-06-02T04:03:08.645046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:03:52.865564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'5","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.088106+0000","last_change":"2024-06-02T04:03:06.279086+0000","last_active":"2024-06-02T04:03:11.088106+0000","last_peered":"2024-06-02T04:03:11.088106+0000","last_clean":"2024-06-02T04:03:11.088106+0000","last_became_active":"2024-06-02T04:03:06.278737+0000","last_became_peered":"2024-06-02T04:03:06.278737+0000","last_unstale":"2024-06-02T04:03:11.088106+0000","last_undegraded":"2024-06-02T04:03:11.088106+0000","last_fullsized":"2024-06-02T04:03:11.088106+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:13:49.888951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.644652+0000","last_change":"2024-06-02T04:03:06.691126+0000","last_active":"2024-06-02T04:03:08.644652+0000","last_peered":"2024-06-02T04:03:08.644652+0000","last_clean":"2024-06-02T04:03:08.644652+0000","last_became_active":"2024-06-02T04:03:06.690758+0000","last_became_peered":"2024-06-02T04:03:06.690758+0000","last_unstale":"2024-06-02T04:03:08.644652+0000","last_undegraded":"2024-06-02T04:03:08.644652+0000","last_fullsized":"2024-06-02T04:03:08.644652+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:51:27.524477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.089923+0000","last_change":"2024-06-02T04:03:06.271837+0000","last_active":"2024-06-02T04:03:11.089923+0000","last_peered":"2024-06-02T04:03:11.089923+0000","last_clean":"2024-06-02T04:03:11.089923+0000","last_became_active":"2024-06-02T04:03:06.271523+0000","last_became_peered":"2024-06-02T04:03:06.271523+0000","last_unstale":"2024-06-02T04:03:11.089923+0000","last_undegraded":"2024-06-02T04:03:11.089923+0000","last_fullsized":"2024-06-02T04:03:11.089923+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:55:14.738237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676954+0000","last_change":"2024-06-02T04:03:06.690646+0000","last_active":"2024-06-02T04:03:07.676954+0000","last_peered":"2024-06-02T04:03:07.676954+0000","last_clean":"2024-06-02T04:03:07.676954+0000","last_became_active":"2024-06-02T04:03:06.690333+0000","last_became_peered":"2024-06-02T04:03:06.690333+0000","last_unstale":"2024-06-02T04:03:07.676954+0000","last_undegraded":"2024-06-02T04:03:07.676954+0000","last_fullsized":"2024-06-02T04:03:07.676954+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:18:41.987031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:09.562594+0000","last_change":"2024-06-02T04:03:06.268892+0000","last_active":"2024-06-02T04:03:09.562594+0000","last_peered":"2024-06-02T04:03:09.562594+0000","last_clean":"2024-06-02T04:03:09.562594+0000","last_became_active":"2024-06-02T04:03:06.268559+0000","last_became_peered":"2024-06-02T04:03:06.268559+0000","last_unstale":"2024-06-02T04:03:09.562594+0000","last_undegraded":"2024-06-02T04:03:09.562594+0000","last_fullsized":"2024-06-02T04:03:09.562594+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:06:34.378769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.001506+0000","last_change":"2024-06-02T04:03:06.688371+0000","last_active":"2024-06-02T04:03:08.001506+0000","last_peered":"2024-06-02T04:03:08.001506+0000","last_clean":"2024-06-02T04:03:08.001506+0000","last_became_active":"2024-06-02T04:03:06.688046+0000","last_became_peered":"2024-06-02T04:03:06.688046+0000","last_unstale":"2024-06-02T04:03:08.001506+0000","last_undegraded":"2024-06-02T04:03:08.001506+0000","last_fullsized":"2024-06-02T04:03:08.001506+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:14:40.534799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:09.716112+0000","last_change":"2024-06-02T04:03:06.274055+0000","last_active":"2024-06-02T04:03:09.716112+0000","last_peered":"2024-06-02T04:03:09.716112+0000","last_clean":"2024-06-02T04:03:09.716112+0000","last_became_active":"2024-06-02T04:03:06.273709+0000","last_became_peered":"2024-06-02T04:03:06.273709+0000","last_unstale":"2024-06-02T04:03:09.716112+0000","last_undegraded":"2024-06-02T04:03:09.716112+0000","last_fullsized":"2024-06-02T04:03:09.716112+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:44:13.256272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:09.192257+0000","last_change":"2024-06-02T04:03:06.686391+0000","last_active":"2024-06-02T04:03:09.192257+0000","last_peered":"2024-06-02T04:03:09.192257+0000","last_clean":"2024-06-02T04:03:09.192257+0000","last_became_active":"2024-06-02T04:03:06.686086+0000","last_became_peered":"2024-06-02T04:03:06.686086+0000","last_unstale":"2024-06-02T04:03:09.192257+0000","last_undegraded":"2024-06-02T04:03:09.192257+0000","last_fullsized":"2024-06-02T04:03:09.192257+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:06:23.572438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:13.109745+0000","last_change":"2024-06-02T04:03:06.278278+0000","last_active":"2024-06-02T04:03:13.109745+0000","last_peered":"2024-06-02T04:03:13.109745+0000","last_clean":"2024-06-02T04:03:13.109745+0000","last_became_active":"2024-06-02T04:03:06.277736+0000","last_became_peered":"2024-06-02T04:03:06.277736+0000","last_unstale":"2024-06-02T04:03:13.109745+0000","last_undegraded":"2024-06-02T04:03:13.109745+0000","last_fullsized":"2024-06-02T04:03:13.109745+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:51:30.458708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.043607+0000","last_change":"2024-06-02T04:03:06.694551+0000","last_active":"2024-06-02T04:03:08.043607+0000","last_peered":"2024-06-02T04:03:08.043607+0000","last_clean":"2024-06-02T04:03:08.043607+0000","last_became_active":"2024-06-02T04:03:06.694265+0000","last_became_peered":"2024-06-02T04:03:06.694265+0000","last_unstale":"2024-06-02T04:03:08.043607+0000","last_undegraded":"2024-06-02T04:03:08.043607+0000","last_fullsized":"2024-06-02T04:03:08.043607+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:41:19.017514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.677003+0000","last_change":"2024-06-02T04:03:06.690869+0000","last_active":"2024-06-02T04:03:07.677003+0000","last_peered":"2024-06-02T04:03:07.677003+0000","last_clean":"2024-06-02T04:03:07.677003+0000","last_became_active":"2024-06-02T04:03:06.690302+0000","last_became_peered":"2024-06-02T04:03:06.690302+0000","last_unstale":"2024-06-02T04:03:07.677003+0000","last_undegraded":"2024-06-02T04:03:07.677003+0000","last_fullsized":"2024-06-02T04:03:07.677003+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:17:15.440309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'4","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:10.717511+0000","last_change":"2024-06-02T04:03:06.271968+0000","last_active":"2024-06-02T04:03:10.717511+0000","last_peered":"2024-06-02T04:03:10.717511+0000","last_clean":"2024-06-02T04:03:10.717511+0000","last_became_active":"2024-06-02T04:03:06.271669+0000","last_became_peered":"2024-06-02T04:03:06.271669+0000","last_unstale":"2024-06-02T04:03:10.717511+0000","last_undegraded":"2024-06-02T04:03:10.717511+0000","last_fullsized":"2024-06-02T04:03:10.717511+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:21:15.966330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676653+0000","last_change":"2024-06-02T04:03:06.694468+0000","last_active":"2024-06-02T04:03:07.676653+0000","last_peered":"2024-06-02T04:03:07.676653+0000","last_clean":"2024-06-02T04:03:07.676653+0000","last_became_active":"2024-06-02T04:03:06.693949+0000","last_became_peered":"2024-06-02T04:03:06.693949+0000","last_unstale":"2024-06-02T04:03:07.676653+0000","last_undegraded":"2024-06-02T04:03:07.676653+0000","last_fullsized":"2024-06-02T04:03:07.676653+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:30:25.539150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.088265+0000","last_change":"2024-06-02T04:03:06.271658+0000","last_active":"2024-06-02T04:03:11.088265+0000","last_peered":"2024-06-02T04:03:11.088265+0000","last_clean":"2024-06-02T04:03:11.088265+0000","last_became_active":"2024-06-02T04:03:06.271313+0000","last_became_peered":"2024-06-02T04:03:06.271313+0000","last_unstale":"2024-06-02T04:03:11.088265+0000","last_undegraded":"2024-06-02T04:03:11.088265+0000","last_fullsized":"2024-06-02T04:03:11.088265+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:44:48.552397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":325,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.677525+0000","last_change":"2024-06-02T04:02:20.359447+0000","last_active":"2024-06-02T04:03:06.677525+0000","last_peered":"2024-06-02T04:03:06.677525+0000","last_clean":"2024-06-02T04:03:06.677525+0000","last_became_active":"2024-06-02T04:02:20.359031+0000","last_became_peered":"2024-06-02T04:02:20.359031+0000","last_unstale":"2024-06-02T04:03:06.677525+0000","last_undegraded":"2024-06-02T04:03:06.677525+0000","last_fullsized":"2024-06-02T04:03:06.677525+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T03:59:57.079508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T03:59:57.079508+0000","last_clean_scrub_stamp":"2024-06-02T03:59:57.079508+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:44:53.765578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.967686+0000","last_change":"2024-06-02T04:03:06.693309+0000","last_active":"2024-06-02T04:03:06.967686+0000","last_peered":"2024-06-02T04:03:06.967686+0000","last_clean":"2024-06-02T04:03:06.967686+0000","last_became_active":"2024-06-02T04:03:06.692961+0000","last_became_peered":"2024-06-02T04:03:06.692961+0000","last_unstale":"2024-06-02T04:03:06.967686+0000","last_undegraded":"2024-06-02T04:03:06.967686+0000","last_fullsized":"2024-06-02T04:03:06.967686+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:30:40.015091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:10.716861+0000","last_change":"2024-06-02T04:03:06.273144+0000","last_active":"2024-06-02T04:03:10.716861+0000","last_peered":"2024-06-02T04:03:10.716861+0000","last_clean":"2024-06-02T04:03:10.716861+0000","last_became_active":"2024-06-02T04:03:06.269431+0000","last_became_peered":"2024-06-02T04:03:06.269431+0000","last_unstale":"2024-06-02T04:03:10.716861+0000","last_undegraded":"2024-06-02T04:03:10.716861+0000","last_fullsized":"2024-06-02T04:03:10.716861+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:58:17.598214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.089622+0000","last_change":"2024-06-02T04:03:06.271914+0000","last_active":"2024-06-02T04:03:11.089622+0000","last_peered":"2024-06-02T04:03:11.089622+0000","last_clean":"2024-06-02T04:03:11.089622+0000","last_became_active":"2024-06-02T04:03:06.271590+0000","last_became_peered":"2024-06-02T04:03:06.271590+0000","last_unstale":"2024-06-02T04:03:11.089622+0000","last_undegraded":"2024-06-02T04:03:11.089622+0000","last_fullsized":"2024-06-02T04:03:11.089622+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:06:03.368086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.967766+0000","last_change":"2024-06-02T04:03:06.693154+0000","last_active":"2024-06-02T04:03:06.967766+0000","last_peered":"2024-06-02T04:03:06.967766+0000","last_clean":"2024-06-02T04:03:06.967766+0000","last_became_active":"2024-06-02T04:03:06.692873+0000","last_became_peered":"2024-06-02T04:03:06.692873+0000","last_unstale":"2024-06-02T04:03:06.967766+0000","last_undegraded":"2024-06-02T04:03:06.967766+0000","last_fullsized":"2024-06-02T04:03:06.967766+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:00:08.959850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'7","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.089339+0000","last_change":"2024-06-02T04:03:06.270804+0000","last_active":"2024-06-02T04:03:11.089339+0000","last_peered":"2024-06-02T04:03:11.089339+0000","last_clean":"2024-06-02T04:03:11.089339+0000","last_became_active":"2024-06-02T04:03:06.270479+0000","last_became_peered":"2024-06-02T04:03:06.270479+0000","last_unstale":"2024-06-02T04:03:11.089339+0000","last_undegraded":"2024-06-02T04:03:11.089339+0000","last_fullsized":"2024-06-02T04:03:11.089339+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:18:39.900900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676615+0000","last_change":"2024-06-02T04:03:06.685906+0000","last_active":"2024-06-02T04:03:07.676615+0000","last_peered":"2024-06-02T04:03:07.676615+0000","last_clean":"2024-06-02T04:03:07.676615+0000","last_became_active":"2024-06-02T04:03:06.685596+0000","last_became_peered":"2024-06-02T04:03:06.685596+0000","last_unstale":"2024-06-02T04:03:07.676615+0000","last_undegraded":"2024-06-02T04:03:07.676615+0000","last_fullsized":"2024-06-02T04:03:07.676615+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:06:13.456950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'5","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:09.713206+0000","last_change":"2024-06-02T04:03:06.275542+0000","last_active":"2024-06-02T04:03:09.713206+0000","last_peered":"2024-06-02T04:03:09.713206+0000","last_clean":"2024-06-02T04:03:09.713206+0000","last_became_active":"2024-06-02T04:03:06.275177+0000","last_became_peered":"2024-06-02T04:03:06.275177+0000","last_unstale":"2024-06-02T04:03:09.713206+0000","last_undegraded":"2024-06-02T04:03:09.713206+0000","last_fullsized":"2024-06-02T04:03:09.713206+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:58:35.587610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.695086+0000","last_change":"2024-06-02T04:03:06.692108+0000","last_active":"2024-06-02T04:03:06.695086+0000","last_peered":"2024-06-02T04:03:06.695086+0000","last_clean":"2024-06-02T04:03:06.695086+0000","last_became_active":"2024-06-02T04:03:06.691842+0000","last_became_peered":"2024-06-02T04:03:06.691842+0000","last_unstale":"2024-06-02T04:03:06.695086+0000","last_undegraded":"2024-06-02T04:03:06.695086+0000","last_fullsized":"2024-06-02T04:03:06.695086+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:35:10.885346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:09.713676+0000","last_change":"2024-06-02T04:03:06.278554+0000","last_active":"2024-06-02T04:03:09.713676+0000","last_peered":"2024-06-02T04:03:09.713676+0000","last_clean":"2024-06-02T04:03:09.713676+0000","last_became_active":"2024-06-02T04:03:06.278217+0000","last_became_peered":"2024-06-02T04:03:06.278217+0000","last_unstale":"2024-06-02T04:03:09.713676+0000","last_undegraded":"2024-06-02T04:03:09.713676+0000","last_fullsized":"2024-06-02T04:03:09.713676+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:04:37.653433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.885774+0000","last_change":"2024-06-02T04:03:06.682723+0000","last_active":"2024-06-02T04:03:07.885774+0000","last_peered":"2024-06-02T04:03:07.885774+0000","last_clean":"2024-06-02T04:03:07.885774+0000","last_became_active":"2024-06-02T04:03:06.682380+0000","last_became_peered":"2024-06-02T04:03:06.682380+0000","last_unstale":"2024-06-02T04:03:07.885774+0000","last_undegraded":"2024-06-02T04:03:07.885774+0000","last_fullsized":"2024-06-02T04:03:07.885774+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:07:56.566326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:12.096618+0000","last_change":"2024-06-02T04:03:06.271142+0000","last_active":"2024-06-02T04:03:12.096618+0000","last_peered":"2024-06-02T04:03:12.096618+0000","last_clean":"2024-06-02T04:03:12.096618+0000","last_became_active":"2024-06-02T04:03:06.270763+0000","last_became_peered":"2024-06-02T04:03:06.270763+0000","last_unstale":"2024-06-02T04:03:12.096618+0000","last_undegraded":"2024-06-02T04:03:12.096618+0000","last_fullsized":"2024-06-02T04:03:12.096618+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:23:12.842549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.001259+0000","last_change":"2024-06-02T04:03:06.690061+0000","last_active":"2024-06-02T04:03:08.001259+0000","last_peered":"2024-06-02T04:03:08.001259+0000","last_clean":"2024-06-02T04:03:08.001259+0000","last_became_active":"2024-06-02T04:03:06.689735+0000","last_became_peered":"2024-06-02T04:03:06.689735+0000","last_unstale":"2024-06-02T04:03:08.001259+0000","last_undegraded":"2024-06-02T04:03:08.001259+0000","last_fullsized":"2024-06-02T04:03:08.001259+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:14:29.096404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.875389+0000","last_change":"2024-06-02T04:03:06.273988+0000","last_active":"2024-06-02T04:03:08.875389+0000","last_peered":"2024-06-02T04:03:08.875389+0000","last_clean":"2024-06-02T04:03:08.875389+0000","last_became_active":"2024-06-02T04:03:06.273690+0000","last_became_peered":"2024-06-02T04:03:06.273690+0000","last_unstale":"2024-06-02T04:03:08.875389+0000","last_undegraded":"2024-06-02T04:03:08.875389+0000","last_fullsized":"2024-06-02T04:03:08.875389+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:55:13.758627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.677771+0000","last_change":"2024-06-02T04:03:06.697167+0000","last_active":"2024-06-02T04:03:07.677771+0000","last_peered":"2024-06-02T04:03:07.677771+0000","last_clean":"2024-06-02T04:03:07.677771+0000","last_became_active":"2024-06-02T04:03:06.696749+0000","last_became_peered":"2024-06-02T04:03:06.696749+0000","last_unstale":"2024-06-02T04:03:07.677771+0000","last_undegraded":"2024-06-02T04:03:07.677771+0000","last_fullsized":"2024-06-02T04:03:07.677771+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:20:06.736129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:09.709430+0000","last_change":"2024-06-02T04:03:06.271790+0000","last_active":"2024-06-02T04:03:09.709430+0000","last_peered":"2024-06-02T04:03:09.709430+0000","last_clean":"2024-06-02T04:03:09.709430+0000","last_became_active":"2024-06-02T04:03:06.271488+0000","last_became_peered":"2024-06-02T04:03:06.271488+0000","last_unstale":"2024-06-02T04:03:09.709430+0000","last_undegraded":"2024-06-02T04:03:09.709430+0000","last_fullsized":"2024-06-02T04:03:09.709430+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:45:55.514785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.644934+0000","last_change":"2024-06-02T04:03:06.700494+0000","last_active":"2024-06-02T04:03:08.644934+0000","last_peered":"2024-06-02T04:03:08.644934+0000","last_clean":"2024-06-02T04:03:08.644934+0000","last_became_active":"2024-06-02T04:03:06.700220+0000","last_became_peered":"2024-06-02T04:03:06.700220+0000","last_unstale":"2024-06-02T04:03:08.644934+0000","last_undegraded":"2024-06-02T04:03:08.644934+0000","last_fullsized":"2024-06-02T04:03:08.644934+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:25:32.547543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'5","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.088850+0000","last_change":"2024-06-02T04:03:06.273757+0000","last_active":"2024-06-02T04:03:11.088850+0000","last_peered":"2024-06-02T04:03:11.088850+0000","last_clean":"2024-06-02T04:03:11.088850+0000","last_became_active":"2024-06-02T04:03:06.273379+0000","last_became_peered":"2024-06-02T04:03:06.273379+0000","last_unstale":"2024-06-02T04:03:11.088850+0000","last_undegraded":"2024-06-02T04:03:11.088850+0000","last_fullsized":"2024-06-02T04:03:11.088850+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:23:09.207009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.645012+0000","last_change":"2024-06-02T04:03:06.700168+0000","last_active":"2024-06-02T04:03:08.645012+0000","last_peered":"2024-06-02T04:03:08.645012+0000","last_clean":"2024-06-02T04:03:08.645012+0000","last_became_active":"2024-06-02T04:03:06.699429+0000","last_became_peered":"2024-06-02T04:03:06.699429+0000","last_unstale":"2024-06-02T04:03:08.645012+0000","last_undegraded":"2024-06-02T04:03:08.645012+0000","last_fullsized":"2024-06-02T04:03:08.645012+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:29:08.397813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.088038+0000","last_change":"2024-06-02T04:03:06.275198+0000","last_active":"2024-06-02T04:03:11.088038+0000","last_peered":"2024-06-02T04:03:11.088038+0000","last_clean":"2024-06-02T04:03:11.088038+0000","last_became_active":"2024-06-02T04:03:06.274649+0000","last_became_peered":"2024-06-02T04:03:06.274649+0000","last_unstale":"2024-06-02T04:03:11.088038+0000","last_undegraded":"2024-06-02T04:03:11.088038+0000","last_fullsized":"2024-06-02T04:03:11.088038+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:37:45.091471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.936463+0000","last_change":"2024-06-02T04:03:06.690309+0000","last_active":"2024-06-02T04:03:08.936463+0000","last_peered":"2024-06-02T04:03:08.936463+0000","last_clean":"2024-06-02T04:03:08.936463+0000","last_became_active":"2024-06-02T04:03:06.689986+0000","last_became_peered":"2024-06-02T04:03:06.689986+0000","last_unstale":"2024-06-02T04:03:08.936463+0000","last_undegraded":"2024-06-02T04:03:08.936463+0000","last_fullsized":"2024-06-02T04:03:08.936463+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:12:18.237133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'3","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:09.706927+0000","last_change":"2024-06-02T04:03:06.272947+0000","last_active":"2024-06-02T04:03:09.706927+0000","last_peered":"2024-06-02T04:03:09.706927+0000","last_clean":"2024-06-02T04:03:09.706927+0000","last_became_active":"2024-06-02T04:03:06.272632+0000","last_became_peered":"2024-06-02T04:03:06.272632+0000","last_unstale":"2024-06-02T04:03:09.706927+0000","last_undegraded":"2024-06-02T04:03:09.706927+0000","last_fullsized":"2024-06-02T04:03:09.706927+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:01:16.085575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.645113+0000","last_change":"2024-06-02T04:03:06.701506+0000","last_active":"2024-06-02T04:03:08.645113+0000","last_peered":"2024-06-02T04:03:08.645113+0000","last_clean":"2024-06-02T04:03:08.645113+0000","last_became_active":"2024-06-02T04:03:06.701202+0000","last_became_peered":"2024-06-02T04:03:06.701202+0000","last_unstale":"2024-06-02T04:03:08.645113+0000","last_undegraded":"2024-06-02T04:03:08.645113+0000","last_fullsized":"2024-06-02T04:03:08.645113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:35:07.269775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.001325+0000","last_change":"2024-06-02T04:03:06.689400+0000","last_active":"2024-06-02T04:03:08.001325+0000","last_peered":"2024-06-02T04:03:08.001325+0000","last_clean":"2024-06-02T04:03:08.001325+0000","last_became_active":"2024-06-02T04:03:06.689044+0000","last_became_peered":"2024-06-02T04:03:06.689044+0000","last_unstale":"2024-06-02T04:03:08.001325+0000","last_undegraded":"2024-06-02T04:03:08.001325+0000","last_fullsized":"2024-06-02T04:03:08.001325+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:52:30.633358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.701754+0000","last_change":"2024-06-02T04:03:06.698863+0000","last_active":"2024-06-02T04:03:06.701754+0000","last_peered":"2024-06-02T04:03:06.701754+0000","last_clean":"2024-06-02T04:03:06.701754+0000","last_became_active":"2024-06-02T04:03:06.698580+0000","last_became_peered":"2024-06-02T04:03:06.698580+0000","last_unstale":"2024-06-02T04:03:06.701754+0000","last_undegraded":"2024-06-02T04:03:06.701754+0000","last_fullsized":"2024-06-02T04:03:06.701754+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:37:17.956746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.699107+0000","last_change":"2024-06-02T04:03:06.691634+0000","last_active":"2024-06-02T04:03:06.699107+0000","last_peered":"2024-06-02T04:03:06.699107+0000","last_clean":"2024-06-02T04:03:06.699107+0000","last_became_active":"2024-06-02T04:03:06.691270+0000","last_became_peered":"2024-06-02T04:03:06.691270+0000","last_unstale":"2024-06-02T04:03:06.699107+0000","last_undegraded":"2024-06-02T04:03:06.699107+0000","last_fullsized":"2024-06-02T04:03:06.699107+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:36:27.879519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.691816+0000","last_change":"2024-06-02T04:03:06.688290+0000","last_active":"2024-06-02T04:03:06.691816+0000","last_peered":"2024-06-02T04:03:06.691816+0000","last_clean":"2024-06-02T04:03:06.691816+0000","last_became_active":"2024-06-02T04:03:06.687970+0000","last_became_peered":"2024-06-02T04:03:06.687970+0000","last_unstale":"2024-06-02T04:03:06.691816+0000","last_undegraded":"2024-06-02T04:03:06.691816+0000","last_fullsized":"2024-06-02T04:03:06.691816+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:48:03.513694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.967775+0000","last_change":"2024-06-02T04:03:06.690498+0000","last_active":"2024-06-02T04:03:06.967775+0000","last_peered":"2024-06-02T04:03:06.967775+0000","last_clean":"2024-06-02T04:03:06.967775+0000","last_became_active":"2024-06-02T04:03:06.689698+0000","last_became_peered":"2024-06-02T04:03:06.689698+0000","last_unstale":"2024-06-02T04:03:06.967775+0000","last_undegraded":"2024-06-02T04:03:06.967775+0000","last_fullsized":"2024-06-02T04:03:06.967775+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:39:12.912589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.001349+0000","last_change":"2024-06-02T04:03:06.694551+0000","last_active":"2024-06-02T04:03:08.001349+0000","last_peered":"2024-06-02T04:03:08.001349+0000","last_clean":"2024-06-02T04:03:08.001349+0000","last_became_active":"2024-06-02T04:03:06.694266+0000","last_became_peered":"2024-06-02T04:03:06.694266+0000","last_unstale":"2024-06-02T04:03:08.001349+0000","last_undegraded":"2024-06-02T04:03:08.001349+0000","last_fullsized":"2024-06-02T04:03:08.001349+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:53:29.168620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.699460+0000","last_change":"2024-06-02T04:03:06.693639+0000","last_active":"2024-06-02T04:03:06.699460+0000","last_peered":"2024-06-02T04:03:06.699460+0000","last_clean":"2024-06-02T04:03:06.699460+0000","last_became_active":"2024-06-02T04:03:06.693283+0000","last_became_peered":"2024-06-02T04:03:06.693283+0000","last_unstale":"2024-06-02T04:03:06.699460+0000","last_undegraded":"2024-06-02T04:03:06.699460+0000","last_fullsized":"2024-06-02T04:03:06.699460+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:12:48.614632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676611+0000","last_change":"2024-06-02T04:03:06.689335+0000","last_active":"2024-06-02T04:03:07.676611+0000","last_peered":"2024-06-02T04:03:07.676611+0000","last_clean":"2024-06-02T04:03:07.676611+0000","last_became_active":"2024-06-02T04:03:06.688986+0000","last_became_peered":"2024-06-02T04:03:06.688986+0000","last_unstale":"2024-06-02T04:03:07.676611+0000","last_undegraded":"2024-06-02T04:03:07.676611+0000","last_fullsized":"2024-06-02T04:03:07.676611+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:16:44.138633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676833+0000","last_change":"2024-06-02T04:03:06.690694+0000","last_active":"2024-06-02T04:03:07.676833+0000","last_peered":"2024-06-02T04:03:07.676833+0000","last_clean":"2024-06-02T04:03:07.676833+0000","last_became_active":"2024-06-02T04:03:06.689684+0000","last_became_peered":"2024-06-02T04:03:06.689684+0000","last_unstale":"2024-06-02T04:03:07.676833+0000","last_undegraded":"2024-06-02T04:03:07.676833+0000","last_fullsized":"2024-06-02T04:03:07.676833+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:32:48.564501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676294+0000","last_change":"2024-06-02T04:03:06.692851+0000","last_active":"2024-06-02T04:03:07.676294+0000","last_peered":"2024-06-02T04:03:07.676294+0000","last_clean":"2024-06-02T04:03:07.676294+0000","last_became_active":"2024-06-02T04:03:06.688996+0000","last_became_peered":"2024-06-02T04:03:06.688996+0000","last_unstale":"2024-06-02T04:03:07.676294+0000","last_undegraded":"2024-06-02T04:03:07.676294+0000","last_fullsized":"2024-06-02T04:03:07.676294+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:21:54.779246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.716881+0000","last_change":"2024-06-02T04:03:06.704472+0000","last_active":"2024-06-02T04:03:08.716881+0000","last_peered":"2024-06-02T04:03:08.716881+0000","last_clean":"2024-06-02T04:03:08.716881+0000","last_became_active":"2024-06-02T04:03:06.704173+0000","last_became_peered":"2024-06-02T04:03:06.704173+0000","last_unstale":"2024-06-02T04:03:08.716881+0000","last_undegraded":"2024-06-02T04:03:08.716881+0000","last_fullsized":"2024-06-02T04:03:08.716881+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:48:26.362945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.967756+0000","last_change":"2024-06-02T04:03:06.688238+0000","last_active":"2024-06-02T04:03:06.967756+0000","last_peered":"2024-06-02T04:03:06.967756+0000","last_clean":"2024-06-02T04:03:06.967756+0000","last_became_active":"2024-06-02T04:03:06.687925+0000","last_became_peered":"2024-06-02T04:03:06.687925+0000","last_unstale":"2024-06-02T04:03:06.967756+0000","last_undegraded":"2024-06-02T04:03:06.967756+0000","last_fullsized":"2024-06-02T04:03:06.967756+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:15:19.314864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.001280+0000","last_change":"2024-06-02T04:03:06.685210+0000","last_active":"2024-06-02T04:03:08.001280+0000","last_peered":"2024-06-02T04:03:08.001280+0000","last_clean":"2024-06-02T04:03:08.001280+0000","last_became_active":"2024-06-02T04:03:06.684819+0000","last_became_peered":"2024-06-02T04:03:06.684819+0000","last_unstale":"2024-06-02T04:03:08.001280+0000","last_undegraded":"2024-06-02T04:03:08.001280+0000","last_fullsized":"2024-06-02T04:03:08.001280+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:05:55.275556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":284198,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":27023,"num_objects":88,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":39,"num_read_kb":31,"num_write":195,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":78184,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},"log_size":173,"ondisk_log_size":173,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481802,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31976,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713176,"statfs":{"total":95995035648,"available":95962292224,"internally_reserved":0,"allocated":880640,"data_stored":425116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]}]},{"osd":10,"up_from":70,"seq":300647710733,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":1018736,"data_compressed":36139,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]}]},{"osd":9,"up_from":64,"seq":274877906962,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":917504,"data_stored":426238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.309}]},{"osd":1,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.40500000000000003}]},{"osd":2,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.48599999999999999}]},{"osd":3,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.36899999999999999}]},{"osd":4,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.42999999999999999}]},{"osd":5,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.502}]},{"osd":6,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.51000000000000001}]},{"osd":7,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.52000000000000002}]},{"osd":8,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.54900000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]}]},{"osd":8,"up_from":57,"seq":244813135893,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":897024,"data_stored":425537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.48599999999999999}]},{"osd":1,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.69399999999999995}]},{"osd":2,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.51800000000000002}]},{"osd":3,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.60799999999999998}]},{"osd":4,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.77200000000000002}]},{"osd":5,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.624},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.71299999999999997}]},{"osd":6,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.57599999999999996}]},{"osd":7,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.746},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.79500000000000004}]},{"osd":9,"last update":"Sun Jun 2 04:03:00 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1,"5min":1,"15min":1},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.78500000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]}]},{"osd":7,"up_from":49,"seq":210453397528,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":1018992,"data_compressed":36139,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.312}]},{"osd":1,"last update":"Sun Jun 2 04:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.54500000000000004}]},{"osd":2,"last update":"Sun Jun 2 04:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.56299999999999994}]},{"osd":3,"last update":"Sun Jun 2 04:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.57599999999999996}]},{"osd":4,"last update":"Sun Jun 2 04:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.58699999999999997}]},{"osd":5,"last update":"Sun Jun 2 04:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.70999999999999996}]},{"osd":6,"last update":"Sun Jun 2 04:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.63200000000000001}]},{"osd":8,"last update":"Sun Jun 2 04:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.73399999999999999}]},{"osd":9,"last update":"Sun Jun 2 04:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.72299999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]}]},{"osd":6,"up_from":44,"seq":188978561051,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":888832,"data_stored":425228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:03:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.36699999999999999,"15min":0.36099999999999999},"min":{"1min":0.28399999999999997,"5min":0.246,"15min":0.246},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.38900000000000001,"15min":0.38300000000000001},"min":{"1min":0.28199999999999997,"5min":0.246,"15min":0.246},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.28199999999999997}]},{"osd":1,"last update":"Sun Jun 2 04:03:06 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.52700000000000002,"15min":0.51500000000000001},"min":{"1min":0.38700000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.46400000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.53200000000000003}]},{"osd":2,"last update":"Sun Jun 2 04:03:06 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.371,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72199999999999998,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.443},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.32700000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.61699999999999999}]},{"osd":3,"last update":"Sun Jun 2 04:03:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45400000000000001,"15min":0.45100000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.372},{"interface":"front","average":{"1min":0.495,"5min":0.46999999999999997,"15min":0.46600000000000003},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.40999999999999998}]},{"osd":4,"last update":"Sun Jun 2 04:03:06 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.39200000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77200000000000002,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.59999999999999998,"15min":0.58699999999999997},"min":{"1min":0.434,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.56699999999999995}]},{"osd":5,"last update":"Sun Jun 2 04:03:06 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.622,"15min":0.623},"min":{"1min":0.432,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.435},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.625,"15min":0.63200000000000001},"min":{"1min":0.42199999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85499999999999998,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.47399999999999998}]},{"osd":7,"last update":"Sun Jun 2 04:02:27 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.59199999999999997}]},{"osd":8,"last update":"Sun Jun 2 04:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.502},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.45700000000000002}]},{"osd":9,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1,"5min":1,"15min":1},"last":0.49199999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":937984,"data_stored":464967,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:02:47 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.47799999999999998,"15min":0.46600000000000003},"min":{"1min":0.32500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.49099999999999999,"15min":0.48099999999999998},"min":{"1min":0.36599999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.439}]},{"osd":2,"last update":"Sun Jun 2 04:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.52500000000000002,"15min":0.50700000000000001},"min":{"1min":0.375,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52000000000000002,"15min":0.51600000000000001},"min":{"1min":0.39300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.71499999999999997}]},{"osd":3,"last update":"Sun Jun 2 04:02:17 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.51800000000000002,"15min":0.51700000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.63},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.42699999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.67500000000000004}]},{"osd":4,"last update":"Sun Jun 2 04:02:37 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.57199999999999995,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.748},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40600000000000003,"15min":0.40799999999999997},"min":{"1min":0.308,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.56499999999999995,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.54200000000000004}]},{"osd":5,"last update":"Sun Jun 2 04:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.42499999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.36299999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.84499999999999997}]},{"osd":6,"last update":"Sun Jun 2 04:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.59399999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.81399999999999995}]},{"osd":7,"last update":"Sun Jun 2 04:02:27 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.78100000000000003}]},{"osd":8,"last update":"Sun Jun 2 04:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.90000000000000002}]},{"osd":9,"last update":"Sun Jun 2 04:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.80200000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]}]},{"osd":0,"up_from":8,"seq":34359738416,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":427134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jun 2 04:02:45 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52100000000000002,"15min":0.51500000000000001},"min":{"1min":0.30399999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.501,"15min":0.49199999999999999},"min":{"1min":0.36299999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.70099999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.48499999999999999}]},{"osd":2,"last update":"Sun Jun 2 04:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.624,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54800000000000004,"15min":0.54300000000000004},"min":{"1min":0.41099999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.65900000000000003,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.66400000000000003}]},{"osd":3,"last update":"Sun Jun 2 04:02:17 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.59599999999999997,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.41699999999999998,"15min":0.41399999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.65200000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.45300000000000001}]},{"osd":4,"last update":"Sun Jun 2 04:02:37 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56899999999999995,"15min":0.56299999999999994},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.752,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55100000000000005,"15min":0.54900000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.52500000000000002}]},{"osd":5,"last update":"Sun Jun 2 04:02:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60099999999999998,"15min":0.60199999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.82799999999999996,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57999999999999996,"15min":0.58299999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.76500000000000001}]},{"osd":6,"last update":"Sun Jun 2 04:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.39900000000000002}]},{"osd":7,"last update":"Sun Jun 2 04:02:27 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.51800000000000002}]},{"osd":8,"last update":"Sun Jun 2 04:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.53700000000000003}]},{"osd":9,"last update":"Sun Jun 2 04:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.42899999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]}]},{"osd":2,"up_from":18,"seq":77309411370,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":925696,"data_stored":428556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.49299999999999999,"15min":0.47299999999999998},"min":{"1min":0.34699999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.496,"15min":0.47199999999999998},"min":{"1min":0.39400000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.57699999999999996}]},{"osd":1,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.497,"15min":0.48999999999999999},"min":{"1min":0.34399999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.79700000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.505,"15min":0.5},"min":{"1min":0.33700000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.74299999999999999}]},{"osd":3,"last update":"Sun Jun 2 04:02:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.54100000000000004,"15min":0.53200000000000003},"min":{"1min":0.36699999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.73799999999999999,"5min":0.747,"15min":0.747},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.55400000000000005,"15min":0.54500000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.63500000000000001}]},{"osd":4,"last update":"Sun Jun 2 04:02:33 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52300000000000002,"15min":0.51700000000000002},"min":{"1min":0.36099999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.52300000000000002,"15min":0.51400000000000001},"min":{"1min":0.442,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.77500000000000002}]},{"osd":5,"last update":"Sun Jun 2 04:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.441,"15min":0.437},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.501},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.501,"15min":0.496},"min":{"1min":0.36899999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.61699999999999999}]},{"osd":6,"last update":"Sun Jun 2 04:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.874,"5min":0.877,"15min":0.877},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63400000000000001,"15min":0.63700000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.66900000000000004}]},{"osd":7,"last update":"Sun Jun 2 04:02:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.48199999999999998}]},{"osd":8,"last update":"Sun Jun 2 04:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.72099999999999997}]},{"osd":9,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.75900000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]}]},{"osd":3,"up_from":25,"seq":107374182438,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":425663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:02:20 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.316,"15min":0.31},"min":{"1min":0.24299999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.34200000000000003,"15min":0.34000000000000002},"min":{"1min":0.251,"5min":0.249,"15min":0.249},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.55100000000000005}]},{"osd":1,"last update":"Sun Jun 2 04:02:20 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.50800000000000001,"15min":0.498},"min":{"1min":0.39300000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.51000000000000001,"15min":0.50700000000000001},"min":{"1min":0.35399999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.60499999999999998}]},{"osd":2,"last update":"Sun Jun 2 04:02:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.52800000000000002,"15min":0.51700000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.52900000000000003,"15min":0.51500000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.59399999999999997}]},{"osd":4,"last update":"Sun Jun 2 04:02:35 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56899999999999995,"15min":0.56999999999999995},"min":{"1min":0.37,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71899999999999997,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.77100000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.63700000000000001}]},{"osd":5,"last update":"Sun Jun 2 04:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.51100000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77700000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.77500000000000002}]},{"osd":6,"last update":"Sun Jun 2 04:03:07 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.49399999999999999,"15min":0.496},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81699999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.69599999999999995}]},{"osd":7,"last update":"Sun Jun 2 04:02:26 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.81999999999999995}]},{"osd":8,"last update":"Sun Jun 2 04:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.44500000000000001}]},{"osd":9,"last update":"Sun Jun 2 04:03:00 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.74399999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":4,"up_from":32,"seq":137438953507,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":897024,"data_stored":425734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:02:31 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.47899999999999998,"15min":0.47499999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71799999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.379},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.50900000000000001,"15min":0.505},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.39100000000000001}]},{"osd":1,"last update":"Sun Jun 2 04:02:31 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.34399999999999997,"15min":0.33600000000000002},"min":{"1min":0.27800000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.372,"15min":0.35799999999999998},"min":{"1min":0.28699999999999998,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.41399999999999998}]},{"osd":2,"last update":"Sun Jun 2 04:02:31 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.51500000000000001,"15min":0.51400000000000001},"min":{"1min":0.371,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.50800000000000001,"15min":0.499},"min":{"1min":0.39100000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.60199999999999998}]},{"osd":3,"last update":"Sun Jun 2 04:02:31 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.52700000000000002,"15min":0.51100000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.67700000000000005,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.44800000000000001}]},{"osd":5,"last update":"Sun Jun 2 04:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54000000000000004,"15min":0.53300000000000003},"min":{"1min":0.40100000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.58299999999999996,"15min":0.57699999999999996},"min":{"1min":0.39800000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.71699999999999997}]},{"osd":6,"last update":"Sun Jun 2 04:02:10 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.54500000000000004}]},{"osd":7,"last update":"Sun Jun 2 04:02:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.66000000000000003}]},{"osd":8,"last update":"Sun Jun 2 04:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.68999999999999995}]},{"osd":9,"last update":"Sun Jun 2 04:03:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.63300000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]}]},{"osd":5,"up_from":37,"seq":158913789984,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":974848,"data_stored":1018256,"data_compressed":36139,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.503,"15min":0.502},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.443},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.36199999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.55800000000000005}]},{"osd":1,"last update":"Sun Jun 2 04:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54600000000000004,"15min":0.54800000000000004},"min":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70199999999999996,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55000000000000004,"15min":0.55400000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68300000000000005,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.51300000000000001}]},{"osd":2,"last update":"Sun Jun 2 04:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40100000000000002,"15min":0.39900000000000002},"min":{"1min":0.29499999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.42899999999999999,"15min":0.433},"min":{"1min":0.28899999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.33600000000000002}]},{"osd":3,"last update":"Sun Jun 2 04:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.55000000000000004,"15min":0.55800000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81399999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73499999999999999,"5min":0.751,"15min":0.751},"last":0.57799999999999996}]},{"osd":4,"last update":"Sun Jun 2 04:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59499999999999997,"15min":0.59599999999999997},"min":{"1min":0.433,"5min":0.372,"15min":0.372},"max":{"1min":0.80200000000000005,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.38600000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80100000000000005,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.58699999999999997}]},{"osd":6,"last update":"Sun Jun 2 04:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.61299999999999999,"15min":0.625},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83799999999999997,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.59299999999999997,"15min":0.60599999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77700000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.49099999999999999}]},{"osd":7,"last update":"Sun Jun 2 04:02:25 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.60899999999999999}]},{"osd":8,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.621}]},{"osd":9,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.53400000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34501,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34501,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34501,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36139,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36139,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36139,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36139,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36139,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":39851,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":22930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T04:03:15.598 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-06-02T04:03:15.598 INFO:tasks.cephadm:Setting up client nodes... 2024-06-02T04:03:15.599 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-06-02T04:03:15.849 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:03:16.272 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:16 smithi123 ceph-mon[42885]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:03:16.272 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:16 smithi123 ceph-mon[42885]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:03:16.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:16 smithi162 ceph-mon[47009]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:03:16.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:16 smithi162 ceph-mon[47009]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:03:16.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:16 smithi136 ceph-mon[47443]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:03:16.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:16 smithi136 ceph-mon[47443]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:03:16.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.825+0000 7f735b815700 1 -- 172.21.15.123:0/3554770388 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7354101070 msgr2=0x7f73541014f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:16.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.825+0000 7f735b815700 1 --2- 172.21.15.123:0/3554770388 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7354101070 0x7f73541014f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7348009990 tx=0x7f7348009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:16.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.825+0000 7f735b815700 1 -- 172.21.15.123:0/3554770388 shutdown_connections 2024-06-02T04:03:16.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.825+0000 7f735b815700 1 --2- 172.21.15.123:0/3554770388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7354101a30 0x7f7354108350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:16.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.825+0000 7f735b815700 1 --2- 172.21.15.123:0/3554770388 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f73540ffe80 0x7f73541002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:16.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.825+0000 7f735b815700 1 --2- 172.21.15.123:0/3554770388 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7354101070 0x7f73541014f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:16.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.825+0000 7f735b815700 1 -- 172.21.15.123:0/3554770388 >> 172.21.15.123:0/3554770388 conn(0x7f73540fb470 msgr2=0x7f73540fd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:16.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.825+0000 7f735b815700 1 -- 172.21.15.123:0/3554770388 shutdown_connections 2024-06-02T04:03:16.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.825+0000 7f735b815700 1 -- 172.21.15.123:0/3554770388 wait complete. 2024-06-02T04:03:16.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.826+0000 7f735b815700 1 Processor -- start 2024-06-02T04:03:16.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.826+0000 7f735b815700 1 -- start start 2024-06-02T04:03:16.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.826+0000 7f735b815700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73540ffe80 0x7f7354069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:16.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.826+0000 7f735b815700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7354101070 0x7f735419bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:16.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.826+0000 7f735b815700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7354101a30 0x7f735419e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:16.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.826+0000 7f735b815700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735419e990 con 0x7f73540ffe80 2024-06-02T04:03:16.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.826+0000 7f735b815700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735419eb00 con 0x7f7354101070 2024-06-02T04:03:16.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.826+0000 7f735b815700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735419ecc0 con 0x7f7354101a30 2024-06-02T04:03:16.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.826+0000 7f73595b1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73540ffe80 0x7f7354069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:16.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.826+0000 7f73595b1700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73540ffe80 0x7f7354069640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42356/0 (socket says 172.21.15.123:42356) 2024-06-02T04:03:16.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.826+0000 7f73595b1700 1 -- 172.21.15.123:0/2190483675 learned_addr learned my addr 172.21.15.123:0/2190483675 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:16.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.826+0000 7f7359db2700 1 --2- 172.21.15.123:0/2190483675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7354101a30 0x7f735419e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:16.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.826+0000 7f7358db0700 1 --2- 172.21.15.123:0/2190483675 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7354101070 0x7f735419bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:16.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.826+0000 7f73595b1700 1 -- 172.21.15.123:0/2190483675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7354101a30 msgr2=0x7f735419e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:16.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.826+0000 7f73595b1700 1 --2- 172.21.15.123:0/2190483675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7354101a30 0x7f735419e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:16.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.826+0000 7f73595b1700 1 -- 172.21.15.123:0/2190483675 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7354101070 msgr2=0x7f735419bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:16.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.826+0000 7f73595b1700 1 --2- 172.21.15.123:0/2190483675 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7354101070 0x7f735419bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:16.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.826+0000 7f73595b1700 1 -- 172.21.15.123:0/2190483675 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73480095f0 con 0x7f73540ffe80 2024-06-02T04:03:16.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.826+0000 7f7359db2700 1 --2- 172.21.15.123:0/2190483675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7354101a30 0x7f735419e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:03:16.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.826+0000 7f7358db0700 1 --2- 172.21.15.123:0/2190483675 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7354101070 0x7f735419bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:03:16.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.826+0000 7f73595b1700 1 --2- 172.21.15.123:0/2190483675 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73540ffe80 0x7f7354069640 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f734400ada0 tx=0x7f734400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:16.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.827+0000 7f73527fc700 1 -- 172.21.15.123:0/2190483675 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734400f070 con 0x7f73540ffe80 2024-06-02T04:03:16.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.827+0000 7f73527fc700 1 -- 172.21.15.123:0/2190483675 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7344007be0 con 0x7f73540ffe80 2024-06-02T04:03:16.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.827+0000 7f735b815700 1 -- 172.21.15.123:0/2190483675 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f735419efa0 con 0x7f73540ffe80 2024-06-02T04:03:16.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.827+0000 7f73527fc700 1 -- 172.21.15.123:0/2190483675 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73440043a0 con 0x7f73540ffe80 2024-06-02T04:03:16.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.827+0000 7f735b815700 1 -- 172.21.15.123:0/2190483675 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f735419f3b0 con 0x7f73540ffe80 2024-06-02T04:03:16.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.828+0000 7f735b815700 1 -- 172.21.15.123:0/2190483675 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7354107390 con 0x7f73540ffe80 2024-06-02T04:03:16.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.829+0000 7f73527fc700 1 -- 172.21.15.123:0/2190483675 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f7344004500 con 0x7f73540ffe80 2024-06-02T04:03:16.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.829+0000 7f73527fc700 1 --2- 172.21.15.123:0/2190483675 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f733c0a11b0 0x7f733c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:16.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.829+0000 7f7358db0700 1 --2- 172.21.15.123:0/2190483675 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f733c0a11b0 0x7f733c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:16.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.830+0000 7f73527fc700 1 -- 172.21.15.123:0/2190483675 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f73440cbf50 con 0x7f73540ffe80 2024-06-02T04:03:16.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.830+0000 7f7358db0700 1 --2- 172.21.15.123:0/2190483675 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f733c0a11b0 0x7f733c0a3670 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7348000c00 tx=0x7f7348005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:16.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:16.834+0000 7f73527fc700 1 -- 172.21.15.123:0/2190483675 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f73440ffd60 con 0x7f73540ffe80 2024-06-02T04:03:17.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:17.104+0000 7f735b815700 1 -- 172.21.15.123:0/2190483675 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f735410b890 con 0x7f73540ffe80 2024-06-02T04:03:17.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:17.107+0000 7f73527fc700 1 -- 172.21.15.123:0/2190483675 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) v1 ==== 170+0+59 (secure 0 0 0) 0x7f73440957c0 con 0x7f73540ffe80 2024-06-02T04:03:17.107 INFO:teuthology.orchestra.run.smithi123.stdout:[client.0] 2024-06-02T04:03:17.107 INFO:teuthology.orchestra.run.smithi123.stdout: key = AQAF71tmpdFKBhAAPRiE4aQmkKx6kw47y973qQ== 2024-06-02T04:03:17.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:17.110+0000 7f735b815700 1 -- 172.21.15.123:0/2190483675 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f733c0a11b0 msgr2=0x7f733c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:17.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:17.110+0000 7f735b815700 1 --2- 172.21.15.123:0/2190483675 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f733c0a11b0 0x7f733c0a3670 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7348000c00 tx=0x7f7348005fd0 comp rx=0 tx=0).stop 2024-06-02T04:03:17.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:17.110+0000 7f735b815700 1 -- 172.21.15.123:0/2190483675 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73540ffe80 msgr2=0x7f7354069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:17.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:17.110+0000 7f735b815700 1 --2- 172.21.15.123:0/2190483675 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73540ffe80 0x7f7354069640 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f734400ada0 tx=0x7f734400c330 comp rx=0 tx=0).stop 2024-06-02T04:03:17.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:17.110+0000 7f735b815700 1 -- 172.21.15.123:0/2190483675 shutdown_connections 2024-06-02T04:03:17.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:17.110+0000 7f735b815700 1 --2- 172.21.15.123:0/2190483675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7354101a30 0x7f735419e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:17.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:17.110+0000 7f735b815700 1 --2- 172.21.15.123:0/2190483675 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f73540ffe80 0x7f7354069640 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:17.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:17.110+0000 7f735b815700 1 --2- 172.21.15.123:0/2190483675 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f733c0a11b0 0x7f733c0a3670 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:17.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:17.110+0000 7f735b815700 1 --2- 172.21.15.123:0/2190483675 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7354101070 0x7f735419bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:17.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:17.110+0000 7f735b815700 1 -- 172.21.15.123:0/2190483675 >> 172.21.15.123:0/2190483675 conn(0x7f73540fb470 msgr2=0x7f73541044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:17.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:17.110+0000 7f735b815700 1 -- 172.21.15.123:0/2190483675 shutdown_connections 2024-06-02T04:03:17.110 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:17.110+0000 7f735b815700 1 -- 172.21.15.123:0/2190483675 wait complete. 2024-06-02T04:03:17.457 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:17 smithi123 ceph-mon[42885]: pgmap v227: 97 pgs: 97 active+clean; 603 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7.7 KiB/s wr, 24 op/s 2024-06-02T04:03:17.524 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-06-02T04:03:17.524 DEBUG:teuthology.orchestra.run.smithi123:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-06-02T04:03:17.524 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-06-02T04:03:17.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:17 smithi162 ceph-mon[47009]: pgmap v227: 97 pgs: 97 active+clean; 603 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7.7 KiB/s wr, 24 op/s 2024-06-02T04:03:17.564 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-06-02T04:03:17.565 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-06-02T04:03:17.565 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph mgr dump --format=json 2024-06-02T04:03:17.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:17 smithi136 ceph-mon[47443]: pgmap v227: 97 pgs: 97 active+clean; 603 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7.7 KiB/s wr, 24 op/s 2024-06-02T04:03:17.822 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:03:18.088 INFO:journalctl@ceph.mds.b.smithi136.stdout:Jun 02 04:03:17 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-b[84767]: 2024-06-02T04:03:17.640+0000 7effd0224700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-06-02T04:03:18.287 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:18 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2190483675' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-02T04:03:18.288 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:18 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2190483675' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-02T04:03:18.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:18 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/2190483675' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-02T04:03:18.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:18 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/2190483675' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-02T04:03:18.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:18 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/2190483675' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-06-02T04:03:18.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:18 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/2190483675' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-06-02T04:03:18.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.856+0000 7fc6fc1d8700 1 -- 172.21.15.123:0/2486573004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6f4106040 msgr2=0x7fc6f4106420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:18.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.856+0000 7fc6fc1d8700 1 --2- 172.21.15.123:0/2486573004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6f4106040 0x7fc6f4106420 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc6f00099c0 tx=0x7fc6f0009cd0 comp rx=0 tx=0).stop 2024-06-02T04:03:18.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.856+0000 7fc6fc1d8700 1 -- 172.21.15.123:0/2486573004 shutdown_connections 2024-06-02T04:03:18.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.856+0000 7fc6fc1d8700 1 --2- 172.21.15.123:0/2486573004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6f4100b80 0x7fc6f410cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:18.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.856+0000 7fc6fc1d8700 1 --2- 172.21.15.123:0/2486573004 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6f4106040 0x7fc6f4106420 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:18.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.856+0000 7fc6fc1d8700 1 --2- 172.21.15.123:0/2486573004 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6f41001c0 0x7fc6f4100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:18.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.856+0000 7fc6fc1d8700 1 -- 172.21.15.123:0/2486573004 >> 172.21.15.123:0/2486573004 conn(0x7fc6f4076c40 msgr2=0x7fc6f4077050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:18.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.856+0000 7fc6fc1d8700 1 -- 172.21.15.123:0/2486573004 shutdown_connections 2024-06-02T04:03:18.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.856+0000 7fc6fc1d8700 1 -- 172.21.15.123:0/2486573004 wait complete. 2024-06-02T04:03:18.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.856+0000 7fc6fc1d8700 1 Processor -- start 2024-06-02T04:03:18.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.856+0000 7fc6fc1d8700 1 -- start start 2024-06-02T04:03:18.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.857+0000 7fc6fc1d8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6f41001c0 0x7fc6f4197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:18.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.857+0000 7fc6fc1d8700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6f4100b80 0x7fc6f4197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:18.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.857+0000 7fc6fc1d8700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6f4106040 0x7fc6f419bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:18.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.857+0000 7fc6fc1d8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f419c320 con 0x7fc6f41001c0 2024-06-02T04:03:18.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.857+0000 7fc6fc1d8700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f419c490 con 0x7fc6f4100b80 2024-06-02T04:03:18.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.857+0000 7fc6fc1d8700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f419c650 con 0x7fc6f4106040 2024-06-02T04:03:18.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.857+0000 7fc6f9f74700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6f41001c0 0x7fc6f4197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:18.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.857+0000 7fc6f9f74700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6f41001c0 0x7fc6f4197420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42382/0 (socket says 172.21.15.123:42382) 2024-06-02T04:03:18.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.857+0000 7fc6f9f74700 1 -- 172.21.15.123:0/3301182951 learned_addr learned my addr 172.21.15.123:0/3301182951 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:18.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.857+0000 7fc6f9f74700 1 -- 172.21.15.123:0/3301182951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6f4106040 msgr2=0x7fc6f419bd10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-06-02T04:03:18.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.857+0000 7fc6f9f74700 1 --2- 172.21.15.123:0/3301182951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6f4106040 0x7fc6f419bd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:18.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.857+0000 7fc6f9f74700 1 -- 172.21.15.123:0/3301182951 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6f4100b80 msgr2=0x7fc6f4197960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:18.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.857+0000 7fc6f9f74700 1 --2- 172.21.15.123:0/3301182951 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6f4100b80 0x7fc6f4197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:18.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.857+0000 7fc6f9f74700 1 -- 172.21.15.123:0/3301182951 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f00095f0 con 0x7fc6f41001c0 2024-06-02T04:03:18.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.857+0000 7fc6f9f74700 1 --2- 172.21.15.123:0/3301182951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6f41001c0 0x7fc6f4197420 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0000c00 tx=0x7fc6f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:18.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.857+0000 7fc6eaffd700 1 -- 172.21.15.123:0/3301182951 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f001d070 con 0x7fc6f41001c0 2024-06-02T04:03:18.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.857+0000 7fc6eaffd700 1 -- 172.21.15.123:0/3301182951 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc6f000fcb0 con 0x7fc6f41001c0 2024-06-02T04:03:18.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.857+0000 7fc6eaffd700 1 -- 172.21.15.123:0/3301182951 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f0022e50 con 0x7fc6f41001c0 2024-06-02T04:03:18.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.857+0000 7fc6fc1d8700 1 -- 172.21.15.123:0/3301182951 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6f419c8d0 con 0x7fc6f41001c0 2024-06-02T04:03:18.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.857+0000 7fc6fc1d8700 1 -- 172.21.15.123:0/3301182951 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f41a4190 con 0x7fc6f41001c0 2024-06-02T04:03:18.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.858+0000 7fc6fc1d8700 1 -- 172.21.15.123:0/3301182951 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f41093f0 con 0x7fc6f41001c0 2024-06-02T04:03:18.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.859+0000 7fc6eaffd700 1 -- 172.21.15.123:0/3301182951 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fc6f0022470 con 0x7fc6f41001c0 2024-06-02T04:03:18.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.860+0000 7fc6eaffd700 1 --2- 172.21.15.123:0/3301182951 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc6e00a1230 0x7fc6e00a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:18.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.860+0000 7fc6f9773700 1 --2- 172.21.15.123:0/3301182951 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc6e00a1230 0x7fc6e00a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:18.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.860+0000 7fc6eaffd700 1 -- 172.21.15.123:0/3301182951 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fc6f00cdaf0 con 0x7fc6f41001c0 2024-06-02T04:03:18.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.860+0000 7fc6f9773700 1 --2- 172.21.15.123:0/3301182951 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc6e00a1230 0x7fc6e00a36f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4005950 tx=0x7fc6e40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:18.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:18.864+0000 7fc6eaffd700 1 -- 172.21.15.123:0/3301182951 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc6f0097360 con 0x7fc6f41001c0 2024-06-02T04:03:19.111 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:19.112+0000 7fc6fc1d8700 1 -- 172.21.15.123:0/3301182951 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fc6f404ec60 con 0x7fc6f41001c0 2024-06-02T04:03:19.116 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:19.116+0000 7fc6eaffd700 1 -- 172.21.15.123:0/3301182951 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+260291 (secure 0 0 0) 0x7fc6f009a980 con 0x7fc6f41001c0 2024-06-02T04:03:19.119 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:03:19.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:19.119+0000 7fc6fc1d8700 1 -- 172.21.15.123:0/3301182951 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc6e00a1230 msgr2=0x7fc6e00a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:19.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:19.119+0000 7fc6fc1d8700 1 --2- 172.21.15.123:0/3301182951 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc6e00a1230 0x7fc6e00a36f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4005950 tx=0x7fc6e40058e0 comp rx=0 tx=0).stop 2024-06-02T04:03:19.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:19.119+0000 7fc6fc1d8700 1 -- 172.21.15.123:0/3301182951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6f41001c0 msgr2=0x7fc6f4197420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:19.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:19.119+0000 7fc6fc1d8700 1 --2- 172.21.15.123:0/3301182951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6f41001c0 0x7fc6f4197420 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0000c00 tx=0x7fc6f00057f0 comp rx=0 tx=0).stop 2024-06-02T04:03:19.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:19.119+0000 7fc6fc1d8700 1 -- 172.21.15.123:0/3301182951 shutdown_connections 2024-06-02T04:03:19.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:19.119+0000 7fc6fc1d8700 1 --2- 172.21.15.123:0/3301182951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6f4106040 0x7fc6f419bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:19.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:19.119+0000 7fc6fc1d8700 1 --2- 172.21.15.123:0/3301182951 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc6f41001c0 0x7fc6f4197420 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:19.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:19.119+0000 7fc6fc1d8700 1 --2- 172.21.15.123:0/3301182951 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc6e00a1230 0x7fc6e00a36f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:19.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:19.119+0000 7fc6fc1d8700 1 --2- 172.21.15.123:0/3301182951 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6f4100b80 0x7fc6f4197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:19.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:19.119+0000 7fc6fc1d8700 1 -- 172.21.15.123:0/3301182951 >> 172.21.15.123:0/3301182951 conn(0x7fc6f4076c40 msgr2=0x7fc6f40698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:19.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:19.119+0000 7fc6fc1d8700 1 -- 172.21.15.123:0/3301182951 shutdown_connections 2024-06-02T04:03:19.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:19.119+0000 7fc6fc1d8700 1 -- 172.21.15.123:0/3301182951 wait complete. 2024-06-02T04:03:19.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:19 smithi123 ceph-mon[42885]: pgmap v228: 97 pgs: 97 active+clean; 626 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 9.8 KiB/s wr, 26 op/s 2024-06-02T04:03:19.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:19 smithi162 ceph-mon[47009]: pgmap v228: 97 pgs: 97 active+clean; 626 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 9.8 KiB/s wr, 26 op/s 2024-06-02T04:03:19.550 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6800","nonce":526143134},{"type":"v1","addr":"172.21.15.123:6801","nonce":526143134}]},"active_addr":"172.21.15.123:6801/526143134","active_change":"2024-06-02T03:58:06.766352+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24115,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24121,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.123:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":286437755}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":4015533888}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":2431972677}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":2789552618}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.123:0","nonce":1899212534}]}]} 2024-06-02T04:03:19.555 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-06-02T04:03:19.555 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-06-02T04:03:19.555 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-02T04:03:19.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:19 smithi136 ceph-mon[47443]: pgmap v228: 97 pgs: 97 active+clean; 626 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 9.8 KiB/s wr, 26 op/s 2024-06-02T04:03:19.779 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:03:20.254 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:20 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/3301182951' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-06-02T04:03:20.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:20 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/3301182951' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-06-02T04:03:20.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:20 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/3301182951' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-06-02T04:03:20.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.821+0000 7f4673c81700 1 -- 172.21.15.123:0/4081462896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f466c105f00 msgr2=0x7f466c1062e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:20.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.821+0000 7f4673c81700 1 --2- 172.21.15.123:0/4081462896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f466c105f00 0x7f466c1062e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4668009990 tx=0x7f4668009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:20.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.822+0000 7f4673c81700 1 -- 172.21.15.123:0/4081462896 shutdown_connections 2024-06-02T04:03:20.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.822+0000 7f4673c81700 1 --2- 172.21.15.123:0/4081462896 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f466c100890 0x7f466c10cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:20.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.822+0000 7f4673c81700 1 --2- 172.21.15.123:0/4081462896 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f466c105f00 0x7f466c1062e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:20.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.822+0000 7f4673c81700 1 --2- 172.21.15.123:0/4081462896 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f466c0ffed0 0x7f466c100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:20.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.822+0000 7f4673c81700 1 -- 172.21.15.123:0/4081462896 >> 172.21.15.123:0/4081462896 conn(0x7f466c075f80 msgr2=0x7f466c076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:20.822 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.822+0000 7f4673c81700 1 -- 172.21.15.123:0/4081462896 shutdown_connections 2024-06-02T04:03:20.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.822+0000 7f4673c81700 1 -- 172.21.15.123:0/4081462896 wait complete. 2024-06-02T04:03:20.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.822+0000 7f4673c81700 1 Processor -- start 2024-06-02T04:03:20.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.822+0000 7f4673c81700 1 -- start start 2024-06-02T04:03:20.824 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.823+0000 7f4673c81700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f466c0ffed0 0x7f466c1981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:20.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.823+0000 7f4673c81700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f466c100890 0x7f466c198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:20.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.823+0000 7f4673c81700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f466c105f00 0x7f466c1a3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:20.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.823+0000 7f4673c81700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466c198fd0 con 0x7f466c0ffed0 2024-06-02T04:03:20.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.823+0000 7f4673c81700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466c1a3790 con 0x7f466c105f00 2024-06-02T04:03:20.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.823+0000 7f4673c81700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466c1a38d0 con 0x7f466c100890 2024-06-02T04:03:20.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.823+0000 7f4671a1d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f466c0ffed0 0x7f466c1981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:20.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.823+0000 7f4671a1d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f466c0ffed0 0x7f466c1981d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42396/0 (socket says 172.21.15.123:42396) 2024-06-02T04:03:20.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.823+0000 7f4671a1d700 1 -- 172.21.15.123:0/579640503 learned_addr learned my addr 172.21.15.123:0/579640503 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:20.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.823+0000 7f467121c700 1 --2- 172.21.15.123:0/579640503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f466c100890 0x7f466c198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:20.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.823+0000 7f467221e700 1 --2- 172.21.15.123:0/579640503 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f466c105f00 0x7f466c1a3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:20.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.823+0000 7f4671a1d700 1 -- 172.21.15.123:0/579640503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f466c100890 msgr2=0x7f466c198710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:20.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.823+0000 7f4671a1d700 1 --2- 172.21.15.123:0/579640503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f466c100890 0x7f466c198710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:20.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.823+0000 7f4671a1d700 1 -- 172.21.15.123:0/579640503 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f466c105f00 msgr2=0x7f466c1a3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:20.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.823+0000 7f4671a1d700 1 --2- 172.21.15.123:0/579640503 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f466c105f00 0x7f466c1a3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:20.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.823+0000 7f4671a1d700 1 -- 172.21.15.123:0/579640503 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46680095f0 con 0x7f466c0ffed0 2024-06-02T04:03:20.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.823+0000 7f4671a1d700 1 --2- 172.21.15.123:0/579640503 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f466c0ffed0 0x7f466c1981d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f46680098e0 tx=0x7f466800f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:20.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.823+0000 7f4662ffd700 1 -- 172.21.15.123:0/579640503 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466801d070 con 0x7f466c0ffed0 2024-06-02T04:03:20.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.824+0000 7f4673c81700 1 -- 172.21.15.123:0/579640503 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f466c1a3af0 con 0x7f466c0ffed0 2024-06-02T04:03:20.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.824+0000 7f4662ffd700 1 -- 172.21.15.123:0/579640503 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4668022470 con 0x7f466c0ffed0 2024-06-02T04:03:20.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.824+0000 7f4662ffd700 1 -- 172.21.15.123:0/579640503 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4668017650 con 0x7f466c0ffed0 2024-06-02T04:03:20.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.824+0000 7f4673c81700 1 -- 172.21.15.123:0/579640503 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f466c1a3f60 con 0x7f466c0ffed0 2024-06-02T04:03:20.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.825+0000 7f4673c81700 1 -- 172.21.15.123:0/579640503 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f466c108420 con 0x7f466c0ffed0 2024-06-02T04:03:20.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.826+0000 7f4662ffd700 1 -- 172.21.15.123:0/579640503 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f46680225e0 con 0x7f466c0ffed0 2024-06-02T04:03:20.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.826+0000 7f4662ffd700 1 --2- 172.21.15.123:0/579640503 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f46580a11b0 0x7f46580a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:20.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.826+0000 7f467121c700 1 --2- 172.21.15.123:0/579640503 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f46580a11b0 0x7f46580a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:20.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.826+0000 7f4662ffd700 1 -- 172.21.15.123:0/579640503 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f46680cd8f0 con 0x7f466c0ffed0 2024-06-02T04:03:20.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.826+0000 7f467121c700 1 --2- 172.21.15.123:0/579640503 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f46580a11b0 0x7f46580a3670 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f466c069160 tx=0x7f465c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:20.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:20.830+0000 7f4662ffd700 1 -- 172.21.15.123:0/579640503 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4668097160 con 0x7f466c0ffed0 2024-06-02T04:03:21.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:21.026+0000 7f4673c81700 1 -- 172.21.15.123:0/579640503 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f466c068f10 con 0x7f466c0ffed0 2024-06-02T04:03:21.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:21.028+0000 7f4662ffd700 1 -- 172.21.15.123:0/579640503 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22175 (secure 0 0 0) 0x7f466809a780 con 0x7f466c0ffed0 2024-06-02T04:03:21.028 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:03:21.028 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":82,"fsid":"1b432ae0-2094-11ef-bc9b-c7b262605968","created":"2024-06-02T03:57:17.383774+0000","modified":"2024-06-02T04:03:07.669997+0000","last_up_change":"2024-06-02T04:02:34.535591+0000","last_in_change":"2024-06-02T04:02:18.346560+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T03:59:57.079448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:03:05.199881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:03:05.853741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d9d8fb5a-dac5-4b14-98e5-665bdbc696ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6803","nonce":2763421276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6805","nonce":2763421276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6809","nonce":2763421276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6807","nonce":2763421276}]},"public_addr":"172.21.15.123:6803/2763421276","cluster_addr":"172.21.15.123:6805/2763421276","heartbeat_back_addr":"172.21.15.123:6809/2763421276","heartbeat_front_addr":"172.21.15.123:6807/2763421276","state":["exists","up"]},{"osd":1,"uuid":"121bbe3c-bb76-4ec4-9596-37db68fbf1ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6801","nonce":956325510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6803","nonce":956325510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6807","nonce":956325510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6805","nonce":956325510}]},"public_addr":"172.21.15.136:6801/956325510","cluster_addr":"172.21.15.136:6803/956325510","heartbeat_back_addr":"172.21.15.136:6807/956325510","heartbeat_front_addr":"172.21.15.136:6805/956325510","state":["exists","up"]},{"osd":2,"uuid":"df9edf0d-f9f0-4699-a6ed-bbcf2dfb1b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6801","nonce":2915749676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6803","nonce":2915749676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6807","nonce":2915749676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6805","nonce":2915749676}]},"public_addr":"172.21.15.162:6801/2915749676","cluster_addr":"172.21.15.162:6803/2915749676","heartbeat_back_addr":"172.21.15.162:6807/2915749676","heartbeat_front_addr":"172.21.15.162:6805/2915749676","state":["exists","up"]},{"osd":3,"uuid":"3e070364-12c6-4780-b2be-f6e933e65773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6811","nonce":1403773143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6813","nonce":1403773143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6817","nonce":1403773143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6815","nonce":1403773143}]},"public_addr":"172.21.15.123:6811/1403773143","cluster_addr":"172.21.15.123:6813/1403773143","heartbeat_back_addr":"172.21.15.123:6817/1403773143","heartbeat_front_addr":"172.21.15.123:6815/1403773143","state":["exists","up"]},{"osd":4,"uuid":"87dd92dd-73c8-4785-bf8a-3756d79dee90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6809","nonce":1403526782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6811","nonce":1403526782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6815","nonce":1403526782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6813","nonce":1403526782}]},"public_addr":"172.21.15.136:6809/1403526782","cluster_addr":"172.21.15.136:6811/1403526782","heartbeat_back_addr":"172.21.15.136:6815/1403526782","heartbeat_front_addr":"172.21.15.136:6813/1403526782","state":["exists","up"]},{"osd":5,"uuid":"1a730863-6b56-43b7-a115-c80d3c8f3ee3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6809","nonce":3094256489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6811","nonce":3094256489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6815","nonce":3094256489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6813","nonce":3094256489}]},"public_addr":"172.21.15.162:6809/3094256489","cluster_addr":"172.21.15.162:6811/3094256489","heartbeat_back_addr":"172.21.15.162:6815/3094256489","heartbeat_front_addr":"172.21.15.162:6813/3094256489","state":["exists","up"]},{"osd":6,"uuid":"6f170b85-6c47-49ff-ba5b-7fe0596a4ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6819","nonce":3025820432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6821","nonce":3025820432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6825","nonce":3025820432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6823","nonce":3025820432}]},"public_addr":"172.21.15.123:6819/3025820432","cluster_addr":"172.21.15.123:6821/3025820432","heartbeat_back_addr":"172.21.15.123:6825/3025820432","heartbeat_front_addr":"172.21.15.123:6823/3025820432","state":["exists","up"]},{"osd":7,"uuid":"ee66bb7a-6c0d-4e5a-b717-258a39f93a87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6817","nonce":1948829505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6819","nonce":1948829505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6823","nonce":1948829505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6821","nonce":1948829505}]},"public_addr":"172.21.15.136:6817/1948829505","cluster_addr":"172.21.15.136:6819/1948829505","heartbeat_back_addr":"172.21.15.136:6823/1948829505","heartbeat_front_addr":"172.21.15.136:6821/1948829505","state":["exists","up"]},{"osd":8,"uuid":"0ff77e33-53a5-43ef-85da-2036a1fcdb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6817","nonce":1590839230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6819","nonce":1590839230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6823","nonce":1590839230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6821","nonce":1590839230}]},"public_addr":"172.21.15.162:6817/1590839230","cluster_addr":"172.21.15.162:6819/1590839230","heartbeat_back_addr":"172.21.15.162:6823/1590839230","heartbeat_front_addr":"172.21.15.162:6821/1590839230","state":["exists","up"]},{"osd":9,"uuid":"1670731c-5e8f-4cbc-8f35-6aeb14ea3075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6827","nonce":608720685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6829","nonce":608720685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6833","nonce":608720685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6831","nonce":608720685}]},"public_addr":"172.21.15.123:6827/608720685","cluster_addr":"172.21.15.123:6829/608720685","heartbeat_back_addr":"172.21.15.123:6833/608720685","heartbeat_front_addr":"172.21.15.123:6831/608720685","state":["exists","up"]},{"osd":10,"uuid":"ae138b96-13e7-46ac-9d4d-48308132465d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6825","nonce":3777263126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6827","nonce":3777263126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6831","nonce":3777263126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6829","nonce":3777263126}]},"public_addr":"172.21.15.136:6825/3777263126","cluster_addr":"172.21.15.136:6827/3777263126","heartbeat_back_addr":"172.21.15.136:6831/3777263126","heartbeat_front_addr":"172.21.15.136:6829/3777263126","state":["exists","up"]},{"osd":11,"uuid":"69f4ede0-7e9b-4edb-be54-01f74f002a06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6825","nonce":704809754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6827","nonce":704809754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6831","nonce":704809754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6829","nonce":704809754}]},"public_addr":"172.21.15.162:6825/704809754","cluster_addr":"172.21.15.162:6827/704809754","heartbeat_back_addr":"172.21.15.162:6831/704809754","heartbeat_front_addr":"172.21.15.162:6829/704809754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:19.188506+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:36.535261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:54.242294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:11.815314+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:29.512086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:46.874319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:04.437358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:22.312520+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:39.917998+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:57.340043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:15.252797+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:32.898924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:0/69783025":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/10165744":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/2081407856":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/4026642298":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/1442330765":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/1595718606":"2024-06-03T03:57:45.611046+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:03:21.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:21.030+0000 7f4673c81700 1 -- 172.21.15.123:0/579640503 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f46580a11b0 msgr2=0x7f46580a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:21.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:21.030+0000 7f4673c81700 1 --2- 172.21.15.123:0/579640503 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f46580a11b0 0x7f46580a3670 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f466c069160 tx=0x7f465c00b410 comp rx=0 tx=0).stop 2024-06-02T04:03:21.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:21.030+0000 7f4673c81700 1 -- 172.21.15.123:0/579640503 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f466c0ffed0 msgr2=0x7f466c1981d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:21.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:21.030+0000 7f4673c81700 1 --2- 172.21.15.123:0/579640503 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f466c0ffed0 0x7f466c1981d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f46680098e0 tx=0x7f466800f670 comp rx=0 tx=0).stop 2024-06-02T04:03:21.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:21.030+0000 7f4673c81700 1 -- 172.21.15.123:0/579640503 shutdown_connections 2024-06-02T04:03:21.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:21.030+0000 7f4673c81700 1 --2- 172.21.15.123:0/579640503 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f46580a11b0 0x7f46580a3670 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:21.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:21.030+0000 7f4673c81700 1 --2- 172.21.15.123:0/579640503 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f466c105f00 0x7f466c1a3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:21.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:21.030+0000 7f4673c81700 1 --2- 172.21.15.123:0/579640503 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f466c0ffed0 0x7f466c1981d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:21.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:21.030+0000 7f4673c81700 1 --2- 172.21.15.123:0/579640503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f466c100890 0x7f466c198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:21.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:21.030+0000 7f4673c81700 1 -- 172.21.15.123:0/579640503 >> 172.21.15.123:0/579640503 conn(0x7f466c075f80 msgr2=0x7f466c0fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:21.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:21.030+0000 7f4673c81700 1 -- 172.21.15.123:0/579640503 shutdown_connections 2024-06-02T04:03:21.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:21.030+0000 7f4673c81700 1 -- 172.21.15.123:0/579640503 wait complete. 2024-06-02T04:03:21.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:21 smithi123 ceph-mon[42885]: pgmap v229: 97 pgs: 97 active+clean; 626 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 8.8 KiB/s wr, 24 op/s 2024-06-02T04:03:21.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:21 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/579640503' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:03:21.449 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-06-02T04:03:21.450 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-06-02T04:03:21.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:21 smithi162 ceph-mon[47009]: pgmap v229: 97 pgs: 97 active+clean; 626 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 8.8 KiB/s wr, 24 op/s 2024-06-02T04:03:21.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:21 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/579640503' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:03:21.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:21 smithi136 ceph-mon[47443]: pgmap v229: 97 pgs: 97 active+clean; 626 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 8.8 KiB/s wr, 24 op/s 2024-06-02T04:03:21.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:21 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/579640503' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:03:21.672 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:03:22.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.596+0000 7f1096baa700 1 -- 172.21.15.123:0/1974496792 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10900692f0 msgr2=0x7f109010de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:22.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.596+0000 7f1096baa700 1 --2- 172.21.15.123:0/1974496792 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10900692f0 0x7f109010de60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f108800b0a0 tx=0x7f108800b3b0 comp rx=0 tx=0).stop 2024-06-02T04:03:22.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.596+0000 7f1096baa700 1 -- 172.21.15.123:0/1974496792 shutdown_connections 2024-06-02T04:03:22.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.596+0000 7f1096baa700 1 --2- 172.21.15.123:0/1974496792 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f10900692f0 0x7f109010de60 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:22.596 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.596+0000 7f1096baa700 1 --2- 172.21.15.123:0/1974496792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1090107020 0x7f1090107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:22.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.596+0000 7f1096baa700 1 --2- 172.21.15.123:0/1974496792 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1090068950 0x7f1090068db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:22.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.596+0000 7f1096baa700 1 -- 172.21.15.123:0/1974496792 >> 172.21.15.123:0/1974496792 conn(0x7f1090075f80 msgr2=0x7f1090076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:22.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.596+0000 7f1096baa700 1 -- 172.21.15.123:0/1974496792 shutdown_connections 2024-06-02T04:03:22.597 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.596+0000 7f1096baa700 1 -- 172.21.15.123:0/1974496792 wait complete. 2024-06-02T04:03:22.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.597+0000 7f1096baa700 1 Processor -- start 2024-06-02T04:03:22.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.597+0000 7f1096baa700 1 -- start start 2024-06-02T04:03:22.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.597+0000 7f1096baa700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1090068950 0x7f10900fffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:22.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.597+0000 7f1096baa700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10900692f0 0x7f10901004e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:22.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.597+0000 7f1096baa700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1090107020 0x7f1090100a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:22.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.597+0000 7f1096baa700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10901a5980 con 0x7f1090068950 2024-06-02T04:03:22.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.597+0000 7f1096baa700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10901a5af0 con 0x7f10900692f0 2024-06-02T04:03:22.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.597+0000 7f1096baa700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10901a5cb0 con 0x7f1090107020 2024-06-02T04:03:22.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.597+0000 7f1094946700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1090068950 0x7f10900fffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:22.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.597+0000 7f1094946700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1090068950 0x7f10900fffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42406/0 (socket says 172.21.15.123:42406) 2024-06-02T04:03:22.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.597+0000 7f1094946700 1 -- 172.21.15.123:0/1490974675 learned_addr learned my addr 172.21.15.123:0/1490974675 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:22.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.597+0000 7f108ffff700 1 --2- 172.21.15.123:0/1490974675 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10900692f0 0x7f10901004e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:22.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.597+0000 7f1095147700 1 --2- 172.21.15.123:0/1490974675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1090107020 0x7f1090100a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:22.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.597+0000 7f1094946700 1 -- 172.21.15.123:0/1490974675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1090107020 msgr2=0x7f1090100a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:22.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.597+0000 7f1094946700 1 --2- 172.21.15.123:0/1490974675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1090107020 0x7f1090100a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:22.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.597+0000 7f1094946700 1 -- 172.21.15.123:0/1490974675 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10900692f0 msgr2=0x7f10901004e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:22.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.597+0000 7f1094946700 1 --2- 172.21.15.123:0/1490974675 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10900692f0 0x7f10901004e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:22.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.597+0000 7f1094946700 1 -- 172.21.15.123:0/1490974675 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1088009d00 con 0x7f1090068950 2024-06-02T04:03:22.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.598+0000 7f1094946700 1 --2- 172.21.15.123:0/1490974675 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1090068950 0x7f10900fffa0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f108400d980 tx=0x7f108400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:22.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.598+0000 7f108dffb700 1 -- 172.21.15.123:0/1490974675 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1084004220 con 0x7f1090068950 2024-06-02T04:03:22.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.598+0000 7f108dffb700 1 -- 172.21.15.123:0/1490974675 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1084007640 con 0x7f1090068950 2024-06-02T04:03:22.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.598+0000 7f1096baa700 1 -- 172.21.15.123:0/1490974675 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10901a5f90 con 0x7f1090068950 2024-06-02T04:03:22.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.598+0000 7f108dffb700 1 -- 172.21.15.123:0/1490974675 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1084005690 con 0x7f1090068950 2024-06-02T04:03:22.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.598+0000 7f1096baa700 1 -- 172.21.15.123:0/1490974675 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10901a6400 con 0x7f1090068950 2024-06-02T04:03:22.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.599+0000 7f1096baa700 1 -- 172.21.15.123:0/1490974675 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1090109540 con 0x7f1090068950 2024-06-02T04:03:22.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.600+0000 7f108dffb700 1 -- 172.21.15.123:0/1490974675 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f1084004750 con 0x7f1090068950 2024-06-02T04:03:22.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.601+0000 7f108dffb700 1 --2- 172.21.15.123:0/1490974675 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f10800a11b0 0x7f10800a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:22.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.601+0000 7f108ffff700 1 --2- 172.21.15.123:0/1490974675 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f10800a11b0 0x7f10800a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:22.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.601+0000 7f108dffb700 1 -- 172.21.15.123:0/1490974675 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f10840ccbb0 con 0x7f1090068950 2024-06-02T04:03:22.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.601+0000 7f108ffff700 1 --2- 172.21.15.123:0/1490974675 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f10800a11b0 0x7f10800a3670 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f10901016d0 tx=0x7f107c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:22.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.604+0000 7f108dffb700 1 -- 172.21.15.123:0/1490974675 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1084096290 con 0x7f1090068950 2024-06-02T04:03:22.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.805+0000 7f1096baa700 1 -- 172.21.15.123:0/1490974675 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1090101480 con 0x7f1090068950 2024-06-02T04:03:22.806 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.806+0000 7f108dffb700 1 -- 172.21.15.123:0/1490974675 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22175 (secure 0 0 0) 0x7f1084016020 con 0x7f1090068950 2024-06-02T04:03:22.807 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:03:22.807 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":82,"fsid":"1b432ae0-2094-11ef-bc9b-c7b262605968","created":"2024-06-02T03:57:17.383774+0000","modified":"2024-06-02T04:03:07.669997+0000","last_up_change":"2024-06-02T04:02:34.535591+0000","last_in_change":"2024-06-02T04:02:18.346560+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T03:59:57.079448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:03:05.199881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:03:05.853741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d9d8fb5a-dac5-4b14-98e5-665bdbc696ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6803","nonce":2763421276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6805","nonce":2763421276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6809","nonce":2763421276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6807","nonce":2763421276}]},"public_addr":"172.21.15.123:6803/2763421276","cluster_addr":"172.21.15.123:6805/2763421276","heartbeat_back_addr":"172.21.15.123:6809/2763421276","heartbeat_front_addr":"172.21.15.123:6807/2763421276","state":["exists","up"]},{"osd":1,"uuid":"121bbe3c-bb76-4ec4-9596-37db68fbf1ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6801","nonce":956325510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6803","nonce":956325510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6807","nonce":956325510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6805","nonce":956325510}]},"public_addr":"172.21.15.136:6801/956325510","cluster_addr":"172.21.15.136:6803/956325510","heartbeat_back_addr":"172.21.15.136:6807/956325510","heartbeat_front_addr":"172.21.15.136:6805/956325510","state":["exists","up"]},{"osd":2,"uuid":"df9edf0d-f9f0-4699-a6ed-bbcf2dfb1b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6801","nonce":2915749676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6803","nonce":2915749676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6807","nonce":2915749676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6805","nonce":2915749676}]},"public_addr":"172.21.15.162:6801/2915749676","cluster_addr":"172.21.15.162:6803/2915749676","heartbeat_back_addr":"172.21.15.162:6807/2915749676","heartbeat_front_addr":"172.21.15.162:6805/2915749676","state":["exists","up"]},{"osd":3,"uuid":"3e070364-12c6-4780-b2be-f6e933e65773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6811","nonce":1403773143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6813","nonce":1403773143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6817","nonce":1403773143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6815","nonce":1403773143}]},"public_addr":"172.21.15.123:6811/1403773143","cluster_addr":"172.21.15.123:6813/1403773143","heartbeat_back_addr":"172.21.15.123:6817/1403773143","heartbeat_front_addr":"172.21.15.123:6815/1403773143","state":["exists","up"]},{"osd":4,"uuid":"87dd92dd-73c8-4785-bf8a-3756d79dee90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6809","nonce":1403526782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6811","nonce":1403526782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6815","nonce":1403526782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6813","nonce":1403526782}]},"public_addr":"172.21.15.136:6809/1403526782","cluster_addr":"172.21.15.136:6811/1403526782","heartbeat_back_addr":"172.21.15.136:6815/1403526782","heartbeat_front_addr":"172.21.15.136:6813/1403526782","state":["exists","up"]},{"osd":5,"uuid":"1a730863-6b56-43b7-a115-c80d3c8f3ee3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6809","nonce":3094256489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6811","nonce":3094256489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6815","nonce":3094256489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6813","nonce":3094256489}]},"public_addr":"172.21.15.162:6809/3094256489","cluster_addr":"172.21.15.162:6811/3094256489","heartbeat_back_addr":"172.21.15.162:6815/3094256489","heartbeat_front_addr":"172.21.15.162:6813/3094256489","state":["exists","up"]},{"osd":6,"uuid":"6f170b85-6c47-49ff-ba5b-7fe0596a4ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6819","nonce":3025820432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6821","nonce":3025820432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6825","nonce":3025820432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6823","nonce":3025820432}]},"public_addr":"172.21.15.123:6819/3025820432","cluster_addr":"172.21.15.123:6821/3025820432","heartbeat_back_addr":"172.21.15.123:6825/3025820432","heartbeat_front_addr":"172.21.15.123:6823/3025820432","state":["exists","up"]},{"osd":7,"uuid":"ee66bb7a-6c0d-4e5a-b717-258a39f93a87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6817","nonce":1948829505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6819","nonce":1948829505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6823","nonce":1948829505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6821","nonce":1948829505}]},"public_addr":"172.21.15.136:6817/1948829505","cluster_addr":"172.21.15.136:6819/1948829505","heartbeat_back_addr":"172.21.15.136:6823/1948829505","heartbeat_front_addr":"172.21.15.136:6821/1948829505","state":["exists","up"]},{"osd":8,"uuid":"0ff77e33-53a5-43ef-85da-2036a1fcdb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6817","nonce":1590839230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6819","nonce":1590839230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6823","nonce":1590839230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6821","nonce":1590839230}]},"public_addr":"172.21.15.162:6817/1590839230","cluster_addr":"172.21.15.162:6819/1590839230","heartbeat_back_addr":"172.21.15.162:6823/1590839230","heartbeat_front_addr":"172.21.15.162:6821/1590839230","state":["exists","up"]},{"osd":9,"uuid":"1670731c-5e8f-4cbc-8f35-6aeb14ea3075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6827","nonce":608720685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6829","nonce":608720685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6833","nonce":608720685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6831","nonce":608720685}]},"public_addr":"172.21.15.123:6827/608720685","cluster_addr":"172.21.15.123:6829/608720685","heartbeat_back_addr":"172.21.15.123:6833/608720685","heartbeat_front_addr":"172.21.15.123:6831/608720685","state":["exists","up"]},{"osd":10,"uuid":"ae138b96-13e7-46ac-9d4d-48308132465d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6825","nonce":3777263126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6827","nonce":3777263126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6831","nonce":3777263126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6829","nonce":3777263126}]},"public_addr":"172.21.15.136:6825/3777263126","cluster_addr":"172.21.15.136:6827/3777263126","heartbeat_back_addr":"172.21.15.136:6831/3777263126","heartbeat_front_addr":"172.21.15.136:6829/3777263126","state":["exists","up"]},{"osd":11,"uuid":"69f4ede0-7e9b-4edb-be54-01f74f002a06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6825","nonce":704809754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6827","nonce":704809754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6831","nonce":704809754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6829","nonce":704809754}]},"public_addr":"172.21.15.162:6825/704809754","cluster_addr":"172.21.15.162:6827/704809754","heartbeat_back_addr":"172.21.15.162:6831/704809754","heartbeat_front_addr":"172.21.15.162:6829/704809754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:19.188506+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:36.535261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:54.242294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:11.815314+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:29.512086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:46.874319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:04.437358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:22.312520+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:39.917998+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:57.340043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:15.252797+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:32.898924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:0/69783025":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/10165744":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/2081407856":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/4026642298":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/1442330765":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/1595718606":"2024-06-03T03:57:45.611046+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:03:22.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.808+0000 7f1096baa700 1 -- 172.21.15.123:0/1490974675 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f10800a11b0 msgr2=0x7f10800a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:22.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.808+0000 7f1096baa700 1 --2- 172.21.15.123:0/1490974675 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f10800a11b0 0x7f10800a3670 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f10901016d0 tx=0x7f107c00b410 comp rx=0 tx=0).stop 2024-06-02T04:03:22.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.808+0000 7f1096baa700 1 -- 172.21.15.123:0/1490974675 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1090068950 msgr2=0x7f10900fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:22.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.808+0000 7f1096baa700 1 --2- 172.21.15.123:0/1490974675 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1090068950 0x7f10900fffa0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f108400d980 tx=0x7f108400dc90 comp rx=0 tx=0).stop 2024-06-02T04:03:22.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.809+0000 7f1096baa700 1 -- 172.21.15.123:0/1490974675 shutdown_connections 2024-06-02T04:03:22.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.809+0000 7f1096baa700 1 --2- 172.21.15.123:0/1490974675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1090107020 0x7f1090100a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:22.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.809+0000 7f1096baa700 1 --2- 172.21.15.123:0/1490974675 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1090068950 0x7f10900fffa0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:22.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.809+0000 7f1096baa700 1 --2- 172.21.15.123:0/1490974675 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f10800a11b0 0x7f10800a3670 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:22.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.809+0000 7f1096baa700 1 --2- 172.21.15.123:0/1490974675 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f10900692f0 0x7f10901004e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:22.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.809+0000 7f1096baa700 1 -- 172.21.15.123:0/1490974675 >> 172.21.15.123:0/1490974675 conn(0x7f1090075f80 msgr2=0x7f10900fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:22.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.809+0000 7f1096baa700 1 -- 172.21.15.123:0/1490974675 shutdown_connections 2024-06-02T04:03:22.809 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:22.809+0000 7f1096baa700 1 -- 172.21.15.123:0/1490974675 wait complete. 2024-06-02T04:03:23.140 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:22 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1490974675' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:03:23.160 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-06-02T04:03:23.160 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-06-02T04:03:23.161 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-06-02T04:03:23.161 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-06-02T04:03:23.162 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-06-02T04:03:23.162 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-06-02T04:03:23.162 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-06-02T04:03:23.163 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-06-02T04:03:23.163 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-06-02T04:03:23.164 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-06-02T04:03:23.164 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-06-02T04:03:23.165 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-06-02T04:03:23.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:22 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/1490974675' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:03:23.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:22 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/1490974675' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:03:23.973 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:03:24.143 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:23 smithi123 ceph-mon[42885]: pgmap v230: 97 pgs: 97 active+clean; 626 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 8.6 KiB/s wr, 24 op/s 2024-06-02T04:03:24.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:23 smithi162 ceph-mon[47009]: pgmap v230: 97 pgs: 97 active+clean; 626 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 8.6 KiB/s wr, 24 op/s 2024-06-02T04:03:24.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:23 smithi136 ceph-mon[47443]: pgmap v230: 97 pgs: 97 active+clean; 626 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 8.6 KiB/s wr, 24 op/s 2024-06-02T04:03:25.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.186+0000 7fd2be46b700 1 -- 172.21.15.123:0/3352889289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2b8107020 msgr2=0x7fd2b8107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:25.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.186+0000 7fd2be46b700 1 --2- 172.21.15.123:0/3352889289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2b8107020 0x7fd2b8107400 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd2a80099c0 tx=0x7fd2a8009cd0 comp rx=0 tx=0).stop 2024-06-02T04:03:25.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.186+0000 7fd2be46b700 1 -- 172.21.15.123:0/3352889289 shutdown_connections 2024-06-02T04:03:25.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.186+0000 7fd2be46b700 1 --2- 172.21.15.123:0/3352889289 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2b80692f0 0x7fd2b810de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:25.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.186+0000 7fd2be46b700 1 --2- 172.21.15.123:0/3352889289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2b8107020 0x7fd2b8107400 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:25.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.186+0000 7fd2be46b700 1 --2- 172.21.15.123:0/3352889289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2b8068950 0x7fd2b8068db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:25.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.186+0000 7fd2be46b700 1 -- 172.21.15.123:0/3352889289 >> 172.21.15.123:0/3352889289 conn(0x7fd2b8075f80 msgr2=0x7fd2b8076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:25.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.186+0000 7fd2be46b700 1 -- 172.21.15.123:0/3352889289 shutdown_connections 2024-06-02T04:03:25.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.186+0000 7fd2be46b700 1 -- 172.21.15.123:0/3352889289 wait complete. 2024-06-02T04:03:25.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.187+0000 7fd2be46b700 1 Processor -- start 2024-06-02T04:03:25.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.187+0000 7fd2be46b700 1 -- start start 2024-06-02T04:03:25.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.188+0000 7fd2be46b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2b8068950 0x7fd2b81a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:25.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.188+0000 7fd2be46b700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2b80692f0 0x7fd2b81a3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:25.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.188+0000 7fd2be46b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2b8107020 0x7fd2b810cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:25.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.188+0000 7fd2be46b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b810d340 con 0x7fd2b8107020 2024-06-02T04:03:25.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.188+0000 7fd2be46b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b810d4b0 con 0x7fd2b8068950 2024-06-02T04:03:25.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.188+0000 7fd2be46b700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b810d670 con 0x7fd2b80692f0 2024-06-02T04:03:25.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.188+0000 7fd2bca08700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2b8107020 0x7fd2b810cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:25.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.188+0000 7fd2bca08700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2b8107020 0x7fd2b810cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46288/0 (socket says 172.21.15.123:46288) 2024-06-02T04:03:25.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.188+0000 7fd2bca08700 1 -- 172.21.15.123:0/2121521071 learned_addr learned my addr 172.21.15.123:0/2121521071 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:25.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.188+0000 7fd2b7fff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2b8068950 0x7fd2b81a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:25.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.188+0000 7fd2b77fe700 1 --2- 172.21.15.123:0/2121521071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2b80692f0 0x7fd2b81a3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:25.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.188+0000 7fd2bca08700 1 -- 172.21.15.123:0/2121521071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2b80692f0 msgr2=0x7fd2b81a3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:25.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.188+0000 7fd2bca08700 1 --2- 172.21.15.123:0/2121521071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2b80692f0 0x7fd2b81a3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:25.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.188+0000 7fd2bca08700 1 -- 172.21.15.123:0/2121521071 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2b8068950 msgr2=0x7fd2b81a3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:25.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.188+0000 7fd2bca08700 1 --2- 172.21.15.123:0/2121521071 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2b8068950 0x7fd2b81a3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:25.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.188+0000 7fd2bca08700 1 -- 172.21.15.123:0/2121521071 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a80095f0 con 0x7fd2b8107020 2024-06-02T04:03:25.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.188+0000 7fd2b77fe700 1 --2- 172.21.15.123:0/2121521071 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2b80692f0 0x7fd2b81a3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:03:25.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.189+0000 7fd2bca08700 1 --2- 172.21.15.123:0/2121521071 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2b8107020 0x7fd2b810cc90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0007ee0 tx=0x7fd2b000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:25.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.189+0000 7fd2b57fa700 1 -- 172.21.15.123:0/2121521071 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0017070 con 0x7fd2b8107020 2024-06-02T04:03:25.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.189+0000 7fd2b57fa700 1 -- 172.21.15.123:0/2121521071 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd2b000f040 con 0x7fd2b8107020 2024-06-02T04:03:25.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.189+0000 7fd2b57fa700 1 -- 172.21.15.123:0/2121521071 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b0005740 con 0x7fd2b8107020 2024-06-02T04:03:25.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.189+0000 7fd2be46b700 1 -- 172.21.15.123:0/2121521071 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b810d950 con 0x7fd2b8107020 2024-06-02T04:03:25.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.189+0000 7fd2be46b700 1 -- 172.21.15.123:0/2121521071 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b81aa640 con 0x7fd2b8107020 2024-06-02T04:03:25.191 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:03:25.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.190+0000 7fd2be46b700 1 -- 172.21.15.123:0/2121521071 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd2b8111160 con 0x7fd2b8107020 2024-06-02T04:03:25.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.192+0000 7fd2b57fa700 1 -- 172.21.15.123:0/2121521071 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fd2b000dc60 con 0x7fd2b8107020 2024-06-02T04:03:25.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.193+0000 7fd2b57fa700 1 --2- 172.21.15.123:0/2121521071 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd2a40a1230 0x7fd2a40a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:25.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.193+0000 7fd2b57fa700 1 -- 172.21.15.123:0/2121521071 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd2b00cbff0 con 0x7fd2b8107020 2024-06-02T04:03:25.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.193+0000 7fd2b7fff700 1 --2- 172.21.15.123:0/2121521071 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd2a40a1230 0x7fd2a40a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:25.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.193+0000 7fd2b57fa700 1 --2- 172.21.15.123:0/2121521071 >> [v2:172.21.15.136:6808/1403526782,v1:172.21.15.136:6809/1403526782] conn(0x7fd2a40aaa10 0x7fd2a40ace30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:25.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.193+0000 7fd2b57fa700 1 -- 172.21.15.123:0/2121521071 --> [v2:172.21.15.136:6808/1403526782,v1:172.21.15.136:6809/1403526782] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd2a40ad4e0 con 0x7fd2a40aaa10 2024-06-02T04:03:25.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.193+0000 7fd2b57fa700 1 -- 172.21.15.123:0/2121521071 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2b00ce700 con 0x7fd2b8107020 2024-06-02T04:03:25.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.193+0000 7fd2b7fff700 1 --2- 172.21.15.123:0/2121521071 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd2a40a1230 0x7fd2a40a36f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8009990 tx=0x7fd2a8003680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:25.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.196+0000 7fd2b77fe700 1 --2- 172.21.15.123:0/2121521071 >> [v2:172.21.15.136:6808/1403526782,v1:172.21.15.136:6809/1403526782] conn(0x7fd2a40aaa10 0x7fd2a40ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:25.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.196+0000 7fd2b77fe700 1 --2- 172.21.15.123:0/2121521071 >> [v2:172.21.15.136:6808/1403526782,v1:172.21.15.136:6809/1403526782] conn(0x7fd2a40aaa10 0x7fd2a40ace30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:25.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.197+0000 7fd2b57fa700 1 -- 172.21.15.123:0/2121521071 <== osd.4 v2:172.21.15.136:6808/1403526782 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd2a40ad4e0 con 0x7fd2a40aaa10 2024-06-02T04:03:25.214 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.214+0000 7fd2be46b700 1 -- 172.21.15.123:0/2121521071 --> [v2:172.21.15.136:6808/1403526782,v1:172.21.15.136:6809/1403526782] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd2b80ff410 con 0x7fd2a40aaa10 2024-06-02T04:03:25.215 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.214+0000 7fd2b57fa700 1 -- 172.21.15.123:0/2121521071 <== osd.4 v2:172.21.15.136:6808/1403526782 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd2b80ff410 con 0x7fd2a40aaa10 2024-06-02T04:03:25.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.215+0000 7fd2be46b700 1 -- 172.21.15.123:0/2121521071 >> [v2:172.21.15.136:6808/1403526782,v1:172.21.15.136:6809/1403526782] conn(0x7fd2a40aaa10 msgr2=0x7fd2a40ace30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:25.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.215+0000 7fd2be46b700 1 --2- 172.21.15.123:0/2121521071 >> [v2:172.21.15.136:6808/1403526782,v1:172.21.15.136:6809/1403526782] conn(0x7fd2a40aaa10 0x7fd2a40ace30 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:25.216 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.215+0000 7fd2be46b700 1 -- 172.21.15.123:0/2121521071 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd2a40a1230 msgr2=0x7fd2a40a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:25.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.215+0000 7fd2be46b700 1 --2- 172.21.15.123:0/2121521071 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd2a40a1230 0x7fd2a40a36f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8009990 tx=0x7fd2a8003680 comp rx=0 tx=0).stop 2024-06-02T04:03:25.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.215+0000 7fd2be46b700 1 -- 172.21.15.123:0/2121521071 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2b8107020 msgr2=0x7fd2b810cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:25.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.215+0000 7fd2be46b700 1 --2- 172.21.15.123:0/2121521071 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd2b8107020 0x7fd2b810cc90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0007ee0 tx=0x7fd2b000d3b0 comp rx=0 tx=0).stop 2024-06-02T04:03:25.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.215+0000 7fd2bca08700 1 -- 172.21.15.123:0/2121521071 reap_dead start 2024-06-02T04:03:25.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.215+0000 7fd2be46b700 1 -- 172.21.15.123:0/2121521071 shutdown_connections 2024-06-02T04:03:25.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.215+0000 7fd2be46b700 1 -- 172.21.15.123:0/2121521071 >> 172.21.15.123:0/2121521071 conn(0x7fd2b8075f80 msgr2=0x7fd2b80fea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:25.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.215+0000 7fd2be46b700 1 -- 172.21.15.123:0/2121521071 shutdown_connections 2024-06-02T04:03:25.218 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:25.215+0000 7fd2be46b700 1 -- 172.21.15.123:0/2121521071 wait complete. 2024-06-02T04:03:25.834 INFO:teuthology.orchestra.run.smithi123.stdout:137438953510 2024-06-02T04:03:25.834 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-06-02T04:03:26.095 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:03:26.096 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:03:26.096 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:03:26.114 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:25 smithi123 ceph-mon[42885]: pgmap v231: 97 pgs: 97 active+clean; 638 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.2 KiB/s wr, 24 op/s 2024-06-02T04:03:26.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:25 smithi162 ceph-mon[47009]: pgmap v231: 97 pgs: 97 active+clean; 638 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.2 KiB/s wr, 24 op/s 2024-06-02T04:03:26.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:25 smithi136 ceph-mon[47443]: pgmap v231: 97 pgs: 97 active+clean; 638 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.2 KiB/s wr, 24 op/s 2024-06-02T04:03:26.802 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:03:27.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.887+0000 7fd4f1d80700 1 -- 172.21.15.123:0/542771641 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4ec068950 msgr2=0x7fd4ec068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:27.910 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.887+0000 7fd4f1d80700 1 --2- 172.21.15.123:0/542771641 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4ec068950 0x7fd4ec068db0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd4e00099c0 tx=0x7fd4e0009cd0 comp rx=0 tx=0).stop 2024-06-02T04:03:27.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.888+0000 7fd4f1d80700 1 -- 172.21.15.123:0/542771641 shutdown_connections 2024-06-02T04:03:27.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.888+0000 7fd4f1d80700 1 --2- 172.21.15.123:0/542771641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4ec0692f0 0x7fd4ec10de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:27.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.888+0000 7fd4f1d80700 1 --2- 172.21.15.123:0/542771641 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd4ec107020 0x7fd4ec107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:27.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.888+0000 7fd4f1d80700 1 --2- 172.21.15.123:0/542771641 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4ec068950 0x7fd4ec068db0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:27.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.888+0000 7fd4f1d80700 1 -- 172.21.15.123:0/542771641 >> 172.21.15.123:0/542771641 conn(0x7fd4ec075f80 msgr2=0x7fd4ec076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:27.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.888+0000 7fd4f1d80700 1 -- 172.21.15.123:0/542771641 shutdown_connections 2024-06-02T04:03:27.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.888+0000 7fd4f1d80700 1 -- 172.21.15.123:0/542771641 wait complete. 2024-06-02T04:03:27.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.888+0000 7fd4f1d80700 1 Processor -- start 2024-06-02T04:03:27.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.889+0000 7fd4f1d80700 1 -- start start 2024-06-02T04:03:27.911 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.889+0000 7fd4f1d80700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4ec068950 0x7fd4ec197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:27.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.889+0000 7fd4f1d80700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd4ec0692f0 0x7fd4ec197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:27.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.889+0000 7fd4f1d80700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4ec107020 0x7fd4ec19bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:27.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.889+0000 7fd4f1d80700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec19c230 con 0x7fd4ec068950 2024-06-02T04:03:27.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.889+0000 7fd4f1d80700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec19c3a0 con 0x7fd4ec0692f0 2024-06-02T04:03:27.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.889+0000 7fd4f1d80700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec19c560 con 0x7fd4ec107020 2024-06-02T04:03:27.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.889+0000 7fd4eb7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4ec068950 0x7fd4ec197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:27.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.889+0000 7fd4eb7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4ec068950 0x7fd4ec197330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46304/0 (socket says 172.21.15.123:46304) 2024-06-02T04:03:27.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.889+0000 7fd4eb7fe700 1 -- 172.21.15.123:0/306016377 learned_addr learned my addr 172.21.15.123:0/306016377 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:27.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.889+0000 7fd4ebfff700 1 --2- 172.21.15.123:0/306016377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4ec107020 0x7fd4ec19bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:27.912 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.889+0000 7fd4eb7fe700 1 -- 172.21.15.123:0/306016377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4ec107020 msgr2=0x7fd4ec19bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:27.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.889+0000 7fd4eb7fe700 1 --2- 172.21.15.123:0/306016377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4ec107020 0x7fd4ec19bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:27.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.889+0000 7fd4eb7fe700 1 -- 172.21.15.123:0/306016377 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd4ec0692f0 msgr2=0x7fd4ec197870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:27.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.889+0000 7fd4eb7fe700 1 --2- 172.21.15.123:0/306016377 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd4ec0692f0 0x7fd4ec197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:27.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.889+0000 7fd4eb7fe700 1 -- 172.21.15.123:0/306016377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e00095f0 con 0x7fd4ec068950 2024-06-02T04:03:27.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.890+0000 7fd4ebfff700 1 --2- 172.21.15.123:0/306016377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd4ec107020 0x7fd4ec19bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:03:27.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.890+0000 7fd4eb7fe700 1 --2- 172.21.15.123:0/306016377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4ec068950 0x7fd4ec197330 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00c920 tx=0x7fd4dc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:27.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.890+0000 7fd4e8ff9700 1 -- 172.21.15.123:0/306016377 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc007b00 con 0x7fd4ec068950 2024-06-02T04:03:27.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.890+0000 7fd4e8ff9700 1 -- 172.21.15.123:0/306016377 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd4dc004cf0 con 0x7fd4ec068950 2024-06-02T04:03:27.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.890+0000 7fd4f1d80700 1 -- 172.21.15.123:0/306016377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4ec19c840 con 0x7fd4ec068950 2024-06-02T04:03:27.913 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.890+0000 7fd4e8ff9700 1 -- 172.21.15.123:0/306016377 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc005610 con 0x7fd4ec068950 2024-06-02T04:03:27.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.890+0000 7fd4f1d80700 1 -- 172.21.15.123:0/306016377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ec1a40a0 con 0x7fd4ec068950 2024-06-02T04:03:27.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.891+0000 7fd4f1d80700 1 -- 172.21.15.123:0/306016377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd4ec111120 con 0x7fd4ec068950 2024-06-02T04:03:27.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.892+0000 7fd4e8ff9700 1 -- 172.21.15.123:0/306016377 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fd4dc00f450 con 0x7fd4ec068950 2024-06-02T04:03:27.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.893+0000 7fd4e8ff9700 1 --2- 172.21.15.123:0/306016377 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd4d40a12b0 0x7fd4d40a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:27.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.893+0000 7fd4eaffd700 1 --2- 172.21.15.123:0/306016377 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd4d40a12b0 0x7fd4d40a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:27.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.893+0000 7fd4e8ff9700 1 -- 172.21.15.123:0/306016377 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd4dc0ccac0 con 0x7fd4ec068950 2024-06-02T04:03:27.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.893+0000 7fd4e8ff9700 1 --2- 172.21.15.123:0/306016377 >> [v2:172.21.15.123:6802/2763421276,v1:172.21.15.123:6803/2763421276] conn(0x7fd4d40aaa90 0x7fd4d40aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:27.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.893+0000 7fd4e8ff9700 1 -- 172.21.15.123:0/306016377 --> [v2:172.21.15.123:6802/2763421276,v1:172.21.15.123:6803/2763421276] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd4d40ad560 con 0x7fd4d40aaa90 2024-06-02T04:03:27.914 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.893+0000 7fd4e8ff9700 1 -- 172.21.15.123:0/306016377 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4dc0cce70 con 0x7fd4ec068950 2024-06-02T04:03:27.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.893+0000 7fd4ebfff700 1 --2- 172.21.15.123:0/306016377 >> [v2:172.21.15.123:6802/2763421276,v1:172.21.15.123:6803/2763421276] conn(0x7fd4d40aaa90 0x7fd4d40aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:27.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.893+0000 7fd4eaffd700 1 --2- 172.21.15.123:0/306016377 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd4d40a12b0 0x7fd4d40a3770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0009fd0 tx=0x7fd4e0000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:27.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.893+0000 7fd4ebfff700 1 --2- 172.21.15.123:0/306016377 >> [v2:172.21.15.123:6802/2763421276,v1:172.21.15.123:6803/2763421276] conn(0x7fd4d40aaa90 0x7fd4d40aceb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:27.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.894+0000 7fd4e8ff9700 1 -- 172.21.15.123:0/306016377 <== osd.0 v2:172.21.15.123:6802/2763421276 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd4d40ad560 con 0x7fd4d40aaa90 2024-06-02T04:03:27.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.910+0000 7fd4f1d80700 1 -- 172.21.15.123:0/306016377 --> [v2:172.21.15.123:6802/2763421276,v1:172.21.15.123:6803/2763421276] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd4ec061620 con 0x7fd4d40aaa90 2024-06-02T04:03:27.915 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.911+0000 7fd4e8ff9700 1 -- 172.21.15.123:0/306016377 <== osd.0 v2:172.21.15.123:6802/2763421276 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd4ec061620 con 0x7fd4d40aaa90 2024-06-02T04:03:27.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.911+0000 7fd4f1d80700 1 -- 172.21.15.123:0/306016377 >> [v2:172.21.15.123:6802/2763421276,v1:172.21.15.123:6803/2763421276] conn(0x7fd4d40aaa90 msgr2=0x7fd4d40aceb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:27.916 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.911+0000 7fd4f1d80700 1 --2- 172.21.15.123:0/306016377 >> [v2:172.21.15.123:6802/2763421276,v1:172.21.15.123:6803/2763421276] conn(0x7fd4d40aaa90 0x7fd4d40aceb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:27.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.911+0000 7fd4f1d80700 1 -- 172.21.15.123:0/306016377 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd4d40a12b0 msgr2=0x7fd4d40a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:27.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.911+0000 7fd4f1d80700 1 --2- 172.21.15.123:0/306016377 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd4d40a12b0 0x7fd4d40a3770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0009fd0 tx=0x7fd4e0000bc0 comp rx=0 tx=0).stop 2024-06-02T04:03:27.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.911+0000 7fd4f1d80700 1 -- 172.21.15.123:0/306016377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4ec068950 msgr2=0x7fd4ec197330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:27.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.911+0000 7fd4f1d80700 1 --2- 172.21.15.123:0/306016377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd4ec068950 0x7fd4ec197330 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00c920 tx=0x7fd4dc00cce0 comp rx=0 tx=0).stop 2024-06-02T04:03:27.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.911+0000 7fd4ebfff700 1 -- 172.21.15.123:0/306016377 reap_dead start 2024-06-02T04:03:27.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.911+0000 7fd4f1d80700 1 -- 172.21.15.123:0/306016377 shutdown_connections 2024-06-02T04:03:27.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.911+0000 7fd4f1d80700 1 -- 172.21.15.123:0/306016377 >> 172.21.15.123:0/306016377 conn(0x7fd4ec075f80 msgr2=0x7fd4ec0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:27.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.912+0000 7fd4f1d80700 1 -- 172.21.15.123:0/306016377 shutdown_connections 2024-06-02T04:03:27.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.912+0000 7fd4f1d80700 1 -- 172.21.15.123:0/306016377 wait complete. 2024-06-02T04:03:27.960 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.945+0000 7f09a8519700 1 -- 172.21.15.123:0/29881668 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09a0068950 msgr2=0x7f09a0068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:27.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.945+0000 7f09a8519700 1 --2- 172.21.15.123:0/29881668 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09a0068950 0x7f09a0068db0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0990009990 tx=0x7f0990009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:27.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.945+0000 7f09a8519700 1 -- 172.21.15.123:0/29881668 shutdown_connections 2024-06-02T04:03:27.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.945+0000 7f09a8519700 1 --2- 172.21.15.123:0/29881668 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09a00692f0 0x7f09a010de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:27.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.945+0000 7f09a8519700 1 --2- 172.21.15.123:0/29881668 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09a0107020 0x7f09a0107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:27.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.945+0000 7f09a8519700 1 --2- 172.21.15.123:0/29881668 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09a0068950 0x7f09a0068db0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:27.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.945+0000 7f09a8519700 1 -- 172.21.15.123:0/29881668 >> 172.21.15.123:0/29881668 conn(0x7f09a0075f80 msgr2=0x7f09a0076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:27.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.945+0000 7f09a8519700 1 -- 172.21.15.123:0/29881668 shutdown_connections 2024-06-02T04:03:27.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.945+0000 7f09a8519700 1 -- 172.21.15.123:0/29881668 wait complete. 2024-06-02T04:03:27.961 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.945+0000 7f09a8519700 1 Processor -- start 2024-06-02T04:03:27.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.946+0000 7f09a8519700 1 -- start start 2024-06-02T04:03:27.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.946+0000 7f09a8519700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09a0068950 0x7f09a0197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:27.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.946+0000 7f09a8519700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09a00692f0 0x7f09a01979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:27.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.946+0000 7f09a8519700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09a0107020 0x7f09a019bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:27.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.946+0000 7f09a8519700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a019c2f0 con 0x7f09a0107020 2024-06-02T04:03:27.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.946+0000 7f09a8519700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a019c460 con 0x7f09a00692f0 2024-06-02T04:03:27.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.946+0000 7f09a8519700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a019c620 con 0x7f09a0068950 2024-06-02T04:03:27.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.946+0000 7f09a6ab6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09a0107020 0x7f09a019bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:27.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.946+0000 7f09a6ab6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09a0107020 0x7f09a019bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46336/0 (socket says 172.21.15.123:46336) 2024-06-02T04:03:27.962 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.946+0000 7f09a6ab6700 1 -- 172.21.15.123:0/4006462258 learned_addr learned my addr 172.21.15.123:0/4006462258 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:27.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.946+0000 7f09a5ab4700 1 --2- 172.21.15.123:0/4006462258 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09a00692f0 0x7f09a01979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:27.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.946+0000 7f09a62b5700 1 --2- 172.21.15.123:0/4006462258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09a0068950 0x7f09a0197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:27.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.946+0000 7f09a6ab6700 1 -- 172.21.15.123:0/4006462258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09a0068950 msgr2=0x7f09a0197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:27.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.946+0000 7f09a6ab6700 1 --2- 172.21.15.123:0/4006462258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09a0068950 0x7f09a0197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:27.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.946+0000 7f09a6ab6700 1 -- 172.21.15.123:0/4006462258 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09a00692f0 msgr2=0x7f09a01979a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:27.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.946+0000 7f09a6ab6700 1 --2- 172.21.15.123:0/4006462258 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09a00692f0 0x7f09a01979a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:27.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.946+0000 7f09a6ab6700 1 -- 172.21.15.123:0/4006462258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09900095f0 con 0x7f09a0107020 2024-06-02T04:03:27.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.946+0000 7f09a6ab6700 1 --2- 172.21.15.123:0/4006462258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09a0107020 0x7f09a019bce0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f099800b970 tx=0x7f099800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:27.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.946+0000 7f09977fe700 1 -- 172.21.15.123:0/4006462258 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099800c9b0 con 0x7f09a0107020 2024-06-02T04:03:27.963 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.946+0000 7f09977fe700 1 -- 172.21.15.123:0/4006462258 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0998014440 con 0x7f09a0107020 2024-06-02T04:03:27.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.946+0000 7f09977fe700 1 -- 172.21.15.123:0/4006462258 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09980075d0 con 0x7f09a0107020 2024-06-02T04:03:27.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.946+0000 7f09a8519700 1 -- 172.21.15.123:0/4006462258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a019c900 con 0x7f09a0107020 2024-06-02T04:03:27.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.946+0000 7f09a8519700 1 -- 172.21.15.123:0/4006462258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a01a4160 con 0x7f09a0107020 2024-06-02T04:03:27.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.947+0000 7f09a8519700 1 -- 172.21.15.123:0/4006462258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f09a0111210 con 0x7f09a0107020 2024-06-02T04:03:27.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.948+0000 7f09977fe700 1 -- 172.21.15.123:0/4006462258 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f09980145b0 con 0x7f09a0107020 2024-06-02T04:03:27.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.949+0000 7f09977fe700 1 --2- 172.21.15.123:0/4006462258 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f098c0a11b0 0x7f098c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:27.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.949+0000 7f09a62b5700 1 --2- 172.21.15.123:0/4006462258 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f098c0a11b0 0x7f098c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:27.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.949+0000 7f09977fe700 1 -- 172.21.15.123:0/4006462258 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f0998006e40 con 0x7f09a0107020 2024-06-02T04:03:27.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.949+0000 7f09977fe700 1 --2- 172.21.15.123:0/4006462258 >> [v2:172.21.15.136:6816/1948829505,v1:172.21.15.136:6817/1948829505] conn(0x7f098c0aa990 0x7f098c0acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:27.964 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.949+0000 7f09977fe700 1 -- 172.21.15.123:0/4006462258 --> [v2:172.21.15.136:6816/1948829505,v1:172.21.15.136:6817/1948829505] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f098c0ad460 con 0x7f098c0aa990 2024-06-02T04:03:27.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.949+0000 7f09977fe700 1 -- 172.21.15.123:0/4006462258 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09980cca10 con 0x7f09a0107020 2024-06-02T04:03:27.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.949+0000 7f09a62b5700 1 --2- 172.21.15.123:0/4006462258 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f098c0a11b0 0x7f098c0a3670 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f099c005fd0 tx=0x7f099c00a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:27.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.949+0000 7f09a5ab4700 1 --2- 172.21.15.123:0/4006462258 >> [v2:172.21.15.136:6816/1948829505,v1:172.21.15.136:6817/1948829505] conn(0x7f098c0aa990 0x7f098c0acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:27.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.950+0000 7f09a5ab4700 1 --2- 172.21.15.123:0/4006462258 >> [v2:172.21.15.136:6816/1948829505,v1:172.21.15.136:6817/1948829505] conn(0x7f098c0aa990 0x7f098c0acdb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:27.965 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.951+0000 7f09977fe700 1 -- 172.21.15.123:0/4006462258 <== osd.7 v2:172.21.15.136:6816/1948829505 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f098c0ad460 con 0x7f098c0aa990 2024-06-02T04:03:27.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.967+0000 7f09a8519700 1 -- 172.21.15.123:0/4006462258 --> [v2:172.21.15.136:6816/1948829505,v1:172.21.15.136:6817/1948829505] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f09a0061620 con 0x7f098c0aa990 2024-06-02T04:03:27.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.968+0000 7f09977fe700 1 -- 172.21.15.123:0/4006462258 <== osd.7 v2:172.21.15.136:6816/1948829505 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f09a0061620 con 0x7f098c0aa990 2024-06-02T04:03:27.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.968+0000 7f09a8519700 1 -- 172.21.15.123:0/4006462258 >> [v2:172.21.15.136:6816/1948829505,v1:172.21.15.136:6817/1948829505] conn(0x7f098c0aa990 msgr2=0x7f098c0acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:27.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.968+0000 7f09a8519700 1 --2- 172.21.15.123:0/4006462258 >> [v2:172.21.15.136:6816/1948829505,v1:172.21.15.136:6817/1948829505] conn(0x7f098c0aa990 0x7f098c0acdb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:27.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.968+0000 7f09a8519700 1 -- 172.21.15.123:0/4006462258 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f098c0a11b0 msgr2=0x7f098c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:27.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.968+0000 7f09a8519700 1 --2- 172.21.15.123:0/4006462258 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f098c0a11b0 0x7f098c0a3670 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f099c005fd0 tx=0x7f099c00a560 comp rx=0 tx=0).stop 2024-06-02T04:03:27.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.968+0000 7f09a8519700 1 -- 172.21.15.123:0/4006462258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09a0107020 msgr2=0x7f09a019bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:27.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.968+0000 7f09a8519700 1 --2- 172.21.15.123:0/4006462258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f09a0107020 0x7f09a019bce0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f099800b970 tx=0x7f099800bd30 comp rx=0 tx=0).stop 2024-06-02T04:03:27.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.968+0000 7f09a6ab6700 1 -- 172.21.15.123:0/4006462258 reap_dead start 2024-06-02T04:03:27.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.968+0000 7f09a8519700 1 -- 172.21.15.123:0/4006462258 shutdown_connections 2024-06-02T04:03:27.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.968+0000 7f09a8519700 1 -- 172.21.15.123:0/4006462258 >> 172.21.15.123:0/4006462258 conn(0x7f09a0075f80 msgr2=0x7f09a00fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:27.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.969+0000 7f09a8519700 1 -- 172.21.15.123:0/4006462258 shutdown_connections 2024-06-02T04:03:27.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:27.969+0000 7f09a8519700 1 -- 172.21.15.123:0/4006462258 wait complete. 2024-06-02T04:03:28.148 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:27 smithi123 ceph-mon[42885]: pgmap v232: 97 pgs: 97 active+clean; 638 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2024-06-02T04:03:28.161 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:03:28.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:27 smithi162 ceph-mon[47009]: pgmap v232: 97 pgs: 97 active+clean; 638 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2024-06-02T04:03:28.314 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:03:28.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:27 smithi136 ceph-mon[47443]: pgmap v232: 97 pgs: 97 active+clean; 638 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.1 KiB/s wr, 12 op/s 2024-06-02T04:03:28.385 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:03:28.611 INFO:teuthology.orchestra.run.smithi123.stdout:34359738420 2024-06-02T04:03:28.612 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-06-02T04:03:28.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.618+0000 7ff8a1426700 1 -- 172.21.15.123:0/2794598254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff89c068950 msgr2=0x7ff89c068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:28.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.618+0000 7ff8a1426700 1 --2- 172.21.15.123:0/2794598254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff89c068950 0x7ff89c068d30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff88c009990 tx=0x7ff88c009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:28.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.618+0000 7ff8a1426700 1 -- 172.21.15.123:0/2794598254 shutdown_connections 2024-06-02T04:03:28.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.618+0000 7ff8a1426700 1 --2- 172.21.15.123:0/2794598254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff89c10da80 0x7ff89c10fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:28.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.618+0000 7ff8a1426700 1 --2- 172.21.15.123:0/2794598254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff89c068950 0x7ff89c068d30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:28.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.618+0000 7ff8a1426700 1 --2- 172.21.15.123:0/2794598254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff89c069270 0x7ff89c10d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:28.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.618+0000 7ff8a1426700 1 -- 172.21.15.123:0/2794598254 >> 172.21.15.123:0/2794598254 conn(0x7ff89c075f80 msgr2=0x7ff89c076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:28.618 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.618+0000 7ff8a1426700 1 -- 172.21.15.123:0/2794598254 shutdown_connections 2024-06-02T04:03:28.619 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.618+0000 7ff8a1426700 1 -- 172.21.15.123:0/2794598254 wait complete. 2024-06-02T04:03:28.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.619+0000 7ff8a1426700 1 Processor -- start 2024-06-02T04:03:28.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.619+0000 7ff8a1426700 1 -- start start 2024-06-02T04:03:28.620 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.619+0000 7ff8a1426700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff89c068950 0x7ff89c199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:28.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.619+0000 7ff8a1426700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff89c069270 0x7ff89c199c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:28.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.619+0000 7ff8a1426700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff89c10da80 0x7ff89c19dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:28.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.619+0000 7ff8a1426700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c19e5f0 con 0x7ff89c069270 2024-06-02T04:03:28.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.619+0000 7ff8a1426700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c19e760 con 0x7ff89c10da80 2024-06-02T04:03:28.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.619+0000 7ff8a1426700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c19e920 con 0x7ff89c068950 2024-06-02T04:03:28.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.619+0000 7ff89a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff89c069270 0x7ff89c199c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:28.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.619+0000 7ff89a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff89c069270 0x7ff89c199c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46352/0 (socket says 172.21.15.123:46352) 2024-06-02T04:03:28.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.619+0000 7ff89a7fc700 1 -- 172.21.15.123:0/3881982055 learned_addr learned my addr 172.21.15.123:0/3881982055 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:28.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.619+0000 7ff89b7fe700 1 --2- 172.21.15.123:0/3881982055 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff89c10da80 0x7ff89c19dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:28.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.619+0000 7ff89affd700 1 --2- 172.21.15.123:0/3881982055 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff89c068950 0x7ff89c199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:28.621 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.620+0000 7ff89a7fc700 1 -- 172.21.15.123:0/3881982055 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff89c068950 msgr2=0x7ff89c199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:28.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.620+0000 7ff89a7fc700 1 --2- 172.21.15.123:0/3881982055 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff89c068950 0x7ff89c199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:28.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.620+0000 7ff89a7fc700 1 -- 172.21.15.123:0/3881982055 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff89c10da80 msgr2=0x7ff89c19dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:28.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.620+0000 7ff89a7fc700 1 --2- 172.21.15.123:0/3881982055 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff89c10da80 0x7ff89c19dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:28.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.620+0000 7ff89a7fc700 1 -- 172.21.15.123:0/3881982055 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff88c0095f0 con 0x7ff89c069270 2024-06-02T04:03:28.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.620+0000 7ff89a7fc700 1 --2- 172.21.15.123:0/3881982055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff89c069270 0x7ff89c199c80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff89000b530 tx=0x7ff89000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:28.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.620+0000 7ff883fff700 1 -- 172.21.15.123:0/3881982055 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff890011830 con 0x7ff89c069270 2024-06-02T04:03:28.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.620+0000 7ff883fff700 1 -- 172.21.15.123:0/3881982055 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff890011e50 con 0x7ff89c069270 2024-06-02T04:03:28.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.620+0000 7ff8a1426700 1 -- 172.21.15.123:0/3881982055 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff89c19ec00 con 0x7ff89c069270 2024-06-02T04:03:28.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.620+0000 7ff883fff700 1 -- 172.21.15.123:0/3881982055 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89000f2e0 con 0x7ff89c069270 2024-06-02T04:03:28.622 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.620+0000 7ff8a1426700 1 -- 172.21.15.123:0/3881982055 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff89c1a6460 con 0x7ff89c069270 2024-06-02T04:03:28.623 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.621+0000 7ff8a1426700 1 -- 172.21.15.123:0/3881982055 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff89c1134b0 con 0x7ff89c069270 2024-06-02T04:03:28.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.623+0000 7ff883fff700 1 -- 172.21.15.123:0/3881982055 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7ff8900105a0 con 0x7ff89c069270 2024-06-02T04:03:28.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.623+0000 7ff883fff700 1 --2- 172.21.15.123:0/3881982055 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff8840a12b0 0x7ff8840a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:28.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.623+0000 7ff883fff700 1 -- 172.21.15.123:0/3881982055 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff8900cc830 con 0x7ff89c069270 2024-06-02T04:03:28.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.624+0000 7ff883fff700 1 --2- 172.21.15.123:0/3881982055 >> [v2:172.21.15.136:6800/956325510,v1:172.21.15.136:6801/956325510] conn(0x7ff8840aaa90 0x7ff8840aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:28.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.624+0000 7ff883fff700 1 -- 172.21.15.123:0/3881982055 --> [v2:172.21.15.136:6800/956325510,v1:172.21.15.136:6801/956325510] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff8840ad560 con 0x7ff8840aaa90 2024-06-02T04:03:28.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.624+0000 7ff883fff700 1 -- 172.21.15.123:0/3881982055 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8900ccbe0 con 0x7ff89c069270 2024-06-02T04:03:28.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.624+0000 7ff89affd700 1 --2- 172.21.15.123:0/3881982055 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff8840a12b0 0x7ff8840a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:28.624 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.624+0000 7ff89b7fe700 1 --2- 172.21.15.123:0/3881982055 >> [v2:172.21.15.136:6800/956325510,v1:172.21.15.136:6801/956325510] conn(0x7ff8840aaa90 0x7ff8840aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:28.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.624+0000 7ff89affd700 1 --2- 172.21.15.123:0/3881982055 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff8840a12b0 0x7ff8840a3770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff88c006010 tx=0x7ff88c00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:28.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.624+0000 7ff89b7fe700 1 --2- 172.21.15.123:0/3881982055 >> [v2:172.21.15.136:6800/956325510,v1:172.21.15.136:6801/956325510] conn(0x7ff8840aaa90 0x7ff8840aceb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:28.625 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.625+0000 7ff883fff700 1 -- 172.21.15.123:0/3881982055 <== osd.1 v2:172.21.15.136:6800/956325510 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff8840ad560 con 0x7ff8840aaa90 2024-06-02T04:03:28.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.643+0000 7ff8a1426700 1 -- 172.21.15.123:0/3881982055 --> [v2:172.21.15.136:6800/956325510,v1:172.21.15.136:6801/956325510] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff89c061620 con 0x7ff8840aaa90 2024-06-02T04:03:28.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.644+0000 7ff883fff700 1 -- 172.21.15.123:0/3881982055 <== osd.1 v2:172.21.15.136:6800/956325510 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff89c061620 con 0x7ff8840aaa90 2024-06-02T04:03:28.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.644+0000 7ff8a1426700 1 -- 172.21.15.123:0/3881982055 >> [v2:172.21.15.136:6800/956325510,v1:172.21.15.136:6801/956325510] conn(0x7ff8840aaa90 msgr2=0x7ff8840aceb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:28.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.644+0000 7ff8a1426700 1 --2- 172.21.15.123:0/3881982055 >> [v2:172.21.15.136:6800/956325510,v1:172.21.15.136:6801/956325510] conn(0x7ff8840aaa90 0x7ff8840aceb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:28.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.644+0000 7ff8a1426700 1 -- 172.21.15.123:0/3881982055 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff8840a12b0 msgr2=0x7ff8840a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:28.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.644+0000 7ff8a1426700 1 --2- 172.21.15.123:0/3881982055 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff8840a12b0 0x7ff8840a3770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff88c006010 tx=0x7ff88c00b540 comp rx=0 tx=0).stop 2024-06-02T04:03:28.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.644+0000 7ff8a1426700 1 -- 172.21.15.123:0/3881982055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff89c069270 msgr2=0x7ff89c199c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:28.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.644+0000 7ff8a1426700 1 --2- 172.21.15.123:0/3881982055 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff89c069270 0x7ff89c199c80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff89000b530 tx=0x7ff89000b840 comp rx=0 tx=0).stop 2024-06-02T04:03:28.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.644+0000 7ff89b7fe700 1 -- 172.21.15.123:0/3881982055 reap_dead start 2024-06-02T04:03:28.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.644+0000 7ff8a1426700 1 -- 172.21.15.123:0/3881982055 shutdown_connections 2024-06-02T04:03:28.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.644+0000 7ff8a1426700 1 -- 172.21.15.123:0/3881982055 >> 172.21.15.123:0/3881982055 conn(0x7ff89c075f80 msgr2=0x7ff89c10f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:28.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.644+0000 7ff8a1426700 1 -- 172.21.15.123:0/3881982055 shutdown_connections 2024-06-02T04:03:28.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:28.644+0000 7ff8a1426700 1 -- 172.21.15.123:0/3881982055 wait complete. 2024-06-02T04:03:28.859 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:03:28.860 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:03:28.860 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:03:28.883 INFO:teuthology.orchestra.run.smithi123.stdout:210453397531 2024-06-02T04:03:28.884 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-06-02T04:03:29.267 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:03:29.970 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:29 smithi123 ceph-mon[42885]: pgmap v233: 97 pgs: 97 active+clean; 638 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.1 KiB/s wr, 14 op/s 2024-06-02T04:03:30.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:29 smithi162 ceph-mon[47009]: pgmap v233: 97 pgs: 97 active+clean; 638 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.1 KiB/s wr, 14 op/s 2024-06-02T04:03:30.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:29 smithi136 ceph-mon[47443]: pgmap v233: 97 pgs: 97 active+clean; 638 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.1 KiB/s wr, 14 op/s 2024-06-02T04:03:30.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.659+0000 7fe19486c700 1 -- 172.21.15.123:0/3284627469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe190107020 msgr2=0x7fe190107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:30.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.659+0000 7fe19486c700 1 --2- 172.21.15.123:0/3284627469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe190107020 0x7fe190107400 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe180009990 tx=0x7fe180009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:30.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.659+0000 7fe19486c700 1 -- 172.21.15.123:0/3284627469 shutdown_connections 2024-06-02T04:03:30.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.659+0000 7fe19486c700 1 --2- 172.21.15.123:0/3284627469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1900692f0 0x7fe19010de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:30.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.659+0000 7fe19486c700 1 --2- 172.21.15.123:0/3284627469 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe190107020 0x7fe190107400 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:30.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.659+0000 7fe19486c700 1 --2- 172.21.15.123:0/3284627469 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe190068950 0x7fe190068db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:30.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.659+0000 7fe19486c700 1 -- 172.21.15.123:0/3284627469 >> 172.21.15.123:0/3284627469 conn(0x7fe190075f80 msgr2=0x7fe190076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:30.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.659+0000 7fe19486c700 1 -- 172.21.15.123:0/3284627469 shutdown_connections 2024-06-02T04:03:30.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.659+0000 7fe19486c700 1 -- 172.21.15.123:0/3284627469 wait complete. 2024-06-02T04:03:30.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.660+0000 7fe19486c700 1 Processor -- start 2024-06-02T04:03:30.376 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.660+0000 7fe19486c700 1 -- start start 2024-06-02T04:03:30.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.660+0000 7fe19486c700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe190068950 0x7fe190197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:30.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.660+0000 7fe19486c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1900692f0 0x7fe1901979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:30.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.660+0000 7fe19486c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe190107020 0x7fe19019bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:30.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.660+0000 7fe19486c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19019c390 con 0x7fe190107020 2024-06-02T04:03:30.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.660+0000 7fe19486c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19019c500 con 0x7fe1900692f0 2024-06-02T04:03:30.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.660+0000 7fe19486c700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19019c6c0 con 0x7fe190068950 2024-06-02T04:03:30.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.660+0000 7fe18ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe190107020 0x7fe19019bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:30.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.660+0000 7fe18ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe190107020 0x7fe19019bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46364/0 (socket says 172.21.15.123:46364) 2024-06-02T04:03:30.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.660+0000 7fe18ed9d700 1 -- 172.21.15.123:0/3110304286 learned_addr learned my addr 172.21.15.123:0/3110304286 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:30.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.661+0000 7fe18e59c700 1 --2- 172.21.15.123:0/3110304286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe190068950 0x7fe190197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:30.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.661+0000 7fe18dd9b700 1 --2- 172.21.15.123:0/3110304286 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1900692f0 0x7fe1901979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:30.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.661+0000 7fe18ed9d700 1 -- 172.21.15.123:0/3110304286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe190068950 msgr2=0x7fe190197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:30.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.661+0000 7fe18ed9d700 1 --2- 172.21.15.123:0/3110304286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe190068950 0x7fe190197490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:30.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.661+0000 7fe18ed9d700 1 -- 172.21.15.123:0/3110304286 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1900692f0 msgr2=0x7fe1901979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:30.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.661+0000 7fe18ed9d700 1 --2- 172.21.15.123:0/3110304286 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1900692f0 0x7fe1901979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:30.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.661+0000 7fe18ed9d700 1 -- 172.21.15.123:0/3110304286 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1800095f0 con 0x7fe190107020 2024-06-02T04:03:30.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.661+0000 7fe18e59c700 1 --2- 172.21.15.123:0/3110304286 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe190068950 0x7fe190197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:03:30.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.661+0000 7fe18ed9d700 1 --2- 172.21.15.123:0/3110304286 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe190107020 0x7fe19019bd80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe18800b970 tx=0x7fe18800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:30.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.661+0000 7fe17f7fe700 1 -- 172.21.15.123:0/3110304286 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18800c9b0 con 0x7fe190107020 2024-06-02T04:03:30.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.661+0000 7fe17f7fe700 1 -- 172.21.15.123:0/3110304286 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe188014440 con 0x7fe190107020 2024-06-02T04:03:30.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.661+0000 7fe17f7fe700 1 -- 172.21.15.123:0/3110304286 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1880075d0 con 0x7fe190107020 2024-06-02T04:03:30.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.661+0000 7fe19486c700 1 -- 172.21.15.123:0/3110304286 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe19019c9a0 con 0x7fe190107020 2024-06-02T04:03:30.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.661+0000 7fe19486c700 1 -- 172.21.15.123:0/3110304286 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1901a4200 con 0x7fe190107020 2024-06-02T04:03:30.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.662+0000 7fe19486c700 1 -- 172.21.15.123:0/3110304286 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe190111260 con 0x7fe190107020 2024-06-02T04:03:30.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.663+0000 7fe17f7fe700 1 -- 172.21.15.123:0/3110304286 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fe1880145b0 con 0x7fe190107020 2024-06-02T04:03:30.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.663+0000 7fe17f7fe700 1 --2- 172.21.15.123:0/3110304286 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe1780a11b0 0x7fe1780a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:30.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.664+0000 7fe18e59c700 1 --2- 172.21.15.123:0/3110304286 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe1780a11b0 0x7fe1780a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:30.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.664+0000 7fe17f7fe700 1 -- 172.21.15.123:0/3110304286 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe188006e40 con 0x7fe190107020 2024-06-02T04:03:30.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.664+0000 7fe17f7fe700 1 --2- 172.21.15.123:0/3110304286 >> [v2:172.21.15.162:6816/1590839230,v1:172.21.15.162:6817/1590839230] conn(0x7fe1780aa990 0x7fe1780acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:30.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.664+0000 7fe17f7fe700 1 -- 172.21.15.123:0/3110304286 --> [v2:172.21.15.162:6816/1590839230,v1:172.21.15.162:6817/1590839230] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe1780ad460 con 0x7fe1780aa990 2024-06-02T04:03:30.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.664+0000 7fe17f7fe700 1 -- 172.21.15.123:0/3110304286 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1880cca60 con 0x7fe190107020 2024-06-02T04:03:30.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.664+0000 7fe18e59c700 1 --2- 172.21.15.123:0/3110304286 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe1780a11b0 0x7fe1780a3670 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe180006010 tx=0x7fe18000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:30.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.664+0000 7fe18dd9b700 1 --2- 172.21.15.123:0/3110304286 >> [v2:172.21.15.162:6816/1590839230,v1:172.21.15.162:6817/1590839230] conn(0x7fe1780aa990 0x7fe1780acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:30.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.664+0000 7fe18dd9b700 1 --2- 172.21.15.123:0/3110304286 >> [v2:172.21.15.162:6816/1590839230,v1:172.21.15.162:6817/1590839230] conn(0x7fe1780aa990 0x7fe1780acdb0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:30.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.665+0000 7fe17f7fe700 1 -- 172.21.15.123:0/3110304286 <== osd.8 v2:172.21.15.162:6816/1590839230 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fe1780ad460 con 0x7fe1780aa990 2024-06-02T04:03:30.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.681+0000 7fe19486c700 1 -- 172.21.15.123:0/3110304286 --> [v2:172.21.15.162:6816/1590839230,v1:172.21.15.162:6817/1590839230] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe1901026d0 con 0x7fe1780aa990 2024-06-02T04:03:30.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.682+0000 7fe17f7fe700 1 -- 172.21.15.123:0/3110304286 <== osd.8 v2:172.21.15.162:6816/1590839230 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fe1901026d0 con 0x7fe1780aa990 2024-06-02T04:03:30.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.682+0000 7fe19486c700 1 -- 172.21.15.123:0/3110304286 >> [v2:172.21.15.162:6816/1590839230,v1:172.21.15.162:6817/1590839230] conn(0x7fe1780aa990 msgr2=0x7fe1780acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:30.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.682+0000 7fe19486c700 1 --2- 172.21.15.123:0/3110304286 >> [v2:172.21.15.162:6816/1590839230,v1:172.21.15.162:6817/1590839230] conn(0x7fe1780aa990 0x7fe1780acdb0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:30.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.682+0000 7fe19486c700 1 -- 172.21.15.123:0/3110304286 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe1780a11b0 msgr2=0x7fe1780a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:30.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.682+0000 7fe19486c700 1 --2- 172.21.15.123:0/3110304286 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe1780a11b0 0x7fe1780a3670 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe180006010 tx=0x7fe18000b540 comp rx=0 tx=0).stop 2024-06-02T04:03:30.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.682+0000 7fe19486c700 1 -- 172.21.15.123:0/3110304286 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe190107020 msgr2=0x7fe19019bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:30.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.682+0000 7fe19486c700 1 --2- 172.21.15.123:0/3110304286 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe190107020 0x7fe19019bd80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe18800b970 tx=0x7fe18800bd30 comp rx=0 tx=0).stop 2024-06-02T04:03:30.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.682+0000 7fe18ed9d700 1 -- 172.21.15.123:0/3110304286 reap_dead start 2024-06-02T04:03:30.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.682+0000 7fe19486c700 1 -- 172.21.15.123:0/3110304286 shutdown_connections 2024-06-02T04:03:30.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.682+0000 7fe19486c700 1 -- 172.21.15.123:0/3110304286 >> 172.21.15.123:0/3110304286 conn(0x7fe190075f80 msgr2=0x7fe1900fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:30.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.682+0000 7fe19486c700 1 -- 172.21.15.123:0/3110304286 shutdown_connections 2024-06-02T04:03:30.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:29.682+0000 7fe19486c700 1 -- 172.21.15.123:0/3110304286 wait complete. 2024-06-02T04:03:30.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.555+0000 7f9fb1b22700 1 -- 172.21.15.123:0/3052760276 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fac105f00 msgr2=0x7f9fac1062e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:30.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.555+0000 7f9fb1b22700 1 --2- 172.21.15.123:0/3052760276 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fac105f00 0x7f9fac1062e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c009990 tx=0x7f9f9c009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:30.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.555+0000 7f9fb1b22700 1 -- 172.21.15.123:0/3052760276 shutdown_connections 2024-06-02T04:03:30.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.555+0000 7f9fb1b22700 1 --2- 172.21.15.123:0/3052760276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9fac100890 0x7f9fac10cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:30.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.555+0000 7f9fb1b22700 1 --2- 172.21.15.123:0/3052760276 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fac105f00 0x7f9fac1062e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:30.555 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.555+0000 7f9fb1b22700 1 --2- 172.21.15.123:0/3052760276 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9fac0ffed0 0x7f9fac100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:30.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.555+0000 7f9fb1b22700 1 -- 172.21.15.123:0/3052760276 >> 172.21.15.123:0/3052760276 conn(0x7f9fac075f80 msgr2=0x7f9fac076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:30.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.555+0000 7f9fb1b22700 1 -- 172.21.15.123:0/3052760276 shutdown_connections 2024-06-02T04:03:30.556 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.555+0000 7f9fb1b22700 1 -- 172.21.15.123:0/3052760276 wait complete. 2024-06-02T04:03:30.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.556+0000 7f9fb1b22700 1 Processor -- start 2024-06-02T04:03:30.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.556+0000 7f9fb1b22700 1 -- start start 2024-06-02T04:03:30.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.556+0000 7f9fb1b22700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fac0ffed0 0x7f9fac1981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:30.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.556+0000 7f9fb1b22700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9fac100890 0x7f9fac1986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:30.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.556+0000 7f9fb1b22700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9fac105f00 0x7f9fac1a3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:30.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.556+0000 7f9fb1b22700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac198f30 con 0x7f9fac0ffed0 2024-06-02T04:03:30.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.556+0000 7f9fb1b22700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac1a3760 con 0x7f9fac105f00 2024-06-02T04:03:30.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.556+0000 7f9fb1b22700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac1a38a0 con 0x7f9fac100890 2024-06-02T04:03:30.558 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.556+0000 7f9fab7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fac0ffed0 0x7f9fac1981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:30.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.556+0000 7f9fab7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fac0ffed0 0x7f9fac1981a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46384/0 (socket says 172.21.15.123:46384) 2024-06-02T04:03:30.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.556+0000 7f9fab7fe700 1 -- 172.21.15.123:0/1330409113 learned_addr learned my addr 172.21.15.123:0/1330409113 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:30.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.556+0000 7f9fabfff700 1 --2- 172.21.15.123:0/1330409113 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9fac105f00 0x7f9fac1a3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:30.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.556+0000 7f9faaffd700 1 --2- 172.21.15.123:0/1330409113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9fac100890 0x7f9fac1986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:30.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.556+0000 7f9fab7fe700 1 -- 172.21.15.123:0/1330409113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9fac100890 msgr2=0x7f9fac1986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:30.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.556+0000 7f9fab7fe700 1 --2- 172.21.15.123:0/1330409113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9fac100890 0x7f9fac1986e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:30.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.556+0000 7f9fab7fe700 1 -- 172.21.15.123:0/1330409113 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9fac105f00 msgr2=0x7f9fac1a3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:30.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.556+0000 7f9fab7fe700 1 --2- 172.21.15.123:0/1330409113 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9fac105f00 0x7f9fac1a3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:30.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.556+0000 7f9fab7fe700 1 -- 172.21.15.123:0/1330409113 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9c0095f0 con 0x7f9fac0ffed0 2024-06-02T04:03:30.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.556+0000 7f9fabfff700 1 --2- 172.21.15.123:0/1330409113 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9fac105f00 0x7f9fac1a3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:03:30.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.557+0000 7f9fab7fe700 1 --2- 172.21.15.123:0/1330409113 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fac0ffed0 0x7f9fac1981a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00f7d0 tx=0x7f9f9c00f8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:30.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.557+0000 7f9fa8ff9700 1 -- 172.21.15.123:0/1330409113 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c01d070 con 0x7f9fac0ffed0 2024-06-02T04:03:30.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.557+0000 7f9fb1b22700 1 -- 172.21.15.123:0/1330409113 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fac1a3aa0 con 0x7f9fac0ffed0 2024-06-02T04:03:30.559 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.557+0000 7f9fa8ff9700 1 -- 172.21.15.123:0/1330409113 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f9c00fdd0 con 0x7f9fac0ffed0 2024-06-02T04:03:30.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.557+0000 7f9fa8ff9700 1 -- 172.21.15.123:0/1330409113 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c017790 con 0x7f9fac0ffed0 2024-06-02T04:03:30.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.557+0000 7f9fb1b22700 1 -- 172.21.15.123:0/1330409113 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fac1a3f10 con 0x7f9fac0ffed0 2024-06-02T04:03:30.560 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.557+0000 7f9fb1b22700 1 -- 172.21.15.123:0/1330409113 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9fac1015b0 con 0x7f9fac0ffed0 2024-06-02T04:03:30.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.559+0000 7f9fa8ff9700 1 -- 172.21.15.123:0/1330409113 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f9f9c022aa0 con 0x7f9fac0ffed0 2024-06-02T04:03:30.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.560+0000 7f9fa8ff9700 1 --2- 172.21.15.123:0/1330409113 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9f980a1230 0x7f9f980a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:30.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.560+0000 7f9faaffd700 1 --2- 172.21.15.123:0/1330409113 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9f980a1230 0x7f9f980a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:30.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.560+0000 7f9fa8ff9700 1 -- 172.21.15.123:0/1330409113 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9f9c0ce160 con 0x7f9fac0ffed0 2024-06-02T04:03:30.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.560+0000 7f9fa8ff9700 1 --2- 172.21.15.123:0/1330409113 >> [v2:172.21.15.123:6818/3025820432,v1:172.21.15.123:6819/3025820432] conn(0x7f9f980aaa10 0x7f9f980ace30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:30.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.560+0000 7f9fa8ff9700 1 -- 172.21.15.123:0/1330409113 --> [v2:172.21.15.123:6818/3025820432,v1:172.21.15.123:6819/3025820432] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9f980ad4e0 con 0x7f9f980aaa10 2024-06-02T04:03:30.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.560+0000 7f9fa8ff9700 1 -- 172.21.15.123:0/1330409113 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f9c0ce600 con 0x7f9fac0ffed0 2024-06-02T04:03:30.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.560+0000 7f9fabfff700 1 --2- 172.21.15.123:0/1330409113 >> [v2:172.21.15.123:6818/3025820432,v1:172.21.15.123:6819/3025820432] conn(0x7f9f980aaa10 0x7f9f980ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:30.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.560+0000 7f9faaffd700 1 --2- 172.21.15.123:0/1330409113 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9f980a1230 0x7f9f980a36f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9f94005fd0 tx=0x7f9f9400a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:30.561 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.561+0000 7f9fabfff700 1 --2- 172.21.15.123:0/1330409113 >> [v2:172.21.15.123:6818/3025820432,v1:172.21.15.123:6819/3025820432] conn(0x7f9f980aaa10 0x7f9f980ace30 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:30.562 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.561+0000 7f9fa8ff9700 1 -- 172.21.15.123:0/1330409113 <== osd.6 v2:172.21.15.123:6818/3025820432 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f9f980ad4e0 con 0x7f9f980aaa10 2024-06-02T04:03:30.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.577+0000 7f9fb1b22700 1 -- 172.21.15.123:0/1330409113 --> [v2:172.21.15.123:6818/3025820432,v1:172.21.15.123:6819/3025820432] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9fac110000 con 0x7f9f980aaa10 2024-06-02T04:03:30.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.577+0000 7f9fa8ff9700 1 -- 172.21.15.123:0/1330409113 <== osd.6 v2:172.21.15.123:6818/3025820432 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f9fac110000 con 0x7f9f980aaa10 2024-06-02T04:03:30.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.578+0000 7f9fb1b22700 1 -- 172.21.15.123:0/1330409113 >> [v2:172.21.15.123:6818/3025820432,v1:172.21.15.123:6819/3025820432] conn(0x7f9f980aaa10 msgr2=0x7f9f980ace30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:30.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.578+0000 7f9fb1b22700 1 --2- 172.21.15.123:0/1330409113 >> [v2:172.21.15.123:6818/3025820432,v1:172.21.15.123:6819/3025820432] conn(0x7f9f980aaa10 0x7f9f980ace30 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:30.578 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.578+0000 7f9fb1b22700 1 -- 172.21.15.123:0/1330409113 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9f980a1230 msgr2=0x7f9f980a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:30.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.578+0000 7f9fb1b22700 1 --2- 172.21.15.123:0/1330409113 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9f980a1230 0x7f9f980a36f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9f94005fd0 tx=0x7f9f9400a560 comp rx=0 tx=0).stop 2024-06-02T04:03:30.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.578+0000 7f9fb1b22700 1 -- 172.21.15.123:0/1330409113 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fac0ffed0 msgr2=0x7f9fac1981a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:30.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.578+0000 7f9fb1b22700 1 --2- 172.21.15.123:0/1330409113 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9fac0ffed0 0x7f9fac1981a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00f7d0 tx=0x7f9f9c00f8b0 comp rx=0 tx=0).stop 2024-06-02T04:03:30.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.578+0000 7f9fabfff700 1 -- 172.21.15.123:0/1330409113 reap_dead start 2024-06-02T04:03:30.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.578+0000 7f9fb1b22700 1 -- 172.21.15.123:0/1330409113 shutdown_connections 2024-06-02T04:03:30.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.578+0000 7f9fb1b22700 1 -- 172.21.15.123:0/1330409113 >> 172.21.15.123:0/1330409113 conn(0x7f9fac075f80 msgr2=0x7f9fac0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:30.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.578+0000 7f9fb1b22700 1 -- 172.21.15.123:0/1330409113 shutdown_connections 2024-06-02T04:03:30.579 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:30.578+0000 7f9fb1b22700 1 -- 172.21.15.123:0/1330409113 wait complete. 2024-06-02T04:03:30.976 INFO:teuthology.orchestra.run.smithi123.stdout:55834574897 2024-06-02T04:03:30.976 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-06-02T04:03:32.034 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:31 smithi123 ceph-mon[42885]: pgmap v234: 97 pgs: 97 active+clean; 638 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-06-02T04:03:32.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:31 smithi162 ceph-mon[47009]: pgmap v234: 97 pgs: 97 active+clean; 638 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-06-02T04:03:32.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:31 smithi136 ceph-mon[47443]: pgmap v234: 97 pgs: 97 active+clean; 638 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-06-02T04:03:32.908 INFO:teuthology.orchestra.run.smithi123.stdout:244813135897 2024-06-02T04:03:32.909 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-06-02T04:03:33.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.313+0000 7fe3aa3cb700 1 -- 172.21.15.123:0/4242131467 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3a4107030 msgr2=0x7fe3a4107410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:33.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.313+0000 7fe3aa3cb700 1 --2- 172.21.15.123:0/4242131467 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3a4107030 0x7fe3a4107410 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe398009990 tx=0x7fe398009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:33.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.313+0000 7fe3aa3cb700 1 -- 172.21.15.123:0/4242131467 shutdown_connections 2024-06-02T04:03:33.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.313+0000 7fe3aa3cb700 1 --2- 172.21.15.123:0/4242131467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3a4101990 0x7fe3a410de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:33.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.313+0000 7fe3aa3cb700 1 --2- 172.21.15.123:0/4242131467 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3a4107030 0x7fe3a4107410 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:33.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.313+0000 7fe3aa3cb700 1 --2- 172.21.15.123:0/4242131467 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe3a4100ff0 0x7fe3a4101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:33.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.313+0000 7fe3aa3cb700 1 -- 172.21.15.123:0/4242131467 >> 172.21.15.123:0/4242131467 conn(0x7fe3a4078190 msgr2=0x7fe3a40785a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:33.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.313+0000 7fe3aa3cb700 1 -- 172.21.15.123:0/4242131467 shutdown_connections 2024-06-02T04:03:33.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.313+0000 7fe3aa3cb700 1 -- 172.21.15.123:0/4242131467 wait complete. 2024-06-02T04:03:33.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.314+0000 7fe3aa3cb700 1 Processor -- start 2024-06-02T04:03:33.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.314+0000 7fe3aa3cb700 1 -- start start 2024-06-02T04:03:33.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.314+0000 7fe3aa3cb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3a4100ff0 0x7fe3a41974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:33.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.314+0000 7fe3aa3cb700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3a4101990 0x7fe3a41979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:33.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.314+0000 7fe3aa3cb700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe3a4107030 0x7fe3a419bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:33.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.314+0000 7fe3aa3cb700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a419c350 con 0x7fe3a4100ff0 2024-06-02T04:03:33.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.314+0000 7fe3aa3cb700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a419c4c0 con 0x7fe3a4107030 2024-06-02T04:03:33.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.314+0000 7fe3aa3cb700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a419c680 con 0x7fe3a4101990 2024-06-02T04:03:33.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.314+0000 7fe3a3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3a4100ff0 0x7fe3a41974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:33.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.315+0000 7fe3a3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3a4100ff0 0x7fe3a41974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46394/0 (socket says 172.21.15.123:46394) 2024-06-02T04:03:33.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.315+0000 7fe3a3fff700 1 -- 172.21.15.123:0/4018760933 learned_addr learned my addr 172.21.15.123:0/4018760933 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:33.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.315+0000 7fe3a8968700 1 --2- 172.21.15.123:0/4018760933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe3a4107030 0x7fe3a419bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:33.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.315+0000 7fe3a37fe700 1 --2- 172.21.15.123:0/4018760933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3a4101990 0x7fe3a41979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:33.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.315+0000 7fe3a3fff700 1 -- 172.21.15.123:0/4018760933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3a4101990 msgr2=0x7fe3a41979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:33.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.315+0000 7fe3a3fff700 1 --2- 172.21.15.123:0/4018760933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3a4101990 0x7fe3a41979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:33.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.315+0000 7fe3a3fff700 1 -- 172.21.15.123:0/4018760933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe3a4107030 msgr2=0x7fe3a419bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:33.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.315+0000 7fe3a3fff700 1 --2- 172.21.15.123:0/4018760933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe3a4107030 0x7fe3a419bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:33.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.315+0000 7fe3a3fff700 1 -- 172.21.15.123:0/4018760933 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3980095f0 con 0x7fe3a4100ff0 2024-06-02T04:03:33.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.315+0000 7fe3a37fe700 1 --2- 172.21.15.123:0/4018760933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe3a4101990 0x7fe3a41979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:03:33.286 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.315+0000 7fe3a3fff700 1 --2- 172.21.15.123:0/4018760933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3a4100ff0 0x7fe3a41974a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe398000c00 tx=0x7fe39800f880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:33.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.315+0000 7fe3a17fa700 1 -- 172.21.15.123:0/4018760933 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39801d070 con 0x7fe3a4100ff0 2024-06-02T04:03:33.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.315+0000 7fe3a17fa700 1 -- 172.21.15.123:0/4018760933 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe39800fde0 con 0x7fe3a4100ff0 2024-06-02T04:03:33.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.315+0000 7fe3aa3cb700 1 -- 172.21.15.123:0/4018760933 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a419c900 con 0x7fe3a4100ff0 2024-06-02T04:03:33.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.315+0000 7fe3a17fa700 1 -- 172.21.15.123:0/4018760933 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe398017770 con 0x7fe3a4100ff0 2024-06-02T04:03:33.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.315+0000 7fe3aa3cb700 1 -- 172.21.15.123:0/4018760933 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a41a41c0 con 0x7fe3a4100ff0 2024-06-02T04:03:33.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.316+0000 7fe3aa3cb700 1 -- 172.21.15.123:0/4018760933 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe3a419cbd0 con 0x7fe3a4100ff0 2024-06-02T04:03:33.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.318+0000 7fe3a17fa700 1 -- 172.21.15.123:0/4018760933 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fe398022aa0 con 0x7fe3a4100ff0 2024-06-02T04:03:33.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.318+0000 7fe3a17fa700 1 --2- 172.21.15.123:0/4018760933 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe38c0a11b0 0x7fe38c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:33.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.318+0000 7fe3a37fe700 1 --2- 172.21.15.123:0/4018760933 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe38c0a11b0 0x7fe38c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:33.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.318+0000 7fe3a17fa700 1 -- 172.21.15.123:0/4018760933 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe3980ce300 con 0x7fe3a4100ff0 2024-06-02T04:03:33.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.318+0000 7fe3a17fa700 1 --2- 172.21.15.123:0/4018760933 >> [v2:172.21.15.123:6810/1403773143,v1:172.21.15.123:6811/1403773143] conn(0x7fe38c0aa990 0x7fe38c0acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:33.287 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.318+0000 7fe3a17fa700 1 -- 172.21.15.123:0/4018760933 --> [v2:172.21.15.123:6810/1403773143,v1:172.21.15.123:6811/1403773143] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe38c0ad460 con 0x7fe38c0aa990 2024-06-02T04:03:33.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.318+0000 7fe3a17fa700 1 -- 172.21.15.123:0/4018760933 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3980ce670 con 0x7fe3a4100ff0 2024-06-02T04:03:33.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.319+0000 7fe3a8968700 1 --2- 172.21.15.123:0/4018760933 >> [v2:172.21.15.123:6810/1403773143,v1:172.21.15.123:6811/1403773143] conn(0x7fe38c0aa990 0x7fe38c0acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:33.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.319+0000 7fe3a37fe700 1 --2- 172.21.15.123:0/4018760933 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe38c0a11b0 0x7fe38c0a3670 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe3a41989b0 tx=0x7fe394008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:33.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.319+0000 7fe3a8968700 1 --2- 172.21.15.123:0/4018760933 >> [v2:172.21.15.123:6810/1403773143,v1:172.21.15.123:6811/1403773143] conn(0x7fe38c0aa990 0x7fe38c0acdb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:33.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.320+0000 7fe3a17fa700 1 -- 172.21.15.123:0/4018760933 <== osd.3 v2:172.21.15.123:6810/1403773143 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fe38c0ad460 con 0x7fe38c0aa990 2024-06-02T04:03:33.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.335+0000 7fe3aa3cb700 1 -- 172.21.15.123:0/4018760933 --> [v2:172.21.15.123:6810/1403773143,v1:172.21.15.123:6811/1403773143] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe3a41111f0 con 0x7fe38c0aa990 2024-06-02T04:03:33.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.336+0000 7fe3a17fa700 1 -- 172.21.15.123:0/4018760933 <== osd.3 v2:172.21.15.123:6810/1403773143 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fe3a41111f0 con 0x7fe38c0aa990 2024-06-02T04:03:33.288 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.336+0000 7fe3aa3cb700 1 -- 172.21.15.123:0/4018760933 >> [v2:172.21.15.123:6810/1403773143,v1:172.21.15.123:6811/1403773143] conn(0x7fe38c0aa990 msgr2=0x7fe38c0acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:33.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.336+0000 7fe3aa3cb700 1 --2- 172.21.15.123:0/4018760933 >> [v2:172.21.15.123:6810/1403773143,v1:172.21.15.123:6811/1403773143] conn(0x7fe38c0aa990 0x7fe38c0acdb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:33.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.336+0000 7fe3aa3cb700 1 -- 172.21.15.123:0/4018760933 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe38c0a11b0 msgr2=0x7fe38c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:33.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.336+0000 7fe3aa3cb700 1 --2- 172.21.15.123:0/4018760933 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe38c0a11b0 0x7fe38c0a3670 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe3a41989b0 tx=0x7fe394008040 comp rx=0 tx=0).stop 2024-06-02T04:03:33.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.336+0000 7fe3aa3cb700 1 -- 172.21.15.123:0/4018760933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3a4100ff0 msgr2=0x7fe3a41974a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:33.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.336+0000 7fe3aa3cb700 1 --2- 172.21.15.123:0/4018760933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe3a4100ff0 0x7fe3a41974a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe398000c00 tx=0x7fe39800f880 comp rx=0 tx=0).stop 2024-06-02T04:03:33.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.336+0000 7fe3a8968700 1 -- 172.21.15.123:0/4018760933 reap_dead start 2024-06-02T04:03:33.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.336+0000 7fe3aa3cb700 1 -- 172.21.15.123:0/4018760933 shutdown_connections 2024-06-02T04:03:33.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.336+0000 7fe3aa3cb700 1 -- 172.21.15.123:0/4018760933 >> 172.21.15.123:0/4018760933 conn(0x7fe3a4078190 msgr2=0x7fe3a40ffef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:33.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.336+0000 7fe3aa3cb700 1 -- 172.21.15.123:0/4018760933 shutdown_connections 2024-06-02T04:03:33.289 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:32.336+0000 7fe3aa3cb700 1 -- 172.21.15.123:0/4018760933 wait complete. 2024-06-02T04:03:33.548 INFO:teuthology.orchestra.run.smithi123.stdout:188978561055 2024-06-02T04:03:33.548 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-06-02T04:03:34.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.000+0000 7faa71e4d700 1 -- 172.21.15.123:0/1546090889 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa6c068950 msgr2=0x7faa6c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:34.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.000+0000 7faa71e4d700 1 --2- 172.21.15.123:0/1546090889 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa6c068950 0x7faa6c068db0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7faa60009990 tx=0x7faa60009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:34.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.000+0000 7faa71e4d700 1 -- 172.21.15.123:0/1546090889 shutdown_connections 2024-06-02T04:03:34.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.000+0000 7faa71e4d700 1 --2- 172.21.15.123:0/1546090889 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa6c0692f0 0x7faa6c10de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:34.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.000+0000 7faa71e4d700 1 --2- 172.21.15.123:0/1546090889 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa6c107020 0x7faa6c107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:34.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.000+0000 7faa71e4d700 1 --2- 172.21.15.123:0/1546090889 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa6c068950 0x7faa6c068db0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:34.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.000+0000 7faa71e4d700 1 -- 172.21.15.123:0/1546090889 >> 172.21.15.123:0/1546090889 conn(0x7faa6c075f80 msgr2=0x7faa6c076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:34.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.000+0000 7faa71e4d700 1 -- 172.21.15.123:0/1546090889 shutdown_connections 2024-06-02T04:03:34.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.000+0000 7faa71e4d700 1 -- 172.21.15.123:0/1546090889 wait complete. 2024-06-02T04:03:34.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.001+0000 7faa71e4d700 1 Processor -- start 2024-06-02T04:03:34.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.001+0000 7faa71e4d700 1 -- start start 2024-06-02T04:03:34.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.001+0000 7faa71e4d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa6c068950 0x7faa6c197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:34.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.001+0000 7faa71e4d700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa6c0692f0 0x7faa6c197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:34.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.001+0000 7faa71e4d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa6c107020 0x7faa6c19bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:34.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.001+0000 7faa71e4d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c19c330 con 0x7faa6c107020 2024-06-02T04:03:34.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.001+0000 7faa71e4d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c19c4a0 con 0x7faa6c068950 2024-06-02T04:03:34.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.001+0000 7faa71e4d700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c19c660 con 0x7faa6c0692f0 2024-06-02T04:03:34.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.002+0000 7faa6bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa6c107020 0x7faa6c19bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:34.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.002+0000 7faa6bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa6c107020 0x7faa6c19bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46404/0 (socket says 172.21.15.123:46404) 2024-06-02T04:03:34.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.002+0000 7faa6bfff700 1 -- 172.21.15.123:0/403485416 learned_addr learned my addr 172.21.15.123:0/403485416 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:34.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.002+0000 7faa6affd700 1 --2- 172.21.15.123:0/403485416 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa6c0692f0 0x7faa6c197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:34.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.002+0000 7faa6b7fe700 1 --2- 172.21.15.123:0/403485416 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa6c068950 0x7faa6c197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:34.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.002+0000 7faa6bfff700 1 -- 172.21.15.123:0/403485416 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa6c0692f0 msgr2=0x7faa6c197970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:34.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.002+0000 7faa6bfff700 1 --2- 172.21.15.123:0/403485416 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa6c0692f0 0x7faa6c197970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:34.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.002+0000 7faa6bfff700 1 -- 172.21.15.123:0/403485416 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa6c068950 msgr2=0x7faa6c197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:34.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.002+0000 7faa6bfff700 1 --2- 172.21.15.123:0/403485416 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa6c068950 0x7faa6c197430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:34.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.002+0000 7faa6bfff700 1 -- 172.21.15.123:0/403485416 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa600095f0 con 0x7faa6c107020 2024-06-02T04:03:34.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.002+0000 7faa6bfff700 1 --2- 172.21.15.123:0/403485416 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa6c107020 0x7faa6c19bd20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faa6400ada0 tx=0x7faa6400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:34.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.002+0000 7faa68ff9700 1 -- 172.21.15.123:0/403485416 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6400f070 con 0x7faa6c107020 2024-06-02T04:03:34.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.002+0000 7faa71e4d700 1 -- 172.21.15.123:0/403485416 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa6c19c940 con 0x7faa6c107020 2024-06-02T04:03:34.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.002+0000 7faa68ff9700 1 -- 172.21.15.123:0/403485416 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa64007b30 con 0x7faa6c107020 2024-06-02T04:03:34.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.002+0000 7faa68ff9700 1 -- 172.21.15.123:0/403485416 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa64005280 con 0x7faa6c107020 2024-06-02T04:03:34.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.002+0000 7faa71e4d700 1 -- 172.21.15.123:0/403485416 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa6c1000a0 con 0x7faa6c107020 2024-06-02T04:03:34.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.003+0000 7faa71e4d700 1 -- 172.21.15.123:0/403485416 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa6c109540 con 0x7faa6c107020 2024-06-02T04:03:34.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.005+0000 7faa68ff9700 1 -- 172.21.15.123:0/403485416 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7faa6400a090 con 0x7faa6c107020 2024-06-02T04:03:34.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.006+0000 7faa68ff9700 1 --2- 172.21.15.123:0/403485416 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7faa540a11b0 0x7faa540a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:34.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.006+0000 7faa68ff9700 1 -- 172.21.15.123:0/403485416 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7faa640cc420 con 0x7faa6c107020 2024-06-02T04:03:34.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.006+0000 7faa6b7fe700 1 --2- 172.21.15.123:0/403485416 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7faa540a11b0 0x7faa540a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:34.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.006+0000 7faa6b7fe700 1 --2- 172.21.15.123:0/403485416 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7faa540a11b0 0x7faa540a3670 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faa5c005950 tx=0x7faa5c00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:34.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.009+0000 7faa68ff9700 1 -- 172.21.15.123:0/403485416 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7faa64099720 con 0x7faa6c107020 2024-06-02T04:03:34.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.067+0000 7fb41605c700 1 -- 172.21.15.123:0/2035721212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb410100ff0 msgr2=0x7fb410101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:34.067 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.067+0000 7fb41605c700 1 --2- 172.21.15.123:0/2035721212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb410100ff0 0x7fb410101470 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8009990 tx=0x7fb3f8009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:34.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.067+0000 7fb41605c700 1 -- 172.21.15.123:0/2035721212 shutdown_connections 2024-06-02T04:03:34.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.067+0000 7fb41605c700 1 --2- 172.21.15.123:0/2035721212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4101019b0 0x7fb41010dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:34.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.067+0000 7fb41605c700 1 --2- 172.21.15.123:0/2035721212 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb410107030 0x7fb410107410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:34.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.067+0000 7fb41605c700 1 --2- 172.21.15.123:0/2035721212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb410100ff0 0x7fb410101470 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:34.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.067+0000 7fb41605c700 1 -- 172.21.15.123:0/2035721212 >> 172.21.15.123:0/2035721212 conn(0x7fb410078100 msgr2=0x7fb410078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:34.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.067+0000 7fb41605c700 1 -- 172.21.15.123:0/2035721212 shutdown_connections 2024-06-02T04:03:34.068 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.067+0000 7fb41605c700 1 -- 172.21.15.123:0/2035721212 wait complete. 2024-06-02T04:03:34.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.068+0000 7fb41605c700 1 Processor -- start 2024-06-02T04:03:34.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.068+0000 7fb41605c700 1 -- start start 2024-06-02T04:03:34.069 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.068+0000 7fb41605c700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb410100ff0 0x7fb410197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:34.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.068+0000 7fb41605c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4101019b0 0x7fb410197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:34.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.068+0000 7fb41605c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb410107030 0x7fb41019bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:34.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.068+0000 7fb41605c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41019c1f0 con 0x7fb410107030 2024-06-02T04:03:34.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.068+0000 7fb41605c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41019c360 con 0x7fb4101019b0 2024-06-02T04:03:34.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.068+0000 7fb41605c700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41019c520 con 0x7fb410100ff0 2024-06-02T04:03:34.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.068+0000 7fb40ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb410107030 0x7fb41019bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:34.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.068+0000 7fb40ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb410107030 0x7fb41019bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:46426/0 (socket says 172.21.15.123:46426) 2024-06-02T04:03:34.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.068+0000 7fb40ffff700 1 -- 172.21.15.123:0/1119211738 learned_addr learned my addr 172.21.15.123:0/1119211738 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:34.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.069+0000 7fb40effd700 1 --2- 172.21.15.123:0/1119211738 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4101019b0 0x7fb410197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:34.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.069+0000 7fb40f7fe700 1 --2- 172.21.15.123:0/1119211738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb410100ff0 0x7fb410197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:34.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.069+0000 7fb40ffff700 1 -- 172.21.15.123:0/1119211738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb410100ff0 msgr2=0x7fb410197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:34.070 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.069+0000 7fb40ffff700 1 --2- 172.21.15.123:0/1119211738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb410100ff0 0x7fb410197340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:34.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.069+0000 7fb40ffff700 1 -- 172.21.15.123:0/1119211738 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4101019b0 msgr2=0x7fb410197880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:34.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.069+0000 7fb40ffff700 1 --2- 172.21.15.123:0/1119211738 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4101019b0 0x7fb410197880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:34.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.069+0000 7fb40ffff700 1 -- 172.21.15.123:0/1119211738 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f80095f0 con 0x7fb410107030 2024-06-02T04:03:34.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.069+0000 7fb40effd700 1 --2- 172.21.15.123:0/1119211738 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4101019b0 0x7fb410197880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:03:34.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.069+0000 7fb40ffff700 1 --2- 172.21.15.123:0/1119211738 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb410107030 0x7fb41019bbe0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb40800ef30 tx=0x7fb40800c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:34.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.069+0000 7fb40cff9700 1 -- 172.21.15.123:0/1119211738 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb408018070 con 0x7fb410107030 2024-06-02T04:03:34.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.069+0000 7fb40cff9700 1 -- 172.21.15.123:0/1119211738 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb40800f040 con 0x7fb410107030 2024-06-02T04:03:34.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.069+0000 7fb41605c700 1 -- 172.21.15.123:0/1119211738 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb41019c7a0 con 0x7fb410107030 2024-06-02T04:03:34.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.069+0000 7fb40cff9700 1 -- 172.21.15.123:0/1119211738 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb408003dc0 con 0x7fb410107030 2024-06-02T04:03:34.071 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.069+0000 7fb41605c700 1 -- 172.21.15.123:0/1119211738 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4100731d0 con 0x7fb410107030 2024-06-02T04:03:34.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.070+0000 7fb41605c700 1 -- 172.21.15.123:0/1119211738 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb41019ca80 con 0x7fb410107030 2024-06-02T04:03:34.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.071+0000 7fb40cff9700 1 -- 172.21.15.123:0/1119211738 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fb40800caa0 con 0x7fb410107030 2024-06-02T04:03:34.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.072+0000 7fb40cff9700 1 --2- 172.21.15.123:0/1119211738 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb3fc0a55c0 0x7fb3fc0a7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:34.072 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.072+0000 7fb40f7fe700 1 --2- 172.21.15.123:0/1119211738 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb3fc0a55c0 0x7fb3fc0a7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:34.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.072+0000 7fb40cff9700 1 -- 172.21.15.123:0/1119211738 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb4080ccee0 con 0x7fb410107030 2024-06-02T04:03:34.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.072+0000 7fb40cff9700 1 --2- 172.21.15.123:0/1119211738 >> [v2:172.21.15.162:6824/704809754,v1:172.21.15.162:6825/704809754] conn(0x7fb3fc0aeda0 0x7fb3fc0b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:34.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.072+0000 7fb40cff9700 1 -- 172.21.15.123:0/1119211738 --> [v2:172.21.15.162:6824/704809754,v1:172.21.15.162:6825/704809754] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb3fc0b1870 con 0x7fb3fc0aeda0 2024-06-02T04:03:34.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.072+0000 7fb40cff9700 1 -- 172.21.15.123:0/1119211738 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4080cd380 con 0x7fb410107030 2024-06-02T04:03:34.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.072+0000 7fb40f7fe700 1 --2- 172.21.15.123:0/1119211738 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb3fc0a55c0 0x7fb3fc0a7a80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb400005ea0 tx=0x7fb400005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:34.073 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.072+0000 7fb40effd700 1 --2- 172.21.15.123:0/1119211738 >> [v2:172.21.15.162:6824/704809754,v1:172.21.15.162:6825/704809754] conn(0x7fb3fc0aeda0 0x7fb3fc0b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:34.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:33 smithi123 ceph-mon[42885]: pgmap v235: 97 pgs: 97 active+clean; 638 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-06-02T04:03:34.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.073+0000 7fb40effd700 1 --2- 172.21.15.123:0/1119211738 >> [v2:172.21.15.162:6824/704809754,v1:172.21.15.162:6825/704809754] conn(0x7fb3fc0aeda0 0x7fb3fc0b11c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:34.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.074+0000 7fb40cff9700 1 -- 172.21.15.123:0/1119211738 <== osd.11 v2:172.21.15.162:6824/704809754 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb3fc0b1870 con 0x7fb3fc0aeda0 2024-06-02T04:03:34.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.090+0000 7fb41605c700 1 -- 172.21.15.123:0/1119211738 --> [v2:172.21.15.162:6824/704809754,v1:172.21.15.162:6825/704809754] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb410111190 con 0x7fb3fc0aeda0 2024-06-02T04:03:34.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.090+0000 7fb40cff9700 1 -- 172.21.15.123:0/1119211738 <== osd.11 v2:172.21.15.162:6824/704809754 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fb410111190 con 0x7fb3fc0aeda0 2024-06-02T04:03:34.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.091+0000 7fb41605c700 1 -- 172.21.15.123:0/1119211738 >> [v2:172.21.15.162:6824/704809754,v1:172.21.15.162:6825/704809754] conn(0x7fb3fc0aeda0 msgr2=0x7fb3fc0b11c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:34.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.091+0000 7fb41605c700 1 --2- 172.21.15.123:0/1119211738 >> [v2:172.21.15.162:6824/704809754,v1:172.21.15.162:6825/704809754] conn(0x7fb3fc0aeda0 0x7fb3fc0b11c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:34.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.091+0000 7fb41605c700 1 -- 172.21.15.123:0/1119211738 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb3fc0a55c0 msgr2=0x7fb3fc0a7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:34.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.091+0000 7fb41605c700 1 --2- 172.21.15.123:0/1119211738 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb3fc0a55c0 0x7fb3fc0a7a80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb400005ea0 tx=0x7fb400005e30 comp rx=0 tx=0).stop 2024-06-02T04:03:34.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.091+0000 7fb41605c700 1 -- 172.21.15.123:0/1119211738 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb410107030 msgr2=0x7fb41019bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:34.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.091+0000 7fb41605c700 1 --2- 172.21.15.123:0/1119211738 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb410107030 0x7fb41019bbe0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb40800ef30 tx=0x7fb40800c450 comp rx=0 tx=0).stop 2024-06-02T04:03:34.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.091+0000 7fb40ffff700 1 -- 172.21.15.123:0/1119211738 reap_dead start 2024-06-02T04:03:34.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.091+0000 7fb41605c700 1 -- 172.21.15.123:0/1119211738 shutdown_connections 2024-06-02T04:03:34.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.091+0000 7fb41605c700 1 -- 172.21.15.123:0/1119211738 >> 172.21.15.123:0/1119211738 conn(0x7fb410078100 msgr2=0x7fb4100ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:34.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.091+0000 7fb41605c700 1 -- 172.21.15.123:0/1119211738 shutdown_connections 2024-06-02T04:03:34.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.091+0000 7fb41605c700 1 -- 172.21.15.123:0/1119211738 wait complete. 2024-06-02T04:03:34.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.230+0000 7faa71e4d700 1 -- 172.21.15.123:0/403485416 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7faa6c04ec90 con 0x7faa6c107020 2024-06-02T04:03:34.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.231+0000 7faa68ff9700 1 -- 172.21.15.123:0/403485416 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faa640992b0 con 0x7faa6c107020 2024-06-02T04:03:34.231 INFO:teuthology.orchestra.run.smithi123.stdout:137438953512 2024-06-02T04:03:34.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.233+0000 7faa71e4d700 1 -- 172.21.15.123:0/403485416 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7faa540a11b0 msgr2=0x7faa540a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:34.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.233+0000 7faa71e4d700 1 --2- 172.21.15.123:0/403485416 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7faa540a11b0 0x7faa540a3670 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faa5c005950 tx=0x7faa5c00a300 comp rx=0 tx=0).stop 2024-06-02T04:03:34.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.233+0000 7faa71e4d700 1 -- 172.21.15.123:0/403485416 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa6c107020 msgr2=0x7faa6c19bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:34.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.233+0000 7faa71e4d700 1 --2- 172.21.15.123:0/403485416 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa6c107020 0x7faa6c19bd20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faa6400ada0 tx=0x7faa6400c330 comp rx=0 tx=0).stop 2024-06-02T04:03:34.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.233+0000 7faa71e4d700 1 -- 172.21.15.123:0/403485416 shutdown_connections 2024-06-02T04:03:34.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.233+0000 7faa71e4d700 1 --2- 172.21.15.123:0/403485416 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7faa6c107020 0x7faa6c19bd20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:34.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.233+0000 7faa71e4d700 1 --2- 172.21.15.123:0/403485416 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7faa540a11b0 0x7faa540a3670 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:34.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.233+0000 7faa71e4d700 1 --2- 172.21.15.123:0/403485416 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa6c068950 0x7faa6c197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:34.233 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.233+0000 7faa71e4d700 1 --2- 172.21.15.123:0/403485416 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa6c0692f0 0x7faa6c197970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:34.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.233+0000 7faa71e4d700 1 -- 172.21.15.123:0/403485416 >> 172.21.15.123:0/403485416 conn(0x7faa6c075f80 msgr2=0x7faa6c0fed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:34.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.233+0000 7faa71e4d700 1 -- 172.21.15.123:0/403485416 shutdown_connections 2024-06-02T04:03:34.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.233+0000 7faa71e4d700 1 -- 172.21.15.123:0/403485416 wait complete. 2024-06-02T04:03:34.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:33 smithi162 ceph-mon[47009]: pgmap v235: 97 pgs: 97 active+clean; 638 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-06-02T04:03:34.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:33 smithi136 ceph-mon[47443]: pgmap v235: 97 pgs: 97 active+clean; 638 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-06-02T04:03:34.816 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953510 got 137438953512 for osd.4 2024-06-02T04:03:34.816 DEBUG:teuthology.parallel:result is None 2024-06-02T04:03:34.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.754+0000 7f910fdc0700 1 -- 172.21.15.123:0/3786821279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91080731d0 msgr2=0x7f91080735b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:34.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.754+0000 7f910fdc0700 1 --2- 172.21.15.123:0/3786821279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91080731d0 0x7f91080735b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9104009990 tx=0x7f9104009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:34.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.754+0000 7f910fdc0700 1 -- 172.21.15.123:0/3786821279 shutdown_connections 2024-06-02T04:03:34.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.754+0000 7f910fdc0700 1 --2- 172.21.15.123:0/3786821279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f910810d9a0 0x7f910810fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:34.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.754+0000 7f910fdc0700 1 --2- 172.21.15.123:0/3786821279 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f91080731d0 0x7f91080735b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:34.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.754+0000 7f910fdc0700 1 --2- 172.21.15.123:0/3786821279 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9108073af0 0x7f910810d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:34.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.754+0000 7f910fdc0700 1 -- 172.21.15.123:0/3786821279 >> 172.21.15.123:0/3786821279 conn(0x7f9108078100 msgr2=0x7f9108078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:34.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.754+0000 7f910fdc0700 1 -- 172.21.15.123:0/3786821279 shutdown_connections 2024-06-02T04:03:34.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.754+0000 7f910fdc0700 1 -- 172.21.15.123:0/3786821279 wait complete. 2024-06-02T04:03:34.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.755+0000 7f910fdc0700 1 Processor -- start 2024-06-02T04:03:34.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.755+0000 7f910fdc0700 1 -- start start 2024-06-02T04:03:34.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.755+0000 7f910fdc0700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91080731d0 0x7f91081996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:34.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.755+0000 7f910fdc0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9108073af0 0x7f9108199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:34.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.755+0000 7f910fdc0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f910810d9a0 0x7f910819df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:34.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.755+0000 7f910fdc0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910819e5a0 con 0x7f9108073af0 2024-06-02T04:03:34.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.755+0000 7f910fdc0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910819e710 con 0x7f910810d9a0 2024-06-02T04:03:34.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.755+0000 7f910fdc0700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910819e8d0 con 0x7f91080731d0 2024-06-02T04:03:34.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.755+0000 7f910d35b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9108073af0 0x7f9108199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:34.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.755+0000 7f910d35b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9108073af0 0x7f9108199be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53232/0 (socket says 172.21.15.123:53232) 2024-06-02T04:03:34.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.755+0000 7f910d35b700 1 -- 172.21.15.123:0/3321167108 learned_addr learned my addr 172.21.15.123:0/3321167108 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:34.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.755+0000 7f910e35d700 1 --2- 172.21.15.123:0/3321167108 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f910810d9a0 0x7f910819df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:34.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.756+0000 7f910db5c700 1 --2- 172.21.15.123:0/3321167108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91080731d0 0x7f91081996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:34.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.756+0000 7f910d35b700 1 -- 172.21.15.123:0/3321167108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91080731d0 msgr2=0x7f91081996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:34.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.756+0000 7f910d35b700 1 --2- 172.21.15.123:0/3321167108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91080731d0 0x7f91081996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:34.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.756+0000 7f910d35b700 1 -- 172.21.15.123:0/3321167108 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f910810d9a0 msgr2=0x7f910819df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:34.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.756+0000 7f910d35b700 1 --2- 172.21.15.123:0/3321167108 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f910810d9a0 0x7f910819df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:34.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.756+0000 7f910d35b700 1 -- 172.21.15.123:0/3321167108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91040095f0 con 0x7f9108073af0 2024-06-02T04:03:34.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.756+0000 7f910e35d700 1 --2- 172.21.15.123:0/3321167108 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f910810d9a0 0x7f910819df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:03:34.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.756+0000 7f910d35b700 1 --2- 172.21.15.123:0/3321167108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9108073af0 0x7f9108199be0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f90f800b480 tx=0x7f90f800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:34.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.756+0000 7f90feffd700 1 -- 172.21.15.123:0/3321167108 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f8011830 con 0x7f9108073af0 2024-06-02T04:03:34.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.756+0000 7f90feffd700 1 -- 172.21.15.123:0/3321167108 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f90f8011e50 con 0x7f9108073af0 2024-06-02T04:03:34.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.756+0000 7f910fdc0700 1 -- 172.21.15.123:0/3321167108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f910819ebb0 con 0x7f9108073af0 2024-06-02T04:03:34.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.756+0000 7f90feffd700 1 -- 172.21.15.123:0/3321167108 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f800f2e0 con 0x7f9108073af0 2024-06-02T04:03:34.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.756+0000 7f910fdc0700 1 -- 172.21.15.123:0/3321167108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91081a6410 con 0x7f9108073af0 2024-06-02T04:03:34.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.757+0000 7f910fdc0700 1 -- 172.21.15.123:0/3321167108 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9108113470 con 0x7f9108073af0 2024-06-02T04:03:34.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.758+0000 7f90feffd700 1 -- 172.21.15.123:0/3321167108 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f90f8010380 con 0x7f9108073af0 2024-06-02T04:03:34.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.759+0000 7f90feffd700 1 --2- 172.21.15.123:0/3321167108 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f90f40a11b0 0x7f90f40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:34.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.759+0000 7f910db5c700 1 --2- 172.21.15.123:0/3321167108 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f90f40a11b0 0x7f90f40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:34.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.759+0000 7f90feffd700 1 -- 172.21.15.123:0/3321167108 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f90f80cc970 con 0x7f9108073af0 2024-06-02T04:03:34.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.759+0000 7f90feffd700 1 --2- 172.21.15.123:0/3321167108 >> [v2:172.21.15.162:6800/2915749676,v1:172.21.15.162:6801/2915749676] conn(0x7f90f40aa990 0x7f90f40acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:34.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.759+0000 7f90feffd700 1 -- 172.21.15.123:0/3321167108 --> [v2:172.21.15.162:6800/2915749676,v1:172.21.15.162:6801/2915749676] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f90f40ad460 con 0x7f90f40aa990 2024-06-02T04:03:34.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.759+0000 7f90feffd700 1 -- 172.21.15.123:0/3321167108 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90f80cce10 con 0x7f9108073af0 2024-06-02T04:03:34.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.759+0000 7f910db5c700 1 --2- 172.21.15.123:0/3321167108 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f90f40a11b0 0x7f90f40a3670 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9104006010 tx=0x7f910400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:34.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.759+0000 7f910e35d700 1 --2- 172.21.15.123:0/3321167108 >> [v2:172.21.15.162:6800/2915749676,v1:172.21.15.162:6801/2915749676] conn(0x7f90f40aa990 0x7f90f40acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:34.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.760+0000 7f910e35d700 1 --2- 172.21.15.123:0/3321167108 >> [v2:172.21.15.162:6800/2915749676,v1:172.21.15.162:6801/2915749676] conn(0x7f90f40aa990 0x7f90f40acdb0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:34.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.761+0000 7f90feffd700 1 -- 172.21.15.123:0/3321167108 <== osd.2 v2:172.21.15.162:6800/2915749676 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f90f40ad460 con 0x7f90f40aa990 2024-06-02T04:03:34.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.776+0000 7f910fdc0700 1 -- 172.21.15.123:0/3321167108 --> [v2:172.21.15.162:6800/2915749676,v1:172.21.15.162:6801/2915749676] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f91080616a0 con 0x7f90f40aa990 2024-06-02T04:03:34.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.777+0000 7f90feffd700 1 -- 172.21.15.123:0/3321167108 <== osd.2 v2:172.21.15.162:6800/2915749676 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f91080616a0 con 0x7f90f40aa990 2024-06-02T04:03:34.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.777+0000 7f910fdc0700 1 -- 172.21.15.123:0/3321167108 >> [v2:172.21.15.162:6800/2915749676,v1:172.21.15.162:6801/2915749676] conn(0x7f90f40aa990 msgr2=0x7f90f40acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:34.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.777+0000 7f910fdc0700 1 --2- 172.21.15.123:0/3321167108 >> [v2:172.21.15.162:6800/2915749676,v1:172.21.15.162:6801/2915749676] conn(0x7f90f40aa990 0x7f90f40acdb0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:34.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.778+0000 7f910fdc0700 1 -- 172.21.15.123:0/3321167108 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f90f40a11b0 msgr2=0x7f90f40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:34.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.778+0000 7f910fdc0700 1 --2- 172.21.15.123:0/3321167108 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f90f40a11b0 0x7f90f40a3670 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9104006010 tx=0x7f910400b540 comp rx=0 tx=0).stop 2024-06-02T04:03:34.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.778+0000 7f910fdc0700 1 -- 172.21.15.123:0/3321167108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9108073af0 msgr2=0x7f9108199be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:34.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.778+0000 7f910fdc0700 1 --2- 172.21.15.123:0/3321167108 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9108073af0 0x7f9108199be0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f90f800b480 tx=0x7f90f800b840 comp rx=0 tx=0).stop 2024-06-02T04:03:34.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.778+0000 7f910e35d700 1 -- 172.21.15.123:0/3321167108 reap_dead start 2024-06-02T04:03:34.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.778+0000 7f910fdc0700 1 -- 172.21.15.123:0/3321167108 shutdown_connections 2024-06-02T04:03:34.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.778+0000 7f910fdc0700 1 -- 172.21.15.123:0/3321167108 >> 172.21.15.123:0/3321167108 conn(0x7f9108078100 msgr2=0x7f91080fe2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:34.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.778+0000 7f910fdc0700 1 -- 172.21.15.123:0/3321167108 shutdown_connections 2024-06-02T04:03:34.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:34.778+0000 7f910fdc0700 1 -- 172.21.15.123:0/3321167108 wait complete. 2024-06-02T04:03:35.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:34 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/403485416' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-06-02T04:03:35.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.073+0000 7fe648865700 1 -- 172.21.15.123:0/40876595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe644100a50 msgr2=0x7fe644100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:35.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.073+0000 7fe648865700 1 --2- 172.21.15.123:0/40876595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe644100a50 0x7fe644100ed0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe6380099c0 tx=0x7fe638009cd0 comp rx=0 tx=0).stop 2024-06-02T04:03:35.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.073+0000 7fe648865700 1 -- 172.21.15.123:0/40876595 shutdown_connections 2024-06-02T04:03:35.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.073+0000 7fe648865700 1 --2- 172.21.15.123:0/40876595 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe644101410 0x7fe64410cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:35.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.073+0000 7fe648865700 1 --2- 172.21.15.123:0/40876595 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe644104ed0 0x7fe6441052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:35.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.073+0000 7fe648865700 1 --2- 172.21.15.123:0/40876595 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe644100a50 0x7fe644100ed0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:35.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.073+0000 7fe648865700 1 -- 172.21.15.123:0/40876595 >> 172.21.15.123:0/40876595 conn(0x7fe644075260 msgr2=0x7fe644075670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:35.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.073+0000 7fe648865700 1 -- 172.21.15.123:0/40876595 shutdown_connections 2024-06-02T04:03:35.075 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.074+0000 7fe648865700 1 -- 172.21.15.123:0/40876595 wait complete. 2024-06-02T04:03:35.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.074+0000 7fe648865700 1 Processor -- start 2024-06-02T04:03:35.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.074+0000 7fe648865700 1 -- start start 2024-06-02T04:03:35.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.074+0000 7fe648865700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe644100a50 0x7fe644197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:35.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.074+0000 7fe648865700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe644101410 0x7fe6441978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:35.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.074+0000 7fe648865700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe644104ed0 0x7fe64419bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:35.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.075+0000 7fe648865700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64419c280 con 0x7fe644101410 2024-06-02T04:03:35.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.075+0000 7fe648865700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64419c3f0 con 0x7fe644104ed0 2024-06-02T04:03:35.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.075+0000 7fe648865700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64419c5b0 con 0x7fe644100a50 2024-06-02T04:03:35.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.075+0000 7fe641d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe644101410 0x7fe6441978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:35.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.075+0000 7fe641d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe644101410 0x7fe6441978c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53252/0 (socket says 172.21.15.123:53252) 2024-06-02T04:03:35.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.075+0000 7fe641d9b700 1 -- 172.21.15.123:0/4154871882 learned_addr learned my addr 172.21.15.123:0/4154871882 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:35.080 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.075+0000 7fe64259c700 1 --2- 172.21.15.123:0/4154871882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe644100a50 0x7fe644197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:35.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.075+0000 7fe642d9d700 1 --2- 172.21.15.123:0/4154871882 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe644104ed0 0x7fe64419bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:35.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.075+0000 7fe641d9b700 1 -- 172.21.15.123:0/4154871882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe644100a50 msgr2=0x7fe644197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:35.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.075+0000 7fe641d9b700 1 --2- 172.21.15.123:0/4154871882 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe644100a50 0x7fe644197380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:35.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.075+0000 7fe641d9b700 1 -- 172.21.15.123:0/4154871882 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe644104ed0 msgr2=0x7fe64419bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:35.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.075+0000 7fe641d9b700 1 --2- 172.21.15.123:0/4154871882 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe644104ed0 0x7fe64419bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:35.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.075+0000 7fe641d9b700 1 -- 172.21.15.123:0/4154871882 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6380095f0 con 0x7fe644101410 2024-06-02T04:03:35.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.075+0000 7fe641d9b700 1 --2- 172.21.15.123:0/4154871882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe644101410 0x7fe6441978c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe6380098e0 tx=0x7fe638005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:35.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.075+0000 7fe6337fe700 1 -- 172.21.15.123:0/4154871882 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63801d070 con 0x7fe644101410 2024-06-02T04:03:35.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.075+0000 7fe6337fe700 1 -- 172.21.15.123:0/4154871882 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe63800fc30 con 0x7fe644101410 2024-06-02T04:03:35.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.075+0000 7fe648865700 1 -- 172.21.15.123:0/4154871882 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe64419c830 con 0x7fe644101410 2024-06-02T04:03:35.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.075+0000 7fe6337fe700 1 -- 172.21.15.123:0/4154871882 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe638022e40 con 0x7fe644101410 2024-06-02T04:03:35.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.075+0000 7fe648865700 1 -- 172.21.15.123:0/4154871882 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6441a40f0 con 0x7fe644101410 2024-06-02T04:03:35.081 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.077+0000 7fe648865700 1 -- 172.21.15.123:0/4154871882 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe644110080 con 0x7fe644101410 2024-06-02T04:03:35.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.078+0000 7fe6337fe700 1 -- 172.21.15.123:0/4154871882 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fe638022570 con 0x7fe644101410 2024-06-02T04:03:35.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.078+0000 7fe6337fe700 1 --2- 172.21.15.123:0/4154871882 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe62c0a11b0 0x7fe62c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:35.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.078+0000 7fe64259c700 1 --2- 172.21.15.123:0/4154871882 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe62c0a11b0 0x7fe62c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:35.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.078+0000 7fe6337fe700 1 -- 172.21.15.123:0/4154871882 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe6380cdb20 con 0x7fe644101410 2024-06-02T04:03:35.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.078+0000 7fe6337fe700 1 --2- 172.21.15.123:0/4154871882 >> [v2:172.21.15.123:6826/608720685,v1:172.21.15.123:6827/608720685] conn(0x7fe62c0aa990 0x7fe62c0acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:35.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.078+0000 7fe6337fe700 1 -- 172.21.15.123:0/4154871882 --> [v2:172.21.15.123:6826/608720685,v1:172.21.15.123:6827/608720685] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe62c0ad460 con 0x7fe62c0aa990 2024-06-02T04:03:35.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.078+0000 7fe6337fe700 1 -- 172.21.15.123:0/4154871882 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6380d22c0 con 0x7fe644101410 2024-06-02T04:03:35.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.079+0000 7fe642d9d700 1 --2- 172.21.15.123:0/4154871882 >> [v2:172.21.15.123:6826/608720685,v1:172.21.15.123:6827/608720685] conn(0x7fe62c0aa990 0x7fe62c0acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:35.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.079+0000 7fe64259c700 1 --2- 172.21.15.123:0/4154871882 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe62c0a11b0 0x7fe62c0a3670 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe634009a10 tx=0x7fe634009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:35.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.079+0000 7fe642d9d700 1 --2- 172.21.15.123:0/4154871882 >> [v2:172.21.15.123:6826/608720685,v1:172.21.15.123:6827/608720685] conn(0x7fe62c0aa990 0x7fe62c0acdb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:35.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.080+0000 7fe6337fe700 1 -- 172.21.15.123:0/4154871882 <== osd.9 v2:172.21.15.123:6826/608720685 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fe62c0ad460 con 0x7fe62c0aa990 2024-06-02T04:03:35.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.096+0000 7fe648865700 1 -- 172.21.15.123:0/4154871882 --> [v2:172.21.15.123:6826/608720685,v1:172.21.15.123:6827/608720685] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe644061620 con 0x7fe62c0aa990 2024-06-02T04:03:35.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.096+0000 7fe6337fe700 1 -- 172.21.15.123:0/4154871882 <== osd.9 v2:172.21.15.123:6826/608720685 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fe644061620 con 0x7fe62c0aa990 2024-06-02T04:03:35.096 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.096+0000 7fe648865700 1 -- 172.21.15.123:0/4154871882 >> [v2:172.21.15.123:6826/608720685,v1:172.21.15.123:6827/608720685] conn(0x7fe62c0aa990 msgr2=0x7fe62c0acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:35.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.096+0000 7fe648865700 1 --2- 172.21.15.123:0/4154871882 >> [v2:172.21.15.123:6826/608720685,v1:172.21.15.123:6827/608720685] conn(0x7fe62c0aa990 0x7fe62c0acdb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:35.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.096+0000 7fe648865700 1 -- 172.21.15.123:0/4154871882 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe62c0a11b0 msgr2=0x7fe62c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:35.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.096+0000 7fe648865700 1 --2- 172.21.15.123:0/4154871882 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe62c0a11b0 0x7fe62c0a3670 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe634009a10 tx=0x7fe634009190 comp rx=0 tx=0).stop 2024-06-02T04:03:35.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.096+0000 7fe648865700 1 -- 172.21.15.123:0/4154871882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe644101410 msgr2=0x7fe6441978c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:35.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.096+0000 7fe648865700 1 --2- 172.21.15.123:0/4154871882 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe644101410 0x7fe6441978c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe6380098e0 tx=0x7fe638005740 comp rx=0 tx=0).stop 2024-06-02T04:03:35.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.096+0000 7fe642d9d700 1 -- 172.21.15.123:0/4154871882 reap_dead start 2024-06-02T04:03:35.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.097+0000 7fe648865700 1 -- 172.21.15.123:0/4154871882 shutdown_connections 2024-06-02T04:03:35.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.097+0000 7fe648865700 1 -- 172.21.15.123:0/4154871882 >> 172.21.15.123:0/4154871882 conn(0x7fe644075260 msgr2=0x7fe6440ffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:35.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.097+0000 7fe648865700 1 -- 172.21.15.123:0/4154871882 shutdown_connections 2024-06-02T04:03:35.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.097+0000 7fe648865700 1 -- 172.21.15.123:0/4154871882 wait complete. 2024-06-02T04:03:35.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.134+0000 7f7ade0e8700 1 -- 172.21.15.123:0/609457054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad8104650 msgr2=0x7f7ad8104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:35.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.134+0000 7f7ade0e8700 1 --2- 172.21.15.123:0/609457054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad8104650 0x7f7ad8104a30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8009990 tx=0x7f7ac8009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:35.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.134+0000 7f7ade0e8700 1 -- 172.21.15.123:0/609457054 shutdown_connections 2024-06-02T04:03:35.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.134+0000 7f7ade0e8700 1 --2- 172.21.15.123:0/609457054 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ad8100300 0x7f7ad810c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:35.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.134+0000 7f7ade0e8700 1 --2- 172.21.15.123:0/609457054 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad8104650 0x7f7ad8104a30 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:35.134 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.134+0000 7f7ade0e8700 1 --2- 172.21.15.123:0/609457054 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ad80ff940 0x7f7ad80ffdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:35.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.134+0000 7f7ade0e8700 1 -- 172.21.15.123:0/609457054 >> 172.21.15.123:0/609457054 conn(0x7f7ad8075260 msgr2=0x7f7ad8075670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:35.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.134+0000 7f7ade0e8700 1 -- 172.21.15.123:0/609457054 shutdown_connections 2024-06-02T04:03:35.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.134+0000 7f7ade0e8700 1 -- 172.21.15.123:0/609457054 wait complete. 2024-06-02T04:03:35.135 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.134+0000 7f7ade0e8700 1 Processor -- start 2024-06-02T04:03:35.136 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.135+0000 7f7ade0e8700 1 -- start start 2024-06-02T04:03:35.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.135+0000 7f7ade0e8700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad80ff940 0x7f7ad8199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:35.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.135+0000 7f7ade0e8700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ad8100300 0x7f7ad8199b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:35.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.135+0000 7f7ade0e8700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ad8104650 0x7f7ad819df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:35.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.135+0000 7f7ade0e8700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad819e510 con 0x7f7ad80ff940 2024-06-02T04:03:35.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.135+0000 7f7ade0e8700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad819e680 con 0x7f7ad8100300 2024-06-02T04:03:35.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.135+0000 7f7ade0e8700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad819e840 con 0x7f7ad8104650 2024-06-02T04:03:35.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.135+0000 7f7ad77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad80ff940 0x7f7ad8199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:35.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.135+0000 7f7ad77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad80ff940 0x7f7ad8199610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53274/0 (socket says 172.21.15.123:53274) 2024-06-02T04:03:35.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.135+0000 7f7ad77fe700 1 -- 172.21.15.123:0/253561627 learned_addr learned my addr 172.21.15.123:0/253561627 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:35.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.135+0000 7f7ad6ffd700 1 --2- 172.21.15.123:0/253561627 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ad8100300 0x7f7ad8199b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:35.137 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.135+0000 7f7ad77fe700 1 -- 172.21.15.123:0/253561627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ad8104650 msgr2=0x7f7ad819df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:35.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.135+0000 7f7ad7fff700 1 --2- 172.21.15.123:0/253561627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ad8104650 0x7f7ad819df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:35.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.135+0000 7f7ad77fe700 1 --2- 172.21.15.123:0/253561627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ad8104650 0x7f7ad819df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:35.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.135+0000 7f7ad77fe700 1 -- 172.21.15.123:0/253561627 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ad8100300 msgr2=0x7f7ad8199b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:35.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.135+0000 7f7ad77fe700 1 --2- 172.21.15.123:0/253561627 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ad8100300 0x7f7ad8199b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:35.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.135+0000 7f7ad77fe700 1 -- 172.21.15.123:0/253561627 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac80095f0 con 0x7f7ad80ff940 2024-06-02T04:03:35.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.135+0000 7f7ad6ffd700 1 --2- 172.21.15.123:0/253561627 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7ad8100300 0x7f7ad8199b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:03:35.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.135+0000 7f7ad7fff700 1 --2- 172.21.15.123:0/253561627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ad8104650 0x7f7ad819df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:03:35.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.135+0000 7f7ad77fe700 1 --2- 172.21.15.123:0/253561627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad80ff940 0x7f7ad8199610 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8003a90 tx=0x7f7ac8003b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:35.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.135+0000 7f7ad4ff9700 1 -- 172.21.15.123:0/253561627 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac801d070 con 0x7f7ad80ff940 2024-06-02T04:03:35.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.135+0000 7f7ade0e8700 1 -- 172.21.15.123:0/253561627 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad819eac0 con 0x7f7ad80ff940 2024-06-02T04:03:35.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.135+0000 7f7ad4ff9700 1 -- 172.21.15.123:0/253561627 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ac8003e80 con 0x7f7ad80ff940 2024-06-02T04:03:35.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.136+0000 7f7ad4ff9700 1 -- 172.21.15.123:0/253561627 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac800fdf0 con 0x7f7ad80ff940 2024-06-02T04:03:35.138 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.136+0000 7f7ade0e8700 1 -- 172.21.15.123:0/253561627 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad81a6380 con 0x7f7ad80ff940 2024-06-02T04:03:35.139 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.136+0000 7f7ade0e8700 1 -- 172.21.15.123:0/253561627 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7ac4000fc0 con 0x7f7ad80ff940 2024-06-02T04:03:35.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.138+0000 7f7ad4ff9700 1 -- 172.21.15.123:0/253561627 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f7ac800f460 con 0x7f7ad80ff940 2024-06-02T04:03:35.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.138+0000 7f7ad4ff9700 1 --2- 172.21.15.123:0/253561627 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7ac00a11b0 0x7f7ac00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:35.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.138+0000 7f7ad6ffd700 1 --2- 172.21.15.123:0/253561627 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7ac00a11b0 0x7f7ac00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:35.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.138+0000 7f7ad4ff9700 1 -- 172.21.15.123:0/253561627 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7ac80ce3a0 con 0x7f7ad80ff940 2024-06-02T04:03:35.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.138+0000 7f7ad4ff9700 1 --2- 172.21.15.123:0/253561627 >> [v2:172.21.15.136:6824/3777263126,v1:172.21.15.136:6825/3777263126] conn(0x7f7ac00aa990 0x7f7ac00acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:35.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.138+0000 7f7ad4ff9700 1 -- 172.21.15.123:0/253561627 --> [v2:172.21.15.136:6824/3777263126,v1:172.21.15.136:6825/3777263126] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7ac00ad460 con 0x7f7ac00aa990 2024-06-02T04:03:35.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.138+0000 7f7ad4ff9700 1 -- 172.21.15.123:0/253561627 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ac80ce840 con 0x7f7ad80ff940 2024-06-02T04:03:35.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.139+0000 7f7ad6ffd700 1 --2- 172.21.15.123:0/253561627 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7ac00a11b0 0x7f7ac00a3670 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7ad819ab70 tx=0x7f7acc00b5f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:35.140 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.139+0000 7f7ad7fff700 1 --2- 172.21.15.123:0/253561627 >> [v2:172.21.15.136:6824/3777263126,v1:172.21.15.136:6825/3777263126] conn(0x7f7ac00aa990 0x7f7ac00acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:35.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.139+0000 7f7ad7fff700 1 --2- 172.21.15.123:0/253561627 >> [v2:172.21.15.136:6824/3777263126,v1:172.21.15.136:6825/3777263126] conn(0x7f7ac00aa990 0x7f7ac00acdb0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:35.141 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.140+0000 7f7ad4ff9700 1 -- 172.21.15.123:0/253561627 <== osd.10 v2:172.21.15.136:6824/3777263126 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f7ac00ad460 con 0x7f7ac00aa990 2024-06-02T04:03:35.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.156+0000 7f7ade0e8700 1 -- 172.21.15.123:0/253561627 --> [v2:172.21.15.136:6824/3777263126,v1:172.21.15.136:6825/3777263126] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7ac4002d40 con 0x7f7ac00aa990 2024-06-02T04:03:35.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.157+0000 7f7ad4ff9700 1 -- 172.21.15.123:0/253561627 <== osd.10 v2:172.21.15.136:6824/3777263126 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f7ac4002d40 con 0x7f7ac00aa990 2024-06-02T04:03:35.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.158+0000 7f7ade0e8700 1 -- 172.21.15.123:0/253561627 >> [v2:172.21.15.136:6824/3777263126,v1:172.21.15.136:6825/3777263126] conn(0x7f7ac00aa990 msgr2=0x7f7ac00acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:35.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.158+0000 7f7ade0e8700 1 --2- 172.21.15.123:0/253561627 >> [v2:172.21.15.136:6824/3777263126,v1:172.21.15.136:6825/3777263126] conn(0x7f7ac00aa990 0x7f7ac00acdb0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:35.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.158+0000 7f7ade0e8700 1 -- 172.21.15.123:0/253561627 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7ac00a11b0 msgr2=0x7f7ac00a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:35.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.158+0000 7f7ade0e8700 1 --2- 172.21.15.123:0/253561627 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7ac00a11b0 0x7f7ac00a3670 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7ad819ab70 tx=0x7f7acc00b5f0 comp rx=0 tx=0).stop 2024-06-02T04:03:35.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.158+0000 7f7ade0e8700 1 -- 172.21.15.123:0/253561627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad80ff940 msgr2=0x7f7ad8199610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:35.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.158+0000 7f7ade0e8700 1 --2- 172.21.15.123:0/253561627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7ad80ff940 0x7f7ad8199610 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8003a90 tx=0x7f7ac8003b70 comp rx=0 tx=0).stop 2024-06-02T04:03:35.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.158+0000 7f7ad7fff700 1 -- 172.21.15.123:0/253561627 reap_dead start 2024-06-02T04:03:35.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.158+0000 7f7ade0e8700 1 -- 172.21.15.123:0/253561627 shutdown_connections 2024-06-02T04:03:35.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.158+0000 7f7ade0e8700 1 -- 172.21.15.123:0/253561627 >> 172.21.15.123:0/253561627 conn(0x7f7ad8075260 msgr2=0x7f7ad810b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:35.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.158+0000 7f7ade0e8700 1 -- 172.21.15.123:0/253561627 shutdown_connections 2024-06-02T04:03:35.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.158+0000 7f7ade0e8700 1 -- 172.21.15.123:0/253561627 wait complete. 2024-06-02T04:03:35.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.268+0000 7f79713ce700 1 -- 172.21.15.123:0/3526859933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f796c1062b0 msgr2=0x7f796c10de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:35.273 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.268+0000 7f79713ce700 1 --2- 172.21.15.123:0/3526859933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f796c1062b0 0x7f796c10de80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f796400b0a0 tx=0x7f796400b3b0 comp rx=0 tx=0).stop 2024-06-02T04:03:35.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.268+0000 7f79713ce700 1 -- 172.21.15.123:0/3526859933 shutdown_connections 2024-06-02T04:03:35.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.268+0000 7f79713ce700 1 --2- 172.21.15.123:0/3526859933 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f796c1062b0 0x7f796c10de80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:35.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.268+0000 7f79713ce700 1 --2- 172.21.15.123:0/3526859933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f796c101250 0x7f796c101630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:35.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.268+0000 7f79713ce700 1 --2- 172.21.15.123:0/3526859933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f796c101c00 0x7f796c105bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:35.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.268+0000 7f79713ce700 1 -- 172.21.15.123:0/3526859933 >> 172.21.15.123:0/3526859933 conn(0x7f796c078100 msgr2=0x7f796c078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:35.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.268+0000 7f79713ce700 1 -- 172.21.15.123:0/3526859933 shutdown_connections 2024-06-02T04:03:35.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.268+0000 7f79713ce700 1 -- 172.21.15.123:0/3526859933 wait complete. 2024-06-02T04:03:35.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.269+0000 7f79713ce700 1 Processor -- start 2024-06-02T04:03:35.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.269+0000 7f79713ce700 1 -- start start 2024-06-02T04:03:35.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.269+0000 7f79713ce700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f796c101250 0x7f796c197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:35.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.269+0000 7f79713ce700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f796c101c00 0x7f796c1979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:35.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.269+0000 7f79713ce700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f796c1062b0 0x7f796c19bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:35.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.269+0000 7f79713ce700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c19c360 con 0x7f796c101c00 2024-06-02T04:03:35.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.269+0000 7f79713ce700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c19c4d0 con 0x7f796c1062b0 2024-06-02T04:03:35.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.269+0000 7f79713ce700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c19c690 con 0x7f796c101250 2024-06-02T04:03:35.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.269+0000 7f796a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f796c101c00 0x7f796c1979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:35.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.269+0000 7f796a7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f796c101c00 0x7f796c1979a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53296/0 (socket says 172.21.15.123:53296) 2024-06-02T04:03:35.276 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.269+0000 7f796a7fc700 1 -- 172.21.15.123:0/1598591841 learned_addr learned my addr 172.21.15.123:0/1598591841 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:35.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.269+0000 7f796b7fe700 1 --2- 172.21.15.123:0/1598591841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f796c1062b0 0x7f796c19bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:35.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.269+0000 7f796a7fc700 1 -- 172.21.15.123:0/1598591841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f796c101250 msgr2=0x7f796c197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:35.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.269+0000 7f796affd700 1 --2- 172.21.15.123:0/1598591841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f796c101250 0x7f796c197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:35.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.269+0000 7f796a7fc700 1 --2- 172.21.15.123:0/1598591841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f796c101250 0x7f796c197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:35.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.269+0000 7f796a7fc700 1 -- 172.21.15.123:0/1598591841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f796c1062b0 msgr2=0x7f796c19bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:35.277 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.269+0000 7f796a7fc700 1 --2- 172.21.15.123:0/1598591841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f796c1062b0 0x7f796c19bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:35.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.269+0000 7f796a7fc700 1 -- 172.21.15.123:0/1598591841 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7964009d00 con 0x7f796c101c00 2024-06-02T04:03:35.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.269+0000 7f796b7fe700 1 --2- 172.21.15.123:0/1598591841 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f796c1062b0 0x7f796c19bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:03:35.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.269+0000 7f796affd700 1 --2- 172.21.15.123:0/1598591841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f796c101250 0x7f796c197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:03:35.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.270+0000 7f796a7fc700 1 --2- 172.21.15.123:0/1598591841 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f796c101c00 0x7f796c1979a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f796000c8f0 tx=0x7f796000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:35.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.270+0000 7f7953fff700 1 -- 172.21.15.123:0/1598591841 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7960007b00 con 0x7f796c101c00 2024-06-02T04:03:35.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.270+0000 7f79713ce700 1 -- 172.21.15.123:0/1598591841 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f796c19c970 con 0x7f796c101c00 2024-06-02T04:03:35.278 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.270+0000 7f7953fff700 1 -- 172.21.15.123:0/1598591841 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7960007c60 con 0x7f796c101c00 2024-06-02T04:03:35.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.270+0000 7f7953fff700 1 -- 172.21.15.123:0/1598591841 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7960018660 con 0x7f796c101c00 2024-06-02T04:03:35.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.270+0000 7f79713ce700 1 -- 172.21.15.123:0/1598591841 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796c1a41d0 con 0x7f796c101c00 2024-06-02T04:03:35.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.270+0000 7f79713ce700 1 -- 172.21.15.123:0/1598591841 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f796c1111b0 con 0x7f796c101c00 2024-06-02T04:03:35.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.272+0000 7f7953fff700 1 -- 172.21.15.123:0/1598591841 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f796000f450 con 0x7f796c101c00 2024-06-02T04:03:35.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.272+0000 7f7953fff700 1 --2- 172.21.15.123:0/1598591841 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f79540a11b0 0x7f79540a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:35.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.273+0000 7f796affd700 1 --2- 172.21.15.123:0/1598591841 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f79540a11b0 0x7f79540a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:35.279 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.273+0000 7f7953fff700 1 -- 172.21.15.123:0/1598591841 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f79600cca60 con 0x7f796c101c00 2024-06-02T04:03:35.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.273+0000 7f7953fff700 1 --2- 172.21.15.123:0/1598591841 >> [v2:172.21.15.162:6808/3094256489,v1:172.21.15.162:6809/3094256489] conn(0x7f79540aa990 0x7f79540acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:35.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.273+0000 7f7953fff700 1 -- 172.21.15.123:0/1598591841 --> [v2:172.21.15.162:6808/3094256489,v1:172.21.15.162:6809/3094256489] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f79540ad460 con 0x7f79540aa990 2024-06-02T04:03:35.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.273+0000 7f7953fff700 1 -- 172.21.15.123:0/1598591841 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79600ccf00 con 0x7f796c101c00 2024-06-02T04:03:35.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.273+0000 7f796affd700 1 --2- 172.21.15.123:0/1598591841 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f79540a11b0 0x7f79540a3670 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f795c005fd0 tx=0x7f795c005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:35.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.273+0000 7f796b7fe700 1 --2- 172.21.15.123:0/1598591841 >> [v2:172.21.15.162:6808/3094256489,v1:172.21.15.162:6809/3094256489] conn(0x7f79540aa990 0x7f79540acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:35.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.274+0000 7f796b7fe700 1 --2- 172.21.15.123:0/1598591841 >> [v2:172.21.15.162:6808/3094256489,v1:172.21.15.162:6809/3094256489] conn(0x7f79540aa990 0x7f79540acdb0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:35.281 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.274+0000 7f7953fff700 1 -- 172.21.15.123:0/1598591841 <== osd.5 v2:172.21.15.162:6808/3094256489 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f79540ad460 con 0x7f79540aa990 2024-06-02T04:03:35.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.291+0000 7f79713ce700 1 -- 172.21.15.123:0/1598591841 --> [v2:172.21.15.162:6808/3094256489,v1:172.21.15.162:6809/3094256489] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f796c061620 con 0x7f79540aa990 2024-06-02T04:03:35.291 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.291+0000 7f7953fff700 1 -- 172.21.15.123:0/1598591841 <== osd.5 v2:172.21.15.162:6808/3094256489 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f796c061620 con 0x7f79540aa990 2024-06-02T04:03:35.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.292+0000 7f79713ce700 1 -- 172.21.15.123:0/1598591841 >> [v2:172.21.15.162:6808/3094256489,v1:172.21.15.162:6809/3094256489] conn(0x7f79540aa990 msgr2=0x7f79540acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:35.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.292+0000 7f79713ce700 1 --2- 172.21.15.123:0/1598591841 >> [v2:172.21.15.162:6808/3094256489,v1:172.21.15.162:6809/3094256489] conn(0x7f79540aa990 0x7f79540acdb0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:35.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.292+0000 7f79713ce700 1 -- 172.21.15.123:0/1598591841 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f79540a11b0 msgr2=0x7f79540a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:35.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.292+0000 7f79713ce700 1 --2- 172.21.15.123:0/1598591841 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f79540a11b0 0x7f79540a3670 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f795c005fd0 tx=0x7f795c005e20 comp rx=0 tx=0).stop 2024-06-02T04:03:35.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.292+0000 7f79713ce700 1 -- 172.21.15.123:0/1598591841 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f796c101c00 msgr2=0x7f796c1979a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:35.293 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.292+0000 7f79713ce700 1 --2- 172.21.15.123:0/1598591841 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f796c101c00 0x7f796c1979a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f796000c8f0 tx=0x7f796000ccb0 comp rx=0 tx=0).stop 2024-06-02T04:03:35.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.292+0000 7f796b7fe700 1 -- 172.21.15.123:0/1598591841 reap_dead start 2024-06-02T04:03:35.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.292+0000 7f79713ce700 1 -- 172.21.15.123:0/1598591841 shutdown_connections 2024-06-02T04:03:35.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.292+0000 7f79713ce700 1 -- 172.21.15.123:0/1598591841 >> 172.21.15.123:0/1598591841 conn(0x7f796c078100 msgr2=0x7f796c0ff0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:35.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.292+0000 7f79713ce700 1 -- 172.21.15.123:0/1598591841 shutdown_connections 2024-06-02T04:03:35.294 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:35.292+0000 7f79713ce700 1 -- 172.21.15.123:0/1598591841 wait complete. 2024-06-02T04:03:35.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:34 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/403485416' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-06-02T04:03:35.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:34 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/403485416' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-06-02T04:03:35.530 INFO:teuthology.orchestra.run.smithi123.stdout:330712481807 2024-06-02T04:03:35.531 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-06-02T04:03:35.925 INFO:teuthology.orchestra.run.smithi123.stdout:107374182442 2024-06-02T04:03:35.926 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-06-02T04:03:35.951 INFO:teuthology.orchestra.run.smithi123.stdout:274877906967 2024-06-02T04:03:35.952 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-06-02T04:03:35.985 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:35 smithi123 ceph-mon[42885]: pgmap v236: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-06-02T04:03:36.298 INFO:teuthology.orchestra.run.smithi123.stdout:77309411375 2024-06-02T04:03:36.298 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-06-02T04:03:36.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:35 smithi162 ceph-mon[47009]: pgmap v236: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-06-02T04:03:36.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:35 smithi136 ceph-mon[47443]: pgmap v236: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-06-02T04:03:36.487 INFO:teuthology.orchestra.run.smithi123.stdout:300647710738 2024-06-02T04:03:36.487 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-06-02T04:03:36.737 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:03:36.909 INFO:teuthology.orchestra.run.smithi123.stdout:158913789989 2024-06-02T04:03:36.910 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-06-02T04:03:37.188 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:03:37.442 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:03:38.212 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:37 smithi123 ceph-mon[42885]: pgmap v237: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 10 op/s 2024-06-02T04:03:38.246 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:03:38.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:37 smithi162 ceph-mon[47009]: pgmap v237: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 10 op/s 2024-06-02T04:03:38.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:37 smithi136 ceph-mon[47443]: pgmap v237: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 10 op/s 2024-06-02T04:03:38.901 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:03:39.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.869+0000 7f5c29a6d700 1 -- 172.21.15.123:0/238894476 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c24105f40 msgr2=0x7f5c24106320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:39.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.869+0000 7f5c29a6d700 1 --2- 172.21.15.123:0/238894476 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c24105f40 0x7f5c24106320 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5c14009990 tx=0x7f5c14009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:39.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.869+0000 7f5c29a6d700 1 -- 172.21.15.123:0/238894476 shutdown_connections 2024-06-02T04:03:39.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.869+0000 7f5c29a6d700 1 --2- 172.21.15.123:0/238894476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c24100850 0x7f5c2410ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:39.058 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.869+0000 7f5c29a6d700 1 --2- 172.21.15.123:0/238894476 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c24105f40 0x7f5c24106320 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:39.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.869+0000 7f5c29a6d700 1 --2- 172.21.15.123:0/238894476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c240ffe90 0x7f5c24100310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:39.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.869+0000 7f5c29a6d700 1 -- 172.21.15.123:0/238894476 >> 172.21.15.123:0/238894476 conn(0x7f5c24076e70 msgr2=0x7f5c24077280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:39.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.869+0000 7f5c29a6d700 1 -- 172.21.15.123:0/238894476 shutdown_connections 2024-06-02T04:03:39.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.869+0000 7f5c29a6d700 1 -- 172.21.15.123:0/238894476 wait complete. 2024-06-02T04:03:39.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.870+0000 7f5c29a6d700 1 Processor -- start 2024-06-02T04:03:39.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.870+0000 7f5c29a6d700 1 -- start start 2024-06-02T04:03:39.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.870+0000 7f5c29a6d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c240ffe90 0x7f5c241973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:39.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.870+0000 7f5c29a6d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c24100850 0x7f5c241978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:39.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.870+0000 7f5c29a6d700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c24105f40 0x7f5c2419bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:39.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.870+0000 7f5c29a6d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2419c2b0 con 0x7f5c240ffe90 2024-06-02T04:03:39.059 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.870+0000 7f5c29a6d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2419c420 con 0x7f5c24100850 2024-06-02T04:03:39.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.870+0000 7f5c29a6d700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2419c5e0 con 0x7f5c24105f40 2024-06-02T04:03:39.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.870+0000 7f5c237fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c240ffe90 0x7f5c241973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:39.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.870+0000 7f5c237fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c240ffe90 0x7f5c241973b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53308/0 (socket says 172.21.15.123:53308) 2024-06-02T04:03:39.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.870+0000 7f5c237fe700 1 -- 172.21.15.123:0/1997415618 learned_addr learned my addr 172.21.15.123:0/1997415618 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:39.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.870+0000 7f5c23fff700 1 --2- 172.21.15.123:0/1997415618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c24105f40 0x7f5c2419bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:39.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.870+0000 7f5c22ffd700 1 --2- 172.21.15.123:0/1997415618 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c24100850 0x7f5c241978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:39.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.870+0000 7f5c237fe700 1 -- 172.21.15.123:0/1997415618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c24105f40 msgr2=0x7f5c2419bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:39.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.870+0000 7f5c237fe700 1 --2- 172.21.15.123:0/1997415618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c24105f40 0x7f5c2419bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:39.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.871+0000 7f5c237fe700 1 -- 172.21.15.123:0/1997415618 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c24100850 msgr2=0x7f5c241978f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:39.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.871+0000 7f5c237fe700 1 --2- 172.21.15.123:0/1997415618 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c24100850 0x7f5c241978f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:39.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.871+0000 7f5c237fe700 1 -- 172.21.15.123:0/1997415618 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c140095f0 con 0x7f5c240ffe90 2024-06-02T04:03:39.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.871+0000 7f5c22ffd700 1 --2- 172.21.15.123:0/1997415618 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c24100850 0x7f5c241978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:03:39.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.871+0000 7f5c237fe700 1 --2- 172.21.15.123:0/1997415618 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c240ffe90 0x7f5c241973b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5c140098e0 tx=0x7f5c1400f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:39.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.871+0000 7f5c20ff9700 1 -- 172.21.15.123:0/1997415618 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1401d070 con 0x7f5c240ffe90 2024-06-02T04:03:39.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.871+0000 7f5c20ff9700 1 -- 172.21.15.123:0/1997415618 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5c14022470 con 0x7f5c240ffe90 2024-06-02T04:03:39.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.871+0000 7f5c29a6d700 1 -- 172.21.15.123:0/1997415618 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c2419c860 con 0x7f5c240ffe90 2024-06-02T04:03:39.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.871+0000 7f5c20ff9700 1 -- 172.21.15.123:0/1997415618 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c14017650 con 0x7f5c240ffe90 2024-06-02T04:03:39.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.871+0000 7f5c29a6d700 1 -- 172.21.15.123:0/1997415618 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c241a4120 con 0x7f5c240ffe90 2024-06-02T04:03:39.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.872+0000 7f5c29a6d700 1 -- 172.21.15.123:0/1997415618 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c24101580 con 0x7f5c240ffe90 2024-06-02T04:03:39.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.873+0000 7f5c20ff9700 1 -- 172.21.15.123:0/1997415618 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f5c140225e0 con 0x7f5c240ffe90 2024-06-02T04:03:39.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.874+0000 7f5c20ff9700 1 --2- 172.21.15.123:0/1997415618 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f5c0c0a11b0 0x7f5c0c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:39.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.874+0000 7f5c22ffd700 1 --2- 172.21.15.123:0/1997415618 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f5c0c0a11b0 0x7f5c0c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:39.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.874+0000 7f5c20ff9700 1 -- 172.21.15.123:0/1997415618 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5c140cdd30 con 0x7f5c240ffe90 2024-06-02T04:03:39.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.874+0000 7f5c22ffd700 1 --2- 172.21.15.123:0/1997415618 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f5c0c0a11b0 0x7f5c0c0a3670 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5c24198910 tx=0x7f5c18008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:39.062 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:38.878+0000 7f5c20ff9700 1 -- 172.21.15.123:0/1997415618 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5c140975a0 con 0x7f5c240ffe90 2024-06-02T04:03:39.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.091+0000 7f5c29a6d700 1 -- 172.21.15.123:0/1997415618 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f5c241986c0 con 0x7f5c240ffe90 2024-06-02T04:03:39.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.091+0000 7f5c20ff9700 1 -- 172.21.15.123:0/1997415618 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5c1409abc0 con 0x7f5c240ffe90 2024-06-02T04:03:39.091 INFO:teuthology.orchestra.run.smithi123.stdout:210453397533 2024-06-02T04:03:39.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.093+0000 7f5c29a6d700 1 -- 172.21.15.123:0/1997415618 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f5c0c0a11b0 msgr2=0x7f5c0c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:39.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.093+0000 7f5c29a6d700 1 --2- 172.21.15.123:0/1997415618 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f5c0c0a11b0 0x7f5c0c0a3670 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5c24198910 tx=0x7f5c18008040 comp rx=0 tx=0).stop 2024-06-02T04:03:39.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.093+0000 7f5c29a6d700 1 -- 172.21.15.123:0/1997415618 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c240ffe90 msgr2=0x7f5c241973b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:39.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.093+0000 7f5c29a6d700 1 --2- 172.21.15.123:0/1997415618 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c240ffe90 0x7f5c241973b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5c140098e0 tx=0x7f5c1400f670 comp rx=0 tx=0).stop 2024-06-02T04:03:39.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.094+0000 7f5c29a6d700 1 -- 172.21.15.123:0/1997415618 shutdown_connections 2024-06-02T04:03:39.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.094+0000 7f5c29a6d700 1 --2- 172.21.15.123:0/1997415618 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5c24105f40 0x7f5c2419bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:39.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.094+0000 7f5c29a6d700 1 --2- 172.21.15.123:0/1997415618 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5c240ffe90 0x7f5c241973b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:39.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.094+0000 7f5c29a6d700 1 --2- 172.21.15.123:0/1997415618 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f5c0c0a11b0 0x7f5c0c0a3670 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:39.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.094+0000 7f5c29a6d700 1 --2- 172.21.15.123:0/1997415618 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5c24100850 0x7f5c241978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:39.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.094+0000 7f5c29a6d700 1 -- 172.21.15.123:0/1997415618 >> 172.21.15.123:0/1997415618 conn(0x7f5c24076e70 msgr2=0x7f5c240ff220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:39.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.094+0000 7f5c29a6d700 1 -- 172.21.15.123:0/1997415618 shutdown_connections 2024-06-02T04:03:39.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.094+0000 7f5c29a6d700 1 -- 172.21.15.123:0/1997415618 wait complete. 2024-06-02T04:03:39.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.207+0000 7f995a0d9700 1 -- 172.21.15.123:0/1847734022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99541019e0 msgr2=0x7f995410de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:39.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.207+0000 7f995a0d9700 1 --2- 172.21.15.123:0/1847734022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99541019e0 0x7f995410de10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f994c00b0a0 tx=0x7f994c00b3b0 comp rx=0 tx=0).stop 2024-06-02T04:03:39.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.207+0000 7f995a0d9700 1 -- 172.21.15.123:0/1847734022 shutdown_connections 2024-06-02T04:03:39.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.207+0000 7f995a0d9700 1 --2- 172.21.15.123:0/1847734022 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99541019e0 0x7f995410de10 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:39.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.207+0000 7f995a0d9700 1 --2- 172.21.15.123:0/1847734022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9954107060 0x7f9954107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:39.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.207+0000 7f995a0d9700 1 --2- 172.21.15.123:0/1847734022 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9954101020 0x7f99541014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:39.333 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.207+0000 7f995a0d9700 1 -- 172.21.15.123:0/1847734022 >> 172.21.15.123:0/1847734022 conn(0x7f9954078100 msgr2=0x7f9954078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:39.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.208+0000 7f995a0d9700 1 -- 172.21.15.123:0/1847734022 shutdown_connections 2024-06-02T04:03:39.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.208+0000 7f995a0d9700 1 -- 172.21.15.123:0/1847734022 wait complete. 2024-06-02T04:03:39.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.208+0000 7f995a0d9700 1 Processor -- start 2024-06-02T04:03:39.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.208+0000 7f995a0d9700 1 -- start start 2024-06-02T04:03:39.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.208+0000 7f995a0d9700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9954101020 0x7f99540732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:39.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.208+0000 7f995a0d9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99541019e0 0x7f99540737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:39.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.209+0000 7f995a0d9700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9954107060 0x7f9954073d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:39.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.209+0000 7f995a0d9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99541a57a0 con 0x7f99541019e0 2024-06-02T04:03:39.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.209+0000 7f995a0d9700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99541a5910 con 0x7f9954101020 2024-06-02T04:03:39.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.209+0000 7f995a0d9700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99541a5ad0 con 0x7f9954107060 2024-06-02T04:03:39.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.209+0000 7f9952ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99541019e0 0x7f99540737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:39.334 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.209+0000 7f9952ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99541019e0 0x7f99540737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53324/0 (socket says 172.21.15.123:53324) 2024-06-02T04:03:39.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.209+0000 7f9952ffd700 1 -- 172.21.15.123:0/1383077494 learned_addr learned my addr 172.21.15.123:0/1383077494 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:39.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.209+0000 7f99537fe700 1 --2- 172.21.15.123:0/1383077494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9954101020 0x7f99540732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:39.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.209+0000 7f9953fff700 1 --2- 172.21.15.123:0/1383077494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9954107060 0x7f9954073d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:39.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.209+0000 7f9952ffd700 1 -- 172.21.15.123:0/1383077494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9954107060 msgr2=0x7f9954073d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:39.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.209+0000 7f9952ffd700 1 --2- 172.21.15.123:0/1383077494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9954107060 0x7f9954073d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:39.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.209+0000 7f9952ffd700 1 -- 172.21.15.123:0/1383077494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9954101020 msgr2=0x7f99540732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:39.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.209+0000 7f9952ffd700 1 --2- 172.21.15.123:0/1383077494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9954101020 0x7f99540732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:39.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.209+0000 7f9952ffd700 1 -- 172.21.15.123:0/1383077494 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f994c009d00 con 0x7f99541019e0 2024-06-02T04:03:39.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.209+0000 7f9953fff700 1 --2- 172.21.15.123:0/1383077494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9954107060 0x7f9954073d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:03:39.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.209+0000 7f9952ffd700 1 --2- 172.21.15.123:0/1383077494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99541019e0 0x7f99540737e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f994800d950 tx=0x7f994800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:39.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.209+0000 7f9950ff9700 1 -- 172.21.15.123:0/1383077494 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9948009940 con 0x7f99541019e0 2024-06-02T04:03:39.335 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.209+0000 7f995a0d9700 1 -- 172.21.15.123:0/1383077494 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99541a5db0 con 0x7f99541019e0 2024-06-02T04:03:39.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.209+0000 7f9950ff9700 1 -- 172.21.15.123:0/1383077494 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9948010460 con 0x7f99541019e0 2024-06-02T04:03:39.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.209+0000 7f9950ff9700 1 -- 172.21.15.123:0/1383077494 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994800f620 con 0x7f99541019e0 2024-06-02T04:03:39.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.209+0000 7f995a0d9700 1 -- 172.21.15.123:0/1383077494 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99541a6270 con 0x7f99541019e0 2024-06-02T04:03:39.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.210+0000 7f995a0d9700 1 -- 172.21.15.123:0/1383077494 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99541094f0 con 0x7f99541019e0 2024-06-02T04:03:39.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.211+0000 7f9950ff9700 1 -- 172.21.15.123:0/1383077494 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f99480108d0 con 0x7f99541019e0 2024-06-02T04:03:39.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.212+0000 7f9950ff9700 1 --2- 172.21.15.123:0/1383077494 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f993c0a11b0 0x7f993c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:39.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.212+0000 7f99537fe700 1 --2- 172.21.15.123:0/1383077494 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f993c0a11b0 0x7f993c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:39.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.212+0000 7f9950ff9700 1 -- 172.21.15.123:0/1383077494 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f99480cc710 con 0x7f99541019e0 2024-06-02T04:03:39.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.212+0000 7f99537fe700 1 --2- 172.21.15.123:0/1383077494 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f993c0a11b0 0x7f993c0a3670 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f994400ac50 tx=0x7f994400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:39.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.216+0000 7f9950ff9700 1 -- 172.21.15.123:0/1383077494 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9948095ef0 con 0x7f99541019e0 2024-06-02T04:03:39.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.423+0000 7f995a0d9700 1 -- 172.21.15.123:0/1383077494 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9954074780 con 0x7f99541019e0 2024-06-02T04:03:39.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.424+0000 7f9950ff9700 1 -- 172.21.15.123:0/1383077494 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9948099510 con 0x7f99541019e0 2024-06-02T04:03:39.424 INFO:teuthology.orchestra.run.smithi123.stdout:34359738422 2024-06-02T04:03:39.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.427+0000 7f995a0d9700 1 -- 172.21.15.123:0/1383077494 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f993c0a11b0 msgr2=0x7f993c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:39.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.427+0000 7f995a0d9700 1 --2- 172.21.15.123:0/1383077494 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f993c0a11b0 0x7f993c0a3670 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f994400ac50 tx=0x7f994400a380 comp rx=0 tx=0).stop 2024-06-02T04:03:39.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.427+0000 7f995a0d9700 1 -- 172.21.15.123:0/1383077494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99541019e0 msgr2=0x7f99540737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:39.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.427+0000 7f995a0d9700 1 --2- 172.21.15.123:0/1383077494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99541019e0 0x7f99540737e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f994800d950 tx=0x7f994800dc60 comp rx=0 tx=0).stop 2024-06-02T04:03:39.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.427+0000 7f995a0d9700 1 -- 172.21.15.123:0/1383077494 shutdown_connections 2024-06-02T04:03:39.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.427+0000 7f995a0d9700 1 --2- 172.21.15.123:0/1383077494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9954107060 0x7f9954073d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:39.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.427+0000 7f995a0d9700 1 --2- 172.21.15.123:0/1383077494 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f993c0a11b0 0x7f993c0a3670 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:39.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.427+0000 7f995a0d9700 1 --2- 172.21.15.123:0/1383077494 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9954101020 0x7f99540732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:39.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.427+0000 7f995a0d9700 1 --2- 172.21.15.123:0/1383077494 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f99541019e0 0x7f99540737e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:39.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.427+0000 7f995a0d9700 1 -- 172.21.15.123:0/1383077494 >> 172.21.15.123:0/1383077494 conn(0x7f9954078100 msgr2=0x7f99540ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:39.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.427+0000 7f995a0d9700 1 -- 172.21.15.123:0/1383077494 shutdown_connections 2024-06-02T04:03:39.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.427+0000 7f995a0d9700 1 -- 172.21.15.123:0/1383077494 wait complete. 2024-06-02T04:03:39.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.640+0000 7fe6d570b700 1 -- 172.21.15.123:0/899596318 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6d0100bb0 msgr2=0x7fe6d010ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:39.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.640+0000 7fe6d570b700 1 --2- 172.21.15.123:0/899596318 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6d0100bb0 0x7fe6d010ccc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe6c800b0a0 tx=0x7fe6c800b3b0 comp rx=0 tx=0).stop 2024-06-02T04:03:39.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.640+0000 7fe6d570b700 1 -- 172.21.15.123:0/899596318 shutdown_connections 2024-06-02T04:03:39.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.640+0000 7fe6d570b700 1 --2- 172.21.15.123:0/899596318 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6d0100bb0 0x7fe6d010ccc0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:39.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.640+0000 7fe6d570b700 1 --2- 172.21.15.123:0/899596318 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6d0105ff0 0x7fe6d01063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:39.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.640+0000 7fe6d570b700 1 --2- 172.21.15.123:0/899596318 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6d01001f0 0x7fe6d0100670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:39.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.640+0000 7fe6d570b700 1 -- 172.21.15.123:0/899596318 >> 172.21.15.123:0/899596318 conn(0x7fe6d0075d10 msgr2=0x7fe6d0076120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:39.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.640+0000 7fe6d570b700 1 -- 172.21.15.123:0/899596318 shutdown_connections 2024-06-02T04:03:39.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.640+0000 7fe6d570b700 1 -- 172.21.15.123:0/899596318 wait complete. 2024-06-02T04:03:39.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.641+0000 7fe6d570b700 1 Processor -- start 2024-06-02T04:03:39.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.641+0000 7fe6d570b700 1 -- start start 2024-06-02T04:03:39.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.641+0000 7fe6d570b700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6d01001f0 0x7fe6d0198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:39.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.641+0000 7fe6d570b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6d0100bb0 0x7fe6d0198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:39.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.641+0000 7fe6d570b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6d0105ff0 0x7fe6d01a33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:39.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.641+0000 7fe6d570b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d01990c0 con 0x7fe6d0100bb0 2024-06-02T04:03:39.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.641+0000 7fe6d570b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d01a38f0 con 0x7fe6d0105ff0 2024-06-02T04:03:39.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.641+0000 7fe6d570b700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d01a3a30 con 0x7fe6d01001f0 2024-06-02T04:03:39.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.641+0000 7fe6ce7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6d0100bb0 0x7fe6d0198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:39.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.641+0000 7fe6ce7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6d0100bb0 0x7fe6d0198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53338/0 (socket says 172.21.15.123:53338) 2024-06-02T04:03:39.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.641+0000 7fe6ce7fc700 1 -- 172.21.15.123:0/3046459632 learned_addr learned my addr 172.21.15.123:0/3046459632 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:39.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.641+0000 7fe6ceffd700 1 --2- 172.21.15.123:0/3046459632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6d01001f0 0x7fe6d0198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:39.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.642+0000 7fe6cf7fe700 1 --2- 172.21.15.123:0/3046459632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6d0105ff0 0x7fe6d01a33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:39.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.642+0000 7fe6ce7fc700 1 -- 172.21.15.123:0/3046459632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6d01001f0 msgr2=0x7fe6d0198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:39.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.642+0000 7fe6ce7fc700 1 --2- 172.21.15.123:0/3046459632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6d01001f0 0x7fe6d0198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:39.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.642+0000 7fe6ce7fc700 1 -- 172.21.15.123:0/3046459632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6d0105ff0 msgr2=0x7fe6d01a33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:39.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.642+0000 7fe6ce7fc700 1 --2- 172.21.15.123:0/3046459632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6d0105ff0 0x7fe6d01a33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:39.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.642+0000 7fe6ce7fc700 1 -- 172.21.15.123:0/3046459632 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c8009d00 con 0x7fe6d0100bb0 2024-06-02T04:03:39.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.642+0000 7fe6ceffd700 1 --2- 172.21.15.123:0/3046459632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6d01001f0 0x7fe6d0198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:03:39.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.642+0000 7fe6cf7fe700 1 --2- 172.21.15.123:0/3046459632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6d0105ff0 0x7fe6d01a33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:03:39.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.642+0000 7fe6ce7fc700 1 --2- 172.21.15.123:0/3046459632 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6d0100bb0 0x7fe6d0198870 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe6c400e9d0 tx=0x7fe6c400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:39.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.642+0000 7fe6b7fff700 1 -- 172.21.15.123:0/3046459632 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4009790 con 0x7fe6d0100bb0 2024-06-02T04:03:39.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.642+0000 7fe6d570b700 1 -- 172.21.15.123:0/3046459632 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d01a3c90 con 0x7fe6d0100bb0 2024-06-02T04:03:39.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.642+0000 7fe6b7fff700 1 -- 172.21.15.123:0/3046459632 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe6c400cbd0 con 0x7fe6d0100bb0 2024-06-02T04:03:39.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.642+0000 7fe6b7fff700 1 -- 172.21.15.123:0/3046459632 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4018680 con 0x7fe6d0100bb0 2024-06-02T04:03:39.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.642+0000 7fe6d570b700 1 -- 172.21.15.123:0/3046459632 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d01a4190 con 0x7fe6d0100bb0 2024-06-02T04:03:39.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.644+0000 7fe6d570b700 1 -- 172.21.15.123:0/3046459632 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d01083a0 con 0x7fe6d0100bb0 2024-06-02T04:03:39.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.644+0000 7fe6b7fff700 1 -- 172.21.15.123:0/3046459632 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fe6c400cd40 con 0x7fe6d0100bb0 2024-06-02T04:03:39.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.645+0000 7fe6b7fff700 1 --2- 172.21.15.123:0/3046459632 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe6b80a11b0 0x7fe6b80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:39.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.645+0000 7fe6ceffd700 1 --2- 172.21.15.123:0/3046459632 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe6b80a11b0 0x7fe6b80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:39.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.645+0000 7fe6b7fff700 1 -- 172.21.15.123:0/3046459632 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe6c4014070 con 0x7fe6d0100bb0 2024-06-02T04:03:39.645 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.645+0000 7fe6ceffd700 1 --2- 172.21.15.123:0/3046459632 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe6b80a11b0 0x7fe6b80a3670 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0009fd0 tx=0x7fe6c0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:39.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.649+0000 7fe6b7fff700 1 -- 172.21.15.123:0/3046459632 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe6c4052d60 con 0x7fe6d0100bb0 2024-06-02T04:03:39.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.864+0000 7fe6d570b700 1 -- 172.21.15.123:0/3046459632 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe6d0069c20 con 0x7fe6d0100bb0 2024-06-02T04:03:39.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.864+0000 7fe6b7fff700 1 -- 172.21.15.123:0/3046459632 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe6c4096310 con 0x7fe6d0100bb0 2024-06-02T04:03:39.863 INFO:teuthology.orchestra.run.smithi123.stdout:188978561057 2024-06-02T04:03:39.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.866+0000 7fe6d570b700 1 -- 172.21.15.123:0/3046459632 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe6b80a11b0 msgr2=0x7fe6b80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:39.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.866+0000 7fe6d570b700 1 --2- 172.21.15.123:0/3046459632 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe6b80a11b0 0x7fe6b80a3670 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0009fd0 tx=0x7fe6c0009260 comp rx=0 tx=0).stop 2024-06-02T04:03:39.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.866+0000 7fe6d570b700 1 -- 172.21.15.123:0/3046459632 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6d0100bb0 msgr2=0x7fe6d0198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:39.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.866+0000 7fe6d570b700 1 --2- 172.21.15.123:0/3046459632 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6d0100bb0 0x7fe6d0198870 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe6c400e9d0 tx=0x7fe6c400ece0 comp rx=0 tx=0).stop 2024-06-02T04:03:39.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.867+0000 7fe6d570b700 1 -- 172.21.15.123:0/3046459632 shutdown_connections 2024-06-02T04:03:39.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.867+0000 7fe6d570b700 1 --2- 172.21.15.123:0/3046459632 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe6b80a11b0 0x7fe6b80a3670 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:39.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.867+0000 7fe6d570b700 1 --2- 172.21.15.123:0/3046459632 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6d0105ff0 0x7fe6d01a33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:39.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.867+0000 7fe6d570b700 1 --2- 172.21.15.123:0/3046459632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6d01001f0 0x7fe6d0198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:39.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.867+0000 7fe6d570b700 1 --2- 172.21.15.123:0/3046459632 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe6d0100bb0 0x7fe6d0198870 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:39.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.867+0000 7fe6d570b700 1 -- 172.21.15.123:0/3046459632 >> 172.21.15.123:0/3046459632 conn(0x7fe6d0075d10 msgr2=0x7fe6d00fef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:39.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.867+0000 7fe6d570b700 1 -- 172.21.15.123:0/3046459632 shutdown_connections 2024-06-02T04:03:39.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:39.867+0000 7fe6d570b700 1 -- 172.21.15.123:0/3046459632 wait complete. 2024-06-02T04:03:40.029 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:39 smithi123 ceph-mon[42885]: pgmap v238: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 341 B/s wr, 10 op/s 2024-06-02T04:03:40.029 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:39 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1997415618' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-06-02T04:03:40.029 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:39 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1383077494' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-06-02T04:03:40.029 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:39 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/3046459632' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-06-02T04:03:40.048 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738420 got 34359738422 for osd.0 2024-06-02T04:03:40.048 DEBUG:teuthology.parallel:result is None 2024-06-02T04:03:40.170 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:03:40.170 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:03:40.172 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:03:40.172 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:03:40.175 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:03:40.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:39 smithi162 ceph-mon[47009]: pgmap v238: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 341 B/s wr, 10 op/s 2024-06-02T04:03:40.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:39 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/1997415618' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-06-02T04:03:40.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:39 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/1383077494' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-06-02T04:03:40.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:39 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/3046459632' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-06-02T04:03:40.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:39 smithi136 ceph-mon[47443]: pgmap v238: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 341 B/s wr, 10 op/s 2024-06-02T04:03:40.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:39 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/1997415618' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-06-02T04:03:40.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:39 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/1383077494' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-06-02T04:03:40.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:39 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/3046459632' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-06-02T04:03:40.570 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561055 got 188978561057 for osd.6 2024-06-02T04:03:40.570 DEBUG:teuthology.parallel:result is None 2024-06-02T04:03:40.976 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397531 got 210453397533 for osd.7 2024-06-02T04:03:40.977 DEBUG:teuthology.parallel:result is None 2024-06-02T04:03:41.260 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:03:41.981 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:41 smithi123 ceph-mon[42885]: pgmap v239: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 9 op/s 2024-06-02T04:03:42.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.168+0000 7f5975006700 1 -- 172.21.15.123:0/1225899212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59700ffed0 msgr2=0x7f5970100350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:42.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.168+0000 7f5975006700 1 --2- 172.21.15.123:0/1225899212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59700ffed0 0x7f5970100350 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5958009990 tx=0x7f5958009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:42.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.168+0000 7f5975006700 1 -- 172.21.15.123:0/1225899212 shutdown_connections 2024-06-02T04:03:42.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.168+0000 7f5975006700 1 --2- 172.21.15.123:0/1225899212 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5970100890 0x7f597010cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:42.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.168+0000 7f5975006700 1 --2- 172.21.15.123:0/1225899212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5970105f00 0x7f59701062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:42.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.168+0000 7f5975006700 1 --2- 172.21.15.123:0/1225899212 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59700ffed0 0x7f5970100350 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:42.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.168+0000 7f5975006700 1 -- 172.21.15.123:0/1225899212 >> 172.21.15.123:0/1225899212 conn(0x7f5970075f80 msgr2=0x7f5970076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:42.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.168+0000 7f5975006700 1 -- 172.21.15.123:0/1225899212 shutdown_connections 2024-06-02T04:03:42.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.168+0000 7f5975006700 1 -- 172.21.15.123:0/1225899212 wait complete. 2024-06-02T04:03:42.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.168+0000 7f5975006700 1 Processor -- start 2024-06-02T04:03:42.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.169+0000 7f5975006700 1 -- start start 2024-06-02T04:03:42.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.169+0000 7f5975006700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59700ffed0 0x7f5970197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:42.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.169+0000 7f5975006700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5970100890 0x7f5970197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:42.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.169+0000 7f5975006700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5970105f00 0x7f597019be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:42.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.169+0000 7f5975006700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597019c430 con 0x7f59700ffed0 2024-06-02T04:03:42.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.169+0000 7f5975006700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597019c5a0 con 0x7f5970100890 2024-06-02T04:03:42.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.169+0000 7f5975006700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597019c760 con 0x7f5970105f00 2024-06-02T04:03:42.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.169+0000 7f596ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59700ffed0 0x7f5970197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:42.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.169+0000 7f596ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59700ffed0 0x7f5970197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53352/0 (socket says 172.21.15.123:53352) 2024-06-02T04:03:42.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.169+0000 7f596ed9d700 1 -- 172.21.15.123:0/3758609208 learned_addr learned my addr 172.21.15.123:0/3758609208 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:42.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.169+0000 7f596659c700 1 --2- 172.21.15.123:0/3758609208 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5970100890 0x7f5970197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:42.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.169+0000 7f596f59e700 1 --2- 172.21.15.123:0/3758609208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5970105f00 0x7f597019be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:42.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.169+0000 7f596ed9d700 1 -- 172.21.15.123:0/3758609208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5970105f00 msgr2=0x7f597019be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:42.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.169+0000 7f596ed9d700 1 --2- 172.21.15.123:0/3758609208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5970105f00 0x7f597019be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:42.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.169+0000 7f596ed9d700 1 -- 172.21.15.123:0/3758609208 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5970100890 msgr2=0x7f5970197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:42.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.169+0000 7f596ed9d700 1 --2- 172.21.15.123:0/3758609208 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5970100890 0x7f5970197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:42.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.169+0000 7f596ed9d700 1 -- 172.21.15.123:0/3758609208 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59580095f0 con 0x7f59700ffed0 2024-06-02T04:03:42.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.169+0000 7f596f59e700 1 --2- 172.21.15.123:0/3758609208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5970105f00 0x7f597019be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:03:42.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.169+0000 7f596659c700 1 --2- 172.21.15.123:0/3758609208 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5970100890 0x7f5970197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:03:42.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.170+0000 7f596ed9d700 1 --2- 172.21.15.123:0/3758609208 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59700ffed0 0x7f5970197530 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f596000b530 tx=0x7f596000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:42.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.170+0000 7f596cd99700 1 -- 172.21.15.123:0/3758609208 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5960011830 con 0x7f59700ffed0 2024-06-02T04:03:42.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.170+0000 7f596cd99700 1 -- 172.21.15.123:0/3758609208 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5960011e50 con 0x7f59700ffed0 2024-06-02T04:03:42.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.170+0000 7f5975006700 1 -- 172.21.15.123:0/3758609208 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f597019ca40 con 0x7f59700ffed0 2024-06-02T04:03:42.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.170+0000 7f596cd99700 1 -- 172.21.15.123:0/3758609208 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596000f2e0 con 0x7f59700ffed0 2024-06-02T04:03:42.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.170+0000 7f5975006700 1 -- 172.21.15.123:0/3758609208 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59701a42a0 con 0x7f59700ffed0 2024-06-02T04:03:42.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.171+0000 7f5975006700 1 -- 172.21.15.123:0/3758609208 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59701015b0 con 0x7f59700ffed0 2024-06-02T04:03:42.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.172+0000 7f596cd99700 1 -- 172.21.15.123:0/3758609208 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f5960010580 con 0x7f59700ffed0 2024-06-02T04:03:42.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.172+0000 7f596cd99700 1 --2- 172.21.15.123:0/3758609208 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f595c0a11b0 0x7f595c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:42.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.172+0000 7f596cd99700 1 -- 172.21.15.123:0/3758609208 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f59600cc2f0 con 0x7f59700ffed0 2024-06-02T04:03:42.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.172+0000 7f596659c700 1 --2- 172.21.15.123:0/3758609208 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f595c0a11b0 0x7f595c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:42.173 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.173+0000 7f596659c700 1 --2- 172.21.15.123:0/3758609208 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f595c0a11b0 0x7f595c0a3670 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5958006010 tx=0x7f595800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:42.175 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.177+0000 7f596cd99700 1 -- 172.21.15.123:0/3758609208 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5960095be0 con 0x7f59700ffed0 2024-06-02T04:03:42.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:41 smithi162 ceph-mon[47009]: pgmap v239: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 9 op/s 2024-06-02T04:03:42.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:41 smithi136 ceph-mon[47443]: pgmap v239: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 9 op/s 2024-06-02T04:03:42.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.389+0000 7f5975006700 1 -- 172.21.15.123:0/3758609208 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f597004ec60 con 0x7f59700ffed0 2024-06-02T04:03:42.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.389+0000 7f596cd99700 1 -- 172.21.15.123:0/3758609208 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5960099200 con 0x7f59700ffed0 2024-06-02T04:03:42.389 INFO:teuthology.orchestra.run.smithi123.stdout:55834574900 2024-06-02T04:03:42.390 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.391+0000 7f5975006700 1 -- 172.21.15.123:0/3758609208 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f595c0a11b0 msgr2=0x7f595c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:42.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.391+0000 7f5975006700 1 --2- 172.21.15.123:0/3758609208 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f595c0a11b0 0x7f595c0a3670 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5958006010 tx=0x7f595800b540 comp rx=0 tx=0).stop 2024-06-02T04:03:42.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.392+0000 7f5975006700 1 -- 172.21.15.123:0/3758609208 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59700ffed0 msgr2=0x7f5970197530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:42.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.392+0000 7f5975006700 1 --2- 172.21.15.123:0/3758609208 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59700ffed0 0x7f5970197530 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f596000b530 tx=0x7f596000b8f0 comp rx=0 tx=0).stop 2024-06-02T04:03:42.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.392+0000 7f5975006700 1 -- 172.21.15.123:0/3758609208 shutdown_connections 2024-06-02T04:03:42.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.392+0000 7f5975006700 1 --2- 172.21.15.123:0/3758609208 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5970105f00 0x7f597019be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:42.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.392+0000 7f5975006700 1 --2- 172.21.15.123:0/3758609208 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f59700ffed0 0x7f5970197530 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:42.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.392+0000 7f5975006700 1 --2- 172.21.15.123:0/3758609208 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f595c0a11b0 0x7f595c0a3670 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:42.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.392+0000 7f5975006700 1 --2- 172.21.15.123:0/3758609208 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5970100890 0x7f5970197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:42.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.392+0000 7f5975006700 1 -- 172.21.15.123:0/3758609208 >> 172.21.15.123:0/3758609208 conn(0x7f5970075f80 msgr2=0x7f5970068bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:42.391 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.392+0000 7f5975006700 1 -- 172.21.15.123:0/3758609208 shutdown_connections 2024-06-02T04:03:42.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.392+0000 7f5975006700 1 -- 172.21.15.123:0/3758609208 wait complete. 2024-06-02T04:03:42.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.604+0000 7f3b4920d700 1 -- 172.21.15.123:0/3108037719 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b44068950 msgr2=0x7f3b44068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:42.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.604+0000 7f3b4920d700 1 --2- 172.21.15.123:0/3108037719 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b44068950 0x7f3b44068d30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3b340098f0 tx=0x7f3b34009c00 comp rx=0 tx=0).stop 2024-06-02T04:03:42.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.604+0000 7f3b4920d700 1 -- 172.21.15.123:0/3108037719 shutdown_connections 2024-06-02T04:03:42.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.604+0000 7f3b4920d700 1 --2- 172.21.15.123:0/3108037719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b4410da80 0x7f3b4410fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:42.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.604+0000 7f3b4920d700 1 --2- 172.21.15.123:0/3108037719 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b44068950 0x7f3b44068d30 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:42.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.604+0000 7f3b4920d700 1 --2- 172.21.15.123:0/3108037719 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b44069270 0x7f3b4410d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:42.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.604+0000 7f3b4920d700 1 -- 172.21.15.123:0/3108037719 >> 172.21.15.123:0/3108037719 conn(0x7f3b44075f80 msgr2=0x7f3b44076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:42.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.604+0000 7f3b4920d700 1 -- 172.21.15.123:0/3108037719 shutdown_connections 2024-06-02T04:03:42.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.604+0000 7f3b4920d700 1 -- 172.21.15.123:0/3108037719 wait complete. 2024-06-02T04:03:42.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.605+0000 7f3b4920d700 1 Processor -- start 2024-06-02T04:03:42.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.606+0000 7f3b4920d700 1 -- start start 2024-06-02T04:03:42.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.606+0000 7f3b4920d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b44068950 0x7f3b441995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:42.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.606+0000 7f3b4920d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b44069270 0x7f3b44199b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:42.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.606+0000 7f3b4920d700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b4410da80 0x7f3b4419dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:42.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.606+0000 7f3b4920d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4419e4f0 con 0x7f3b44069270 2024-06-02T04:03:42.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.606+0000 7f3b4920d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4419e660 con 0x7f3b44068950 2024-06-02T04:03:42.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.606+0000 7f3b4920d700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4419e820 con 0x7f3b4410da80 2024-06-02T04:03:42.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.606+0000 7f3b4259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b44069270 0x7f3b44199b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:42.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.606+0000 7f3b4259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b44069270 0x7f3b44199b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53366/0 (socket says 172.21.15.123:53366) 2024-06-02T04:03:42.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.606+0000 7f3b4259c700 1 -- 172.21.15.123:0/133813977 learned_addr learned my addr 172.21.15.123:0/133813977 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:42.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.606+0000 7f3b4359e700 1 --2- 172.21.15.123:0/133813977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b4410da80 0x7f3b4419dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:42.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.606+0000 7f3b42d9d700 1 --2- 172.21.15.123:0/133813977 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b44068950 0x7f3b441995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:42.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.606+0000 7f3b4259c700 1 -- 172.21.15.123:0/133813977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b4410da80 msgr2=0x7f3b4419dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:42.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.606+0000 7f3b4259c700 1 --2- 172.21.15.123:0/133813977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b4410da80 0x7f3b4419dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:42.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.606+0000 7f3b4259c700 1 -- 172.21.15.123:0/133813977 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b44068950 msgr2=0x7f3b441995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:42.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.606+0000 7f3b4259c700 1 --2- 172.21.15.123:0/133813977 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b44068950 0x7f3b441995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:42.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.606+0000 7f3b4259c700 1 -- 172.21.15.123:0/133813977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3c009d00 con 0x7f3b44069270 2024-06-02T04:03:42.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.607+0000 7f3b4259c700 1 --2- 172.21.15.123:0/133813977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b44069270 0x7f3b44199b30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3b3800e9a0 tx=0x7f3b3800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:42.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.607+0000 7f3b2bfff700 1 -- 172.21.15.123:0/133813977 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b38009790 con 0x7f3b44069270 2024-06-02T04:03:42.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.607+0000 7f3b2bfff700 1 -- 172.21.15.123:0/133813977 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b3800cbd0 con 0x7f3b44069270 2024-06-02T04:03:42.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.607+0000 7f3b4920d700 1 -- 172.21.15.123:0/133813977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b34009520 con 0x7f3b44069270 2024-06-02T04:03:42.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.607+0000 7f3b2bfff700 1 -- 172.21.15.123:0/133813977 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b38018680 con 0x7f3b44069270 2024-06-02T04:03:42.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.607+0000 7f3b4920d700 1 -- 172.21.15.123:0/133813977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b441a6190 con 0x7f3b44069270 2024-06-02T04:03:42.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.608+0000 7f3b4920d700 1 -- 172.21.15.123:0/133813977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b44108ca0 con 0x7f3b44069270 2024-06-02T04:03:42.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.610+0000 7f3b2bfff700 1 -- 172.21.15.123:0/133813977 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f3b3800cd40 con 0x7f3b44069270 2024-06-02T04:03:42.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.611+0000 7f3b2bfff700 1 --2- 172.21.15.123:0/133813977 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3b2c0a1230 0x7f3b2c0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:42.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.611+0000 7f3b42d9d700 1 --2- 172.21.15.123:0/133813977 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3b2c0a1230 0x7f3b2c0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:42.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.611+0000 7f3b2bfff700 1 -- 172.21.15.123:0/133813977 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3b38014070 con 0x7f3b44069270 2024-06-02T04:03:42.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.611+0000 7f3b42d9d700 1 --2- 172.21.15.123:0/133813977 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3b2c0a1230 0x7f3b2c0a36f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3b34009fd0 tx=0x7f3b34019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:42.669 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.614+0000 7f3b2bfff700 1 -- 172.21.15.123:0/133813977 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3b38096c30 con 0x7f3b44069270 2024-06-02T04:03:42.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.827+0000 7f3b4920d700 1 -- 172.21.15.123:0/133813977 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f3b4419a900 con 0x7f3b44069270 2024-06-02T04:03:42.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.827+0000 7f3b2bfff700 1 -- 172.21.15.123:0/133813977 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f3b3809a250 con 0x7f3b44069270 2024-06-02T04:03:42.827 INFO:teuthology.orchestra.run.smithi123.stdout:300647710739 2024-06-02T04:03:42.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.829+0000 7f3b4920d700 1 -- 172.21.15.123:0/133813977 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3b2c0a1230 msgr2=0x7f3b2c0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:42.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.829+0000 7f3b4920d700 1 --2- 172.21.15.123:0/133813977 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3b2c0a1230 0x7f3b2c0a36f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3b34009fd0 tx=0x7f3b34019040 comp rx=0 tx=0).stop 2024-06-02T04:03:42.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.829+0000 7f3b4920d700 1 -- 172.21.15.123:0/133813977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b44069270 msgr2=0x7f3b44199b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:42.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.829+0000 7f3b4920d700 1 --2- 172.21.15.123:0/133813977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b44069270 0x7f3b44199b30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3b3800e9a0 tx=0x7f3b3800ecb0 comp rx=0 tx=0).stop 2024-06-02T04:03:42.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.829+0000 7f3b4920d700 1 -- 172.21.15.123:0/133813977 shutdown_connections 2024-06-02T04:03:42.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.830+0000 7f3b4920d700 1 --2- 172.21.15.123:0/133813977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b4410da80 0x7f3b4419dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:42.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.830+0000 7f3b4920d700 1 --2- 172.21.15.123:0/133813977 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3b2c0a1230 0x7f3b2c0a36f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:42.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.830+0000 7f3b4920d700 1 --2- 172.21.15.123:0/133813977 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b44068950 0x7f3b441995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:42.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.830+0000 7f3b4920d700 1 --2- 172.21.15.123:0/133813977 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3b44069270 0x7f3b44199b30 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:42.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.830+0000 7f3b4920d700 1 -- 172.21.15.123:0/133813977 >> 172.21.15.123:0/133813977 conn(0x7f3b44075f80 msgr2=0x7f3b4410f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:42.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.830+0000 7f3b4920d700 1 -- 172.21.15.123:0/133813977 shutdown_connections 2024-06-02T04:03:42.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:42.830+0000 7f3b4920d700 1 -- 172.21.15.123:0/133813977 wait complete. 2024-06-02T04:03:43.022 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:42 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/3758609208' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-06-02T04:03:43.022 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:42 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/133813977' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-06-02T04:03:43.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:42 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/3758609208' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-06-02T04:03:43.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:42 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/133813977' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-06-02T04:03:43.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:42 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/3758609208' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-06-02T04:03:43.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:42 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/133813977' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-06-02T04:03:43.740 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.266+0000 7f9d53def700 1 -- 172.21.15.123:0/2514449231 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d4c105f80 msgr2=0x7f9d4c106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:43.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.266+0000 7f9d53def700 1 --2- 172.21.15.123:0/2514449231 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d4c105f80 0x7f9d4c106360 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009990 tx=0x7f9d48009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:43.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.267+0000 7f9d53def700 1 -- 172.21.15.123:0/2514449231 shutdown_connections 2024-06-02T04:03:43.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.267+0000 7f9d53def700 1 --2- 172.21.15.123:0/2514449231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d4c100bb0 0x7f9d4c10cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:43.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.267+0000 7f9d53def700 1 --2- 172.21.15.123:0/2514449231 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d4c105f80 0x7f9d4c106360 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:43.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.267+0000 7f9d53def700 1 --2- 172.21.15.123:0/2514449231 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d4c1001f0 0x7f9d4c100670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:43.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.267+0000 7f9d53def700 1 -- 172.21.15.123:0/2514449231 >> 172.21.15.123:0/2514449231 conn(0x7f9d4c076c50 msgr2=0x7f9d4c077060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:43.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.267+0000 7f9d53def700 1 -- 172.21.15.123:0/2514449231 shutdown_connections 2024-06-02T04:03:43.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.267+0000 7f9d53def700 1 -- 172.21.15.123:0/2514449231 wait complete. 2024-06-02T04:03:43.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.267+0000 7f9d53def700 1 Processor -- start 2024-06-02T04:03:43.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.267+0000 7f9d53def700 1 -- start start 2024-06-02T04:03:43.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.267+0000 7f9d53def700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d4c1001f0 0x7f9d4c1962b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:43.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.267+0000 7f9d53def700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d4c100bb0 0x7f9d4c1967f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:43.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.267+0000 7f9d53def700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d4c105f80 0x7f9d4c19aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:43.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.267+0000 7f9d53def700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c19b1b0 con 0x7f9d4c105f80 2024-06-02T04:03:43.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.267+0000 7f9d53def700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c19b320 con 0x7f9d4c1001f0 2024-06-02T04:03:43.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.267+0000 7f9d53def700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c19b4e0 con 0x7f9d4c100bb0 2024-06-02T04:03:43.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.268+0000 7f9d5238c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d4c105f80 0x7f9d4c19aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:43.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.268+0000 7f9d5238c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d4c105f80 0x7f9d4c19aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53384/0 (socket says 172.21.15.123:53384) 2024-06-02T04:03:43.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.268+0000 7f9d5238c700 1 -- 172.21.15.123:0/618402176 learned_addr learned my addr 172.21.15.123:0/618402176 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:43.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.268+0000 7f9d5138a700 1 --2- 172.21.15.123:0/618402176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d4c100bb0 0x7f9d4c1967f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:43.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.268+0000 7f9d51b8b700 1 --2- 172.21.15.123:0/618402176 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d4c1001f0 0x7f9d4c1962b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:43.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.268+0000 7f9d5238c700 1 -- 172.21.15.123:0/618402176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d4c100bb0 msgr2=0x7f9d4c1967f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:43.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.268+0000 7f9d5238c700 1 --2- 172.21.15.123:0/618402176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d4c100bb0 0x7f9d4c1967f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:43.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.268+0000 7f9d5238c700 1 -- 172.21.15.123:0/618402176 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d4c1001f0 msgr2=0x7f9d4c1962b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:43.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.268+0000 7f9d5238c700 1 --2- 172.21.15.123:0/618402176 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d4c1001f0 0x7f9d4c1962b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:43.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.268+0000 7f9d5238c700 1 -- 172.21.15.123:0/618402176 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d480095f0 con 0x7f9d4c105f80 2024-06-02T04:03:43.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.268+0000 7f9d5138a700 1 --2- 172.21.15.123:0/618402176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d4c100bb0 0x7f9d4c1967f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:03:43.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.268+0000 7f9d5238c700 1 --2- 172.21.15.123:0/618402176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d4c105f80 0x7f9d4c19aba0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9d44007ee0 tx=0x7f9d4400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:43.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.268+0000 7f9d42ffd700 1 -- 172.21.15.123:0/618402176 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d44017070 con 0x7f9d4c105f80 2024-06-02T04:03:43.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.268+0000 7f9d42ffd700 1 -- 172.21.15.123:0/618402176 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9d4400f040 con 0x7f9d4c105f80 2024-06-02T04:03:43.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.268+0000 7f9d53def700 1 -- 172.21.15.123:0/618402176 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d4c19b7c0 con 0x7f9d4c105f80 2024-06-02T04:03:43.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.268+0000 7f9d42ffd700 1 -- 172.21.15.123:0/618402176 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d44005740 con 0x7f9d4c105f80 2024-06-02T04:03:43.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.268+0000 7f9d53def700 1 -- 172.21.15.123:0/618402176 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d4c1a3020 con 0x7f9d4c105f80 2024-06-02T04:03:43.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.269+0000 7f9d53def700 1 -- 172.21.15.123:0/618402176 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d4c108410 con 0x7f9d4c105f80 2024-06-02T04:03:43.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.270+0000 7f9d42ffd700 1 -- 172.21.15.123:0/618402176 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f9d440058a0 con 0x7f9d4c105f80 2024-06-02T04:03:43.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.271+0000 7f9d42ffd700 1 --2- 172.21.15.123:0/618402176 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9d380a11b0 0x7f9d380a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:43.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.271+0000 7f9d51b8b700 1 --2- 172.21.15.123:0/618402176 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9d380a11b0 0x7f9d380a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:43.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.271+0000 7f9d42ffd700 1 -- 172.21.15.123:0/618402176 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9d440cc180 con 0x7f9d4c105f80 2024-06-02T04:03:43.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.271+0000 7f9d51b8b700 1 --2- 172.21.15.123:0/618402176 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9d380a11b0 0x7f9d380a3670 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9d48006010 tx=0x7f9d4800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:43.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.275+0000 7f9d42ffd700 1 -- 172.21.15.123:0/618402176 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9d44095960 con 0x7f9d4c105f80 2024-06-02T04:03:43.744 INFO:teuthology.orchestra.run.smithi123.stdout:244813135899 2024-06-02T04:03:43.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.478+0000 7f9d53def700 1 -- 172.21.15.123:0/618402176 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f9d4c1975c0 con 0x7f9d4c105f80 2024-06-02T04:03:43.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.479+0000 7f9d42ffd700 1 -- 172.21.15.123:0/618402176 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d44098f80 con 0x7f9d4c105f80 2024-06-02T04:03:43.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.481+0000 7f9d53def700 1 -- 172.21.15.123:0/618402176 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9d380a11b0 msgr2=0x7f9d380a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:43.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.481+0000 7f9d53def700 1 --2- 172.21.15.123:0/618402176 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9d380a11b0 0x7f9d380a3670 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9d48006010 tx=0x7f9d4800b540 comp rx=0 tx=0).stop 2024-06-02T04:03:43.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.481+0000 7f9d53def700 1 -- 172.21.15.123:0/618402176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d4c105f80 msgr2=0x7f9d4c19aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:43.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.481+0000 7f9d53def700 1 --2- 172.21.15.123:0/618402176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d4c105f80 0x7f9d4c19aba0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9d44007ee0 tx=0x7f9d4400d3b0 comp rx=0 tx=0).stop 2024-06-02T04:03:43.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.481+0000 7f9d53def700 1 -- 172.21.15.123:0/618402176 shutdown_connections 2024-06-02T04:03:43.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.481+0000 7f9d53def700 1 --2- 172.21.15.123:0/618402176 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9d4c105f80 0x7f9d4c19aba0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:43.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.481+0000 7f9d53def700 1 --2- 172.21.15.123:0/618402176 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9d380a11b0 0x7f9d380a3670 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:43.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.481+0000 7f9d53def700 1 --2- 172.21.15.123:0/618402176 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9d4c1001f0 0x7f9d4c1962b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:43.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.481+0000 7f9d53def700 1 --2- 172.21.15.123:0/618402176 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d4c100bb0 0x7f9d4c1967f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:43.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.481+0000 7f9d53def700 1 -- 172.21.15.123:0/618402176 >> 172.21.15.123:0/618402176 conn(0x7f9d4c076c50 msgr2=0x7f9d4c0fef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:43.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.481+0000 7f9d53def700 1 -- 172.21.15.123:0/618402176 shutdown_connections 2024-06-02T04:03:43.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:43.481+0000 7f9d53def700 1 -- 172.21.15.123:0/618402176 wait complete. 2024-06-02T04:03:44.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.090+0000 7f5aa7d1e700 1 -- 172.21.15.123:0/810739380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5aa0101020 msgr2=0x7f5aa01014a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:44.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.090+0000 7f5aa7d1e700 1 --2- 172.21.15.123:0/810739380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5aa0101020 0x7f5aa01014a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5a90009990 tx=0x7f5a90009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:44.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.090+0000 7f5aa7d1e700 1 -- 172.21.15.123:0/810739380 shutdown_connections 2024-06-02T04:03:44.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.090+0000 7f5aa7d1e700 1 --2- 172.21.15.123:0/810739380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5aa01019e0 0x7f5aa010ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:44.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.090+0000 7f5aa7d1e700 1 --2- 172.21.15.123:0/810739380 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5aa0107040 0x7f5aa0107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:44.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.090+0000 7f5aa7d1e700 1 --2- 172.21.15.123:0/810739380 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5aa0101020 0x7f5aa01014a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:44.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.090+0000 7f5aa7d1e700 1 -- 172.21.15.123:0/810739380 >> 172.21.15.123:0/810739380 conn(0x7f5aa0078100 msgr2=0x7f5aa0078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:44.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.091+0000 7f5aa7d1e700 1 -- 172.21.15.123:0/810739380 shutdown_connections 2024-06-02T04:03:44.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.091+0000 7f5aa7d1e700 1 -- 172.21.15.123:0/810739380 wait complete. 2024-06-02T04:03:44.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.091+0000 7f5aa7d1e700 1 Processor -- start 2024-06-02T04:03:44.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.091+0000 7f5aa7d1e700 1 -- start start 2024-06-02T04:03:44.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.091+0000 7f5aa7d1e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5aa0101020 0x7f5aa0197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:44.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.091+0000 7f5aa7d1e700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5aa01019e0 0x7f5aa0197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:44.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.091+0000 7f5aa7d1e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5aa0107040 0x7f5aa019bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:44.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.091+0000 7f5aa7d1e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa019c240 con 0x7f5aa0101020 2024-06-02T04:03:44.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.091+0000 7f5aa7d1e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa019c3b0 con 0x7f5aa0107040 2024-06-02T04:03:44.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.091+0000 7f5aa7d1e700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa019c570 con 0x7f5aa01019e0 2024-06-02T04:03:44.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.091+0000 7f5aa5aba700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5aa0101020 0x7f5aa0197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:44.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.091+0000 7f5aa5aba700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5aa0101020 0x7f5aa0197340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:53388/0 (socket says 172.21.15.123:53388) 2024-06-02T04:03:44.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.091+0000 7f5aa5aba700 1 -- 172.21.15.123:0/1327643733 learned_addr learned my addr 172.21.15.123:0/1327643733 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:44.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.092+0000 7f5aa52b9700 1 --2- 172.21.15.123:0/1327643733 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5aa01019e0 0x7f5aa0197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:44.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.092+0000 7f5aa5aba700 1 -- 172.21.15.123:0/1327643733 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5aa01019e0 msgr2=0x7f5aa0197880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:44.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.092+0000 7f5aa5aba700 1 --2- 172.21.15.123:0/1327643733 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5aa01019e0 0x7f5aa0197880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:44.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.092+0000 7f5aa5aba700 1 -- 172.21.15.123:0/1327643733 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5aa0107040 msgr2=0x7f5aa019bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:44.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.092+0000 7f5aa5aba700 1 --2- 172.21.15.123:0/1327643733 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5aa0107040 0x7f5aa019bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:44.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.092+0000 7f5aa5aba700 1 -- 172.21.15.123:0/1327643733 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a900095f0 con 0x7f5aa0101020 2024-06-02T04:03:44.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.092+0000 7f5aa5aba700 1 --2- 172.21.15.123:0/1327643733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5aa0101020 0x7f5aa0197340 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c00d980 tx=0x7f5a9c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:44.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.092+0000 7f5a96ffd700 1 -- 172.21.15.123:0/1327643733 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c00bb60 con 0x7f5aa0101020 2024-06-02T04:03:44.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.092+0000 7f5aa7d1e700 1 -- 172.21.15.123:0/1327643733 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa019c850 con 0x7f5aa0101020 2024-06-02T04:03:44.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.092+0000 7f5a96ffd700 1 -- 172.21.15.123:0/1327643733 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5a9c007640 con 0x7f5aa0101020 2024-06-02T04:03:44.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.092+0000 7f5a96ffd700 1 -- 172.21.15.123:0/1327643733 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c004e90 con 0x7f5aa0101020 2024-06-02T04:03:44.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.092+0000 7f5aa7d1e700 1 -- 172.21.15.123:0/1327643733 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa01a40b0 con 0x7f5aa0101020 2024-06-02T04:03:44.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.093+0000 7f5aa7d1e700 1 -- 172.21.15.123:0/1327643733 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aa01094d0 con 0x7f5aa0101020 2024-06-02T04:03:44.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.094+0000 7f5a96ffd700 1 -- 172.21.15.123:0/1327643733 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f5a9c00bcc0 con 0x7f5aa0101020 2024-06-02T04:03:44.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.094+0000 7f5a96ffd700 1 --2- 172.21.15.123:0/1327643733 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f5a8c0a11b0 0x7f5a8c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:44.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.095+0000 7f5aa52b9700 1 --2- 172.21.15.123:0/1327643733 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f5a8c0a11b0 0x7f5a8c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:44.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.095+0000 7f5a96ffd700 1 -- 172.21.15.123:0/1327643733 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5a9c0cc770 con 0x7f5aa0101020 2024-06-02T04:03:44.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.095+0000 7f5aa52b9700 1 --2- 172.21.15.123:0/1327643733 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f5a8c0a11b0 0x7f5a8c0a3670 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5a90003730 tx=0x7f5a900036c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:44.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.099+0000 7f5a96ffd700 1 -- 172.21.15.123:0/1327643733 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5a9c095f50 con 0x7f5aa0101020 2024-06-02T04:03:44.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:43 smithi162 ceph-mon[47009]: pgmap v240: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 341 B/s wr, 9 op/s 2024-06-02T04:03:44.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:43 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/618402176' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-06-02T04:03:44.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.305+0000 7f5aa7d1e700 1 -- 172.21.15.123:0/1327643733 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f5aa019ca40 con 0x7f5aa0101020 2024-06-02T04:03:44.304 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.305+0000 7f5a96ffd700 1 -- 172.21.15.123:0/1327643733 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f5a9c016090 con 0x7f5aa0101020 2024-06-02T04:03:44.304 INFO:teuthology.orchestra.run.smithi123.stdout:330712481809 2024-06-02T04:03:44.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.307+0000 7f5aa7d1e700 1 -- 172.21.15.123:0/1327643733 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f5a8c0a11b0 msgr2=0x7f5a8c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:44.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.307+0000 7f5aa7d1e700 1 --2- 172.21.15.123:0/1327643733 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f5a8c0a11b0 0x7f5a8c0a3670 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5a90003730 tx=0x7f5a900036c0 comp rx=0 tx=0).stop 2024-06-02T04:03:44.306 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.307+0000 7f5aa7d1e700 1 -- 172.21.15.123:0/1327643733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5aa0101020 msgr2=0x7f5aa0197340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:44.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.307+0000 7f5aa7d1e700 1 --2- 172.21.15.123:0/1327643733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5aa0101020 0x7f5aa0197340 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c00d980 tx=0x7f5a9c00dd40 comp rx=0 tx=0).stop 2024-06-02T04:03:44.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.307+0000 7f5aa7d1e700 1 -- 172.21.15.123:0/1327643733 shutdown_connections 2024-06-02T04:03:44.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.307+0000 7f5aa7d1e700 1 --2- 172.21.15.123:0/1327643733 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f5a8c0a11b0 0x7f5a8c0a3670 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:44.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.307+0000 7f5aa7d1e700 1 --2- 172.21.15.123:0/1327643733 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5aa0107040 0x7f5aa019bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:44.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.307+0000 7f5aa7d1e700 1 --2- 172.21.15.123:0/1327643733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5aa0101020 0x7f5aa0197340 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:44.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.307+0000 7f5aa7d1e700 1 --2- 172.21.15.123:0/1327643733 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5aa01019e0 0x7f5aa0197880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:44.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.307+0000 7f5aa7d1e700 1 -- 172.21.15.123:0/1327643733 >> 172.21.15.123:0/1327643733 conn(0x7f5aa0078100 msgr2=0x7f5aa00ffd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:44.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.308+0000 7f5aa7d1e700 1 -- 172.21.15.123:0/1327643733 shutdown_connections 2024-06-02T04:03:44.307 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:44.308+0000 7f5aa7d1e700 1 -- 172.21.15.123:0/1327643733 wait complete. 2024-06-02T04:03:44.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:43 smithi123 ceph-mon[42885]: pgmap v240: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 341 B/s wr, 9 op/s 2024-06-02T04:03:44.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:43 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/618402176' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-06-02T04:03:44.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:43 smithi136 ceph-mon[47443]: pgmap v240: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 341 B/s wr, 9 op/s 2024-06-02T04:03:44.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:43 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/618402176' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-06-02T04:03:44.571 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574897 got 55834574900 for osd.1 2024-06-02T04:03:44.571 DEBUG:teuthology.parallel:result is None 2024-06-02T04:03:44.696 INFO:tasks.cephadm.ceph_manager.ceph:need seq 244813135897 got 244813135899 for osd.8 2024-06-02T04:03:44.696 DEBUG:teuthology.parallel:result is None 2024-06-02T04:03:44.738 INFO:tasks.cephadm.ceph_manager.ceph:need seq 300647710738 got 300647710739 for osd.10 2024-06-02T04:03:44.738 DEBUG:teuthology.parallel:result is None 2024-06-02T04:03:45.049 INFO:tasks.cephadm.ceph_manager.ceph:need seq 330712481807 got 330712481809 for osd.11 2024-06-02T04:03:45.049 DEBUG:teuthology.parallel:result is None 2024-06-02T04:03:45.193 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:44 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1327643733' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-06-02T04:03:45.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:44 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/1327643733' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-06-02T04:03:45.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:44 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/1327643733' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-06-02T04:03:45.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.381+0000 7fe181219700 1 -- 172.21.15.123:0/2694341470 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe17c068950 msgr2=0x7fe17c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:45.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.381+0000 7fe181219700 1 --2- 172.21.15.123:0/2694341470 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe17c068950 0x7fe17c068db0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe170009990 tx=0x7fe170009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:45.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.381+0000 7fe181219700 1 -- 172.21.15.123:0/2694341470 shutdown_connections 2024-06-02T04:03:45.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.381+0000 7fe181219700 1 --2- 172.21.15.123:0/2694341470 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe17c0692f0 0x7fe17c10de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:45.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.381+0000 7fe181219700 1 --2- 172.21.15.123:0/2694341470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe17c107020 0x7fe17c107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:45.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.381+0000 7fe181219700 1 --2- 172.21.15.123:0/2694341470 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe17c068950 0x7fe17c068db0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:45.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.381+0000 7fe181219700 1 -- 172.21.15.123:0/2694341470 >> 172.21.15.123:0/2694341470 conn(0x7fe17c075f80 msgr2=0x7fe17c076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:45.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.381+0000 7fe181219700 1 -- 172.21.15.123:0/2694341470 shutdown_connections 2024-06-02T04:03:45.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.381+0000 7fe181219700 1 -- 172.21.15.123:0/2694341470 wait complete. 2024-06-02T04:03:45.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.381+0000 7fe181219700 1 Processor -- start 2024-06-02T04:03:45.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.382+0000 7fe181219700 1 -- start start 2024-06-02T04:03:45.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.382+0000 7fe181219700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe17c068950 0x7fe17c0fffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:45.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.382+0000 7fe181219700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe17c0692f0 0x7fe17c1004e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:45.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.382+0000 7fe181219700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe17c107020 0x7fe17c100a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:45.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.382+0000 7fe181219700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c1a5710 con 0x7fe17c107020 2024-06-02T04:03:45.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.382+0000 7fe181219700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c1a5880 con 0x7fe17c068950 2024-06-02T04:03:45.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.382+0000 7fe181219700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c1a5a40 con 0x7fe17c0692f0 2024-06-02T04:03:45.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.382+0000 7fe17b59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe17c107020 0x7fe17c100a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:45.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.382+0000 7fe17b59e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe17c107020 0x7fe17c100a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41302/0 (socket says 172.21.15.123:41302) 2024-06-02T04:03:45.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.382+0000 7fe17a59c700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe17c0692f0 0x7fe17c1004e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:45.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.382+0000 7fe17b59e700 1 -- 172.21.15.123:0/2215298634 learned_addr learned my addr 172.21.15.123:0/2215298634 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:45.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.382+0000 7fe17ad9d700 1 --2- 172.21.15.123:0/2215298634 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe17c068950 0x7fe17c0fffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:45.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.382+0000 7fe17b59e700 1 -- 172.21.15.123:0/2215298634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe17c0692f0 msgr2=0x7fe17c1004e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:45.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.382+0000 7fe17b59e700 1 --2- 172.21.15.123:0/2215298634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe17c0692f0 0x7fe17c1004e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:45.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.382+0000 7fe17b59e700 1 -- 172.21.15.123:0/2215298634 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe17c068950 msgr2=0x7fe17c0fffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:45.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.382+0000 7fe17b59e700 1 --2- 172.21.15.123:0/2215298634 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe17c068950 0x7fe17c0fffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:45.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.382+0000 7fe17b59e700 1 -- 172.21.15.123:0/2215298634 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1700095f0 con 0x7fe17c107020 2024-06-02T04:03:45.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.382+0000 7fe17a59c700 1 --2- 172.21.15.123:0/2215298634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe17c0692f0 0x7fe17c1004e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:03:45.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.383+0000 7fe17b59e700 1 --2- 172.21.15.123:0/2215298634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe17c107020 0x7fe17c100a20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe174007d70 tx=0x7fe17400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:45.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.383+0000 7fe163fff700 1 -- 172.21.15.123:0/2215298634 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17400ac90 con 0x7fe17c107020 2024-06-02T04:03:45.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.383+0000 7fe181219700 1 -- 172.21.15.123:0/2215298634 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17c1a5d20 con 0x7fe17c107020 2024-06-02T04:03:45.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.383+0000 7fe163fff700 1 -- 172.21.15.123:0/2215298634 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe17400adf0 con 0x7fe17c107020 2024-06-02T04:03:45.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.383+0000 7fe163fff700 1 -- 172.21.15.123:0/2215298634 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1740115e0 con 0x7fe17c107020 2024-06-02T04:03:45.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.383+0000 7fe181219700 1 -- 172.21.15.123:0/2215298634 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17c1a61a0 con 0x7fe17c107020 2024-06-02T04:03:45.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.384+0000 7fe181219700 1 -- 172.21.15.123:0/2215298634 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17c109540 con 0x7fe17c107020 2024-06-02T04:03:45.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.385+0000 7fe163fff700 1 -- 172.21.15.123:0/2215298634 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fe174004ad0 con 0x7fe17c107020 2024-06-02T04:03:45.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.386+0000 7fe163fff700 1 --2- 172.21.15.123:0/2215298634 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe1640a11b0 0x7fe1640a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:45.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.386+0000 7fe17ad9d700 1 --2- 172.21.15.123:0/2215298634 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe1640a11b0 0x7fe1640a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:45.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.386+0000 7fe163fff700 1 -- 172.21.15.123:0/2215298634 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe1740ccd70 con 0x7fe17c107020 2024-06-02T04:03:45.386 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.386+0000 7fe17ad9d700 1 --2- 172.21.15.123:0/2215298634 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe1640a11b0 0x7fe1640a3670 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe16c005950 tx=0x7fe16c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:45.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.389+0000 7fe163fff700 1 -- 172.21.15.123:0/2215298634 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe174096660 con 0x7fe17c107020 2024-06-02T04:03:45.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.440+0000 7f32b28b9700 1 -- 172.21.15.123:0/3801963826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32ac0ffed0 msgr2=0x7f32ac100350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:45.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.440+0000 7f32b28b9700 1 --2- 172.21.15.123:0/3801963826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32ac0ffed0 0x7f32ac100350 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3294009990 tx=0x7f3294009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:45.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.440+0000 7f32b28b9700 1 -- 172.21.15.123:0/3801963826 shutdown_connections 2024-06-02T04:03:45.439 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.440+0000 7f32b28b9700 1 --2- 172.21.15.123:0/3801963826 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f32ac100890 0x7f32ac10cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:45.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.440+0000 7f32b28b9700 1 --2- 172.21.15.123:0/3801963826 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32ac105f00 0x7f32ac1062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:45.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.440+0000 7f32b28b9700 1 --2- 172.21.15.123:0/3801963826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32ac0ffed0 0x7f32ac100350 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:45.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.440+0000 7f32b28b9700 1 -- 172.21.15.123:0/3801963826 >> 172.21.15.123:0/3801963826 conn(0x7f32ac075f80 msgr2=0x7f32ac076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:45.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.440+0000 7f32b28b9700 1 -- 172.21.15.123:0/3801963826 shutdown_connections 2024-06-02T04:03:45.440 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.440+0000 7f32b28b9700 1 -- 172.21.15.123:0/3801963826 wait complete. 2024-06-02T04:03:45.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.441+0000 7f32b28b9700 1 Processor -- start 2024-06-02T04:03:45.441 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.441+0000 7f32b28b9700 1 -- start start 2024-06-02T04:03:45.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.441+0000 7f32b28b9700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f32ac0ffed0 0x7f32ac1962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:45.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.441+0000 7f32b28b9700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32ac100890 0x7f32ac196820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:45.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.441+0000 7f32b28b9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32ac105f00 0x7f32ac19abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:45.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.441+0000 7f32b28b9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac19b1e0 con 0x7f32ac105f00 2024-06-02T04:03:45.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.441+0000 7f32b28b9700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac19b350 con 0x7f32ac0ffed0 2024-06-02T04:03:45.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.441+0000 7f32b28b9700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac19b510 con 0x7f32ac100890 2024-06-02T04:03:45.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.441+0000 7f32abfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f32ac0ffed0 0x7f32ac1962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:45.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.441+0000 7f32b0e56700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32ac105f00 0x7f32ac19abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:45.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.441+0000 7f32abfff700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f32ac0ffed0 0x7f32ac1962e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.123:43844/0 (socket says 172.21.15.123:43844) 2024-06-02T04:03:45.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.441+0000 7f32abfff700 1 -- 172.21.15.123:0/122156025 learned_addr learned my addr 172.21.15.123:0/122156025 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:45.442 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.442+0000 7f32a3fff700 1 --2- 172.21.15.123:0/122156025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32ac100890 0x7f32ac196820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:45.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.442+0000 7f32abfff700 1 -- 172.21.15.123:0/122156025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32ac100890 msgr2=0x7f32ac196820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:45.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.442+0000 7f32abfff700 1 --2- 172.21.15.123:0/122156025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32ac100890 0x7f32ac196820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:45.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.442+0000 7f32abfff700 1 -- 172.21.15.123:0/122156025 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32ac105f00 msgr2=0x7f32ac19abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:45.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.442+0000 7f32abfff700 1 --2- 172.21.15.123:0/122156025 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32ac105f00 0x7f32ac19abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:45.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.442+0000 7f32abfff700 1 -- 172.21.15.123:0/122156025 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32940095f0 con 0x7f32ac0ffed0 2024-06-02T04:03:45.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.442+0000 7f32b0e56700 1 --2- 172.21.15.123:0/122156025 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32ac105f00 0x7f32ac19abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:03:45.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.442+0000 7f32abfff700 1 --2- 172.21.15.123:0/122156025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f32ac0ffed0 0x7f32ac1962e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f329c00e9a0 tx=0x7f329c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:45.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.442+0000 7f32a9ffb700 1 -- 172.21.15.123:0/122156025 <== mon.2 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c009790 con 0x7f32ac0ffed0 2024-06-02T04:03:45.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.442+0000 7f32b28b9700 1 -- 172.21.15.123:0/122156025 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32ac19b7f0 con 0x7f32ac0ffed0 2024-06-02T04:03:45.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.442+0000 7f32a9ffb700 1 -- 172.21.15.123:0/122156025 <== mon.2 v2:172.21.15.136:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f329c010430 con 0x7f32ac0ffed0 2024-06-02T04:03:45.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.442+0000 7f32b28b9700 1 -- 172.21.15.123:0/122156025 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32ac068b20 con 0x7f32ac0ffed0 2024-06-02T04:03:45.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.442+0000 7f32a9ffb700 1 -- 172.21.15.123:0/122156025 <== mon.2 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c018680 con 0x7f32ac0ffed0 2024-06-02T04:03:45.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.443+0000 7f32b28b9700 1 -- 172.21.15.123:0/122156025 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32ac1015b0 con 0x7f32ac0ffed0 2024-06-02T04:03:45.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.445+0000 7f32a9ffb700 1 -- 172.21.15.123:0/122156025 <== mon.2 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f329c0105a0 con 0x7f32ac0ffed0 2024-06-02T04:03:45.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.446+0000 7f32a9ffb700 1 --2- 172.21.15.123:0/122156025 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f32980a11b0 0x7f32980a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:45.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.446+0000 7f32a3fff700 1 --2- 172.21.15.123:0/122156025 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f32980a11b0 0x7f32980a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:45.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.446+0000 7f32a9ffb700 1 -- 172.21.15.123:0/122156025 <== mon.2 v2:172.21.15.136:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f329c014070 con 0x7f32ac0ffed0 2024-06-02T04:03:45.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.446+0000 7f32a3fff700 1 --2- 172.21.15.123:0/122156025 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f32980a11b0 0x7f32980a3670 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f329400b2e0 tx=0x7f3294005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:45.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.449+0000 7f32a9ffb700 1 -- 172.21.15.123:0/122156025 <== mon.2 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f329c096420 con 0x7f32ac0ffed0 2024-06-02T04:03:45.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.587+0000 7f6256889700 1 -- 172.21.15.123:0/2869724900 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6250105f00 msgr2=0x7f62501062e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:45.586 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.587+0000 7f6256889700 1 --2- 172.21.15.123:0/2869724900 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6250105f00 0x7f62501062e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6240009990 tx=0x7f6240009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:45.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.587+0000 7f6256889700 1 -- 172.21.15.123:0/2869724900 shutdown_connections 2024-06-02T04:03:45.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.587+0000 7f6256889700 1 --2- 172.21.15.123:0/2869724900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6250100890 0x7f625010cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:45.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.587+0000 7f6256889700 1 --2- 172.21.15.123:0/2869724900 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6250105f00 0x7f62501062e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:45.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.587+0000 7f6256889700 1 --2- 172.21.15.123:0/2869724900 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f62500ffed0 0x7f6250100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:45.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.587+0000 7f6256889700 1 -- 172.21.15.123:0/2869724900 >> 172.21.15.123:0/2869724900 conn(0x7f6250075f80 msgr2=0x7f6250076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:45.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.587+0000 7f6256889700 1 -- 172.21.15.123:0/2869724900 shutdown_connections 2024-06-02T04:03:45.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.587+0000 7f6256889700 1 -- 172.21.15.123:0/2869724900 wait complete. 2024-06-02T04:03:45.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.588+0000 7f6256889700 1 Processor -- start 2024-06-02T04:03:45.587 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.588+0000 7f6256889700 1 -- start start 2024-06-02T04:03:45.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.588+0000 7f6256889700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f62500ffed0 0x7f6250197410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:45.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.588+0000 7f6256889700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6250100890 0x7f6250197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:45.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.588+0000 7f6256889700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6250105f00 0x7f625019bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:45.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.588+0000 7f6256889700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625019c2c0 con 0x7f6250105f00 2024-06-02T04:03:45.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.588+0000 7f6256889700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625019c430 con 0x7f62500ffed0 2024-06-02T04:03:45.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.588+0000 7f6256889700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625019c5f0 con 0x7f6250100890 2024-06-02T04:03:45.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.588+0000 7f6254e26700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6250105f00 0x7f625019bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:45.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.588+0000 7f6254e26700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6250105f00 0x7f625019bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41326/0 (socket says 172.21.15.123:41326) 2024-06-02T04:03:45.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.588+0000 7f6254e26700 1 -- 172.21.15.123:0/877877448 learned_addr learned my addr 172.21.15.123:0/877877448 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:45.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.588+0000 7f624f7fe700 1 --2- 172.21.15.123:0/877877448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6250100890 0x7f6250197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:45.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.588+0000 7f624ffff700 1 --2- 172.21.15.123:0/877877448 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f62500ffed0 0x7f6250197410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:45.589 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.589+0000 7f6254e26700 1 -- 172.21.15.123:0/877877448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6250100890 msgr2=0x7f6250197950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:45.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.589+0000 7f6254e26700 1 --2- 172.21.15.123:0/877877448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6250100890 0x7f6250197950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:45.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.589+0000 7f6254e26700 1 -- 172.21.15.123:0/877877448 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f62500ffed0 msgr2=0x7f6250197410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:45.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.589+0000 7f6254e26700 1 --2- 172.21.15.123:0/877877448 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f62500ffed0 0x7f6250197410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:45.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.589+0000 7f6254e26700 1 -- 172.21.15.123:0/877877448 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62400095f0 con 0x7f6250105f00 2024-06-02T04:03:45.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.589+0000 7f624f7fe700 1 --2- 172.21.15.123:0/877877448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6250100890 0x7f6250197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:03:45.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.589+0000 7f6254e26700 1 --2- 172.21.15.123:0/877877448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6250105f00 0x7f625019bcb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6248007d70 tx=0x7f624800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:45.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.589+0000 7f624d7fa700 1 -- 172.21.15.123:0/877877448 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624800ac90 con 0x7f6250105f00 2024-06-02T04:03:45.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.589+0000 7f6256889700 1 -- 172.21.15.123:0/877877448 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f625019c8d0 con 0x7f6250105f00 2024-06-02T04:03:45.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.589+0000 7f624d7fa700 1 -- 172.21.15.123:0/877877448 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f624800adf0 con 0x7f6250105f00 2024-06-02T04:03:45.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.589+0000 7f624d7fa700 1 -- 172.21.15.123:0/877877448 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62480115e0 con 0x7f6250105f00 2024-06-02T04:03:45.591 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.589+0000 7f6256889700 1 -- 172.21.15.123:0/877877448 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62501a4130 con 0x7f6250105f00 2024-06-02T04:03:45.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.590+0000 7f6256889700 1 -- 172.21.15.123:0/877877448 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6250108420 con 0x7f6250105f00 2024-06-02T04:03:45.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.592+0000 7f624d7fa700 1 -- 172.21.15.123:0/877877448 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f6248004ad0 con 0x7f6250105f00 2024-06-02T04:03:45.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.592+0000 7f624d7fa700 1 --2- 172.21.15.123:0/877877448 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f62380a1230 0x7f62380a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:45.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.592+0000 7f624d7fa700 1 -- 172.21.15.123:0/877877448 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f62480cccd0 con 0x7f6250105f00 2024-06-02T04:03:45.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.592+0000 7f624ffff700 1 --2- 172.21.15.123:0/877877448 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f62380a1230 0x7f62380a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:45.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.593+0000 7f624ffff700 1 --2- 172.21.15.123:0/877877448 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f62380a1230 0x7f62380a36f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f62400098e0 tx=0x7f6240005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:45.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.599+0000 7fe181219700 1 -- 172.21.15.123:0/2215298634 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe17c1026d0 con 0x7fe17c107020 2024-06-02T04:03:45.598 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.600+0000 7fe163fff700 1 -- 172.21.15.123:0/2215298634 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe174099c80 con 0x7fe17c107020 2024-06-02T04:03:45.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.600+0000 7f624d7fa700 1 -- 172.21.15.123:0/877877448 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f62480965c0 con 0x7f6250105f00 2024-06-02T04:03:45.599 INFO:teuthology.orchestra.run.smithi123.stdout:77309411377 2024-06-02T04:03:45.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.602+0000 7fe181219700 1 -- 172.21.15.123:0/2215298634 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe1640a11b0 msgr2=0x7fe1640a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:45.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.602+0000 7fe181219700 1 --2- 172.21.15.123:0/2215298634 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe1640a11b0 0x7fe1640a3670 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe16c005950 tx=0x7fe16c00b410 comp rx=0 tx=0).stop 2024-06-02T04:03:45.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.602+0000 7fe181219700 1 -- 172.21.15.123:0/2215298634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe17c107020 msgr2=0x7fe17c100a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:45.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.602+0000 7fe181219700 1 --2- 172.21.15.123:0/2215298634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe17c107020 0x7fe17c100a20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe174007d70 tx=0x7fe17400a340 comp rx=0 tx=0).stop 2024-06-02T04:03:45.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.602+0000 7fe181219700 1 -- 172.21.15.123:0/2215298634 shutdown_connections 2024-06-02T04:03:45.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.602+0000 7fe181219700 1 --2- 172.21.15.123:0/2215298634 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe17c107020 0x7fe17c100a20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:45.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.602+0000 7fe181219700 1 --2- 172.21.15.123:0/2215298634 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe1640a11b0 0x7fe1640a3670 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:45.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.602+0000 7fe181219700 1 --2- 172.21.15.123:0/2215298634 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe17c068950 0x7fe17c0fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:45.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.602+0000 7fe181219700 1 --2- 172.21.15.123:0/2215298634 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe17c0692f0 0x7fe17c1004e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:45.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.602+0000 7fe181219700 1 -- 172.21.15.123:0/2215298634 >> 172.21.15.123:0/2215298634 conn(0x7fe17c075f80 msgr2=0x7fe17c0fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:45.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.602+0000 7fe181219700 1 -- 172.21.15.123:0/2215298634 shutdown_connections 2024-06-02T04:03:45.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.602+0000 7fe181219700 1 -- 172.21.15.123:0/2215298634 wait complete. 2024-06-02T04:03:45.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.659+0000 7f32b28b9700 1 -- 172.21.15.123:0/122156025 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f32ac04ec60 con 0x7f32ac0ffed0 2024-06-02T04:03:45.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.660+0000 7f32a9ffb700 1 -- 172.21.15.123:0/122156025 <== mon.2 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f329c026020 con 0x7f32ac0ffed0 2024-06-02T04:03:45.659 INFO:teuthology.orchestra.run.smithi123.stdout:274877906969 2024-06-02T04:03:45.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.663+0000 7f32b28b9700 1 -- 172.21.15.123:0/122156025 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f32980a11b0 msgr2=0x7f32980a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:45.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.663+0000 7f32b28b9700 1 --2- 172.21.15.123:0/122156025 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f32980a11b0 0x7f32980a3670 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f329400b2e0 tx=0x7f3294005960 comp rx=0 tx=0).stop 2024-06-02T04:03:45.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.663+0000 7f32b28b9700 1 -- 172.21.15.123:0/122156025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f32ac0ffed0 msgr2=0x7f32ac1962e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:45.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.663+0000 7f32b28b9700 1 --2- 172.21.15.123:0/122156025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f32ac0ffed0 0x7f32ac1962e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f329c00e9a0 tx=0x7f329c00ecb0 comp rx=0 tx=0).stop 2024-06-02T04:03:45.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.663+0000 7f32b28b9700 1 -- 172.21.15.123:0/122156025 shutdown_connections 2024-06-02T04:03:45.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.663+0000 7f32b28b9700 1 --2- 172.21.15.123:0/122156025 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f32ac105f00 0x7f32ac19abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:45.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.663+0000 7f32b28b9700 1 --2- 172.21.15.123:0/122156025 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f32980a11b0 0x7f32980a3670 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:45.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.663+0000 7f32b28b9700 1 --2- 172.21.15.123:0/122156025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f32ac0ffed0 0x7f32ac1962e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:45.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.663+0000 7f32b28b9700 1 --2- 172.21.15.123:0/122156025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32ac100890 0x7f32ac196820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:45.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.663+0000 7f32b28b9700 1 -- 172.21.15.123:0/122156025 >> 172.21.15.123:0/122156025 conn(0x7f32ac075f80 msgr2=0x7f32ac0fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:45.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.663+0000 7f32b28b9700 1 -- 172.21.15.123:0/122156025 shutdown_connections 2024-06-02T04:03:45.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.663+0000 7f32b28b9700 1 -- 172.21.15.123:0/122156025 wait complete. 2024-06-02T04:03:45.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.813+0000 7f6256889700 1 -- 172.21.15.123:0/877877448 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f62501015b0 con 0x7f6250105f00 2024-06-02T04:03:45.812 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.813+0000 7f624d7fa700 1 -- 172.21.15.123:0/877877448 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6248016020 con 0x7f6250105f00 2024-06-02T04:03:45.813 INFO:teuthology.orchestra.run.smithi123.stdout:158913789991 2024-06-02T04:03:45.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.815+0000 7f6256889700 1 -- 172.21.15.123:0/877877448 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f62380a1230 msgr2=0x7f62380a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:45.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.816+0000 7f6256889700 1 --2- 172.21.15.123:0/877877448 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f62380a1230 0x7f62380a36f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f62400098e0 tx=0x7f6240005960 comp rx=0 tx=0).stop 2024-06-02T04:03:45.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.816+0000 7f6256889700 1 -- 172.21.15.123:0/877877448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6250105f00 msgr2=0x7f625019bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:45.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.816+0000 7f6256889700 1 --2- 172.21.15.123:0/877877448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6250105f00 0x7f625019bcb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6248007d70 tx=0x7f624800a340 comp rx=0 tx=0).stop 2024-06-02T04:03:45.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.816+0000 7f6256889700 1 -- 172.21.15.123:0/877877448 shutdown_connections 2024-06-02T04:03:45.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.816+0000 7f6256889700 1 --2- 172.21.15.123:0/877877448 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6250105f00 0x7f625019bcb0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:45.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.816+0000 7f6256889700 1 --2- 172.21.15.123:0/877877448 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f62380a1230 0x7f62380a36f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:45.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.816+0000 7f6256889700 1 --2- 172.21.15.123:0/877877448 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f62500ffed0 0x7f6250197410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:45.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.816+0000 7f6256889700 1 --2- 172.21.15.123:0/877877448 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6250100890 0x7f6250197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:45.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.816+0000 7f6256889700 1 -- 172.21.15.123:0/877877448 >> 172.21.15.123:0/877877448 conn(0x7f6250075f80 msgr2=0x7f62500fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:45.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.816+0000 7f6256889700 1 -- 172.21.15.123:0/877877448 shutdown_connections 2024-06-02T04:03:45.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:45.816+0000 7f6256889700 1 -- 172.21.15.123:0/877877448 wait complete. 2024-06-02T04:03:45.932 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:45 smithi123 ceph-mon[42885]: pgmap v241: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 11 op/s 2024-06-02T04:03:45.932 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:45 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2215298634' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-06-02T04:03:45.932 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:45 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/122156025' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-06-02T04:03:45.932 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:45 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/877877448' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-06-02T04:03:46.265 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411375 got 77309411377 for osd.2 2024-06-02T04:03:46.265 DEBUG:teuthology.parallel:result is None 2024-06-02T04:03:46.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:45 smithi162 ceph-mon[47009]: pgmap v241: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 11 op/s 2024-06-02T04:03:46.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:45 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/2215298634' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-06-02T04:03:46.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:45 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/122156025' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-06-02T04:03:46.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:45 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/877877448' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-06-02T04:03:46.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:45 smithi136 ceph-mon[47443]: pgmap v241: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 11 op/s 2024-06-02T04:03:46.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:45 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/2215298634' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-06-02T04:03:46.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:45 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/122156025' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-06-02T04:03:46.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:45 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/877877448' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-06-02T04:03:46.395 INFO:tasks.cephadm.ceph_manager.ceph:need seq 274877906967 got 274877906969 for osd.9 2024-06-02T04:03:46.396 DEBUG:teuthology.parallel:result is None 2024-06-02T04:03:46.604 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789989 got 158913789991 for osd.5 2024-06-02T04:03:46.604 DEBUG:teuthology.parallel:result is None 2024-06-02T04:03:46.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.890+0000 7ff5c9d6b700 1 -- 172.21.15.123:0/2409823265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5c4069210 msgr2=0x7ff5c4069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:46.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.890+0000 7ff5c9d6b700 1 --2- 172.21.15.123:0/2409823265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5c4069210 0x7ff5c4069690 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0099c0 tx=0x7ff5ac009cd0 comp rx=0 tx=0).stop 2024-06-02T04:03:46.891 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.890+0000 7ff5c9d6b700 1 -- 172.21.15.123:0/2409823265 shutdown_connections 2024-06-02T04:03:46.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.890+0000 7ff5c9d6b700 1 --2- 172.21.15.123:0/2409823265 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5c4069bd0 0x7ff5c410de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:46.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.890+0000 7ff5c9d6b700 1 --2- 172.21.15.123:0/2409823265 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5c4106fe0 0x7ff5c41073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:46.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.890+0000 7ff5c9d6b700 1 --2- 172.21.15.123:0/2409823265 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5c4069210 0x7ff5c4069690 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:46.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.890+0000 7ff5c9d6b700 1 -- 172.21.15.123:0/2409823265 >> 172.21.15.123:0/2409823265 conn(0x7ff5c4076e70 msgr2=0x7ff5c4077280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:46.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.890+0000 7ff5c9d6b700 1 -- 172.21.15.123:0/2409823265 shutdown_connections 2024-06-02T04:03:46.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.890+0000 7ff5c9d6b700 1 -- 172.21.15.123:0/2409823265 wait complete. 2024-06-02T04:03:46.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.891+0000 7ff5c9d6b700 1 Processor -- start 2024-06-02T04:03:46.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.891+0000 7ff5c9d6b700 1 -- start start 2024-06-02T04:03:46.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.891+0000 7ff5c9d6b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5c4069210 0x7ff5c41972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:46.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.891+0000 7ff5c9d6b700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5c4069bd0 0x7ff5c4197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:46.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.891+0000 7ff5c9d6b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5c4106fe0 0x7ff5c419bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:46.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.891+0000 7ff5c9d6b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c419c1f0 con 0x7ff5c4106fe0 2024-06-02T04:03:46.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.891+0000 7ff5c9d6b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c419c360 con 0x7ff5c4069210 2024-06-02T04:03:46.892 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.891+0000 7ff5c9d6b700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c419c520 con 0x7ff5c4069bd0 2024-06-02T04:03:46.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.891+0000 7ff5c3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5c4106fe0 0x7ff5c419bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:46.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.891+0000 7ff5c3fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5c4106fe0 0x7ff5c419bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41342/0 (socket says 172.21.15.123:41342) 2024-06-02T04:03:46.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.891+0000 7ff5c3fff700 1 -- 172.21.15.123:0/2827368325 learned_addr learned my addr 172.21.15.123:0/2827368325 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:46.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.891+0000 7ff5c37fe700 1 --2- 172.21.15.123:0/2827368325 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5c4069210 0x7ff5c41972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:46.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.891+0000 7ff5c2ffd700 1 --2- 172.21.15.123:0/2827368325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5c4069bd0 0x7ff5c4197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:46.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.892+0000 7ff5c3fff700 1 -- 172.21.15.123:0/2827368325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5c4069bd0 msgr2=0x7ff5c4197830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:46.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.892+0000 7ff5c3fff700 1 --2- 172.21.15.123:0/2827368325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5c4069bd0 0x7ff5c4197830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:46.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.892+0000 7ff5c3fff700 1 -- 172.21.15.123:0/2827368325 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5c4069210 msgr2=0x7ff5c41972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:46.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.892+0000 7ff5c3fff700 1 --2- 172.21.15.123:0/2827368325 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5c4069210 0x7ff5c41972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:46.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.892+0000 7ff5c3fff700 1 -- 172.21.15.123:0/2827368325 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ac0095f0 con 0x7ff5c4106fe0 2024-06-02T04:03:46.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.892+0000 7ff5c3fff700 1 --2- 172.21.15.123:0/2827368325 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5c4106fe0 0x7ff5c419bbe0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc007d70 tx=0x7ff5bc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:46.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.892+0000 7ff5c0ff9700 1 -- 172.21.15.123:0/2827368325 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc00ac90 con 0x7ff5c4106fe0 2024-06-02T04:03:46.893 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.892+0000 7ff5c0ff9700 1 -- 172.21.15.123:0/2827368325 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5bc00adf0 con 0x7ff5c4106fe0 2024-06-02T04:03:46.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.892+0000 7ff5c9d6b700 1 -- 172.21.15.123:0/2827368325 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c419c800 con 0x7ff5c4106fe0 2024-06-02T04:03:46.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.892+0000 7ff5c0ff9700 1 -- 172.21.15.123:0/2827368325 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc0115e0 con 0x7ff5c4106fe0 2024-06-02T04:03:46.894 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.892+0000 7ff5c9d6b700 1 -- 172.21.15.123:0/2827368325 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c41a4060 con 0x7ff5c4106fe0 2024-06-02T04:03:46.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.893+0000 7ff5c9d6b700 1 -- 172.21.15.123:0/2827368325 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c41094e0 con 0x7ff5c4106fe0 2024-06-02T04:03:46.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.894+0000 7ff5c0ff9700 1 -- 172.21.15.123:0/2827368325 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7ff5bc012420 con 0x7ff5c4106fe0 2024-06-02T04:03:46.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.894+0000 7ff5c0ff9700 1 --2- 172.21.15.123:0/2827368325 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff5b00a11b0 0x7ff5b00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:46.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.895+0000 7ff5c37fe700 1 --2- 172.21.15.123:0/2827368325 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff5b00a11b0 0x7ff5b00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:46.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.895+0000 7ff5c0ff9700 1 -- 172.21.15.123:0/2827368325 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff5bc0cc980 con 0x7ff5c4106fe0 2024-06-02T04:03:46.895 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.895+0000 7ff5c37fe700 1 --2- 172.21.15.123:0/2827368325 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff5b00a11b0 0x7ff5b00a3670 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4009a10 tx=0x7ff5b4009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:46.898 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:46.899+0000 7ff5c0ff9700 1 -- 172.21.15.123:0/2827368325 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff5bc096270 con 0x7ff5c4106fe0 2024-06-02T04:03:47.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:47.092+0000 7ff5c9d6b700 1 -- 172.21.15.123:0/2827368325 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff5c4198600 con 0x7ff5c4106fe0 2024-06-02T04:03:47.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:47.092+0000 7ff5c0ff9700 1 -- 172.21.15.123:0/2827368325 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff5bc016020 con 0x7ff5c4106fe0 2024-06-02T04:03:47.091 INFO:teuthology.orchestra.run.smithi123.stdout:107374182445 2024-06-02T04:03:47.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:47.094+0000 7ff5c9d6b700 1 -- 172.21.15.123:0/2827368325 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff5b00a11b0 msgr2=0x7ff5b00a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:47.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:47.094+0000 7ff5c9d6b700 1 --2- 172.21.15.123:0/2827368325 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff5b00a11b0 0x7ff5b00a3670 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4009a10 tx=0x7ff5b4009190 comp rx=0 tx=0).stop 2024-06-02T04:03:47.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:47.094+0000 7ff5c9d6b700 1 -- 172.21.15.123:0/2827368325 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5c4106fe0 msgr2=0x7ff5c419bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:47.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:47.094+0000 7ff5c9d6b700 1 --2- 172.21.15.123:0/2827368325 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5c4106fe0 0x7ff5c419bbe0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc007d70 tx=0x7ff5bc00a340 comp rx=0 tx=0).stop 2024-06-02T04:03:47.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:47.094+0000 7ff5c9d6b700 1 -- 172.21.15.123:0/2827368325 shutdown_connections 2024-06-02T04:03:47.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:47.094+0000 7ff5c9d6b700 1 --2- 172.21.15.123:0/2827368325 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff5c4106fe0 0x7ff5c419bbe0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:47.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:47.094+0000 7ff5c9d6b700 1 --2- 172.21.15.123:0/2827368325 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff5b00a11b0 0x7ff5b00a3670 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:47.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:47.094+0000 7ff5c9d6b700 1 --2- 172.21.15.123:0/2827368325 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5c4069210 0x7ff5c41972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:47.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:47.094+0000 7ff5c9d6b700 1 --2- 172.21.15.123:0/2827368325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5c4069bd0 0x7ff5c4197830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:47.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:47.094+0000 7ff5c9d6b700 1 -- 172.21.15.123:0/2827368325 >> 172.21.15.123:0/2827368325 conn(0x7ff5c4076e70 msgr2=0x7ff5c40fea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:47.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:47.094+0000 7ff5c9d6b700 1 -- 172.21.15.123:0/2827368325 shutdown_connections 2024-06-02T04:03:47.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:47.094+0000 7ff5c9d6b700 1 -- 172.21.15.123:0/2827368325 wait complete. 2024-06-02T04:03:47.462 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182442 got 107374182445 for osd.3 2024-06-02T04:03:47.462 DEBUG:teuthology.parallel:result is None 2024-06-02T04:03:47.462 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-06-02T04:03:47.463 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-06-02T04:03:47.688 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:03:48.199 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:47 smithi123 ceph-mon[42885]: pgmap v242: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-06-02T04:03:48.200 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:47 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2827368325' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-06-02T04:03:48.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:47 smithi162 ceph-mon[47009]: pgmap v242: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-06-02T04:03:48.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:47 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/2827368325' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-06-02T04:03:48.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:47 smithi136 ceph-mon[47443]: pgmap v242: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-06-02T04:03:48.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:47 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/2827368325' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-06-02T04:03:48.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.758+0000 7fa3c7965700 1 -- 172.21.15.123:0/657921354 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3c00ffe90 msgr2=0x7fa3c0100310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:48.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.758+0000 7fa3c7965700 1 --2- 172.21.15.123:0/657921354 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3c00ffe90 0x7fa3c0100310 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc009990 tx=0x7fa3bc009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:48.758 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.758+0000 7fa3c7965700 1 -- 172.21.15.123:0/657921354 shutdown_connections 2024-06-02T04:03:48.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.758+0000 7fa3c7965700 1 --2- 172.21.15.123:0/657921354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3c0100850 0x7fa3c010ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:48.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.758+0000 7fa3c7965700 1 --2- 172.21.15.123:0/657921354 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3c0105f40 0x7fa3c0106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:48.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.758+0000 7fa3c7965700 1 --2- 172.21.15.123:0/657921354 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3c00ffe90 0x7fa3c0100310 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:48.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.758+0000 7fa3c7965700 1 -- 172.21.15.123:0/657921354 >> 172.21.15.123:0/657921354 conn(0x7fa3c0076e70 msgr2=0x7fa3c0077280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:48.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.758+0000 7fa3c7965700 1 -- 172.21.15.123:0/657921354 shutdown_connections 2024-06-02T04:03:48.759 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.758+0000 7fa3c7965700 1 -- 172.21.15.123:0/657921354 wait complete. 2024-06-02T04:03:48.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.759+0000 7fa3c7965700 1 Processor -- start 2024-06-02T04:03:48.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.759+0000 7fa3c7965700 1 -- start start 2024-06-02T04:03:48.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.759+0000 7fa3c7965700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3c00ffe90 0x7fa3c01980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:48.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.759+0000 7fa3c7965700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3c0100850 0x7fa3c01985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:48.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.759+0000 7fa3c7965700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3c0105f40 0x7fa3c01a3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:48.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.759+0000 7fa3c7965700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c0198e90 con 0x7fa3c00ffe90 2024-06-02T04:03:48.761 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.759+0000 7fa3c7965700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c01a3670 con 0x7fa3c0100850 2024-06-02T04:03:48.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.759+0000 7fa3c7965700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c01a37b0 con 0x7fa3c0105f40 2024-06-02T04:03:48.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.759+0000 7fa3c5701700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3c00ffe90 0x7fa3c01980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:48.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.759+0000 7fa3c5701700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3c00ffe90 0x7fa3c01980b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41364/0 (socket says 172.21.15.123:41364) 2024-06-02T04:03:48.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.759+0000 7fa3c5701700 1 -- 172.21.15.123:0/3009368803 learned_addr learned my addr 172.21.15.123:0/3009368803 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:48.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.759+0000 7fa3c4f00700 1 --2- 172.21.15.123:0/3009368803 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3c0100850 0x7fa3c01985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:48.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.759+0000 7fa3c5f02700 1 --2- 172.21.15.123:0/3009368803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3c0105f40 0x7fa3c01a3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:48.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.759+0000 7fa3c5701700 1 -- 172.21.15.123:0/3009368803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3c0105f40 msgr2=0x7fa3c01a3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:48.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.760+0000 7fa3c5701700 1 --2- 172.21.15.123:0/3009368803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3c0105f40 0x7fa3c01a3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:48.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.760+0000 7fa3c5701700 1 -- 172.21.15.123:0/3009368803 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3c0100850 msgr2=0x7fa3c01985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:48.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.760+0000 7fa3c5701700 1 --2- 172.21.15.123:0/3009368803 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3c0100850 0x7fa3c01985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:48.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.760+0000 7fa3c5701700 1 -- 172.21.15.123:0/3009368803 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3bc0095f0 con 0x7fa3c00ffe90 2024-06-02T04:03:48.762 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.760+0000 7fa3c5f02700 1 --2- 172.21.15.123:0/3009368803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3c0105f40 0x7fa3c01a3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:03:48.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.760+0000 7fa3c5701700 1 --2- 172.21.15.123:0/3009368803 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3c00ffe90 0x7fa3c01980b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400d980 tx=0x7fa3b400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:48.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.760+0000 7fa3b27fc700 1 -- 172.21.15.123:0/3009368803 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4009b40 con 0x7fa3c00ffe90 2024-06-02T04:03:48.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.760+0000 7fa3b27fc700 1 -- 172.21.15.123:0/3009368803 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa3b400b6e0 con 0x7fa3c00ffe90 2024-06-02T04:03:48.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.760+0000 7fa3c7965700 1 -- 172.21.15.123:0/3009368803 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c01a3a60 con 0x7fa3c00ffe90 2024-06-02T04:03:48.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.760+0000 7fa3b27fc700 1 -- 172.21.15.123:0/3009368803 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b400f620 con 0x7fa3c00ffe90 2024-06-02T04:03:48.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.760+0000 7fa3c7965700 1 -- 172.21.15.123:0/3009368803 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c01a3f30 con 0x7fa3c00ffe90 2024-06-02T04:03:48.763 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.761+0000 7fa3c7965700 1 -- 172.21.15.123:0/3009368803 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c01083d0 con 0x7fa3c00ffe90 2024-06-02T04:03:48.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.762+0000 7fa3b27fc700 1 -- 172.21.15.123:0/3009368803 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fa3b4010460 con 0x7fa3c00ffe90 2024-06-02T04:03:48.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.763+0000 7fa3b27fc700 1 --2- 172.21.15.123:0/3009368803 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa3ac0a11b0 0x7fa3ac0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:48.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.763+0000 7fa3c4f00700 1 --2- 172.21.15.123:0/3009368803 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa3ac0a11b0 0x7fa3ac0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:48.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.763+0000 7fa3b27fc700 1 -- 172.21.15.123:0/3009368803 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa3b40ccc60 con 0x7fa3c00ffe90 2024-06-02T04:03:48.764 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.763+0000 7fa3c4f00700 1 --2- 172.21.15.123:0/3009368803 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa3ac0a11b0 0x7fa3ac0a3670 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc0098e0 tx=0x7fa3bc005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:48.766 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.766+0000 7fa3b27fc700 1 -- 172.21.15.123:0/3009368803 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa3b4096340 con 0x7fa3c00ffe90 2024-06-02T04:03:48.958 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.958+0000 7fa3c7965700 1 -- 172.21.15.123:0/3009368803 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa3c0069890 con 0x7fa3ac0a11b0 2024-06-02T04:03:48.968 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.968+0000 7fa3b27fc700 1 -- 172.21.15.123:0/3009368803 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+341090 (secure 0 0 0) 0x7fa3c0069890 con 0x7fa3ac0a11b0 2024-06-02T04:03:48.973 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:03:48.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.972+0000 7fa3c7965700 1 -- 172.21.15.123:0/3009368803 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa3ac0a11b0 msgr2=0x7fa3ac0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:48.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.972+0000 7fa3c7965700 1 --2- 172.21.15.123:0/3009368803 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa3ac0a11b0 0x7fa3ac0a3670 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc0098e0 tx=0x7fa3bc005960 comp rx=0 tx=0).stop 2024-06-02T04:03:48.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.972+0000 7fa3c7965700 1 -- 172.21.15.123:0/3009368803 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3c00ffe90 msgr2=0x7fa3c01980b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:48.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.972+0000 7fa3c7965700 1 --2- 172.21.15.123:0/3009368803 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3c00ffe90 0x7fa3c01980b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa3b400d980 tx=0x7fa3b400dc90 comp rx=0 tx=0).stop 2024-06-02T04:03:48.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.972+0000 7fa3c7965700 1 -- 172.21.15.123:0/3009368803 shutdown_connections 2024-06-02T04:03:48.976 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.972+0000 7fa3c7965700 1 --2- 172.21.15.123:0/3009368803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3c0105f40 0x7fa3c01a3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:48.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.972+0000 7fa3c7965700 1 --2- 172.21.15.123:0/3009368803 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3c00ffe90 0x7fa3c01980b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:48.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.972+0000 7fa3c7965700 1 --2- 172.21.15.123:0/3009368803 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa3ac0a11b0 0x7fa3ac0a3670 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:48.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.972+0000 7fa3c7965700 1 --2- 172.21.15.123:0/3009368803 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3c0100850 0x7fa3c01985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:48.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.972+0000 7fa3c7965700 1 -- 172.21.15.123:0/3009368803 >> 172.21.15.123:0/3009368803 conn(0x7fa3c0076e70 msgr2=0x7fa3c00feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:48.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.972+0000 7fa3c7965700 1 -- 172.21.15.123:0/3009368803 shutdown_connections 2024-06-02T04:03:48.977 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:48.972+0000 7fa3c7965700 1 -- 172.21.15.123:0/3009368803 wait complete. 2024-06-02T04:03:48.977 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-06-02T04:03:49.363 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":243,"stamp":"2024-06-02T04:03:48.836159+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656573,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":513,"num_read_kb":378,"num_write":412,"num_write_kb":3068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":340,"ondisk_log_size":340,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359792,"kb_used_data":11024,"kb_used_omap":18,"kb_used_meta":348653,"kb_avail":1124582032,"statfs":{"total":1151940427776,"available":1151572000768,"internally_reserved":0,"allocated":11288576,"data_stored":7070794,"data_compressed":113934,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19129,"internal_metadata":357020999},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":61,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002614"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.001512+0000","last_change":"2024-06-02T04:03:06.690548+0000","last_active":"2024-06-02T04:03:08.001512+0000","last_peered":"2024-06-02T04:03:08.001512+0000","last_clean":"2024-06-02T04:03:08.001512+0000","last_became_active":"2024-06-02T04:03:06.690003+0000","last_became_peered":"2024-06-02T04:03:06.690003+0000","last_unstale":"2024-06-02T04:03:08.001512+0000","last_undegraded":"2024-06-02T04:03:08.001512+0000","last_fullsized":"2024-06-02T04:03:08.001512+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:36:23.875017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.695899+0000","last_change":"2024-06-02T04:03:06.694664+0000","last_active":"2024-06-02T04:03:06.695899+0000","last_peered":"2024-06-02T04:03:06.695899+0000","last_clean":"2024-06-02T04:03:06.695899+0000","last_became_active":"2024-06-02T04:03:06.692173+0000","last_became_peered":"2024-06-02T04:03:06.692173+0000","last_unstale":"2024-06-02T04:03:06.695899+0000","last_undegraded":"2024-06-02T04:03:06.695899+0000","last_fullsized":"2024-06-02T04:03:06.695899+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:28:07.252793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.692106+0000","last_change":"2024-06-02T04:03:06.691118+0000","last_active":"2024-06-02T04:03:06.692106+0000","last_peered":"2024-06-02T04:03:06.692106+0000","last_clean":"2024-06-02T04:03:06.692106+0000","last_became_active":"2024-06-02T04:03:06.690782+0000","last_became_peered":"2024-06-02T04:03:06.690782+0000","last_unstale":"2024-06-02T04:03:06.692106+0000","last_undegraded":"2024-06-02T04:03:06.692106+0000","last_fullsized":"2024-06-02T04:03:06.692106+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:30:02.876432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.828784+0000","last_change":"2024-06-02T04:03:06.692716+0000","last_active":"2024-06-02T04:03:06.828784+0000","last_peered":"2024-06-02T04:03:06.828784+0000","last_clean":"2024-06-02T04:03:06.828784+0000","last_became_active":"2024-06-02T04:03:06.692084+0000","last_became_peered":"2024-06-02T04:03:06.692084+0000","last_unstale":"2024-06-02T04:03:06.828784+0000","last_undegraded":"2024-06-02T04:03:06.828784+0000","last_fullsized":"2024-06-02T04:03:06.828784+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:32:20.191118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.885799+0000","last_change":"2024-06-02T04:03:06.685966+0000","last_active":"2024-06-02T04:03:07.885799+0000","last_peered":"2024-06-02T04:03:07.885799+0000","last_clean":"2024-06-02T04:03:07.885799+0000","last_became_active":"2024-06-02T04:03:06.685622+0000","last_became_peered":"2024-06-02T04:03:06.685622+0000","last_unstale":"2024-06-02T04:03:07.885799+0000","last_undegraded":"2024-06-02T04:03:07.885799+0000","last_fullsized":"2024-06-02T04:03:07.885799+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:37:11.472602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.043587+0000","last_change":"2024-06-02T04:03:06.687067+0000","last_active":"2024-06-02T04:03:08.043587+0000","last_peered":"2024-06-02T04:03:08.043587+0000","last_clean":"2024-06-02T04:03:08.043587+0000","last_became_active":"2024-06-02T04:03:06.686746+0000","last_became_peered":"2024-06-02T04:03:06.686746+0000","last_unstale":"2024-06-02T04:03:08.043587+0000","last_undegraded":"2024-06-02T04:03:08.043587+0000","last_fullsized":"2024-06-02T04:03:08.043587+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:18:28.240961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.644681+0000","last_change":"2024-06-02T04:03:06.685437+0000","last_active":"2024-06-02T04:03:08.644681+0000","last_peered":"2024-06-02T04:03:08.644681+0000","last_clean":"2024-06-02T04:03:08.644681+0000","last_became_active":"2024-06-02T04:03:06.685127+0000","last_became_peered":"2024-06-02T04:03:06.685127+0000","last_unstale":"2024-06-02T04:03:08.644681+0000","last_undegraded":"2024-06-02T04:03:08.644681+0000","last_fullsized":"2024-06-02T04:03:08.644681+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:45:08.746351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676297+0000","last_change":"2024-06-02T04:03:06.688091+0000","last_active":"2024-06-02T04:03:07.676297+0000","last_peered":"2024-06-02T04:03:07.676297+0000","last_clean":"2024-06-02T04:03:07.676297+0000","last_became_active":"2024-06-02T04:03:06.687827+0000","last_became_peered":"2024-06-02T04:03:06.687827+0000","last_unstale":"2024-06-02T04:03:07.676297+0000","last_undegraded":"2024-06-02T04:03:07.676297+0000","last_fullsized":"2024-06-02T04:03:07.676297+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:44:10.968199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.717204+0000","last_change":"2024-06-02T04:03:06.699748+0000","last_active":"2024-06-02T04:03:08.717204+0000","last_peered":"2024-06-02T04:03:08.717204+0000","last_clean":"2024-06-02T04:03:08.717204+0000","last_became_active":"2024-06-02T04:03:06.699442+0000","last_became_peered":"2024-06-02T04:03:06.699442+0000","last_unstale":"2024-06-02T04:03:08.717204+0000","last_undegraded":"2024-06-02T04:03:08.717204+0000","last_fullsized":"2024-06-02T04:03:08.717204+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:00:40.165226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.043690+0000","last_change":"2024-06-02T04:03:06.691914+0000","last_active":"2024-06-02T04:03:08.043690+0000","last_peered":"2024-06-02T04:03:08.043690+0000","last_clean":"2024-06-02T04:03:08.043690+0000","last_became_active":"2024-06-02T04:03:06.691250+0000","last_became_peered":"2024-06-02T04:03:06.691250+0000","last_unstale":"2024-06-02T04:03:08.043690+0000","last_undegraded":"2024-06-02T04:03:08.043690+0000","last_fullsized":"2024-06-02T04:03:08.043690+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:21:17.201134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.644985+0000","last_change":"2024-06-02T04:03:06.700359+0000","last_active":"2024-06-02T04:03:08.644985+0000","last_peered":"2024-06-02T04:03:08.644985+0000","last_clean":"2024-06-02T04:03:08.644985+0000","last_became_active":"2024-06-02T04:03:06.699829+0000","last_became_peered":"2024-06-02T04:03:06.699829+0000","last_unstale":"2024-06-02T04:03:08.644985+0000","last_undegraded":"2024-06-02T04:03:08.644985+0000","last_fullsized":"2024-06-02T04:03:08.644985+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:00:48.645655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.828757+0000","last_change":"2024-06-02T04:03:06.693172+0000","last_active":"2024-06-02T04:03:06.828757+0000","last_peered":"2024-06-02T04:03:06.828757+0000","last_clean":"2024-06-02T04:03:06.828757+0000","last_became_active":"2024-06-02T04:03:06.692859+0000","last_became_peered":"2024-06-02T04:03:06.692859+0000","last_unstale":"2024-06-02T04:03:06.828757+0000","last_undegraded":"2024-06-02T04:03:06.828757+0000","last_fullsized":"2024-06-02T04:03:06.828757+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:34:56.027760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.967731+0000","last_change":"2024-06-02T04:03:06.688171+0000","last_active":"2024-06-02T04:03:06.967731+0000","last_peered":"2024-06-02T04:03:06.967731+0000","last_clean":"2024-06-02T04:03:06.967731+0000","last_became_active":"2024-06-02T04:03:06.687476+0000","last_became_peered":"2024-06-02T04:03:06.687476+0000","last_unstale":"2024-06-02T04:03:06.967731+0000","last_undegraded":"2024-06-02T04:03:06.967731+0000","last_fullsized":"2024-06-02T04:03:06.967731+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:03:49.023726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.698675+0000","last_change":"2024-06-02T04:03:06.697507+0000","last_active":"2024-06-02T04:03:06.698675+0000","last_peered":"2024-06-02T04:03:06.698675+0000","last_clean":"2024-06-02T04:03:06.698675+0000","last_became_active":"2024-06-02T04:03:06.697201+0000","last_became_peered":"2024-06-02T04:03:06.697201+0000","last_unstale":"2024-06-02T04:03:06.698675+0000","last_undegraded":"2024-06-02T04:03:06.698675+0000","last_fullsized":"2024-06-02T04:03:06.698675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:33:08.883076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.691982+0000","last_change":"2024-06-02T04:03:06.690488+0000","last_active":"2024-06-02T04:03:06.691982+0000","last_peered":"2024-06-02T04:03:06.691982+0000","last_clean":"2024-06-02T04:03:06.691982+0000","last_became_active":"2024-06-02T04:03:06.690186+0000","last_became_peered":"2024-06-02T04:03:06.690186+0000","last_unstale":"2024-06-02T04:03:06.691982+0000","last_undegraded":"2024-06-02T04:03:06.691982+0000","last_fullsized":"2024-06-02T04:03:06.691982+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:55:44.408427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.716746+0000","last_change":"2024-06-02T04:03:06.693950+0000","last_active":"2024-06-02T04:03:08.716746+0000","last_peered":"2024-06-02T04:03:08.716746+0000","last_clean":"2024-06-02T04:03:08.716746+0000","last_became_active":"2024-06-02T04:03:06.693656+0000","last_became_peered":"2024-06-02T04:03:06.693656+0000","last_unstale":"2024-06-02T04:03:08.716746+0000","last_undegraded":"2024-06-02T04:03:08.716746+0000","last_fullsized":"2024-06-02T04:03:08.716746+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:14:24.687129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.001599+0000","last_change":"2024-06-02T04:03:06.690325+0000","last_active":"2024-06-02T04:03:08.001599+0000","last_peered":"2024-06-02T04:03:08.001599+0000","last_clean":"2024-06-02T04:03:08.001599+0000","last_became_active":"2024-06-02T04:03:06.689579+0000","last_became_peered":"2024-06-02T04:03:06.689579+0000","last_unstale":"2024-06-02T04:03:08.001599+0000","last_undegraded":"2024-06-02T04:03:08.001599+0000","last_fullsized":"2024-06-02T04:03:08.001599+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:46:49.709737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:09.706673+0000","last_change":"2024-06-02T04:03:06.691817+0000","last_active":"2024-06-02T04:03:09.706673+0000","last_peered":"2024-06-02T04:03:09.706673+0000","last_clean":"2024-06-02T04:03:09.706673+0000","last_became_active":"2024-06-02T04:03:06.691487+0000","last_became_peered":"2024-06-02T04:03:06.691487+0000","last_unstale":"2024-06-02T04:03:09.706673+0000","last_undegraded":"2024-06-02T04:03:09.706673+0000","last_fullsized":"2024-06-02T04:03:09.706673+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:32:29.983404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.689707+0000","last_change":"2024-06-02T04:03:06.687928+0000","last_active":"2024-06-02T04:03:06.689707+0000","last_peered":"2024-06-02T04:03:06.689707+0000","last_clean":"2024-06-02T04:03:06.689707+0000","last_became_active":"2024-06-02T04:03:06.687626+0000","last_became_peered":"2024-06-02T04:03:06.687626+0000","last_unstale":"2024-06-02T04:03:06.689707+0000","last_undegraded":"2024-06-02T04:03:06.689707+0000","last_fullsized":"2024-06-02T04:03:06.689707+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:00:49.112152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"82'13","reported_seq":58,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:43.147103+0000","last_change":"2024-06-02T04:03:06.278393+0000","last_active":"2024-06-02T04:03:43.147103+0000","last_peered":"2024-06-02T04:03:43.147103+0000","last_clean":"2024-06-02T04:03:43.147103+0000","last_became_active":"2024-06-02T04:03:06.278033+0000","last_became_peered":"2024-06-02T04:03:06.278033+0000","last_unstale":"2024-06-02T04:03:43.147103+0000","last_undegraded":"2024-06-02T04:03:43.147103+0000","last_fullsized":"2024-06-02T04:03:43.147103+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:34:01.806795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676615+0000","last_change":"2024-06-02T04:03:06.693074+0000","last_active":"2024-06-02T04:03:07.676615+0000","last_peered":"2024-06-02T04:03:07.676615+0000","last_clean":"2024-06-02T04:03:07.676615+0000","last_became_active":"2024-06-02T04:03:06.689257+0000","last_became_peered":"2024-06-02T04:03:06.689257+0000","last_unstale":"2024-06-02T04:03:07.676615+0000","last_undegraded":"2024-06-02T04:03:07.676615+0000","last_fullsized":"2024-06-02T04:03:07.676615+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:36:48.346723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.882169+0000","last_change":"2024-06-02T04:03:06.275088+0000","last_active":"2024-06-02T04:03:08.882169+0000","last_peered":"2024-06-02T04:03:08.882169+0000","last_clean":"2024-06-02T04:03:08.882169+0000","last_became_active":"2024-06-02T04:03:06.274731+0000","last_became_peered":"2024-06-02T04:03:06.274731+0000","last_unstale":"2024-06-02T04:03:08.882169+0000","last_undegraded":"2024-06-02T04:03:08.882169+0000","last_fullsized":"2024-06-02T04:03:08.882169+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:41:01.298971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.693659+0000","last_change":"2024-06-02T04:03:06.691841+0000","last_active":"2024-06-02T04:03:06.693659+0000","last_peered":"2024-06-02T04:03:06.693659+0000","last_clean":"2024-06-02T04:03:06.693659+0000","last_became_active":"2024-06-02T04:03:06.690960+0000","last_became_peered":"2024-06-02T04:03:06.690960+0000","last_unstale":"2024-06-02T04:03:06.693659+0000","last_undegraded":"2024-06-02T04:03:06.693659+0000","last_fullsized":"2024-06-02T04:03:06.693659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:05:13.716189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:13.105671+0000","last_change":"2024-06-02T04:03:06.278745+0000","last_active":"2024-06-02T04:03:13.105671+0000","last_peered":"2024-06-02T04:03:13.105671+0000","last_clean":"2024-06-02T04:03:13.105671+0000","last_became_active":"2024-06-02T04:03:06.278449+0000","last_became_peered":"2024-06-02T04:03:06.278449+0000","last_unstale":"2024-06-02T04:03:13.105671+0000","last_undegraded":"2024-06-02T04:03:13.105671+0000","last_fullsized":"2024-06-02T04:03:13.105671+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:56:46.039492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.716762+0000","last_change":"2024-06-02T04:03:06.695832+0000","last_active":"2024-06-02T04:03:08.716762+0000","last_peered":"2024-06-02T04:03:08.716762+0000","last_clean":"2024-06-02T04:03:08.716762+0000","last_became_active":"2024-06-02T04:03:06.695266+0000","last_became_peered":"2024-06-02T04:03:06.695266+0000","last_unstale":"2024-06-02T04:03:08.716762+0000","last_undegraded":"2024-06-02T04:03:08.716762+0000","last_fullsized":"2024-06-02T04:03:08.716762+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:06:27.708914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:12.097560+0000","last_change":"2024-06-02T04:03:06.277846+0000","last_active":"2024-06-02T04:03:12.097560+0000","last_peered":"2024-06-02T04:03:12.097560+0000","last_clean":"2024-06-02T04:03:12.097560+0000","last_became_active":"2024-06-02T04:03:06.277514+0000","last_became_peered":"2024-06-02T04:03:06.277514+0000","last_unstale":"2024-06-02T04:03:12.097560+0000","last_undegraded":"2024-06-02T04:03:12.097560+0000","last_fullsized":"2024-06-02T04:03:12.097560+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:41:20.915468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.677279+0000","last_change":"2024-06-02T04:03:06.692309+0000","last_active":"2024-06-02T04:03:07.677279+0000","last_peered":"2024-06-02T04:03:07.677279+0000","last_clean":"2024-06-02T04:03:07.677279+0000","last_became_active":"2024-06-02T04:03:06.691988+0000","last_became_peered":"2024-06-02T04:03:06.691988+0000","last_unstale":"2024-06-02T04:03:07.677279+0000","last_undegraded":"2024-06-02T04:03:07.677279+0000","last_fullsized":"2024-06-02T04:03:07.677279+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:19:08.790807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:43.134693+0000","last_change":"2024-06-02T04:03:06.271789+0000","last_active":"2024-06-02T04:03:43.134693+0000","last_peered":"2024-06-02T04:03:43.134693+0000","last_clean":"2024-06-02T04:03:43.134693+0000","last_became_active":"2024-06-02T04:03:06.271482+0000","last_became_peered":"2024-06-02T04:03:06.271482+0000","last_unstale":"2024-06-02T04:03:43.134693+0000","last_undegraded":"2024-06-02T04:03:43.134693+0000","last_fullsized":"2024-06-02T04:03:43.134693+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:23:10.065847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":36,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.885786+0000","last_change":"2024-06-02T04:03:06.690544+0000","last_active":"2024-06-02T04:03:07.885786+0000","last_peered":"2024-06-02T04:03:07.885786+0000","last_clean":"2024-06-02T04:03:07.885786+0000","last_became_active":"2024-06-02T04:03:06.687225+0000","last_became_peered":"2024-06-02T04:03:06.687225+0000","last_unstale":"2024-06-02T04:03:07.885786+0000","last_undegraded":"2024-06-02T04:03:07.885786+0000","last_fullsized":"2024-06-02T04:03:07.885786+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:26:44.414575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.089094+0000","last_change":"2024-06-02T04:03:06.269559+0000","last_active":"2024-06-02T04:03:11.089094+0000","last_peered":"2024-06-02T04:03:11.089094+0000","last_clean":"2024-06-02T04:03:11.089094+0000","last_became_active":"2024-06-02T04:03:06.269211+0000","last_became_peered":"2024-06-02T04:03:06.269211+0000","last_unstale":"2024-06-02T04:03:11.089094+0000","last_undegraded":"2024-06-02T04:03:11.089094+0000","last_fullsized":"2024-06-02T04:03:11.089094+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:28:39.167267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.677438+0000","last_change":"2024-06-02T04:03:06.692224+0000","last_active":"2024-06-02T04:03:07.677438+0000","last_peered":"2024-06-02T04:03:07.677438+0000","last_clean":"2024-06-02T04:03:07.677438+0000","last_became_active":"2024-06-02T04:03:06.691664+0000","last_became_peered":"2024-06-02T04:03:06.691664+0000","last_unstale":"2024-06-02T04:03:07.677438+0000","last_undegraded":"2024-06-02T04:03:07.677438+0000","last_fullsized":"2024-06-02T04:03:07.677438+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:12:17.679245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:10.717094+0000","last_change":"2024-06-02T04:03:06.268602+0000","last_active":"2024-06-02T04:03:10.717094+0000","last_peered":"2024-06-02T04:03:10.717094+0000","last_clean":"2024-06-02T04:03:10.717094+0000","last_became_active":"2024-06-02T04:03:06.268268+0000","last_became_peered":"2024-06-02T04:03:06.268268+0000","last_unstale":"2024-06-02T04:03:10.717094+0000","last_undegraded":"2024-06-02T04:03:10.717094+0000","last_fullsized":"2024-06-02T04:03:10.717094+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:29:40.033649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676424+0000","last_change":"2024-06-02T04:03:06.687534+0000","last_active":"2024-06-02T04:03:07.676424+0000","last_peered":"2024-06-02T04:03:07.676424+0000","last_clean":"2024-06-02T04:03:07.676424+0000","last_became_active":"2024-06-02T04:03:06.687210+0000","last_became_peered":"2024-06-02T04:03:06.687210+0000","last_unstale":"2024-06-02T04:03:07.676424+0000","last_undegraded":"2024-06-02T04:03:07.676424+0000","last_fullsized":"2024-06-02T04:03:07.676424+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:09:54.479287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:12.096635+0000","last_change":"2024-06-02T04:03:06.275477+0000","last_active":"2024-06-02T04:03:12.096635+0000","last_peered":"2024-06-02T04:03:12.096635+0000","last_clean":"2024-06-02T04:03:12.096635+0000","last_became_active":"2024-06-02T04:03:06.275091+0000","last_became_peered":"2024-06-02T04:03:06.275091+0000","last_unstale":"2024-06-02T04:03:12.096635+0000","last_undegraded":"2024-06-02T04:03:12.096635+0000","last_fullsized":"2024-06-02T04:03:12.096635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:30:49.126971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:09.706733+0000","last_change":"2024-06-02T04:03:06.685908+0000","last_active":"2024-06-02T04:03:09.706733+0000","last_peered":"2024-06-02T04:03:09.706733+0000","last_clean":"2024-06-02T04:03:09.706733+0000","last_became_active":"2024-06-02T04:03:06.685572+0000","last_became_peered":"2024-06-02T04:03:06.685572+0000","last_unstale":"2024-06-02T04:03:09.706733+0000","last_undegraded":"2024-06-02T04:03:09.706733+0000","last_fullsized":"2024-06-02T04:03:09.706733+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:31:35.685227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":88,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:47.139792+0000","last_change":"2024-06-02T04:03:06.274773+0000","last_active":"2024-06-02T04:03:47.139792+0000","last_peered":"2024-06-02T04:03:47.139792+0000","last_clean":"2024-06-02T04:03:47.139792+0000","last_became_active":"2024-06-02T04:03:06.274434+0000","last_became_peered":"2024-06-02T04:03:06.274434+0000","last_unstale":"2024-06-02T04:03:47.139792+0000","last_undegraded":"2024-06-02T04:03:47.139792+0000","last_fullsized":"2024-06-02T04:03:47.139792+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:46:41.681535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":72,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.717119+0000","last_change":"2024-06-02T04:03:06.702113+0000","last_active":"2024-06-02T04:03:08.717119+0000","last_peered":"2024-06-02T04:03:08.717119+0000","last_clean":"2024-06-02T04:03:08.717119+0000","last_became_active":"2024-06-02T04:03:06.701811+0000","last_became_peered":"2024-06-02T04:03:06.701811+0000","last_unstale":"2024-06-02T04:03:08.717119+0000","last_undegraded":"2024-06-02T04:03:08.717119+0000","last_fullsized":"2024-06-02T04:03:08.717119+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:04:28.772781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:12.096720+0000","last_change":"2024-06-02T04:03:06.278195+0000","last_active":"2024-06-02T04:03:12.096720+0000","last_peered":"2024-06-02T04:03:12.096720+0000","last_clean":"2024-06-02T04:03:12.096720+0000","last_became_active":"2024-06-02T04:03:06.277813+0000","last_became_peered":"2024-06-02T04:03:06.277813+0000","last_unstale":"2024-06-02T04:03:12.096720+0000","last_undegraded":"2024-06-02T04:03:12.096720+0000","last_fullsized":"2024-06-02T04:03:12.096720+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:50:31.381498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.693641+0000","last_change":"2024-06-02T04:03:06.691247+0000","last_active":"2024-06-02T04:03:06.693641+0000","last_peered":"2024-06-02T04:03:06.693641+0000","last_clean":"2024-06-02T04:03:06.693641+0000","last_became_active":"2024-06-02T04:03:06.689936+0000","last_became_peered":"2024-06-02T04:03:06.689936+0000","last_unstale":"2024-06-02T04:03:06.693641+0000","last_undegraded":"2024-06-02T04:03:06.693641+0000","last_fullsized":"2024-06-02T04:03:06.693641+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:47:36.577989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.082992+0000","last_change":"2024-06-02T04:03:06.271582+0000","last_active":"2024-06-02T04:03:11.082992+0000","last_peered":"2024-06-02T04:03:11.082992+0000","last_clean":"2024-06-02T04:03:11.082992+0000","last_became_active":"2024-06-02T04:03:06.271252+0000","last_became_peered":"2024-06-02T04:03:06.271252+0000","last_unstale":"2024-06-02T04:03:11.082992+0000","last_undegraded":"2024-06-02T04:03:11.082992+0000","last_fullsized":"2024-06-02T04:03:11.082992+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:21:30.861205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.716823+0000","last_change":"2024-06-02T04:03:06.698345+0000","last_active":"2024-06-02T04:03:08.716823+0000","last_peered":"2024-06-02T04:03:08.716823+0000","last_clean":"2024-06-02T04:03:08.716823+0000","last_became_active":"2024-06-02T04:03:06.698003+0000","last_became_peered":"2024-06-02T04:03:06.698003+0000","last_unstale":"2024-06-02T04:03:08.716823+0000","last_undegraded":"2024-06-02T04:03:08.716823+0000","last_fullsized":"2024-06-02T04:03:08.716823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:53:13.866319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'29","reported_seq":122,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:47.146243+0000","last_change":"2024-06-02T04:03:06.276367+0000","last_active":"2024-06-02T04:03:47.146243+0000","last_peered":"2024-06-02T04:03:47.146243+0000","last_clean":"2024-06-02T04:03:47.146243+0000","last_became_active":"2024-06-02T04:03:06.276006+0000","last_became_peered":"2024-06-02T04:03:06.276006+0000","last_unstale":"2024-06-02T04:03:47.146243+0000","last_undegraded":"2024-06-02T04:03:47.146243+0000","last_fullsized":"2024-06-02T04:03:47.146243+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:43:26.353155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59348,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":81,"num_read_kb":98,"num_write":31,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.885854+0000","last_change":"2024-06-02T04:03:06.689688+0000","last_active":"2024-06-02T04:03:07.885854+0000","last_peered":"2024-06-02T04:03:07.885854+0000","last_clean":"2024-06-02T04:03:07.885854+0000","last_became_active":"2024-06-02T04:03:06.686870+0000","last_became_peered":"2024-06-02T04:03:06.686870+0000","last_unstale":"2024-06-02T04:03:07.885854+0000","last_undegraded":"2024-06-02T04:03:07.885854+0000","last_fullsized":"2024-06-02T04:03:07.885854+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:46:20.489444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:12.097124+0000","last_change":"2024-06-02T04:03:06.275950+0000","last_active":"2024-06-02T04:03:12.097124+0000","last_peered":"2024-06-02T04:03:12.097124+0000","last_clean":"2024-06-02T04:03:12.097124+0000","last_became_active":"2024-06-02T04:03:06.274800+0000","last_became_peered":"2024-06-02T04:03:06.274800+0000","last_unstale":"2024-06-02T04:03:12.097124+0000","last_undegraded":"2024-06-02T04:03:12.097124+0000","last_fullsized":"2024-06-02T04:03:12.097124+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:17:36.352933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.967722+0000","last_change":"2024-06-02T04:03:06.687332+0000","last_active":"2024-06-02T04:03:06.967722+0000","last_peered":"2024-06-02T04:03:06.967722+0000","last_clean":"2024-06-02T04:03:06.967722+0000","last_became_active":"2024-06-02T04:03:06.687056+0000","last_became_peered":"2024-06-02T04:03:06.687056+0000","last_unstale":"2024-06-02T04:03:06.967722+0000","last_undegraded":"2024-06-02T04:03:06.967722+0000","last_fullsized":"2024-06-02T04:03:06.967722+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:16:58.069559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:12.096615+0000","last_change":"2024-06-02T04:03:06.267618+0000","last_active":"2024-06-02T04:03:12.096615+0000","last_peered":"2024-06-02T04:03:12.096615+0000","last_clean":"2024-06-02T04:03:12.096615+0000","last_became_active":"2024-06-02T04:03:06.267326+0000","last_became_peered":"2024-06-02T04:03:06.267326+0000","last_unstale":"2024-06-02T04:03:12.096615+0000","last_undegraded":"2024-06-02T04:03:12.096615+0000","last_fullsized":"2024-06-02T04:03:12.096615+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:20:19.794922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.645046+0000","last_change":"2024-06-02T04:03:06.693973+0000","last_active":"2024-06-02T04:03:08.645046+0000","last_peered":"2024-06-02T04:03:08.645046+0000","last_clean":"2024-06-02T04:03:08.645046+0000","last_became_active":"2024-06-02T04:03:06.693628+0000","last_became_peered":"2024-06-02T04:03:06.693628+0000","last_unstale":"2024-06-02T04:03:08.645046+0000","last_undegraded":"2024-06-02T04:03:08.645046+0000","last_fullsized":"2024-06-02T04:03:08.645046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:03:52.865564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":57,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:45.136880+0000","last_change":"2024-06-02T04:03:06.279086+0000","last_active":"2024-06-02T04:03:45.136880+0000","last_peered":"2024-06-02T04:03:45.136880+0000","last_clean":"2024-06-02T04:03:45.136880+0000","last_became_active":"2024-06-02T04:03:06.278737+0000","last_became_peered":"2024-06-02T04:03:06.278737+0000","last_unstale":"2024-06-02T04:03:45.136880+0000","last_undegraded":"2024-06-02T04:03:45.136880+0000","last_fullsized":"2024-06-02T04:03:45.136880+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:13:49.888951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":933,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.644652+0000","last_change":"2024-06-02T04:03:06.691126+0000","last_active":"2024-06-02T04:03:08.644652+0000","last_peered":"2024-06-02T04:03:08.644652+0000","last_clean":"2024-06-02T04:03:08.644652+0000","last_became_active":"2024-06-02T04:03:06.690758+0000","last_became_peered":"2024-06-02T04:03:06.690758+0000","last_unstale":"2024-06-02T04:03:08.644652+0000","last_undegraded":"2024-06-02T04:03:08.644652+0000","last_fullsized":"2024-06-02T04:03:08.644652+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:51:27.524477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.089923+0000","last_change":"2024-06-02T04:03:06.271837+0000","last_active":"2024-06-02T04:03:11.089923+0000","last_peered":"2024-06-02T04:03:11.089923+0000","last_clean":"2024-06-02T04:03:11.089923+0000","last_became_active":"2024-06-02T04:03:06.271523+0000","last_became_peered":"2024-06-02T04:03:06.271523+0000","last_unstale":"2024-06-02T04:03:11.089923+0000","last_undegraded":"2024-06-02T04:03:11.089923+0000","last_fullsized":"2024-06-02T04:03:11.089923+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:55:14.738237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676954+0000","last_change":"2024-06-02T04:03:06.690646+0000","last_active":"2024-06-02T04:03:07.676954+0000","last_peered":"2024-06-02T04:03:07.676954+0000","last_clean":"2024-06-02T04:03:07.676954+0000","last_became_active":"2024-06-02T04:03:06.690333+0000","last_became_peered":"2024-06-02T04:03:06.690333+0000","last_unstale":"2024-06-02T04:03:07.676954+0000","last_undegraded":"2024-06-02T04:03:07.676954+0000","last_fullsized":"2024-06-02T04:03:07.676954+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:18:41.987031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.077972+0000","last_change":"2024-06-02T04:03:06.268892+0000","last_active":"2024-06-02T04:03:11.077972+0000","last_peered":"2024-06-02T04:03:11.077972+0000","last_clean":"2024-06-02T04:03:11.077972+0000","last_became_active":"2024-06-02T04:03:06.268559+0000","last_became_peered":"2024-06-02T04:03:06.268559+0000","last_unstale":"2024-06-02T04:03:11.077972+0000","last_undegraded":"2024-06-02T04:03:11.077972+0000","last_fullsized":"2024-06-02T04:03:11.077972+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:06:34.378769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.001506+0000","last_change":"2024-06-02T04:03:06.688371+0000","last_active":"2024-06-02T04:03:08.001506+0000","last_peered":"2024-06-02T04:03:08.001506+0000","last_clean":"2024-06-02T04:03:08.001506+0000","last_became_active":"2024-06-02T04:03:06.688046+0000","last_became_peered":"2024-06-02T04:03:06.688046+0000","last_unstale":"2024-06-02T04:03:08.001506+0000","last_undegraded":"2024-06-02T04:03:08.001506+0000","last_fullsized":"2024-06-02T04:03:08.001506+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:14:40.534799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:09.716112+0000","last_change":"2024-06-02T04:03:06.274055+0000","last_active":"2024-06-02T04:03:09.716112+0000","last_peered":"2024-06-02T04:03:09.716112+0000","last_clean":"2024-06-02T04:03:09.716112+0000","last_became_active":"2024-06-02T04:03:06.273709+0000","last_became_peered":"2024-06-02T04:03:06.273709+0000","last_unstale":"2024-06-02T04:03:09.716112+0000","last_undegraded":"2024-06-02T04:03:09.716112+0000","last_fullsized":"2024-06-02T04:03:09.716112+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:44:13.256272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:09.192257+0000","last_change":"2024-06-02T04:03:06.686391+0000","last_active":"2024-06-02T04:03:09.192257+0000","last_peered":"2024-06-02T04:03:09.192257+0000","last_clean":"2024-06-02T04:03:09.192257+0000","last_became_active":"2024-06-02T04:03:06.686086+0000","last_became_peered":"2024-06-02T04:03:06.686086+0000","last_unstale":"2024-06-02T04:03:09.192257+0000","last_undegraded":"2024-06-02T04:03:09.192257+0000","last_fullsized":"2024-06-02T04:03:09.192257+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:06:23.572438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'5","reported_seq":49,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:42.146489+0000","last_change":"2024-06-02T04:03:06.278278+0000","last_active":"2024-06-02T04:03:42.146489+0000","last_peered":"2024-06-02T04:03:42.146489+0000","last_clean":"2024-06-02T04:03:42.146489+0000","last_became_active":"2024-06-02T04:03:06.277736+0000","last_became_peered":"2024-06-02T04:03:06.277736+0000","last_unstale":"2024-06-02T04:03:42.146489+0000","last_undegraded":"2024-06-02T04:03:42.146489+0000","last_fullsized":"2024-06-02T04:03:42.146489+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:51:30.458708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.043607+0000","last_change":"2024-06-02T04:03:06.694551+0000","last_active":"2024-06-02T04:03:08.043607+0000","last_peered":"2024-06-02T04:03:08.043607+0000","last_clean":"2024-06-02T04:03:08.043607+0000","last_became_active":"2024-06-02T04:03:06.694265+0000","last_became_peered":"2024-06-02T04:03:06.694265+0000","last_unstale":"2024-06-02T04:03:08.043607+0000","last_undegraded":"2024-06-02T04:03:08.043607+0000","last_fullsized":"2024-06-02T04:03:08.043607+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:41:19.017514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.677003+0000","last_change":"2024-06-02T04:03:06.690869+0000","last_active":"2024-06-02T04:03:07.677003+0000","last_peered":"2024-06-02T04:03:07.677003+0000","last_clean":"2024-06-02T04:03:07.677003+0000","last_became_active":"2024-06-02T04:03:06.690302+0000","last_became_peered":"2024-06-02T04:03:06.690302+0000","last_unstale":"2024-06-02T04:03:07.677003+0000","last_undegraded":"2024-06-02T04:03:07.677003+0000","last_fullsized":"2024-06-02T04:03:07.677003+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:17:15.440309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:45.136166+0000","last_change":"2024-06-02T04:03:06.271968+0000","last_active":"2024-06-02T04:03:45.136166+0000","last_peered":"2024-06-02T04:03:45.136166+0000","last_clean":"2024-06-02T04:03:45.136166+0000","last_became_active":"2024-06-02T04:03:06.271669+0000","last_became_peered":"2024-06-02T04:03:06.271669+0000","last_unstale":"2024-06-02T04:03:45.136166+0000","last_undegraded":"2024-06-02T04:03:45.136166+0000","last_fullsized":"2024-06-02T04:03:45.136166+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:21:15.966330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676653+0000","last_change":"2024-06-02T04:03:06.694468+0000","last_active":"2024-06-02T04:03:07.676653+0000","last_peered":"2024-06-02T04:03:07.676653+0000","last_clean":"2024-06-02T04:03:07.676653+0000","last_became_active":"2024-06-02T04:03:06.693949+0000","last_became_peered":"2024-06-02T04:03:06.693949+0000","last_unstale":"2024-06-02T04:03:07.676653+0000","last_undegraded":"2024-06-02T04:03:07.676653+0000","last_fullsized":"2024-06-02T04:03:07.676653+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:30:25.539150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:12.096484+0000","last_change":"2024-06-02T04:03:06.271658+0000","last_active":"2024-06-02T04:03:12.096484+0000","last_peered":"2024-06-02T04:03:12.096484+0000","last_clean":"2024-06-02T04:03:12.096484+0000","last_became_active":"2024-06-02T04:03:06.271313+0000","last_became_peered":"2024-06-02T04:03:06.271313+0000","last_unstale":"2024-06-02T04:03:12.096484+0000","last_undegraded":"2024-06-02T04:03:12.096484+0000","last_fullsized":"2024-06-02T04:03:12.096484+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:44:48.552397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":326,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.644494+0000","last_change":"2024-06-02T04:02:20.359447+0000","last_active":"2024-06-02T04:03:08.644494+0000","last_peered":"2024-06-02T04:03:08.644494+0000","last_clean":"2024-06-02T04:03:08.644494+0000","last_became_active":"2024-06-02T04:02:20.359031+0000","last_became_peered":"2024-06-02T04:02:20.359031+0000","last_unstale":"2024-06-02T04:03:08.644494+0000","last_undegraded":"2024-06-02T04:03:08.644494+0000","last_fullsized":"2024-06-02T04:03:08.644494+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T03:59:57.079508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T03:59:57.079508+0000","last_clean_scrub_stamp":"2024-06-02T03:59:57.079508+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:44:53.765578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.967686+0000","last_change":"2024-06-02T04:03:06.693309+0000","last_active":"2024-06-02T04:03:06.967686+0000","last_peered":"2024-06-02T04:03:06.967686+0000","last_clean":"2024-06-02T04:03:06.967686+0000","last_became_active":"2024-06-02T04:03:06.692961+0000","last_became_peered":"2024-06-02T04:03:06.692961+0000","last_unstale":"2024-06-02T04:03:06.967686+0000","last_undegraded":"2024-06-02T04:03:06.967686+0000","last_fullsized":"2024-06-02T04:03:06.967686+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:30:40.015091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:10.716861+0000","last_change":"2024-06-02T04:03:06.273144+0000","last_active":"2024-06-02T04:03:10.716861+0000","last_peered":"2024-06-02T04:03:10.716861+0000","last_clean":"2024-06-02T04:03:10.716861+0000","last_became_active":"2024-06-02T04:03:06.269431+0000","last_became_peered":"2024-06-02T04:03:06.269431+0000","last_unstale":"2024-06-02T04:03:10.716861+0000","last_undegraded":"2024-06-02T04:03:10.716861+0000","last_fullsized":"2024-06-02T04:03:10.716861+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:58:17.598214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.089622+0000","last_change":"2024-06-02T04:03:06.271914+0000","last_active":"2024-06-02T04:03:11.089622+0000","last_peered":"2024-06-02T04:03:11.089622+0000","last_clean":"2024-06-02T04:03:11.089622+0000","last_became_active":"2024-06-02T04:03:06.271590+0000","last_became_peered":"2024-06-02T04:03:06.271590+0000","last_unstale":"2024-06-02T04:03:11.089622+0000","last_undegraded":"2024-06-02T04:03:11.089622+0000","last_fullsized":"2024-06-02T04:03:11.089622+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:06:03.368086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.967766+0000","last_change":"2024-06-02T04:03:06.693154+0000","last_active":"2024-06-02T04:03:06.967766+0000","last_peered":"2024-06-02T04:03:06.967766+0000","last_clean":"2024-06-02T04:03:06.967766+0000","last_became_active":"2024-06-02T04:03:06.692873+0000","last_became_peered":"2024-06-02T04:03:06.692873+0000","last_unstale":"2024-06-02T04:03:06.967766+0000","last_undegraded":"2024-06-02T04:03:06.967766+0000","last_fullsized":"2024-06-02T04:03:06.967766+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:00:08.959850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'9","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:17.195511+0000","last_change":"2024-06-02T04:03:06.270804+0000","last_active":"2024-06-02T04:03:17.195511+0000","last_peered":"2024-06-02T04:03:17.195511+0000","last_clean":"2024-06-02T04:03:17.195511+0000","last_became_active":"2024-06-02T04:03:06.270479+0000","last_became_peered":"2024-06-02T04:03:06.270479+0000","last_unstale":"2024-06-02T04:03:17.195511+0000","last_undegraded":"2024-06-02T04:03:17.195511+0000","last_fullsized":"2024-06-02T04:03:17.195511+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:18:39.900900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676615+0000","last_change":"2024-06-02T04:03:06.685906+0000","last_active":"2024-06-02T04:03:07.676615+0000","last_peered":"2024-06-02T04:03:07.676615+0000","last_clean":"2024-06-02T04:03:07.676615+0000","last_became_active":"2024-06-02T04:03:06.685596+0000","last_became_peered":"2024-06-02T04:03:06.685596+0000","last_unstale":"2024-06-02T04:03:07.676615+0000","last_undegraded":"2024-06-02T04:03:07.676615+0000","last_fullsized":"2024-06-02T04:03:07.676615+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:06:13.456950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:12.096657+0000","last_change":"2024-06-02T04:03:06.275542+0000","last_active":"2024-06-02T04:03:12.096657+0000","last_peered":"2024-06-02T04:03:12.096657+0000","last_clean":"2024-06-02T04:03:12.096657+0000","last_became_active":"2024-06-02T04:03:06.275177+0000","last_became_peered":"2024-06-02T04:03:06.275177+0000","last_unstale":"2024-06-02T04:03:12.096657+0000","last_undegraded":"2024-06-02T04:03:12.096657+0000","last_fullsized":"2024-06-02T04:03:12.096657+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:58:35.587610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.695086+0000","last_change":"2024-06-02T04:03:06.692108+0000","last_active":"2024-06-02T04:03:06.695086+0000","last_peered":"2024-06-02T04:03:06.695086+0000","last_clean":"2024-06-02T04:03:06.695086+0000","last_became_active":"2024-06-02T04:03:06.691842+0000","last_became_peered":"2024-06-02T04:03:06.691842+0000","last_unstale":"2024-06-02T04:03:06.695086+0000","last_undegraded":"2024-06-02T04:03:06.695086+0000","last_fullsized":"2024-06-02T04:03:06.695086+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:35:10.885346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:09.713676+0000","last_change":"2024-06-02T04:03:06.278554+0000","last_active":"2024-06-02T04:03:09.713676+0000","last_peered":"2024-06-02T04:03:09.713676+0000","last_clean":"2024-06-02T04:03:09.713676+0000","last_became_active":"2024-06-02T04:03:06.278217+0000","last_became_peered":"2024-06-02T04:03:06.278217+0000","last_unstale":"2024-06-02T04:03:09.713676+0000","last_undegraded":"2024-06-02T04:03:09.713676+0000","last_fullsized":"2024-06-02T04:03:09.713676+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:04:37.653433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.885774+0000","last_change":"2024-06-02T04:03:06.682723+0000","last_active":"2024-06-02T04:03:07.885774+0000","last_peered":"2024-06-02T04:03:07.885774+0000","last_clean":"2024-06-02T04:03:07.885774+0000","last_became_active":"2024-06-02T04:03:06.682380+0000","last_became_peered":"2024-06-02T04:03:06.682380+0000","last_unstale":"2024-06-02T04:03:07.885774+0000","last_undegraded":"2024-06-02T04:03:07.885774+0000","last_fullsized":"2024-06-02T04:03:07.885774+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:07:56.566326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:12.096618+0000","last_change":"2024-06-02T04:03:06.271142+0000","last_active":"2024-06-02T04:03:12.096618+0000","last_peered":"2024-06-02T04:03:12.096618+0000","last_clean":"2024-06-02T04:03:12.096618+0000","last_became_active":"2024-06-02T04:03:06.270763+0000","last_became_peered":"2024-06-02T04:03:06.270763+0000","last_unstale":"2024-06-02T04:03:12.096618+0000","last_undegraded":"2024-06-02T04:03:12.096618+0000","last_fullsized":"2024-06-02T04:03:12.096618+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:23:12.842549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.001259+0000","last_change":"2024-06-02T04:03:06.690061+0000","last_active":"2024-06-02T04:03:08.001259+0000","last_peered":"2024-06-02T04:03:08.001259+0000","last_clean":"2024-06-02T04:03:08.001259+0000","last_became_active":"2024-06-02T04:03:06.689735+0000","last_became_peered":"2024-06-02T04:03:06.689735+0000","last_unstale":"2024-06-02T04:03:08.001259+0000","last_undegraded":"2024-06-02T04:03:08.001259+0000","last_fullsized":"2024-06-02T04:03:08.001259+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:14:29.096404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.760291+0000","last_change":"2024-06-02T04:03:06.273988+0000","last_active":"2024-06-02T04:03:11.760291+0000","last_peered":"2024-06-02T04:03:11.760291+0000","last_clean":"2024-06-02T04:03:11.760291+0000","last_became_active":"2024-06-02T04:03:06.273690+0000","last_became_peered":"2024-06-02T04:03:06.273690+0000","last_unstale":"2024-06-02T04:03:11.760291+0000","last_undegraded":"2024-06-02T04:03:11.760291+0000","last_fullsized":"2024-06-02T04:03:11.760291+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:55:13.758627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.677771+0000","last_change":"2024-06-02T04:03:06.697167+0000","last_active":"2024-06-02T04:03:07.677771+0000","last_peered":"2024-06-02T04:03:07.677771+0000","last_clean":"2024-06-02T04:03:07.677771+0000","last_became_active":"2024-06-02T04:03:06.696749+0000","last_became_peered":"2024-06-02T04:03:06.696749+0000","last_unstale":"2024-06-02T04:03:07.677771+0000","last_undegraded":"2024-06-02T04:03:07.677771+0000","last_fullsized":"2024-06-02T04:03:07.677771+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:20:06.736129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:09.709430+0000","last_change":"2024-06-02T04:03:06.271790+0000","last_active":"2024-06-02T04:03:09.709430+0000","last_peered":"2024-06-02T04:03:09.709430+0000","last_clean":"2024-06-02T04:03:09.709430+0000","last_became_active":"2024-06-02T04:03:06.271488+0000","last_became_peered":"2024-06-02T04:03:06.271488+0000","last_unstale":"2024-06-02T04:03:09.709430+0000","last_undegraded":"2024-06-02T04:03:09.709430+0000","last_fullsized":"2024-06-02T04:03:09.709430+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:45:55.514785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.644934+0000","last_change":"2024-06-02T04:03:06.700494+0000","last_active":"2024-06-02T04:03:08.644934+0000","last_peered":"2024-06-02T04:03:08.644934+0000","last_clean":"2024-06-02T04:03:08.644934+0000","last_became_active":"2024-06-02T04:03:06.700220+0000","last_became_peered":"2024-06-02T04:03:06.700220+0000","last_unstale":"2024-06-02T04:03:08.644934+0000","last_undegraded":"2024-06-02T04:03:08.644934+0000","last_fullsized":"2024-06-02T04:03:08.644934+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:25:32.547543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'5","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:45.152908+0000","last_change":"2024-06-02T04:03:06.273757+0000","last_active":"2024-06-02T04:03:45.152908+0000","last_peered":"2024-06-02T04:03:45.152908+0000","last_clean":"2024-06-02T04:03:45.152908+0000","last_became_active":"2024-06-02T04:03:06.273379+0000","last_became_peered":"2024-06-02T04:03:06.273379+0000","last_unstale":"2024-06-02T04:03:45.152908+0000","last_undegraded":"2024-06-02T04:03:45.152908+0000","last_fullsized":"2024-06-02T04:03:45.152908+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:23:09.207009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.645012+0000","last_change":"2024-06-02T04:03:06.700168+0000","last_active":"2024-06-02T04:03:08.645012+0000","last_peered":"2024-06-02T04:03:08.645012+0000","last_clean":"2024-06-02T04:03:08.645012+0000","last_became_active":"2024-06-02T04:03:06.699429+0000","last_became_peered":"2024-06-02T04:03:06.699429+0000","last_unstale":"2024-06-02T04:03:08.645012+0000","last_undegraded":"2024-06-02T04:03:08.645012+0000","last_fullsized":"2024-06-02T04:03:08.645012+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:29:08.397813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.088038+0000","last_change":"2024-06-02T04:03:06.275198+0000","last_active":"2024-06-02T04:03:11.088038+0000","last_peered":"2024-06-02T04:03:11.088038+0000","last_clean":"2024-06-02T04:03:11.088038+0000","last_became_active":"2024-06-02T04:03:06.274649+0000","last_became_peered":"2024-06-02T04:03:06.274649+0000","last_unstale":"2024-06-02T04:03:11.088038+0000","last_undegraded":"2024-06-02T04:03:11.088038+0000","last_fullsized":"2024-06-02T04:03:11.088038+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:37:45.091471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.936463+0000","last_change":"2024-06-02T04:03:06.690309+0000","last_active":"2024-06-02T04:03:08.936463+0000","last_peered":"2024-06-02T04:03:08.936463+0000","last_clean":"2024-06-02T04:03:08.936463+0000","last_became_active":"2024-06-02T04:03:06.689986+0000","last_became_peered":"2024-06-02T04:03:06.689986+0000","last_unstale":"2024-06-02T04:03:08.936463+0000","last_undegraded":"2024-06-02T04:03:08.936463+0000","last_fullsized":"2024-06-02T04:03:08.936463+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:12:18.237133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:12.096732+0000","last_change":"2024-06-02T04:03:06.272947+0000","last_active":"2024-06-02T04:03:12.096732+0000","last_peered":"2024-06-02T04:03:12.096732+0000","last_clean":"2024-06-02T04:03:12.096732+0000","last_became_active":"2024-06-02T04:03:06.272632+0000","last_became_peered":"2024-06-02T04:03:06.272632+0000","last_unstale":"2024-06-02T04:03:12.096732+0000","last_undegraded":"2024-06-02T04:03:12.096732+0000","last_fullsized":"2024-06-02T04:03:12.096732+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:01:16.085575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.645113+0000","last_change":"2024-06-02T04:03:06.701506+0000","last_active":"2024-06-02T04:03:08.645113+0000","last_peered":"2024-06-02T04:03:08.645113+0000","last_clean":"2024-06-02T04:03:08.645113+0000","last_became_active":"2024-06-02T04:03:06.701202+0000","last_became_peered":"2024-06-02T04:03:06.701202+0000","last_unstale":"2024-06-02T04:03:08.645113+0000","last_undegraded":"2024-06-02T04:03:08.645113+0000","last_fullsized":"2024-06-02T04:03:08.645113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:35:07.269775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.001325+0000","last_change":"2024-06-02T04:03:06.689400+0000","last_active":"2024-06-02T04:03:08.001325+0000","last_peered":"2024-06-02T04:03:08.001325+0000","last_clean":"2024-06-02T04:03:08.001325+0000","last_became_active":"2024-06-02T04:03:06.689044+0000","last_became_peered":"2024-06-02T04:03:06.689044+0000","last_unstale":"2024-06-02T04:03:08.001325+0000","last_undegraded":"2024-06-02T04:03:08.001325+0000","last_fullsized":"2024-06-02T04:03:08.001325+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:52:30.633358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.701754+0000","last_change":"2024-06-02T04:03:06.698863+0000","last_active":"2024-06-02T04:03:06.701754+0000","last_peered":"2024-06-02T04:03:06.701754+0000","last_clean":"2024-06-02T04:03:06.701754+0000","last_became_active":"2024-06-02T04:03:06.698580+0000","last_became_peered":"2024-06-02T04:03:06.698580+0000","last_unstale":"2024-06-02T04:03:06.701754+0000","last_undegraded":"2024-06-02T04:03:06.701754+0000","last_fullsized":"2024-06-02T04:03:06.701754+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:37:17.956746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.699107+0000","last_change":"2024-06-02T04:03:06.691634+0000","last_active":"2024-06-02T04:03:06.699107+0000","last_peered":"2024-06-02T04:03:06.699107+0000","last_clean":"2024-06-02T04:03:06.699107+0000","last_became_active":"2024-06-02T04:03:06.691270+0000","last_became_peered":"2024-06-02T04:03:06.691270+0000","last_unstale":"2024-06-02T04:03:06.699107+0000","last_undegraded":"2024-06-02T04:03:06.699107+0000","last_fullsized":"2024-06-02T04:03:06.699107+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:36:27.879519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.691816+0000","last_change":"2024-06-02T04:03:06.688290+0000","last_active":"2024-06-02T04:03:06.691816+0000","last_peered":"2024-06-02T04:03:06.691816+0000","last_clean":"2024-06-02T04:03:06.691816+0000","last_became_active":"2024-06-02T04:03:06.687970+0000","last_became_peered":"2024-06-02T04:03:06.687970+0000","last_unstale":"2024-06-02T04:03:06.691816+0000","last_undegraded":"2024-06-02T04:03:06.691816+0000","last_fullsized":"2024-06-02T04:03:06.691816+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:48:03.513694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.967775+0000","last_change":"2024-06-02T04:03:06.690498+0000","last_active":"2024-06-02T04:03:06.967775+0000","last_peered":"2024-06-02T04:03:06.967775+0000","last_clean":"2024-06-02T04:03:06.967775+0000","last_became_active":"2024-06-02T04:03:06.689698+0000","last_became_peered":"2024-06-02T04:03:06.689698+0000","last_unstale":"2024-06-02T04:03:06.967775+0000","last_undegraded":"2024-06-02T04:03:06.967775+0000","last_fullsized":"2024-06-02T04:03:06.967775+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:39:12.912589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.001349+0000","last_change":"2024-06-02T04:03:06.694551+0000","last_active":"2024-06-02T04:03:08.001349+0000","last_peered":"2024-06-02T04:03:08.001349+0000","last_clean":"2024-06-02T04:03:08.001349+0000","last_became_active":"2024-06-02T04:03:06.694266+0000","last_became_peered":"2024-06-02T04:03:06.694266+0000","last_unstale":"2024-06-02T04:03:08.001349+0000","last_undegraded":"2024-06-02T04:03:08.001349+0000","last_fullsized":"2024-06-02T04:03:08.001349+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:53:29.168620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.699460+0000","last_change":"2024-06-02T04:03:06.693639+0000","last_active":"2024-06-02T04:03:06.699460+0000","last_peered":"2024-06-02T04:03:06.699460+0000","last_clean":"2024-06-02T04:03:06.699460+0000","last_became_active":"2024-06-02T04:03:06.693283+0000","last_became_peered":"2024-06-02T04:03:06.693283+0000","last_unstale":"2024-06-02T04:03:06.699460+0000","last_undegraded":"2024-06-02T04:03:06.699460+0000","last_fullsized":"2024-06-02T04:03:06.699460+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:12:48.614632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676611+0000","last_change":"2024-06-02T04:03:06.689335+0000","last_active":"2024-06-02T04:03:07.676611+0000","last_peered":"2024-06-02T04:03:07.676611+0000","last_clean":"2024-06-02T04:03:07.676611+0000","last_became_active":"2024-06-02T04:03:06.688986+0000","last_became_peered":"2024-06-02T04:03:06.688986+0000","last_unstale":"2024-06-02T04:03:07.676611+0000","last_undegraded":"2024-06-02T04:03:07.676611+0000","last_fullsized":"2024-06-02T04:03:07.676611+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:16:44.138633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676833+0000","last_change":"2024-06-02T04:03:06.690694+0000","last_active":"2024-06-02T04:03:07.676833+0000","last_peered":"2024-06-02T04:03:07.676833+0000","last_clean":"2024-06-02T04:03:07.676833+0000","last_became_active":"2024-06-02T04:03:06.689684+0000","last_became_peered":"2024-06-02T04:03:06.689684+0000","last_unstale":"2024-06-02T04:03:07.676833+0000","last_undegraded":"2024-06-02T04:03:07.676833+0000","last_fullsized":"2024-06-02T04:03:07.676833+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:32:48.564501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676294+0000","last_change":"2024-06-02T04:03:06.692851+0000","last_active":"2024-06-02T04:03:07.676294+0000","last_peered":"2024-06-02T04:03:07.676294+0000","last_clean":"2024-06-02T04:03:07.676294+0000","last_became_active":"2024-06-02T04:03:06.688996+0000","last_became_peered":"2024-06-02T04:03:06.688996+0000","last_unstale":"2024-06-02T04:03:07.676294+0000","last_undegraded":"2024-06-02T04:03:07.676294+0000","last_fullsized":"2024-06-02T04:03:07.676294+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:21:54.779246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.716881+0000","last_change":"2024-06-02T04:03:06.704472+0000","last_active":"2024-06-02T04:03:08.716881+0000","last_peered":"2024-06-02T04:03:08.716881+0000","last_clean":"2024-06-02T04:03:08.716881+0000","last_became_active":"2024-06-02T04:03:06.704173+0000","last_became_peered":"2024-06-02T04:03:06.704173+0000","last_unstale":"2024-06-02T04:03:08.716881+0000","last_undegraded":"2024-06-02T04:03:08.716881+0000","last_fullsized":"2024-06-02T04:03:08.716881+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:48:26.362945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.967756+0000","last_change":"2024-06-02T04:03:06.688238+0000","last_active":"2024-06-02T04:03:06.967756+0000","last_peered":"2024-06-02T04:03:06.967756+0000","last_clean":"2024-06-02T04:03:06.967756+0000","last_became_active":"2024-06-02T04:03:06.687925+0000","last_became_peered":"2024-06-02T04:03:06.687925+0000","last_unstale":"2024-06-02T04:03:06.967756+0000","last_undegraded":"2024-06-02T04:03:06.967756+0000","last_fullsized":"2024-06-02T04:03:06.967756+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:15:19.314864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.001280+0000","last_change":"2024-06-02T04:03:06.685210+0000","last_active":"2024-06-02T04:03:08.001280+0000","last_peered":"2024-06-02T04:03:08.001280+0000","last_clean":"2024-06-02T04:03:08.001280+0000","last_became_active":"2024-06-02T04:03:06.684819+0000","last_became_peered":"2024-06-02T04:03:06.684819+0000","last_unstale":"2024-06-02T04:03:08.001280+0000","last_undegraded":"2024-06-02T04:03:08.001280+0000","last_fullsized":"2024-06-02T04:03:08.001280+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:05:55.275556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":284198,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65971,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":387,"num_read_kb":269,"num_write":229,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":197913,"data_compressed":5517,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481810,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31984,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713168,"statfs":{"total":95995035648,"available":95962284032,"internally_reserved":0,"allocated":892928,"data_stored":426260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:03:35 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.52800000000000002}]},{"osd":1,"last update":"Sun Jun 2 04:03:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.64000000000000001}]},{"osd":2,"last update":"Sun Jun 2 04:03:35 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.375},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Sun Jun 2 04:03:35 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.44400000000000001}]},{"osd":5,"last update":"Sun Jun 2 04:03:35 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.67200000000000004}]},{"osd":6,"last update":"Sun Jun 2 04:03:35 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.56200000000000006}]},{"osd":7,"last update":"Sun Jun 2 04:03:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.71999999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":9,"last update":"Sun Jun 2 04:03:35 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.746}]},{"osd":10,"last update":"Sun Jun 2 04:03:35 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":0.69999999999999996}]}]},{"osd":10,"up_from":70,"seq":300647710741,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1044480,"data_stored":1077030,"data_compressed":37978,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":1,"last update":"Sun Jun 2 04:03:18 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.51500000000000001}]},{"osd":2,"last update":"Sun Jun 2 04:03:18 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.61799999999999999}]},{"osd":3,"last update":"Sun Jun 2 04:03:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.59399999999999997}]},{"osd":4,"last update":"Sun Jun 2 04:03:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.53100000000000003}]},{"osd":5,"last update":"Sun Jun 2 04:03:18 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.78300000000000003}]},{"osd":6,"last update":"Sun Jun 2 04:03:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":8,"last update":"Sun Jun 2 04:03:18 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.75800000000000001}]},{"osd":9,"last update":"Sun Jun 2 04:03:18 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.872},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.84799999999999998}]},{"osd":11,"last update":"Sun Jun 2 04:03:37 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.748}]}]},{"osd":9,"up_from":64,"seq":274877906969,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":917504,"data_stored":426238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.315}]},{"osd":1,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.33800000000000002}]},{"osd":2,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.57799999999999996}]},{"osd":3,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.36599999999999999}]},{"osd":4,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.52600000000000002}]},{"osd":5,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.69799999999999995}]},{"osd":6,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.70899999999999996}]},{"osd":7,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.45300000000000001}]},{"osd":8,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.65200000000000002}]},{"osd":10,"last update":"Sun Jun 2 04:03:17 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.624}]}]},{"osd":8,"up_from":57,"seq":244813135901,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32000,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713152,"statfs":{"total":95995035648,"available":95962267648,"internally_reserved":0,"allocated":909312,"data_stored":426299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.38700000000000001}]},{"osd":1,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.53900000000000003}]},{"osd":2,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.33800000000000002}]},{"osd":3,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.49399999999999999}]},{"osd":4,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.69399999999999995}]},{"osd":5,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.435},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.52100000000000002}]},{"osd":6,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.67600000000000005}]},{"osd":7,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.71899999999999997}]},{"osd":9,"last update":"Sun Jun 2 04:03:00 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1,"5min":1,"15min":1},"last":0.629},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.59599999999999997}]},{"osd":10,"last update":"Sun Jun 2 04:03:17 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.745},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.79500000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":7,"up_from":49,"seq":210453397535,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":1018992,"data_compressed":36139,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.312}]},{"osd":1,"last update":"Sun Jun 2 04:03:24 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.42799999999999999,"15min":0.42599999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.55100000000000005,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.44900000000000001,"15min":0.44700000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.35399999999999998}]},{"osd":2,"last update":"Sun Jun 2 04:03:24 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56299999999999994,"15min":0.55500000000000005},"min":{"1min":0.34499999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.78900000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.37},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.56699999999999995}]},{"osd":3,"last update":"Sun Jun 2 04:03:24 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57399999999999995,"15min":0.56999999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.81499999999999995,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.41799999999999998}]},{"osd":4,"last update":"Sun Jun 2 04:03:24 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68500000000000005,"5min":0.753,"15min":0.753},"last":0.46600000000000003}]},{"osd":5,"last update":"Sun Jun 2 04:03:24 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61499999999999999,"15min":0.60899999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.86399999999999999,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.502},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.63100000000000001,"15min":0.627},"min":{"1min":0.48699999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.60399999999999998}]},{"osd":6,"last update":"Sun Jun 2 04:03:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64100000000000001,"15min":0.63600000000000001},"min":{"1min":0.44800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64100000000000001,"15min":0.63800000000000001},"min":{"1min":0.45800000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.53900000000000003}]},{"osd":8,"last update":"Sun Jun 2 04:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.58399999999999996}]},{"osd":9,"last update":"Sun Jun 2 04:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.55500000000000005}]},{"osd":10,"last update":"Sun Jun 2 04:03:17 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.621},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.70899999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]}]},{"osd":6,"up_from":44,"seq":188978561059,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":425907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:03:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.36699999999999999,"15min":0.36099999999999999},"min":{"1min":0.28399999999999997,"5min":0.246,"15min":0.246},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.189},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.38900000000000001,"15min":0.38300000000000001},"min":{"1min":0.28199999999999997,"5min":0.246,"15min":0.246},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.70899999999999996}]},{"osd":1,"last update":"Sun Jun 2 04:03:06 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.52700000000000002,"15min":0.51500000000000001},"min":{"1min":0.38700000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.46400000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.22}]},{"osd":2,"last update":"Sun Jun 2 04:03:06 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.371,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72199999999999998,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.32700000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.39800000000000002}]},{"osd":3,"last update":"Sun Jun 2 04:03:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45400000000000001,"15min":0.45100000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.37},{"interface":"front","average":{"1min":0.495,"5min":0.46999999999999997,"15min":0.46600000000000003},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.83399999999999996}]},{"osd":4,"last update":"Sun Jun 2 04:03:06 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.39200000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77200000000000002,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.59999999999999998,"15min":0.58699999999999997},"min":{"1min":0.434,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.45600000000000002}]},{"osd":5,"last update":"Sun Jun 2 04:03:06 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.622,"15min":0.623},"min":{"1min":0.432,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.441},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.625,"15min":0.63200000000000001},"min":{"1min":0.42199999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85499999999999998,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.85699999999999998}]},{"osd":7,"last update":"Sun Jun 2 04:03:30 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63100000000000001,"15min":0.63500000000000001},"min":{"1min":0.45300000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89700000000000002,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.65200000000000002,"15min":0.65700000000000003},"min":{"1min":0.44400000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90300000000000002,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.51100000000000001}]},{"osd":8,"last update":"Sun Jun 2 04:03:46 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63800000000000001,"15min":0.64100000000000001},"min":{"1min":0.47799999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.78100000000000003,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.65200000000000002,"15min":0.66000000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73099999999999998,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.38100000000000001}]},{"osd":9,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1,"5min":1,"15min":1},"last":0.28699999999999998}]},{"osd":10,"last update":"Sun Jun 2 04:03:17 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.53500000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":958464,"data_stored":486168,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:02:47 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.47799999999999998,"15min":0.46600000000000003},"min":{"1min":0.32500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.504,"5min":0.49099999999999999,"15min":0.48099999999999998},"min":{"1min":0.36599999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.502}]},{"osd":2,"last update":"Sun Jun 2 04:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.52500000000000002,"15min":0.50700000000000001},"min":{"1min":0.375,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.62},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52000000000000002,"15min":0.51600000000000001},"min":{"1min":0.39300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.54000000000000004}]},{"osd":3,"last update":"Sun Jun 2 04:03:18 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.67700000000000005,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.40100000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79900000000000004,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.55500000000000005}]},{"osd":4,"last update":"Sun Jun 2 04:03:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.442,"15min":0.42299999999999999},"min":{"1min":0.34499999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.42599999999999999,"15min":0.41399999999999998},"min":{"1min":0.27700000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.443}]},{"osd":5,"last update":"Sun Jun 2 04:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.42499999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.36299999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.60399999999999998}]},{"osd":6,"last update":"Sun Jun 2 04:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.59399999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.79600000000000004}]},{"osd":7,"last update":"Sun Jun 2 04:03:28 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.51500000000000001,"15min":0.495},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.52600000000000002,"15min":0.503},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.56699999999999995}]},{"osd":8,"last update":"Sun Jun 2 04:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.71899999999999997}]},{"osd":9,"last update":"Sun Jun 2 04:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.70899999999999996}]},{"osd":10,"last update":"Sun Jun 2 04:03:18 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.749},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.755}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738424,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":427246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jun 2 04:02:45 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52100000000000002,"15min":0.51500000000000001},"min":{"1min":0.30399999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.626},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.501,"15min":0.49199999999999999},"min":{"1min":0.36299999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.70099999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.502}]},{"osd":2,"last update":"Sun Jun 2 04:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.624,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54800000000000004,"15min":0.54300000000000004},"min":{"1min":0.41099999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.65900000000000003,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.47499999999999998}]},{"osd":3,"last update":"Sun Jun 2 04:02:17 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.59599999999999997,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.316},{"interface":"front","average":{"1min":0.433,"5min":0.41699999999999998,"15min":0.41399999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.65200000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.379}]},{"osd":4,"last update":"Sun Jun 2 04:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56399999999999995,"15min":0.56200000000000006},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.42799999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.54200000000000004}]},{"osd":5,"last update":"Sun Jun 2 04:02:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60099999999999998,"15min":0.60199999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.82799999999999996,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57999999999999996,"15min":0.58299999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.46400000000000002}]},{"osd":6,"last update":"Sun Jun 2 04:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.503,"15min":0.51200000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69299999999999995,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.49199999999999999,"15min":0.496},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.34000000000000002}]},{"osd":7,"last update":"Sun Jun 2 04:02:27 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.51800000000000002}]},{"osd":8,"last update":"Sun Jun 2 04:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61799999999999999,"15min":0.623},"min":{"1min":0.41199999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.68200000000000005,"15min":0.68999999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.56000000000000005}]},{"osd":9,"last update":"Sun Jun 2 04:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.42399999999999999}]},{"osd":10,"last update":"Sun Jun 2 04:03:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.66400000000000003}]},{"osd":11,"last update":"Sun Jun 2 04:03:35 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.51100000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411378,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":978944,"data_stored":486340,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.49299999999999999,"15min":0.47299999999999998},"min":{"1min":0.34699999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.496,"15min":0.47199999999999998},"min":{"1min":0.39400000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.496}]},{"osd":1,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.497,"15min":0.48999999999999999},"min":{"1min":0.34399999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.79700000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.505,"15min":0.5},"min":{"1min":0.33700000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.58399999999999996}]},{"osd":3,"last update":"Sun Jun 2 04:03:19 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.53300000000000003},"min":{"1min":0.35999999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56599999999999995,"15min":0.54900000000000004},"min":{"1min":0.39900000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.67400000000000004}]},{"osd":4,"last update":"Sun Jun 2 04:02:33 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52300000000000002,"15min":0.51700000000000002},"min":{"1min":0.36099999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.52300000000000002,"15min":0.51400000000000001},"min":{"1min":0.442,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.51900000000000002}]},{"osd":5,"last update":"Sun Jun 2 04:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.441,"15min":0.437},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.501,"15min":0.496},"min":{"1min":0.36899999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.65500000000000003}]},{"osd":6,"last update":"Sun Jun 2 04:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.874,"5min":0.877,"15min":0.877},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63400000000000001,"15min":0.63700000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.72099999999999997}]},{"osd":7,"last update":"Sun Jun 2 04:02:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.48199999999999998}]},{"osd":8,"last update":"Sun Jun 2 04:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.39100000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.84599999999999997,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.37,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80300000000000005,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.70699999999999996}]},{"osd":9,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.80700000000000005}]},{"osd":10,"last update":"Sun Jun 2 04:03:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.85899999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]}]},{"osd":3,"up_from":25,"seq":107374182445,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":425780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.32600000000000001,"15min":0.313},"min":{"1min":0.23400000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.60399999999999998,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.35699999999999998,"15min":0.34499999999999997},"min":{"1min":0.28000000000000003,"5min":0.249,"15min":0.249},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.30199999999999999}]},{"osd":1,"last update":"Sun Jun 2 04:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.52300000000000002,"15min":0.503},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.35399999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.60199999999999998}]},{"osd":2,"last update":"Sun Jun 2 04:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.54600000000000004,"15min":0.52300000000000002},"min":{"1min":0.42499999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54000000000000004,"15min":0.51900000000000002},"min":{"1min":0.36099999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.496}]},{"osd":4,"last update":"Sun Jun 2 04:03:35 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56499999999999995,"15min":0.56899999999999995},"min":{"1min":0.39600000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.67400000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57599999999999996,"15min":0.57799999999999996},"min":{"1min":0.45500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.73399999999999999,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.64200000000000002}]},{"osd":5,"last update":"Sun Jun 2 04:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.51100000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77700000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.52000000000000002}]},{"osd":6,"last update":"Sun Jun 2 04:03:07 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.49399999999999999,"15min":0.496},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.441},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81699999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.38900000000000001}]},{"osd":7,"last update":"Sun Jun 2 04:03:28 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.433,"5min":0.374,"15min":0.374},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.627},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64700000000000002,"15min":0.64600000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.59299999999999997}]},{"osd":8,"last update":"Sun Jun 2 04:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.44500000000000001}]},{"osd":9,"last update":"Sun Jun 2 04:03:00 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.36499999999999999}]},{"osd":10,"last update":"Sun Jun 2 04:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.56499999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]}]},{"osd":4,"up_from":32,"seq":137438953515,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":426161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:02:31 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.47899999999999998,"15min":0.47499999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71799999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.379},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.50900000000000001,"15min":0.505},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.39100000000000001}]},{"osd":1,"last update":"Sun Jun 2 04:03:32 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.36499999999999999,"15min":0.34300000000000003},"min":{"1min":0.29299999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.432,"5min":0.38800000000000001,"15min":0.36399999999999999},"min":{"1min":0.253,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.52000000000000002}]},{"osd":2,"last update":"Sun Jun 2 04:03:32 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.53800000000000003,"15min":0.52200000000000002},"min":{"1min":0.36499999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.53400000000000003,"15min":0.50800000000000001},"min":{"1min":0.42999999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.86599999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.62}]},{"osd":3,"last update":"Sun Jun 2 04:03:32 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54200000000000004,"15min":0.51600000000000001},"min":{"1min":0.35499999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.505,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.63900000000000001,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.54500000000000004}]},{"osd":5,"last update":"Sun Jun 2 04:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54000000000000004,"15min":0.53300000000000003},"min":{"1min":0.40100000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.58299999999999996,"15min":0.57699999999999996},"min":{"1min":0.39800000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.59199999999999997}]},{"osd":6,"last update":"Sun Jun 2 04:03:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59399999999999997,"15min":0.58799999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57599999999999996,"15min":0.57199999999999995},"min":{"1min":0.45700000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.67300000000000004}]},{"osd":7,"last update":"Sun Jun 2 04:03:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59099999999999997,"15min":0.58999999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.68400000000000005}]},{"osd":8,"last update":"Sun Jun 2 04:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.626,"15min":0.622},"min":{"1min":0.48199999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.82899999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.70999999999999996,"15min":0.70799999999999996},"min":{"1min":0.501,"5min":0.437,"15min":0.437},"max":{"1min":0.98799999999999999,"5min":1.117,"15min":1.117},"last":0.72099999999999997}]},{"osd":9,"last update":"Sun Jun 2 04:03:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.70999999999999996}]},{"osd":10,"last update":"Sun Jun 2 04:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.69999999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":5,"up_from":37,"seq":158913789991,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":978944,"data_stored":1018373,"data_compressed":36139,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.503,"15min":0.502},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.36199999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.53000000000000003}]},{"osd":1,"last update":"Sun Jun 2 04:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54600000000000004,"15min":0.54800000000000004},"min":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70199999999999996,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55000000000000004,"15min":0.55400000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68300000000000005,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.63400000000000001}]},{"osd":2,"last update":"Sun Jun 2 04:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40100000000000002,"15min":0.39900000000000002},"min":{"1min":0.29499999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.378},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.42899999999999999,"15min":0.433},"min":{"1min":0.28899999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.34100000000000003}]},{"osd":3,"last update":"Sun Jun 2 04:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.55000000000000004,"15min":0.55800000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81399999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73499999999999999,"5min":0.751,"15min":0.751},"last":0.44}]},{"osd":4,"last update":"Sun Jun 2 04:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59499999999999997,"15min":0.59599999999999997},"min":{"1min":0.433,"5min":0.372,"15min":0.372},"max":{"1min":0.80200000000000005,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.38600000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80100000000000005,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.64700000000000002}]},{"osd":6,"last update":"Sun Jun 2 04:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.61299999999999999,"15min":0.625},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83799999999999997,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.622},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.59299999999999997,"15min":0.60599999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77700000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.49399999999999999}]},{"osd":7,"last update":"Sun Jun 2 04:03:28 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63500000000000001,"15min":0.63400000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.66300000000000003,"15min":0.66900000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.83999999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.61199999999999999}]},{"osd":8,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.42399999999999999}]},{"osd":9,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.56200000000000006}]},{"osd":10,"last update":"Sun Jun 2 04:03:18 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.755},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.71699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34501,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34501,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34501,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36139,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36139,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36139,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36139,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36139,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":61052,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":61224,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":61429,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T04:03:49.369 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-06-02T04:03:49.592 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:03:50.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:49 smithi123 ceph-mon[42885]: pgmap v243: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2024-06-02T04:03:50.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:49 smithi123 ceph-mon[42885]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:03:50.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:49 smithi162 ceph-mon[47009]: pgmap v243: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2024-06-02T04:03:50.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:49 smithi162 ceph-mon[47009]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:03:50.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:49 smithi136 ceph-mon[47443]: pgmap v243: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2024-06-02T04:03:50.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:49 smithi136 ceph-mon[47443]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:03:50.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.600+0000 7f0c8607f700 1 -- 172.21.15.123:0/1023024021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c801001c0 msgr2=0x7f0c80100640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:50.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.600+0000 7f0c8607f700 1 --2- 172.21.15.123:0/1023024021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c801001c0 0x7f0c80100640 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0c680099c0 tx=0x7f0c68009cd0 comp rx=0 tx=0).stop 2024-06-02T04:03:50.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.600+0000 7f0c8607f700 1 -- 172.21.15.123:0/1023024021 shutdown_connections 2024-06-02T04:03:50.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.600+0000 7f0c8607f700 1 --2- 172.21.15.123:0/1023024021 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c80100b80 0x7f0c8010ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:50.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.600+0000 7f0c8607f700 1 --2- 172.21.15.123:0/1023024021 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c80106080 0x7f0c80106460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:50.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.600+0000 7f0c8607f700 1 --2- 172.21.15.123:0/1023024021 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c801001c0 0x7f0c80100640 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:50.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.600+0000 7f0c8607f700 1 -- 172.21.15.123:0/1023024021 >> 172.21.15.123:0/1023024021 conn(0x7f0c80076cd0 msgr2=0x7f0c800770e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:50.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.600+0000 7f0c8607f700 1 -- 172.21.15.123:0/1023024021 shutdown_connections 2024-06-02T04:03:50.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.600+0000 7f0c8607f700 1 -- 172.21.15.123:0/1023024021 wait complete. 2024-06-02T04:03:50.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.601+0000 7f0c8607f700 1 Processor -- start 2024-06-02T04:03:50.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.601+0000 7f0c8607f700 1 -- start start 2024-06-02T04:03:50.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.601+0000 7f0c8607f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c801001c0 0x7f0c80198150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:50.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.601+0000 7f0c8607f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c80100b80 0x7f0c80198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:50.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.601+0000 7f0c8607f700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c80106080 0x7f0c801a31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:50.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.601+0000 7f0c8607f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c80198ee0 con 0x7f0c801001c0 2024-06-02T04:03:50.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.601+0000 7f0c8607f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c801a3710 con 0x7f0c80100b80 2024-06-02T04:03:50.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.601+0000 7f0c8607f700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c801a3850 con 0x7f0c80106080 2024-06-02T04:03:50.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.601+0000 7f0c7f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c801001c0 0x7f0c80198150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:50.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.601+0000 7f0c7f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c801001c0 0x7f0c80198150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41374/0 (socket says 172.21.15.123:41374) 2024-06-02T04:03:50.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.601+0000 7f0c7f7fe700 1 -- 172.21.15.123:0/3025642360 learned_addr learned my addr 172.21.15.123:0/3025642360 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:50.605 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.602+0000 7f0c7ffff700 1 --2- 172.21.15.123:0/3025642360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c80106080 0x7f0c801a31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:50.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.602+0000 7f0c7effd700 1 --2- 172.21.15.123:0/3025642360 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c80100b80 0x7f0c80198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:50.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.602+0000 7f0c7f7fe700 1 -- 172.21.15.123:0/3025642360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c80106080 msgr2=0x7f0c801a31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:50.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.602+0000 7f0c7f7fe700 1 --2- 172.21.15.123:0/3025642360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c80106080 0x7f0c801a31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:50.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.602+0000 7f0c7f7fe700 1 -- 172.21.15.123:0/3025642360 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c80100b80 msgr2=0x7f0c80198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:50.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.602+0000 7f0c7f7fe700 1 --2- 172.21.15.123:0/3025642360 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c80100b80 0x7f0c80198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:50.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.602+0000 7f0c7f7fe700 1 -- 172.21.15.123:0/3025642360 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c680095f0 con 0x7f0c801001c0 2024-06-02T04:03:50.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.602+0000 7f0c7f7fe700 1 --2- 172.21.15.123:0/3025642360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c801001c0 0x7f0c80198150 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0c7000c950 tx=0x7f0c7000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:50.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.602+0000 7f0c7cff9700 1 -- 172.21.15.123:0/3025642360 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c700078d0 con 0x7f0c801001c0 2024-06-02T04:03:50.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.602+0000 7f0c7cff9700 1 -- 172.21.15.123:0/3025642360 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c7000f450 con 0x7f0c801001c0 2024-06-02T04:03:50.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.602+0000 7f0c8607f700 1 -- 172.21.15.123:0/3025642360 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c801a3ab0 con 0x7f0c801001c0 2024-06-02T04:03:50.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.602+0000 7f0c7cff9700 1 -- 172.21.15.123:0/3025642360 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c70018660 con 0x7f0c801001c0 2024-06-02T04:03:50.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.602+0000 7f0c8607f700 1 -- 172.21.15.123:0/3025642360 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c801a3f80 con 0x7f0c801001c0 2024-06-02T04:03:50.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.603+0000 7f0c8607f700 1 -- 172.21.15.123:0/3025642360 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c80101600 con 0x7f0c801001c0 2024-06-02T04:03:50.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.604+0000 7f0c7cff9700 1 -- 172.21.15.123:0/3025642360 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f0c70007a30 con 0x7f0c801001c0 2024-06-02T04:03:50.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.605+0000 7f0c7cff9700 1 --2- 172.21.15.123:0/3025642360 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0c6c0a11b0 0x7f0c6c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:50.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.605+0000 7f0c7effd700 1 --2- 172.21.15.123:0/3025642360 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0c6c0a11b0 0x7f0c6c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:50.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.605+0000 7f0c7cff9700 1 -- 172.21.15.123:0/3025642360 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f0c700cc6d0 con 0x7f0c801001c0 2024-06-02T04:03:50.608 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.605+0000 7f0c7effd700 1 --2- 172.21.15.123:0/3025642360 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0c6c0a11b0 0x7f0c6c0a3670 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009990 tx=0x7f0c68005c60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:50.609 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.609+0000 7f0c7cff9700 1 -- 172.21.15.123:0/3025642360 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0c70095eb0 con 0x7f0c801001c0 2024-06-02T04:03:50.799 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.799+0000 7f0c8607f700 1 -- 172.21.15.123:0/3025642360 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0c8010fe30 con 0x7f0c6c0a11b0 2024-06-02T04:03:50.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.808+0000 7f0c7cff9700 1 -- 172.21.15.123:0/3025642360 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+341090 (secure 0 0 0) 0x7f0c8010fe30 con 0x7f0c6c0a11b0 2024-06-02T04:03:50.812 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:03:50.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.812+0000 7f0c8607f700 1 -- 172.21.15.123:0/3025642360 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0c6c0a11b0 msgr2=0x7f0c6c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:50.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.812+0000 7f0c8607f700 1 --2- 172.21.15.123:0/3025642360 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0c6c0a11b0 0x7f0c6c0a3670 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009990 tx=0x7f0c68005c60 comp rx=0 tx=0).stop 2024-06-02T04:03:50.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.812+0000 7f0c8607f700 1 -- 172.21.15.123:0/3025642360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c801001c0 msgr2=0x7f0c80198150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:50.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.812+0000 7f0c8607f700 1 --2- 172.21.15.123:0/3025642360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c801001c0 0x7f0c80198150 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0c7000c950 tx=0x7f0c7000cc60 comp rx=0 tx=0).stop 2024-06-02T04:03:50.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.812+0000 7f0c8607f700 1 -- 172.21.15.123:0/3025642360 shutdown_connections 2024-06-02T04:03:50.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.812+0000 7f0c8607f700 1 --2- 172.21.15.123:0/3025642360 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c80106080 0x7f0c801a31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:50.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.812+0000 7f0c8607f700 1 --2- 172.21.15.123:0/3025642360 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0c801001c0 0x7f0c80198150 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:50.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.812+0000 7f0c8607f700 1 --2- 172.21.15.123:0/3025642360 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0c6c0a11b0 0x7f0c6c0a3670 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:50.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.812+0000 7f0c8607f700 1 --2- 172.21.15.123:0/3025642360 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c80100b80 0x7f0c80198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:50.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.812+0000 7f0c8607f700 1 -- 172.21.15.123:0/3025642360 >> 172.21.15.123:0/3025642360 conn(0x7f0c80076cd0 msgr2=0x7f0c800fee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:50.815 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.812+0000 7f0c8607f700 1 -- 172.21.15.123:0/3025642360 shutdown_connections 2024-06-02T04:03:50.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:50.812+0000 7f0c8607f700 1 -- 172.21.15.123:0/3025642360 wait complete. 2024-06-02T04:03:50.816 INFO:teuthology.orchestra.run.smithi123.stderr:dumped all 2024-06-02T04:03:51.237 INFO:teuthology.orchestra.run.smithi123.stdout:{"pg_ready":true,"pg_map":{"version":243,"stamp":"2024-06-02T04:03:48.836159+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656573,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":513,"num_read_kb":378,"num_write":412,"num_write_kb":3068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":340,"ondisk_log_size":340,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":359792,"kb_used_data":11024,"kb_used_omap":18,"kb_used_meta":348653,"kb_avail":1124582032,"statfs":{"total":1151940427776,"available":1151572000768,"internally_reserved":0,"allocated":11288576,"data_stored":7070794,"data_compressed":113934,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19129,"internal_metadata":357020999},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":61,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002614"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.001512+0000","last_change":"2024-06-02T04:03:06.690548+0000","last_active":"2024-06-02T04:03:08.001512+0000","last_peered":"2024-06-02T04:03:08.001512+0000","last_clean":"2024-06-02T04:03:08.001512+0000","last_became_active":"2024-06-02T04:03:06.690003+0000","last_became_peered":"2024-06-02T04:03:06.690003+0000","last_unstale":"2024-06-02T04:03:08.001512+0000","last_undegraded":"2024-06-02T04:03:08.001512+0000","last_fullsized":"2024-06-02T04:03:08.001512+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:36:23.875017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.695899+0000","last_change":"2024-06-02T04:03:06.694664+0000","last_active":"2024-06-02T04:03:06.695899+0000","last_peered":"2024-06-02T04:03:06.695899+0000","last_clean":"2024-06-02T04:03:06.695899+0000","last_became_active":"2024-06-02T04:03:06.692173+0000","last_became_peered":"2024-06-02T04:03:06.692173+0000","last_unstale":"2024-06-02T04:03:06.695899+0000","last_undegraded":"2024-06-02T04:03:06.695899+0000","last_fullsized":"2024-06-02T04:03:06.695899+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:28:07.252793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.692106+0000","last_change":"2024-06-02T04:03:06.691118+0000","last_active":"2024-06-02T04:03:06.692106+0000","last_peered":"2024-06-02T04:03:06.692106+0000","last_clean":"2024-06-02T04:03:06.692106+0000","last_became_active":"2024-06-02T04:03:06.690782+0000","last_became_peered":"2024-06-02T04:03:06.690782+0000","last_unstale":"2024-06-02T04:03:06.692106+0000","last_undegraded":"2024-06-02T04:03:06.692106+0000","last_fullsized":"2024-06-02T04:03:06.692106+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:30:02.876432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.828784+0000","last_change":"2024-06-02T04:03:06.692716+0000","last_active":"2024-06-02T04:03:06.828784+0000","last_peered":"2024-06-02T04:03:06.828784+0000","last_clean":"2024-06-02T04:03:06.828784+0000","last_became_active":"2024-06-02T04:03:06.692084+0000","last_became_peered":"2024-06-02T04:03:06.692084+0000","last_unstale":"2024-06-02T04:03:06.828784+0000","last_undegraded":"2024-06-02T04:03:06.828784+0000","last_fullsized":"2024-06-02T04:03:06.828784+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:32:20.191118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.885799+0000","last_change":"2024-06-02T04:03:06.685966+0000","last_active":"2024-06-02T04:03:07.885799+0000","last_peered":"2024-06-02T04:03:07.885799+0000","last_clean":"2024-06-02T04:03:07.885799+0000","last_became_active":"2024-06-02T04:03:06.685622+0000","last_became_peered":"2024-06-02T04:03:06.685622+0000","last_unstale":"2024-06-02T04:03:07.885799+0000","last_undegraded":"2024-06-02T04:03:07.885799+0000","last_fullsized":"2024-06-02T04:03:07.885799+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:37:11.472602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.043587+0000","last_change":"2024-06-02T04:03:06.687067+0000","last_active":"2024-06-02T04:03:08.043587+0000","last_peered":"2024-06-02T04:03:08.043587+0000","last_clean":"2024-06-02T04:03:08.043587+0000","last_became_active":"2024-06-02T04:03:06.686746+0000","last_became_peered":"2024-06-02T04:03:06.686746+0000","last_unstale":"2024-06-02T04:03:08.043587+0000","last_undegraded":"2024-06-02T04:03:08.043587+0000","last_fullsized":"2024-06-02T04:03:08.043587+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:18:28.240961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.644681+0000","last_change":"2024-06-02T04:03:06.685437+0000","last_active":"2024-06-02T04:03:08.644681+0000","last_peered":"2024-06-02T04:03:08.644681+0000","last_clean":"2024-06-02T04:03:08.644681+0000","last_became_active":"2024-06-02T04:03:06.685127+0000","last_became_peered":"2024-06-02T04:03:06.685127+0000","last_unstale":"2024-06-02T04:03:08.644681+0000","last_undegraded":"2024-06-02T04:03:08.644681+0000","last_fullsized":"2024-06-02T04:03:08.644681+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:45:08.746351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676297+0000","last_change":"2024-06-02T04:03:06.688091+0000","last_active":"2024-06-02T04:03:07.676297+0000","last_peered":"2024-06-02T04:03:07.676297+0000","last_clean":"2024-06-02T04:03:07.676297+0000","last_became_active":"2024-06-02T04:03:06.687827+0000","last_became_peered":"2024-06-02T04:03:06.687827+0000","last_unstale":"2024-06-02T04:03:07.676297+0000","last_undegraded":"2024-06-02T04:03:07.676297+0000","last_fullsized":"2024-06-02T04:03:07.676297+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:44:10.968199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.717204+0000","last_change":"2024-06-02T04:03:06.699748+0000","last_active":"2024-06-02T04:03:08.717204+0000","last_peered":"2024-06-02T04:03:08.717204+0000","last_clean":"2024-06-02T04:03:08.717204+0000","last_became_active":"2024-06-02T04:03:06.699442+0000","last_became_peered":"2024-06-02T04:03:06.699442+0000","last_unstale":"2024-06-02T04:03:08.717204+0000","last_undegraded":"2024-06-02T04:03:08.717204+0000","last_fullsized":"2024-06-02T04:03:08.717204+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:00:40.165226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.043690+0000","last_change":"2024-06-02T04:03:06.691914+0000","last_active":"2024-06-02T04:03:08.043690+0000","last_peered":"2024-06-02T04:03:08.043690+0000","last_clean":"2024-06-02T04:03:08.043690+0000","last_became_active":"2024-06-02T04:03:06.691250+0000","last_became_peered":"2024-06-02T04:03:06.691250+0000","last_unstale":"2024-06-02T04:03:08.043690+0000","last_undegraded":"2024-06-02T04:03:08.043690+0000","last_fullsized":"2024-06-02T04:03:08.043690+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:21:17.201134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.644985+0000","last_change":"2024-06-02T04:03:06.700359+0000","last_active":"2024-06-02T04:03:08.644985+0000","last_peered":"2024-06-02T04:03:08.644985+0000","last_clean":"2024-06-02T04:03:08.644985+0000","last_became_active":"2024-06-02T04:03:06.699829+0000","last_became_peered":"2024-06-02T04:03:06.699829+0000","last_unstale":"2024-06-02T04:03:08.644985+0000","last_undegraded":"2024-06-02T04:03:08.644985+0000","last_fullsized":"2024-06-02T04:03:08.644985+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:00:48.645655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.828757+0000","last_change":"2024-06-02T04:03:06.693172+0000","last_active":"2024-06-02T04:03:06.828757+0000","last_peered":"2024-06-02T04:03:06.828757+0000","last_clean":"2024-06-02T04:03:06.828757+0000","last_became_active":"2024-06-02T04:03:06.692859+0000","last_became_peered":"2024-06-02T04:03:06.692859+0000","last_unstale":"2024-06-02T04:03:06.828757+0000","last_undegraded":"2024-06-02T04:03:06.828757+0000","last_fullsized":"2024-06-02T04:03:06.828757+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:34:56.027760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.967731+0000","last_change":"2024-06-02T04:03:06.688171+0000","last_active":"2024-06-02T04:03:06.967731+0000","last_peered":"2024-06-02T04:03:06.967731+0000","last_clean":"2024-06-02T04:03:06.967731+0000","last_became_active":"2024-06-02T04:03:06.687476+0000","last_became_peered":"2024-06-02T04:03:06.687476+0000","last_unstale":"2024-06-02T04:03:06.967731+0000","last_undegraded":"2024-06-02T04:03:06.967731+0000","last_fullsized":"2024-06-02T04:03:06.967731+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:03:49.023726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.698675+0000","last_change":"2024-06-02T04:03:06.697507+0000","last_active":"2024-06-02T04:03:06.698675+0000","last_peered":"2024-06-02T04:03:06.698675+0000","last_clean":"2024-06-02T04:03:06.698675+0000","last_became_active":"2024-06-02T04:03:06.697201+0000","last_became_peered":"2024-06-02T04:03:06.697201+0000","last_unstale":"2024-06-02T04:03:06.698675+0000","last_undegraded":"2024-06-02T04:03:06.698675+0000","last_fullsized":"2024-06-02T04:03:06.698675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:33:08.883076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.691982+0000","last_change":"2024-06-02T04:03:06.690488+0000","last_active":"2024-06-02T04:03:06.691982+0000","last_peered":"2024-06-02T04:03:06.691982+0000","last_clean":"2024-06-02T04:03:06.691982+0000","last_became_active":"2024-06-02T04:03:06.690186+0000","last_became_peered":"2024-06-02T04:03:06.690186+0000","last_unstale":"2024-06-02T04:03:06.691982+0000","last_undegraded":"2024-06-02T04:03:06.691982+0000","last_fullsized":"2024-06-02T04:03:06.691982+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:55:44.408427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.716746+0000","last_change":"2024-06-02T04:03:06.693950+0000","last_active":"2024-06-02T04:03:08.716746+0000","last_peered":"2024-06-02T04:03:08.716746+0000","last_clean":"2024-06-02T04:03:08.716746+0000","last_became_active":"2024-06-02T04:03:06.693656+0000","last_became_peered":"2024-06-02T04:03:06.693656+0000","last_unstale":"2024-06-02T04:03:08.716746+0000","last_undegraded":"2024-06-02T04:03:08.716746+0000","last_fullsized":"2024-06-02T04:03:08.716746+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:14:24.687129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.001599+0000","last_change":"2024-06-02T04:03:06.690325+0000","last_active":"2024-06-02T04:03:08.001599+0000","last_peered":"2024-06-02T04:03:08.001599+0000","last_clean":"2024-06-02T04:03:08.001599+0000","last_became_active":"2024-06-02T04:03:06.689579+0000","last_became_peered":"2024-06-02T04:03:06.689579+0000","last_unstale":"2024-06-02T04:03:08.001599+0000","last_undegraded":"2024-06-02T04:03:08.001599+0000","last_fullsized":"2024-06-02T04:03:08.001599+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:46:49.709737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:09.706673+0000","last_change":"2024-06-02T04:03:06.691817+0000","last_active":"2024-06-02T04:03:09.706673+0000","last_peered":"2024-06-02T04:03:09.706673+0000","last_clean":"2024-06-02T04:03:09.706673+0000","last_became_active":"2024-06-02T04:03:06.691487+0000","last_became_peered":"2024-06-02T04:03:06.691487+0000","last_unstale":"2024-06-02T04:03:09.706673+0000","last_undegraded":"2024-06-02T04:03:09.706673+0000","last_fullsized":"2024-06-02T04:03:09.706673+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:32:29.983404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.689707+0000","last_change":"2024-06-02T04:03:06.687928+0000","last_active":"2024-06-02T04:03:06.689707+0000","last_peered":"2024-06-02T04:03:06.689707+0000","last_clean":"2024-06-02T04:03:06.689707+0000","last_became_active":"2024-06-02T04:03:06.687626+0000","last_became_peered":"2024-06-02T04:03:06.687626+0000","last_unstale":"2024-06-02T04:03:06.689707+0000","last_undegraded":"2024-06-02T04:03:06.689707+0000","last_fullsized":"2024-06-02T04:03:06.689707+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:00:49.112152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"82'13","reported_seq":58,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:43.147103+0000","last_change":"2024-06-02T04:03:06.278393+0000","last_active":"2024-06-02T04:03:43.147103+0000","last_peered":"2024-06-02T04:03:43.147103+0000","last_clean":"2024-06-02T04:03:43.147103+0000","last_became_active":"2024-06-02T04:03:06.278033+0000","last_became_peered":"2024-06-02T04:03:06.278033+0000","last_unstale":"2024-06-02T04:03:43.147103+0000","last_undegraded":"2024-06-02T04:03:43.147103+0000","last_fullsized":"2024-06-02T04:03:43.147103+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:34:01.806795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676615+0000","last_change":"2024-06-02T04:03:06.693074+0000","last_active":"2024-06-02T04:03:07.676615+0000","last_peered":"2024-06-02T04:03:07.676615+0000","last_clean":"2024-06-02T04:03:07.676615+0000","last_became_active":"2024-06-02T04:03:06.689257+0000","last_became_peered":"2024-06-02T04:03:06.689257+0000","last_unstale":"2024-06-02T04:03:07.676615+0000","last_undegraded":"2024-06-02T04:03:07.676615+0000","last_fullsized":"2024-06-02T04:03:07.676615+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:36:48.346723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"82'2","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.882169+0000","last_change":"2024-06-02T04:03:06.275088+0000","last_active":"2024-06-02T04:03:08.882169+0000","last_peered":"2024-06-02T04:03:08.882169+0000","last_clean":"2024-06-02T04:03:08.882169+0000","last_became_active":"2024-06-02T04:03:06.274731+0000","last_became_peered":"2024-06-02T04:03:06.274731+0000","last_unstale":"2024-06-02T04:03:08.882169+0000","last_undegraded":"2024-06-02T04:03:08.882169+0000","last_fullsized":"2024-06-02T04:03:08.882169+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:41:01.298971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.693659+0000","last_change":"2024-06-02T04:03:06.691841+0000","last_active":"2024-06-02T04:03:06.693659+0000","last_peered":"2024-06-02T04:03:06.693659+0000","last_clean":"2024-06-02T04:03:06.693659+0000","last_became_active":"2024-06-02T04:03:06.690960+0000","last_became_peered":"2024-06-02T04:03:06.690960+0000","last_unstale":"2024-06-02T04:03:06.693659+0000","last_undegraded":"2024-06-02T04:03:06.693659+0000","last_fullsized":"2024-06-02T04:03:06.693659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:05:13.716189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"82'12","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:13.105671+0000","last_change":"2024-06-02T04:03:06.278745+0000","last_active":"2024-06-02T04:03:13.105671+0000","last_peered":"2024-06-02T04:03:13.105671+0000","last_clean":"2024-06-02T04:03:13.105671+0000","last_became_active":"2024-06-02T04:03:06.278449+0000","last_became_peered":"2024-06-02T04:03:06.278449+0000","last_unstale":"2024-06-02T04:03:13.105671+0000","last_undegraded":"2024-06-02T04:03:13.105671+0000","last_fullsized":"2024-06-02T04:03:13.105671+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:56:46.039492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.716762+0000","last_change":"2024-06-02T04:03:06.695832+0000","last_active":"2024-06-02T04:03:08.716762+0000","last_peered":"2024-06-02T04:03:08.716762+0000","last_clean":"2024-06-02T04:03:08.716762+0000","last_became_active":"2024-06-02T04:03:06.695266+0000","last_became_peered":"2024-06-02T04:03:06.695266+0000","last_unstale":"2024-06-02T04:03:08.716762+0000","last_undegraded":"2024-06-02T04:03:08.716762+0000","last_fullsized":"2024-06-02T04:03:08.716762+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:06:27.708914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"82'5","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:12.097560+0000","last_change":"2024-06-02T04:03:06.277846+0000","last_active":"2024-06-02T04:03:12.097560+0000","last_peered":"2024-06-02T04:03:12.097560+0000","last_clean":"2024-06-02T04:03:12.097560+0000","last_became_active":"2024-06-02T04:03:06.277514+0000","last_became_peered":"2024-06-02T04:03:06.277514+0000","last_unstale":"2024-06-02T04:03:12.097560+0000","last_undegraded":"2024-06-02T04:03:12.097560+0000","last_fullsized":"2024-06-02T04:03:12.097560+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:41:20.915468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.677279+0000","last_change":"2024-06-02T04:03:06.692309+0000","last_active":"2024-06-02T04:03:07.677279+0000","last_peered":"2024-06-02T04:03:07.677279+0000","last_clean":"2024-06-02T04:03:07.677279+0000","last_became_active":"2024-06-02T04:03:06.691988+0000","last_became_peered":"2024-06-02T04:03:06.691988+0000","last_unstale":"2024-06-02T04:03:07.677279+0000","last_undegraded":"2024-06-02T04:03:07.677279+0000","last_fullsized":"2024-06-02T04:03:07.677279+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:19:08.790807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'5","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:43.134693+0000","last_change":"2024-06-02T04:03:06.271789+0000","last_active":"2024-06-02T04:03:43.134693+0000","last_peered":"2024-06-02T04:03:43.134693+0000","last_clean":"2024-06-02T04:03:43.134693+0000","last_became_active":"2024-06-02T04:03:06.271482+0000","last_became_peered":"2024-06-02T04:03:06.271482+0000","last_unstale":"2024-06-02T04:03:43.134693+0000","last_undegraded":"2024-06-02T04:03:43.134693+0000","last_fullsized":"2024-06-02T04:03:43.134693+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:23:10.065847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":36,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.885786+0000","last_change":"2024-06-02T04:03:06.690544+0000","last_active":"2024-06-02T04:03:07.885786+0000","last_peered":"2024-06-02T04:03:07.885786+0000","last_clean":"2024-06-02T04:03:07.885786+0000","last_became_active":"2024-06-02T04:03:06.687225+0000","last_became_peered":"2024-06-02T04:03:06.687225+0000","last_unstale":"2024-06-02T04:03:07.885786+0000","last_undegraded":"2024-06-02T04:03:07.885786+0000","last_fullsized":"2024-06-02T04:03:07.885786+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:26:44.414575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"82'7","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.089094+0000","last_change":"2024-06-02T04:03:06.269559+0000","last_active":"2024-06-02T04:03:11.089094+0000","last_peered":"2024-06-02T04:03:11.089094+0000","last_clean":"2024-06-02T04:03:11.089094+0000","last_became_active":"2024-06-02T04:03:06.269211+0000","last_became_peered":"2024-06-02T04:03:06.269211+0000","last_unstale":"2024-06-02T04:03:11.089094+0000","last_undegraded":"2024-06-02T04:03:11.089094+0000","last_fullsized":"2024-06-02T04:03:11.089094+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:28:39.167267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.677438+0000","last_change":"2024-06-02T04:03:06.692224+0000","last_active":"2024-06-02T04:03:07.677438+0000","last_peered":"2024-06-02T04:03:07.677438+0000","last_clean":"2024-06-02T04:03:07.677438+0000","last_became_active":"2024-06-02T04:03:06.691664+0000","last_became_peered":"2024-06-02T04:03:06.691664+0000","last_unstale":"2024-06-02T04:03:07.677438+0000","last_undegraded":"2024-06-02T04:03:07.677438+0000","last_fullsized":"2024-06-02T04:03:07.677438+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:12:17.679245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"82'3","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:10.717094+0000","last_change":"2024-06-02T04:03:06.268602+0000","last_active":"2024-06-02T04:03:10.717094+0000","last_peered":"2024-06-02T04:03:10.717094+0000","last_clean":"2024-06-02T04:03:10.717094+0000","last_became_active":"2024-06-02T04:03:06.268268+0000","last_became_peered":"2024-06-02T04:03:06.268268+0000","last_unstale":"2024-06-02T04:03:10.717094+0000","last_undegraded":"2024-06-02T04:03:10.717094+0000","last_fullsized":"2024-06-02T04:03:10.717094+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:29:40.033649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676424+0000","last_change":"2024-06-02T04:03:06.687534+0000","last_active":"2024-06-02T04:03:07.676424+0000","last_peered":"2024-06-02T04:03:07.676424+0000","last_clean":"2024-06-02T04:03:07.676424+0000","last_became_active":"2024-06-02T04:03:06.687210+0000","last_became_peered":"2024-06-02T04:03:06.687210+0000","last_unstale":"2024-06-02T04:03:07.676424+0000","last_undegraded":"2024-06-02T04:03:07.676424+0000","last_fullsized":"2024-06-02T04:03:07.676424+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:09:54.479287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"82'3","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:12.096635+0000","last_change":"2024-06-02T04:03:06.275477+0000","last_active":"2024-06-02T04:03:12.096635+0000","last_peered":"2024-06-02T04:03:12.096635+0000","last_clean":"2024-06-02T04:03:12.096635+0000","last_became_active":"2024-06-02T04:03:06.275091+0000","last_became_peered":"2024-06-02T04:03:06.275091+0000","last_unstale":"2024-06-02T04:03:12.096635+0000","last_undegraded":"2024-06-02T04:03:12.096635+0000","last_fullsized":"2024-06-02T04:03:12.096635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:30:49.126971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:09.706733+0000","last_change":"2024-06-02T04:03:06.685908+0000","last_active":"2024-06-02T04:03:09.706733+0000","last_peered":"2024-06-02T04:03:09.706733+0000","last_clean":"2024-06-02T04:03:09.706733+0000","last_became_active":"2024-06-02T04:03:06.685572+0000","last_became_peered":"2024-06-02T04:03:06.685572+0000","last_unstale":"2024-06-02T04:03:09.706733+0000","last_undegraded":"2024-06-02T04:03:09.706733+0000","last_fullsized":"2024-06-02T04:03:09.706733+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:31:35.685227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'4","reported_seq":88,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:47.139792+0000","last_change":"2024-06-02T04:03:06.274773+0000","last_active":"2024-06-02T04:03:47.139792+0000","last_peered":"2024-06-02T04:03:47.139792+0000","last_clean":"2024-06-02T04:03:47.139792+0000","last_became_active":"2024-06-02T04:03:06.274434+0000","last_became_peered":"2024-06-02T04:03:06.274434+0000","last_unstale":"2024-06-02T04:03:47.139792+0000","last_undegraded":"2024-06-02T04:03:47.139792+0000","last_fullsized":"2024-06-02T04:03:47.139792+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:46:41.681535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":72,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.717119+0000","last_change":"2024-06-02T04:03:06.702113+0000","last_active":"2024-06-02T04:03:08.717119+0000","last_peered":"2024-06-02T04:03:08.717119+0000","last_clean":"2024-06-02T04:03:08.717119+0000","last_became_active":"2024-06-02T04:03:06.701811+0000","last_became_peered":"2024-06-02T04:03:06.701811+0000","last_unstale":"2024-06-02T04:03:08.717119+0000","last_undegraded":"2024-06-02T04:03:08.717119+0000","last_fullsized":"2024-06-02T04:03:08.717119+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:04:28.772781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"82'4","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:12.096720+0000","last_change":"2024-06-02T04:03:06.278195+0000","last_active":"2024-06-02T04:03:12.096720+0000","last_peered":"2024-06-02T04:03:12.096720+0000","last_clean":"2024-06-02T04:03:12.096720+0000","last_became_active":"2024-06-02T04:03:06.277813+0000","last_became_peered":"2024-06-02T04:03:06.277813+0000","last_unstale":"2024-06-02T04:03:12.096720+0000","last_undegraded":"2024-06-02T04:03:12.096720+0000","last_fullsized":"2024-06-02T04:03:12.096720+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:50:31.381498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.693641+0000","last_change":"2024-06-02T04:03:06.691247+0000","last_active":"2024-06-02T04:03:06.693641+0000","last_peered":"2024-06-02T04:03:06.693641+0000","last_clean":"2024-06-02T04:03:06.693641+0000","last_became_active":"2024-06-02T04:03:06.689936+0000","last_became_peered":"2024-06-02T04:03:06.689936+0000","last_unstale":"2024-06-02T04:03:06.693641+0000","last_undegraded":"2024-06-02T04:03:06.693641+0000","last_fullsized":"2024-06-02T04:03:06.693641+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:47:36.577989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"82'5","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.082992+0000","last_change":"2024-06-02T04:03:06.271582+0000","last_active":"2024-06-02T04:03:11.082992+0000","last_peered":"2024-06-02T04:03:11.082992+0000","last_clean":"2024-06-02T04:03:11.082992+0000","last_became_active":"2024-06-02T04:03:06.271252+0000","last_became_peered":"2024-06-02T04:03:06.271252+0000","last_unstale":"2024-06-02T04:03:11.082992+0000","last_undegraded":"2024-06-02T04:03:11.082992+0000","last_fullsized":"2024-06-02T04:03:11.082992+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:21:30.861205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.716823+0000","last_change":"2024-06-02T04:03:06.698345+0000","last_active":"2024-06-02T04:03:08.716823+0000","last_peered":"2024-06-02T04:03:08.716823+0000","last_clean":"2024-06-02T04:03:08.716823+0000","last_became_active":"2024-06-02T04:03:06.698003+0000","last_became_peered":"2024-06-02T04:03:06.698003+0000","last_unstale":"2024-06-02T04:03:08.716823+0000","last_undegraded":"2024-06-02T04:03:08.716823+0000","last_fullsized":"2024-06-02T04:03:08.716823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:53:13.866319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'29","reported_seq":122,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:47.146243+0000","last_change":"2024-06-02T04:03:06.276367+0000","last_active":"2024-06-02T04:03:47.146243+0000","last_peered":"2024-06-02T04:03:47.146243+0000","last_clean":"2024-06-02T04:03:47.146243+0000","last_became_active":"2024-06-02T04:03:06.276006+0000","last_became_peered":"2024-06-02T04:03:06.276006+0000","last_unstale":"2024-06-02T04:03:47.146243+0000","last_undegraded":"2024-06-02T04:03:47.146243+0000","last_fullsized":"2024-06-02T04:03:47.146243+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:43:26.353155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59348,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":81,"num_read_kb":98,"num_write":31,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.885854+0000","last_change":"2024-06-02T04:03:06.689688+0000","last_active":"2024-06-02T04:03:07.885854+0000","last_peered":"2024-06-02T04:03:07.885854+0000","last_clean":"2024-06-02T04:03:07.885854+0000","last_became_active":"2024-06-02T04:03:06.686870+0000","last_became_peered":"2024-06-02T04:03:06.686870+0000","last_unstale":"2024-06-02T04:03:07.885854+0000","last_undegraded":"2024-06-02T04:03:07.885854+0000","last_fullsized":"2024-06-02T04:03:07.885854+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:46:20.489444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"82'9","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:12.097124+0000","last_change":"2024-06-02T04:03:06.275950+0000","last_active":"2024-06-02T04:03:12.097124+0000","last_peered":"2024-06-02T04:03:12.097124+0000","last_clean":"2024-06-02T04:03:12.097124+0000","last_became_active":"2024-06-02T04:03:06.274800+0000","last_became_peered":"2024-06-02T04:03:06.274800+0000","last_unstale":"2024-06-02T04:03:12.097124+0000","last_undegraded":"2024-06-02T04:03:12.097124+0000","last_fullsized":"2024-06-02T04:03:12.097124+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:17:36.352933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.967722+0000","last_change":"2024-06-02T04:03:06.687332+0000","last_active":"2024-06-02T04:03:06.967722+0000","last_peered":"2024-06-02T04:03:06.967722+0000","last_clean":"2024-06-02T04:03:06.967722+0000","last_became_active":"2024-06-02T04:03:06.687056+0000","last_became_peered":"2024-06-02T04:03:06.687056+0000","last_unstale":"2024-06-02T04:03:06.967722+0000","last_undegraded":"2024-06-02T04:03:06.967722+0000","last_fullsized":"2024-06-02T04:03:06.967722+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:16:58.069559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"82'5","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:12.096615+0000","last_change":"2024-06-02T04:03:06.267618+0000","last_active":"2024-06-02T04:03:12.096615+0000","last_peered":"2024-06-02T04:03:12.096615+0000","last_clean":"2024-06-02T04:03:12.096615+0000","last_became_active":"2024-06-02T04:03:06.267326+0000","last_became_peered":"2024-06-02T04:03:06.267326+0000","last_unstale":"2024-06-02T04:03:12.096615+0000","last_undegraded":"2024-06-02T04:03:12.096615+0000","last_fullsized":"2024-06-02T04:03:12.096615+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:20:19.794922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.645046+0000","last_change":"2024-06-02T04:03:06.693973+0000","last_active":"2024-06-02T04:03:08.645046+0000","last_peered":"2024-06-02T04:03:08.645046+0000","last_clean":"2024-06-02T04:03:08.645046+0000","last_became_active":"2024-06-02T04:03:06.693628+0000","last_became_peered":"2024-06-02T04:03:06.693628+0000","last_unstale":"2024-06-02T04:03:08.645046+0000","last_undegraded":"2024-06-02T04:03:08.645046+0000","last_fullsized":"2024-06-02T04:03:08.645046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:03:52.865564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":57,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:45.136880+0000","last_change":"2024-06-02T04:03:06.279086+0000","last_active":"2024-06-02T04:03:45.136880+0000","last_peered":"2024-06-02T04:03:45.136880+0000","last_clean":"2024-06-02T04:03:45.136880+0000","last_became_active":"2024-06-02T04:03:06.278737+0000","last_became_peered":"2024-06-02T04:03:06.278737+0000","last_unstale":"2024-06-02T04:03:45.136880+0000","last_undegraded":"2024-06-02T04:03:45.136880+0000","last_fullsized":"2024-06-02T04:03:45.136880+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:13:49.888951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":933,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.644652+0000","last_change":"2024-06-02T04:03:06.691126+0000","last_active":"2024-06-02T04:03:08.644652+0000","last_peered":"2024-06-02T04:03:08.644652+0000","last_clean":"2024-06-02T04:03:08.644652+0000","last_became_active":"2024-06-02T04:03:06.690758+0000","last_became_peered":"2024-06-02T04:03:06.690758+0000","last_unstale":"2024-06-02T04:03:08.644652+0000","last_undegraded":"2024-06-02T04:03:08.644652+0000","last_fullsized":"2024-06-02T04:03:08.644652+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:51:27.524477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"82'17","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.089923+0000","last_change":"2024-06-02T04:03:06.271837+0000","last_active":"2024-06-02T04:03:11.089923+0000","last_peered":"2024-06-02T04:03:11.089923+0000","last_clean":"2024-06-02T04:03:11.089923+0000","last_became_active":"2024-06-02T04:03:06.271523+0000","last_became_peered":"2024-06-02T04:03:06.271523+0000","last_unstale":"2024-06-02T04:03:11.089923+0000","last_undegraded":"2024-06-02T04:03:11.089923+0000","last_fullsized":"2024-06-02T04:03:11.089923+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:55:14.738237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676954+0000","last_change":"2024-06-02T04:03:06.690646+0000","last_active":"2024-06-02T04:03:07.676954+0000","last_peered":"2024-06-02T04:03:07.676954+0000","last_clean":"2024-06-02T04:03:07.676954+0000","last_became_active":"2024-06-02T04:03:06.690333+0000","last_became_peered":"2024-06-02T04:03:06.690333+0000","last_unstale":"2024-06-02T04:03:07.676954+0000","last_undegraded":"2024-06-02T04:03:07.676954+0000","last_fullsized":"2024-06-02T04:03:07.676954+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:18:41.987031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"82'2","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.077972+0000","last_change":"2024-06-02T04:03:06.268892+0000","last_active":"2024-06-02T04:03:11.077972+0000","last_peered":"2024-06-02T04:03:11.077972+0000","last_clean":"2024-06-02T04:03:11.077972+0000","last_became_active":"2024-06-02T04:03:06.268559+0000","last_became_peered":"2024-06-02T04:03:06.268559+0000","last_unstale":"2024-06-02T04:03:11.077972+0000","last_undegraded":"2024-06-02T04:03:11.077972+0000","last_fullsized":"2024-06-02T04:03:11.077972+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:06:34.378769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.001506+0000","last_change":"2024-06-02T04:03:06.688371+0000","last_active":"2024-06-02T04:03:08.001506+0000","last_peered":"2024-06-02T04:03:08.001506+0000","last_clean":"2024-06-02T04:03:08.001506+0000","last_became_active":"2024-06-02T04:03:06.688046+0000","last_became_peered":"2024-06-02T04:03:06.688046+0000","last_unstale":"2024-06-02T04:03:08.001506+0000","last_undegraded":"2024-06-02T04:03:08.001506+0000","last_fullsized":"2024-06-02T04:03:08.001506+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:14:40.534799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"82'1","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:09.716112+0000","last_change":"2024-06-02T04:03:06.274055+0000","last_active":"2024-06-02T04:03:09.716112+0000","last_peered":"2024-06-02T04:03:09.716112+0000","last_clean":"2024-06-02T04:03:09.716112+0000","last_became_active":"2024-06-02T04:03:06.273709+0000","last_became_peered":"2024-06-02T04:03:06.273709+0000","last_unstale":"2024-06-02T04:03:09.716112+0000","last_undegraded":"2024-06-02T04:03:09.716112+0000","last_fullsized":"2024-06-02T04:03:09.716112+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:44:13.256272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:09.192257+0000","last_change":"2024-06-02T04:03:06.686391+0000","last_active":"2024-06-02T04:03:09.192257+0000","last_peered":"2024-06-02T04:03:09.192257+0000","last_clean":"2024-06-02T04:03:09.192257+0000","last_became_active":"2024-06-02T04:03:06.686086+0000","last_became_peered":"2024-06-02T04:03:06.686086+0000","last_unstale":"2024-06-02T04:03:09.192257+0000","last_undegraded":"2024-06-02T04:03:09.192257+0000","last_fullsized":"2024-06-02T04:03:09.192257+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:06:23.572438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"82'5","reported_seq":49,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:42.146489+0000","last_change":"2024-06-02T04:03:06.278278+0000","last_active":"2024-06-02T04:03:42.146489+0000","last_peered":"2024-06-02T04:03:42.146489+0000","last_clean":"2024-06-02T04:03:42.146489+0000","last_became_active":"2024-06-02T04:03:06.277736+0000","last_became_peered":"2024-06-02T04:03:06.277736+0000","last_unstale":"2024-06-02T04:03:42.146489+0000","last_undegraded":"2024-06-02T04:03:42.146489+0000","last_fullsized":"2024-06-02T04:03:42.146489+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:51:30.458708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.043607+0000","last_change":"2024-06-02T04:03:06.694551+0000","last_active":"2024-06-02T04:03:08.043607+0000","last_peered":"2024-06-02T04:03:08.043607+0000","last_clean":"2024-06-02T04:03:08.043607+0000","last_became_active":"2024-06-02T04:03:06.694265+0000","last_became_peered":"2024-06-02T04:03:06.694265+0000","last_unstale":"2024-06-02T04:03:08.043607+0000","last_undegraded":"2024-06-02T04:03:08.043607+0000","last_fullsized":"2024-06-02T04:03:08.043607+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T05:41:19.017514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.677003+0000","last_change":"2024-06-02T04:03:06.690869+0000","last_active":"2024-06-02T04:03:07.677003+0000","last_peered":"2024-06-02T04:03:07.677003+0000","last_clean":"2024-06-02T04:03:07.677003+0000","last_became_active":"2024-06-02T04:03:06.690302+0000","last_became_peered":"2024-06-02T04:03:06.690302+0000","last_unstale":"2024-06-02T04:03:07.677003+0000","last_undegraded":"2024-06-02T04:03:07.677003+0000","last_fullsized":"2024-06-02T04:03:07.677003+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:17:15.440309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":54,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:45.136166+0000","last_change":"2024-06-02T04:03:06.271968+0000","last_active":"2024-06-02T04:03:45.136166+0000","last_peered":"2024-06-02T04:03:45.136166+0000","last_clean":"2024-06-02T04:03:45.136166+0000","last_became_active":"2024-06-02T04:03:06.271669+0000","last_became_peered":"2024-06-02T04:03:06.271669+0000","last_unstale":"2024-06-02T04:03:45.136166+0000","last_undegraded":"2024-06-02T04:03:45.136166+0000","last_fullsized":"2024-06-02T04:03:45.136166+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:21:15.966330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676653+0000","last_change":"2024-06-02T04:03:06.694468+0000","last_active":"2024-06-02T04:03:07.676653+0000","last_peered":"2024-06-02T04:03:07.676653+0000","last_clean":"2024-06-02T04:03:07.676653+0000","last_became_active":"2024-06-02T04:03:06.693949+0000","last_became_peered":"2024-06-02T04:03:06.693949+0000","last_unstale":"2024-06-02T04:03:07.676653+0000","last_undegraded":"2024-06-02T04:03:07.676653+0000","last_fullsized":"2024-06-02T04:03:07.676653+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:30:25.539150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"82'6","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:12.096484+0000","last_change":"2024-06-02T04:03:06.271658+0000","last_active":"2024-06-02T04:03:12.096484+0000","last_peered":"2024-06-02T04:03:12.096484+0000","last_clean":"2024-06-02T04:03:12.096484+0000","last_became_active":"2024-06-02T04:03:06.271313+0000","last_became_peered":"2024-06-02T04:03:06.271313+0000","last_unstale":"2024-06-02T04:03:12.096484+0000","last_undegraded":"2024-06-02T04:03:12.096484+0000","last_fullsized":"2024-06-02T04:03:12.096484+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:44:48.552397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":326,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.644494+0000","last_change":"2024-06-02T04:02:20.359447+0000","last_active":"2024-06-02T04:03:08.644494+0000","last_peered":"2024-06-02T04:03:08.644494+0000","last_clean":"2024-06-02T04:03:08.644494+0000","last_became_active":"2024-06-02T04:02:20.359031+0000","last_became_peered":"2024-06-02T04:02:20.359031+0000","last_unstale":"2024-06-02T04:03:08.644494+0000","last_undegraded":"2024-06-02T04:03:08.644494+0000","last_fullsized":"2024-06-02T04:03:08.644494+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T03:59:57.079508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T03:59:57.079508+0000","last_clean_scrub_stamp":"2024-06-02T03:59:57.079508+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:44:53.765578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.967686+0000","last_change":"2024-06-02T04:03:06.693309+0000","last_active":"2024-06-02T04:03:06.967686+0000","last_peered":"2024-06-02T04:03:06.967686+0000","last_clean":"2024-06-02T04:03:06.967686+0000","last_became_active":"2024-06-02T04:03:06.692961+0000","last_became_peered":"2024-06-02T04:03:06.692961+0000","last_unstale":"2024-06-02T04:03:06.967686+0000","last_undegraded":"2024-06-02T04:03:06.967686+0000","last_fullsized":"2024-06-02T04:03:06.967686+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:30:40.015091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"82'4","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:10.716861+0000","last_change":"2024-06-02T04:03:06.273144+0000","last_active":"2024-06-02T04:03:10.716861+0000","last_peered":"2024-06-02T04:03:10.716861+0000","last_clean":"2024-06-02T04:03:10.716861+0000","last_became_active":"2024-06-02T04:03:06.269431+0000","last_became_peered":"2024-06-02T04:03:06.269431+0000","last_unstale":"2024-06-02T04:03:10.716861+0000","last_undegraded":"2024-06-02T04:03:10.716861+0000","last_fullsized":"2024-06-02T04:03:10.716861+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:58:17.598214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"82'4","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.089622+0000","last_change":"2024-06-02T04:03:06.271914+0000","last_active":"2024-06-02T04:03:11.089622+0000","last_peered":"2024-06-02T04:03:11.089622+0000","last_clean":"2024-06-02T04:03:11.089622+0000","last_became_active":"2024-06-02T04:03:06.271590+0000","last_became_peered":"2024-06-02T04:03:06.271590+0000","last_unstale":"2024-06-02T04:03:11.089622+0000","last_undegraded":"2024-06-02T04:03:11.089622+0000","last_fullsized":"2024-06-02T04:03:11.089622+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T06:06:03.368086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.967766+0000","last_change":"2024-06-02T04:03:06.693154+0000","last_active":"2024-06-02T04:03:06.967766+0000","last_peered":"2024-06-02T04:03:06.967766+0000","last_clean":"2024-06-02T04:03:06.967766+0000","last_became_active":"2024-06-02T04:03:06.692873+0000","last_became_peered":"2024-06-02T04:03:06.692873+0000","last_unstale":"2024-06-02T04:03:06.967766+0000","last_undegraded":"2024-06-02T04:03:06.967766+0000","last_fullsized":"2024-06-02T04:03:06.967766+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T16:00:08.959850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'9","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:17.195511+0000","last_change":"2024-06-02T04:03:06.270804+0000","last_active":"2024-06-02T04:03:17.195511+0000","last_peered":"2024-06-02T04:03:17.195511+0000","last_clean":"2024-06-02T04:03:17.195511+0000","last_became_active":"2024-06-02T04:03:06.270479+0000","last_became_peered":"2024-06-02T04:03:06.270479+0000","last_unstale":"2024-06-02T04:03:17.195511+0000","last_undegraded":"2024-06-02T04:03:17.195511+0000","last_fullsized":"2024-06-02T04:03:17.195511+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:18:39.900900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676615+0000","last_change":"2024-06-02T04:03:06.685906+0000","last_active":"2024-06-02T04:03:07.676615+0000","last_peered":"2024-06-02T04:03:07.676615+0000","last_clean":"2024-06-02T04:03:07.676615+0000","last_became_active":"2024-06-02T04:03:06.685596+0000","last_became_peered":"2024-06-02T04:03:06.685596+0000","last_unstale":"2024-06-02T04:03:07.676615+0000","last_undegraded":"2024-06-02T04:03:07.676615+0000","last_fullsized":"2024-06-02T04:03:07.676615+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:06:13.456950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"82'7","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:12.096657+0000","last_change":"2024-06-02T04:03:06.275542+0000","last_active":"2024-06-02T04:03:12.096657+0000","last_peered":"2024-06-02T04:03:12.096657+0000","last_clean":"2024-06-02T04:03:12.096657+0000","last_became_active":"2024-06-02T04:03:06.275177+0000","last_became_peered":"2024-06-02T04:03:06.275177+0000","last_unstale":"2024-06-02T04:03:12.096657+0000","last_undegraded":"2024-06-02T04:03:12.096657+0000","last_fullsized":"2024-06-02T04:03:12.096657+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:58:35.587610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.695086+0000","last_change":"2024-06-02T04:03:06.692108+0000","last_active":"2024-06-02T04:03:06.695086+0000","last_peered":"2024-06-02T04:03:06.695086+0000","last_clean":"2024-06-02T04:03:06.695086+0000","last_became_active":"2024-06-02T04:03:06.691842+0000","last_became_peered":"2024-06-02T04:03:06.691842+0000","last_unstale":"2024-06-02T04:03:06.695086+0000","last_undegraded":"2024-06-02T04:03:06.695086+0000","last_fullsized":"2024-06-02T04:03:06.695086+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:35:10.885346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"82'2","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:09.713676+0000","last_change":"2024-06-02T04:03:06.278554+0000","last_active":"2024-06-02T04:03:09.713676+0000","last_peered":"2024-06-02T04:03:09.713676+0000","last_clean":"2024-06-02T04:03:09.713676+0000","last_became_active":"2024-06-02T04:03:06.278217+0000","last_became_peered":"2024-06-02T04:03:06.278217+0000","last_unstale":"2024-06-02T04:03:09.713676+0000","last_undegraded":"2024-06-02T04:03:09.713676+0000","last_fullsized":"2024-06-02T04:03:09.713676+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:04:37.653433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.885774+0000","last_change":"2024-06-02T04:03:06.682723+0000","last_active":"2024-06-02T04:03:07.885774+0000","last_peered":"2024-06-02T04:03:07.885774+0000","last_clean":"2024-06-02T04:03:07.885774+0000","last_became_active":"2024-06-02T04:03:06.682380+0000","last_became_peered":"2024-06-02T04:03:06.682380+0000","last_unstale":"2024-06-02T04:03:07.885774+0000","last_undegraded":"2024-06-02T04:03:07.885774+0000","last_fullsized":"2024-06-02T04:03:07.885774+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:07:56.566326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"82'7","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:12.096618+0000","last_change":"2024-06-02T04:03:06.271142+0000","last_active":"2024-06-02T04:03:12.096618+0000","last_peered":"2024-06-02T04:03:12.096618+0000","last_clean":"2024-06-02T04:03:12.096618+0000","last_became_active":"2024-06-02T04:03:06.270763+0000","last_became_peered":"2024-06-02T04:03:06.270763+0000","last_unstale":"2024-06-02T04:03:12.096618+0000","last_undegraded":"2024-06-02T04:03:12.096618+0000","last_fullsized":"2024-06-02T04:03:12.096618+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T11:23:12.842549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.001259+0000","last_change":"2024-06-02T04:03:06.690061+0000","last_active":"2024-06-02T04:03:08.001259+0000","last_peered":"2024-06-02T04:03:08.001259+0000","last_clean":"2024-06-02T04:03:08.001259+0000","last_became_active":"2024-06-02T04:03:06.689735+0000","last_became_peered":"2024-06-02T04:03:06.689735+0000","last_unstale":"2024-06-02T04:03:08.001259+0000","last_undegraded":"2024-06-02T04:03:08.001259+0000","last_fullsized":"2024-06-02T04:03:08.001259+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:14:29.096404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'3","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.760291+0000","last_change":"2024-06-02T04:03:06.273988+0000","last_active":"2024-06-02T04:03:11.760291+0000","last_peered":"2024-06-02T04:03:11.760291+0000","last_clean":"2024-06-02T04:03:11.760291+0000","last_became_active":"2024-06-02T04:03:06.273690+0000","last_became_peered":"2024-06-02T04:03:06.273690+0000","last_unstale":"2024-06-02T04:03:11.760291+0000","last_undegraded":"2024-06-02T04:03:11.760291+0000","last_fullsized":"2024-06-02T04:03:11.760291+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:55:13.758627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.677771+0000","last_change":"2024-06-02T04:03:06.697167+0000","last_active":"2024-06-02T04:03:07.677771+0000","last_peered":"2024-06-02T04:03:07.677771+0000","last_clean":"2024-06-02T04:03:07.677771+0000","last_became_active":"2024-06-02T04:03:06.696749+0000","last_became_peered":"2024-06-02T04:03:06.696749+0000","last_unstale":"2024-06-02T04:03:07.677771+0000","last_undegraded":"2024-06-02T04:03:07.677771+0000","last_fullsized":"2024-06-02T04:03:07.677771+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:20:06.736129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"82'4","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:09.709430+0000","last_change":"2024-06-02T04:03:06.271790+0000","last_active":"2024-06-02T04:03:09.709430+0000","last_peered":"2024-06-02T04:03:09.709430+0000","last_clean":"2024-06-02T04:03:09.709430+0000","last_became_active":"2024-06-02T04:03:06.271488+0000","last_became_peered":"2024-06-02T04:03:06.271488+0000","last_unstale":"2024-06-02T04:03:09.709430+0000","last_undegraded":"2024-06-02T04:03:09.709430+0000","last_fullsized":"2024-06-02T04:03:09.709430+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:45:55.514785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.644934+0000","last_change":"2024-06-02T04:03:06.700494+0000","last_active":"2024-06-02T04:03:08.644934+0000","last_peered":"2024-06-02T04:03:08.644934+0000","last_clean":"2024-06-02T04:03:08.644934+0000","last_became_active":"2024-06-02T04:03:06.700220+0000","last_became_peered":"2024-06-02T04:03:06.700220+0000","last_unstale":"2024-06-02T04:03:08.644934+0000","last_undegraded":"2024-06-02T04:03:08.644934+0000","last_fullsized":"2024-06-02T04:03:08.644934+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:25:32.547543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'5","reported_seq":53,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:45.152908+0000","last_change":"2024-06-02T04:03:06.273757+0000","last_active":"2024-06-02T04:03:45.152908+0000","last_peered":"2024-06-02T04:03:45.152908+0000","last_clean":"2024-06-02T04:03:45.152908+0000","last_became_active":"2024-06-02T04:03:06.273379+0000","last_became_peered":"2024-06-02T04:03:06.273379+0000","last_unstale":"2024-06-02T04:03:45.152908+0000","last_undegraded":"2024-06-02T04:03:45.152908+0000","last_fullsized":"2024-06-02T04:03:45.152908+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:23:09.207009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.645012+0000","last_change":"2024-06-02T04:03:06.700168+0000","last_active":"2024-06-02T04:03:08.645012+0000","last_peered":"2024-06-02T04:03:08.645012+0000","last_clean":"2024-06-02T04:03:08.645012+0000","last_became_active":"2024-06-02T04:03:06.699429+0000","last_became_peered":"2024-06-02T04:03:06.699429+0000","last_unstale":"2024-06-02T04:03:08.645012+0000","last_undegraded":"2024-06-02T04:03:08.645012+0000","last_fullsized":"2024-06-02T04:03:08.645012+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:29:08.397813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'3","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:11.088038+0000","last_change":"2024-06-02T04:03:06.275198+0000","last_active":"2024-06-02T04:03:11.088038+0000","last_peered":"2024-06-02T04:03:11.088038+0000","last_clean":"2024-06-02T04:03:11.088038+0000","last_became_active":"2024-06-02T04:03:06.274649+0000","last_became_peered":"2024-06-02T04:03:06.274649+0000","last_unstale":"2024-06-02T04:03:11.088038+0000","last_undegraded":"2024-06-02T04:03:11.088038+0000","last_fullsized":"2024-06-02T04:03:11.088038+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:37:45.091471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'1","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.936463+0000","last_change":"2024-06-02T04:03:06.690309+0000","last_active":"2024-06-02T04:03:08.936463+0000","last_peered":"2024-06-02T04:03:08.936463+0000","last_clean":"2024-06-02T04:03:08.936463+0000","last_became_active":"2024-06-02T04:03:06.689986+0000","last_became_peered":"2024-06-02T04:03:06.689986+0000","last_unstale":"2024-06-02T04:03:08.936463+0000","last_undegraded":"2024-06-02T04:03:08.936463+0000","last_fullsized":"2024-06-02T04:03:08.936463+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T12:12:18.237133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"82'5","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:12.096732+0000","last_change":"2024-06-02T04:03:06.272947+0000","last_active":"2024-06-02T04:03:12.096732+0000","last_peered":"2024-06-02T04:03:12.096732+0000","last_clean":"2024-06-02T04:03:12.096732+0000","last_became_active":"2024-06-02T04:03:06.272632+0000","last_became_peered":"2024-06-02T04:03:06.272632+0000","last_unstale":"2024-06-02T04:03:12.096732+0000","last_undegraded":"2024-06-02T04:03:12.096732+0000","last_fullsized":"2024-06-02T04:03:12.096732+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:05.249059+0000","last_clean_scrub_stamp":"2024-06-02T04:03:05.249059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:01:16.085575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.645113+0000","last_change":"2024-06-02T04:03:06.701506+0000","last_active":"2024-06-02T04:03:08.645113+0000","last_peered":"2024-06-02T04:03:08.645113+0000","last_clean":"2024-06-02T04:03:08.645113+0000","last_became_active":"2024-06-02T04:03:06.701202+0000","last_became_peered":"2024-06-02T04:03:06.701202+0000","last_unstale":"2024-06-02T04:03:08.645113+0000","last_undegraded":"2024-06-02T04:03:08.645113+0000","last_fullsized":"2024-06-02T04:03:08.645113+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:35:07.269775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.001325+0000","last_change":"2024-06-02T04:03:06.689400+0000","last_active":"2024-06-02T04:03:08.001325+0000","last_peered":"2024-06-02T04:03:08.001325+0000","last_clean":"2024-06-02T04:03:08.001325+0000","last_became_active":"2024-06-02T04:03:06.689044+0000","last_became_peered":"2024-06-02T04:03:06.689044+0000","last_unstale":"2024-06-02T04:03:08.001325+0000","last_undegraded":"2024-06-02T04:03:08.001325+0000","last_fullsized":"2024-06-02T04:03:08.001325+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:52:30.633358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.701754+0000","last_change":"2024-06-02T04:03:06.698863+0000","last_active":"2024-06-02T04:03:06.701754+0000","last_peered":"2024-06-02T04:03:06.701754+0000","last_clean":"2024-06-02T04:03:06.701754+0000","last_became_active":"2024-06-02T04:03:06.698580+0000","last_became_peered":"2024-06-02T04:03:06.698580+0000","last_unstale":"2024-06-02T04:03:06.701754+0000","last_undegraded":"2024-06-02T04:03:06.701754+0000","last_fullsized":"2024-06-02T04:03:06.701754+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T08:37:17.956746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.699107+0000","last_change":"2024-06-02T04:03:06.691634+0000","last_active":"2024-06-02T04:03:06.699107+0000","last_peered":"2024-06-02T04:03:06.699107+0000","last_clean":"2024-06-02T04:03:06.699107+0000","last_became_active":"2024-06-02T04:03:06.691270+0000","last_became_peered":"2024-06-02T04:03:06.691270+0000","last_unstale":"2024-06-02T04:03:06.699107+0000","last_undegraded":"2024-06-02T04:03:06.699107+0000","last_fullsized":"2024-06-02T04:03:06.699107+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:36:27.879519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.691816+0000","last_change":"2024-06-02T04:03:06.688290+0000","last_active":"2024-06-02T04:03:06.691816+0000","last_peered":"2024-06-02T04:03:06.691816+0000","last_clean":"2024-06-02T04:03:06.691816+0000","last_became_active":"2024-06-02T04:03:06.687970+0000","last_became_peered":"2024-06-02T04:03:06.687970+0000","last_unstale":"2024-06-02T04:03:06.691816+0000","last_undegraded":"2024-06-02T04:03:06.691816+0000","last_fullsized":"2024-06-02T04:03:06.691816+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:48:03.513694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.967775+0000","last_change":"2024-06-02T04:03:06.690498+0000","last_active":"2024-06-02T04:03:06.967775+0000","last_peered":"2024-06-02T04:03:06.967775+0000","last_clean":"2024-06-02T04:03:06.967775+0000","last_became_active":"2024-06-02T04:03:06.689698+0000","last_became_peered":"2024-06-02T04:03:06.689698+0000","last_unstale":"2024-06-02T04:03:06.967775+0000","last_undegraded":"2024-06-02T04:03:06.967775+0000","last_fullsized":"2024-06-02T04:03:06.967775+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:39:12.912589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.001349+0000","last_change":"2024-06-02T04:03:06.694551+0000","last_active":"2024-06-02T04:03:08.001349+0000","last_peered":"2024-06-02T04:03:08.001349+0000","last_clean":"2024-06-02T04:03:08.001349+0000","last_became_active":"2024-06-02T04:03:06.694266+0000","last_became_peered":"2024-06-02T04:03:06.694266+0000","last_unstale":"2024-06-02T04:03:08.001349+0000","last_undegraded":"2024-06-02T04:03:08.001349+0000","last_fullsized":"2024-06-02T04:03:08.001349+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T13:53:29.168620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.699460+0000","last_change":"2024-06-02T04:03:06.693639+0000","last_active":"2024-06-02T04:03:06.699460+0000","last_peered":"2024-06-02T04:03:06.699460+0000","last_clean":"2024-06-02T04:03:06.699460+0000","last_became_active":"2024-06-02T04:03:06.693283+0000","last_became_peered":"2024-06-02T04:03:06.693283+0000","last_unstale":"2024-06-02T04:03:06.699460+0000","last_undegraded":"2024-06-02T04:03:06.699460+0000","last_fullsized":"2024-06-02T04:03:06.699460+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:12:48.614632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676611+0000","last_change":"2024-06-02T04:03:06.689335+0000","last_active":"2024-06-02T04:03:07.676611+0000","last_peered":"2024-06-02T04:03:07.676611+0000","last_clean":"2024-06-02T04:03:07.676611+0000","last_became_active":"2024-06-02T04:03:06.688986+0000","last_became_peered":"2024-06-02T04:03:06.688986+0000","last_unstale":"2024-06-02T04:03:07.676611+0000","last_undegraded":"2024-06-02T04:03:07.676611+0000","last_fullsized":"2024-06-02T04:03:07.676611+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T15:16:44.138633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676833+0000","last_change":"2024-06-02T04:03:06.690694+0000","last_active":"2024-06-02T04:03:07.676833+0000","last_peered":"2024-06-02T04:03:07.676833+0000","last_clean":"2024-06-02T04:03:07.676833+0000","last_became_active":"2024-06-02T04:03:06.689684+0000","last_became_peered":"2024-06-02T04:03:06.689684+0000","last_unstale":"2024-06-02T04:03:07.676833+0000","last_undegraded":"2024-06-02T04:03:07.676833+0000","last_fullsized":"2024-06-02T04:03:07.676833+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T10:32:48.564501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:07.676294+0000","last_change":"2024-06-02T04:03:06.692851+0000","last_active":"2024-06-02T04:03:07.676294+0000","last_peered":"2024-06-02T04:03:07.676294+0000","last_clean":"2024-06-02T04:03:07.676294+0000","last_became_active":"2024-06-02T04:03:06.688996+0000","last_became_peered":"2024-06-02T04:03:06.688996+0000","last_unstale":"2024-06-02T04:03:07.676294+0000","last_undegraded":"2024-06-02T04:03:07.676294+0000","last_fullsized":"2024-06-02T04:03:07.676294+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T07:21:54.779246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.716881+0000","last_change":"2024-06-02T04:03:06.704472+0000","last_active":"2024-06-02T04:03:08.716881+0000","last_peered":"2024-06-02T04:03:08.716881+0000","last_clean":"2024-06-02T04:03:08.716881+0000","last_became_active":"2024-06-02T04:03:06.704173+0000","last_became_peered":"2024-06-02T04:03:06.704173+0000","last_unstale":"2024-06-02T04:03:08.716881+0000","last_undegraded":"2024-06-02T04:03:08.716881+0000","last_fullsized":"2024-06-02T04:03:08.716881+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T04:48:26.362945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-06-02T04:03:06.967756+0000","last_change":"2024-06-02T04:03:06.688238+0000","last_active":"2024-06-02T04:03:06.967756+0000","last_peered":"2024-06-02T04:03:06.967756+0000","last_clean":"2024-06-02T04:03:06.967756+0000","last_became_active":"2024-06-02T04:03:06.687925+0000","last_became_peered":"2024-06-02T04:03:06.687925+0000","last_unstale":"2024-06-02T04:03:06.967756+0000","last_undegraded":"2024-06-02T04:03:06.967756+0000","last_fullsized":"2024-06-02T04:03:06.967756+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T14:15:19.314864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-06-02T04:03:08.001280+0000","last_change":"2024-06-02T04:03:06.685210+0000","last_active":"2024-06-02T04:03:08.001280+0000","last_peered":"2024-06-02T04:03:08.001280+0000","last_clean":"2024-06-02T04:03:08.001280+0000","last_became_active":"2024-06-02T04:03:06.684819+0000","last_became_peered":"2024-06-02T04:03:06.684819+0000","last_unstale":"2024-06-02T04:03:08.001280+0000","last_undegraded":"2024-06-02T04:03:08.001280+0000","last_fullsized":"2024-06-02T04:03:08.001280+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-06-02T04:03:06.253055+0000","last_clean_scrub_stamp":"2024-06-02T04:03:06.253055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-06-03T09:05:55.275556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":284198,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65971,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":387,"num_read_kb":269,"num_write":229,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":197913,"data_compressed":5517,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481810,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31984,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713168,"statfs":{"total":95995035648,"available":95962284032,"internally_reserved":0,"allocated":892928,"data_stored":426260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:03:35 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.52800000000000002}]},{"osd":1,"last update":"Sun Jun 2 04:03:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.64000000000000001}]},{"osd":2,"last update":"Sun Jun 2 04:03:35 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.375},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.40000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Sun Jun 2 04:03:35 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.44400000000000001}]},{"osd":5,"last update":"Sun Jun 2 04:03:35 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.67200000000000004}]},{"osd":6,"last update":"Sun Jun 2 04:03:35 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.56200000000000006}]},{"osd":7,"last update":"Sun Jun 2 04:03:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.71999999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":9,"last update":"Sun Jun 2 04:03:35 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.746}]},{"osd":10,"last update":"Sun Jun 2 04:03:35 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":0.69999999999999996}]}]},{"osd":10,"up_from":70,"seq":300647710741,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1044480,"data_stored":1077030,"data_compressed":37978,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":1,"last update":"Sun Jun 2 04:03:18 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.51500000000000001}]},{"osd":2,"last update":"Sun Jun 2 04:03:18 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.61799999999999999}]},{"osd":3,"last update":"Sun Jun 2 04:03:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.59399999999999997}]},{"osd":4,"last update":"Sun Jun 2 04:03:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.53100000000000003}]},{"osd":5,"last update":"Sun Jun 2 04:03:18 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.78300000000000003}]},{"osd":6,"last update":"Sun Jun 2 04:03:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":8,"last update":"Sun Jun 2 04:03:18 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.75800000000000001}]},{"osd":9,"last update":"Sun Jun 2 04:03:18 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.872},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.84799999999999998}]},{"osd":11,"last update":"Sun Jun 2 04:03:37 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.748}]}]},{"osd":9,"up_from":64,"seq":274877906969,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":917504,"data_stored":426238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.315}]},{"osd":1,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.33800000000000002}]},{"osd":2,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.57799999999999996}]},{"osd":3,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.36599999999999999}]},{"osd":4,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.52600000000000002}]},{"osd":5,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.69799999999999995}]},{"osd":6,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.70899999999999996}]},{"osd":7,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.45300000000000001}]},{"osd":8,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.65200000000000002}]},{"osd":10,"last update":"Sun Jun 2 04:03:17 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.624}]}]},{"osd":8,"up_from":57,"seq":244813135901,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32000,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713152,"statfs":{"total":95995035648,"available":95962267648,"internally_reserved":0,"allocated":909312,"data_stored":426299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.38700000000000001}]},{"osd":1,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.53900000000000003}]},{"osd":2,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.33800000000000002}]},{"osd":3,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.49399999999999999}]},{"osd":4,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.69399999999999995}]},{"osd":5,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.435},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.52100000000000002}]},{"osd":6,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.67600000000000005}]},{"osd":7,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.71899999999999997}]},{"osd":9,"last update":"Sun Jun 2 04:03:00 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1,"5min":1,"15min":1},"last":0.629},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.59599999999999997}]},{"osd":10,"last update":"Sun Jun 2 04:03:17 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.745},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.79500000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":7,"up_from":49,"seq":210453397535,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":1018992,"data_compressed":36139,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.312}]},{"osd":1,"last update":"Sun Jun 2 04:03:24 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.42799999999999999,"15min":0.42599999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.55100000000000005,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.44900000000000001,"15min":0.44700000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.35399999999999998}]},{"osd":2,"last update":"Sun Jun 2 04:03:24 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56299999999999994,"15min":0.55500000000000005},"min":{"1min":0.34499999999999997,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.78900000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.37},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.56699999999999995}]},{"osd":3,"last update":"Sun Jun 2 04:03:24 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.57399999999999995,"15min":0.56999999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.81499999999999995,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.41799999999999998}]},{"osd":4,"last update":"Sun Jun 2 04:03:24 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.68500000000000005,"5min":0.753,"15min":0.753},"last":0.46600000000000003}]},{"osd":5,"last update":"Sun Jun 2 04:03:24 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61499999999999999,"15min":0.60899999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.86399999999999999,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.502},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.63100000000000001,"15min":0.627},"min":{"1min":0.48699999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.60399999999999998}]},{"osd":6,"last update":"Sun Jun 2 04:03:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64100000000000001,"15min":0.63600000000000001},"min":{"1min":0.44800000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.64100000000000001,"15min":0.63800000000000001},"min":{"1min":0.45800000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.53900000000000003}]},{"osd":8,"last update":"Sun Jun 2 04:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.58399999999999996}]},{"osd":9,"last update":"Sun Jun 2 04:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.55500000000000005}]},{"osd":10,"last update":"Sun Jun 2 04:03:17 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.621},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.70899999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]}]},{"osd":6,"up_from":44,"seq":188978561059,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":425907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:03:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.36699999999999999,"15min":0.36099999999999999},"min":{"1min":0.28399999999999997,"5min":0.246,"15min":0.246},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.189},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.38900000000000001,"15min":0.38300000000000001},"min":{"1min":0.28199999999999997,"5min":0.246,"15min":0.246},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.70899999999999996}]},{"osd":1,"last update":"Sun Jun 2 04:03:06 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.52700000000000002,"15min":0.51500000000000001},"min":{"1min":0.38700000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.46400000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.22}]},{"osd":2,"last update":"Sun Jun 2 04:03:06 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.371,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.72199999999999998,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.32700000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.39800000000000002}]},{"osd":3,"last update":"Sun Jun 2 04:03:06 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45400000000000001,"15min":0.45100000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.37},{"interface":"front","average":{"1min":0.495,"5min":0.46999999999999997,"15min":0.46600000000000003},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.83399999999999996}]},{"osd":4,"last update":"Sun Jun 2 04:03:06 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.39200000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77200000000000002,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.59999999999999998,"15min":0.58699999999999997},"min":{"1min":0.434,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.45600000000000002}]},{"osd":5,"last update":"Sun Jun 2 04:03:06 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.622,"15min":0.623},"min":{"1min":0.432,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.441},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.625,"15min":0.63200000000000001},"min":{"1min":0.42199999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85499999999999998,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.85699999999999998}]},{"osd":7,"last update":"Sun Jun 2 04:03:30 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63100000000000001,"15min":0.63500000000000001},"min":{"1min":0.45300000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89700000000000002,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.65200000000000002,"15min":0.65700000000000003},"min":{"1min":0.44400000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90300000000000002,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.51100000000000001}]},{"osd":8,"last update":"Sun Jun 2 04:03:46 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63800000000000001,"15min":0.64100000000000001},"min":{"1min":0.47799999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.78100000000000003,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.65200000000000002,"15min":0.66000000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73099999999999998,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.38100000000000001}]},{"osd":9,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1,"5min":1,"15min":1},"last":0.28699999999999998}]},{"osd":10,"last update":"Sun Jun 2 04:03:17 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.53500000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":958464,"data_stored":486168,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:02:47 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.47799999999999998,"15min":0.46600000000000003},"min":{"1min":0.32500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.504,"5min":0.49099999999999999,"15min":0.48099999999999998},"min":{"1min":0.36599999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.502}]},{"osd":2,"last update":"Sun Jun 2 04:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.52500000000000002,"15min":0.50700000000000001},"min":{"1min":0.375,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.62},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.52000000000000002,"15min":0.51600000000000001},"min":{"1min":0.39300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.54000000000000004}]},{"osd":3,"last update":"Sun Jun 2 04:03:18 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.67700000000000005,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.40100000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79900000000000004,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.55500000000000005}]},{"osd":4,"last update":"Sun Jun 2 04:03:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.442,"15min":0.42299999999999999},"min":{"1min":0.34499999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.42599999999999999,"15min":0.41399999999999998},"min":{"1min":0.27700000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.443}]},{"osd":5,"last update":"Sun Jun 2 04:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.42499999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.36299999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.60399999999999998}]},{"osd":6,"last update":"Sun Jun 2 04:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.39400000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59499999999999997,"15min":0.59399999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.79600000000000004}]},{"osd":7,"last update":"Sun Jun 2 04:03:28 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.51500000000000001,"15min":0.495},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.52600000000000002,"15min":0.503},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.56699999999999995}]},{"osd":8,"last update":"Sun Jun 2 04:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.71899999999999997}]},{"osd":9,"last update":"Sun Jun 2 04:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.70899999999999996}]},{"osd":10,"last update":"Sun Jun 2 04:03:18 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.749},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.755}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738424,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":427246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jun 2 04:02:45 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52100000000000002,"15min":0.51500000000000001},"min":{"1min":0.30399999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.626},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.501,"15min":0.49199999999999999},"min":{"1min":0.36299999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.70099999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.502}]},{"osd":2,"last update":"Sun Jun 2 04:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.624,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54800000000000004,"15min":0.54300000000000004},"min":{"1min":0.41099999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.65900000000000003,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.47499999999999998}]},{"osd":3,"last update":"Sun Jun 2 04:02:17 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.59599999999999997,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.316},{"interface":"front","average":{"1min":0.433,"5min":0.41699999999999998,"15min":0.41399999999999998},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.65200000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.379}]},{"osd":4,"last update":"Sun Jun 2 04:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56399999999999995,"15min":0.56200000000000006},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55200000000000005,"15min":0.54900000000000004},"min":{"1min":0.42799999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.54200000000000004}]},{"osd":5,"last update":"Sun Jun 2 04:02:49 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60099999999999998,"15min":0.60199999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.82799999999999996,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.57999999999999996,"15min":0.58299999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.46400000000000002}]},{"osd":6,"last update":"Sun Jun 2 04:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.503,"15min":0.51200000000000001},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.69299999999999995,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.49199999999999999,"15min":0.496},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.34000000000000002}]},{"osd":7,"last update":"Sun Jun 2 04:02:27 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.51800000000000002}]},{"osd":8,"last update":"Sun Jun 2 04:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.61799999999999999,"15min":0.623},"min":{"1min":0.41199999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.68200000000000005,"15min":0.68999999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.56000000000000005}]},{"osd":9,"last update":"Sun Jun 2 04:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.42399999999999999}]},{"osd":10,"last update":"Sun Jun 2 04:03:18 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.66400000000000003}]},{"osd":11,"last update":"Sun Jun 2 04:03:35 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.51100000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411378,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":978944,"data_stored":486340,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.49299999999999999,"15min":0.47299999999999998},"min":{"1min":0.34699999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.496,"15min":0.47199999999999998},"min":{"1min":0.39400000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.496}]},{"osd":1,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.497,"15min":0.48999999999999999},"min":{"1min":0.34399999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.79700000000000004,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.505,"15min":0.5},"min":{"1min":0.33700000000000002,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.58399999999999996}]},{"osd":3,"last update":"Sun Jun 2 04:03:19 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.53300000000000003},"min":{"1min":0.35999999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56599999999999995,"15min":0.54900000000000004},"min":{"1min":0.39900000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.67400000000000004}]},{"osd":4,"last update":"Sun Jun 2 04:02:33 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52300000000000002,"15min":0.51700000000000002},"min":{"1min":0.36099999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.52300000000000002,"15min":0.51400000000000001},"min":{"1min":0.442,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.51900000000000002}]},{"osd":5,"last update":"Sun Jun 2 04:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.441,"15min":0.437},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.501,"15min":0.496},"min":{"1min":0.36899999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.65500000000000003}]},{"osd":6,"last update":"Sun Jun 2 04:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.874,"5min":0.877,"15min":0.877},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63400000000000001,"15min":0.63700000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.72099999999999997}]},{"osd":7,"last update":"Sun Jun 2 04:02:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.48199999999999998}]},{"osd":8,"last update":"Sun Jun 2 04:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.39100000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.84599999999999997,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.37,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.80300000000000005,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.70699999999999996}]},{"osd":9,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.80700000000000005}]},{"osd":10,"last update":"Sun Jun 2 04:03:19 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.85899999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]}]},{"osd":3,"up_from":25,"seq":107374182445,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":425780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.32600000000000001,"15min":0.313},"min":{"1min":0.23400000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.60399999999999998,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.35699999999999998,"15min":0.34499999999999997},"min":{"1min":0.28000000000000003,"5min":0.249,"15min":0.249},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.30199999999999999}]},{"osd":1,"last update":"Sun Jun 2 04:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.52300000000000002,"15min":0.503},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.35399999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.60199999999999998}]},{"osd":2,"last update":"Sun Jun 2 04:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.54600000000000004,"15min":0.52300000000000002},"min":{"1min":0.42499999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.54000000000000004,"15min":0.51900000000000002},"min":{"1min":0.36099999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.496}]},{"osd":4,"last update":"Sun Jun 2 04:03:35 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56499999999999995,"15min":0.56899999999999995},"min":{"1min":0.39600000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.67400000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57599999999999996,"15min":0.57799999999999996},"min":{"1min":0.45500000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.73399999999999999,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.64200000000000002}]},{"osd":5,"last update":"Sun Jun 2 04:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.51100000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77700000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.52000000000000002}]},{"osd":6,"last update":"Sun Jun 2 04:03:07 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.49399999999999999,"15min":0.496},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.441},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81699999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.38900000000000001}]},{"osd":7,"last update":"Sun Jun 2 04:03:28 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.433,"5min":0.374,"15min":0.374},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.627},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64700000000000002,"15min":0.64600000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.59299999999999997}]},{"osd":8,"last update":"Sun Jun 2 04:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.44500000000000001}]},{"osd":9,"last update":"Sun Jun 2 04:03:00 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.36499999999999999}]},{"osd":10,"last update":"Sun Jun 2 04:03:21 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.56499999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]}]},{"osd":4,"up_from":32,"seq":137438953515,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":426161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:02:31 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.47899999999999998,"15min":0.47499999999999998},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71799999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.379},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.50900000000000001,"15min":0.505},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.39100000000000001}]},{"osd":1,"last update":"Sun Jun 2 04:03:32 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.36499999999999999,"15min":0.34300000000000003},"min":{"1min":0.29299999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.432,"5min":0.38800000000000001,"15min":0.36399999999999999},"min":{"1min":0.253,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.52000000000000002}]},{"osd":2,"last update":"Sun Jun 2 04:03:32 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.53800000000000003,"15min":0.52200000000000002},"min":{"1min":0.36499999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.53400000000000003,"15min":0.50800000000000001},"min":{"1min":0.42999999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.86599999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.62}]},{"osd":3,"last update":"Sun Jun 2 04:03:32 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54200000000000004,"15min":0.51600000000000001},"min":{"1min":0.35499999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.505,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.63900000000000001,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.54500000000000004}]},{"osd":5,"last update":"Sun Jun 2 04:02:54 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54000000000000004,"15min":0.53300000000000003},"min":{"1min":0.40100000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.58299999999999996,"15min":0.57699999999999996},"min":{"1min":0.39800000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.59199999999999997}]},{"osd":6,"last update":"Sun Jun 2 04:03:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59399999999999997,"15min":0.58799999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57599999999999996,"15min":0.57199999999999995},"min":{"1min":0.45700000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.67300000000000004}]},{"osd":7,"last update":"Sun Jun 2 04:03:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59099999999999997,"15min":0.58999999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.68400000000000005}]},{"osd":8,"last update":"Sun Jun 2 04:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.626,"15min":0.622},"min":{"1min":0.48199999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.82899999999999996,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.70999999999999996,"15min":0.70799999999999996},"min":{"1min":0.501,"5min":0.437,"15min":0.437},"max":{"1min":0.98799999999999999,"5min":1.117,"15min":1.117},"last":0.72099999999999997}]},{"osd":9,"last update":"Sun Jun 2 04:03:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.70999999999999996}]},{"osd":10,"last update":"Sun Jun 2 04:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.69999999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":5,"up_from":37,"seq":158913789991,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32068,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713084,"statfs":{"total":95995035648,"available":95962198016,"internally_reserved":0,"allocated":978944,"data_stored":1018373,"data_compressed":36139,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jun 2 04:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.503,"15min":0.502},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.36199999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.53000000000000003}]},{"osd":1,"last update":"Sun Jun 2 04:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54600000000000004,"15min":0.54800000000000004},"min":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70199999999999996,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55000000000000004,"15min":0.55400000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68300000000000005,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.63400000000000001}]},{"osd":2,"last update":"Sun Jun 2 04:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.40100000000000002,"15min":0.39900000000000002},"min":{"1min":0.29499999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.378},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.42899999999999999,"15min":0.433},"min":{"1min":0.28899999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.34100000000000003}]},{"osd":3,"last update":"Sun Jun 2 04:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.55000000000000004,"15min":0.55800000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.81399999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73499999999999999,"5min":0.751,"15min":0.751},"last":0.44}]},{"osd":4,"last update":"Sun Jun 2 04:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59499999999999997,"15min":0.59599999999999997},"min":{"1min":0.433,"5min":0.372,"15min":0.372},"max":{"1min":0.80200000000000005,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.38600000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80100000000000005,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.64700000000000002}]},{"osd":6,"last update":"Sun Jun 2 04:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.61299999999999999,"15min":0.625},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83799999999999997,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.622},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.59299999999999997,"15min":0.60599999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.77700000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.49399999999999999}]},{"osd":7,"last update":"Sun Jun 2 04:03:28 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.63500000000000001,"15min":0.63400000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.66300000000000003,"15min":0.66900000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.83999999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.61199999999999999}]},{"osd":8,"last update":"Sun Jun 2 04:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.42399999999999999}]},{"osd":9,"last update":"Sun Jun 2 04:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.56200000000000006}]},{"osd":10,"last update":"Sun Jun 2 04:03:18 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.755},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.71699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34501,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34501,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34501,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36139,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36139,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36139,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36139,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36139,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":61052,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":61224,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":61429,"data_compressed":1839,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-06-02T04:03:51.243 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-06-02T04:03:51.243 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-06-02T04:03:51.243 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-06-02T04:03:51.244 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph health --format=json 2024-06-02T04:03:51.467 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:03:52.258 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:51 smithi123 ceph-mon[42885]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:03:52.259 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:51 smithi123 ceph-mon[42885]: pgmap v244: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T04:03:52.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:51 smithi162 ceph-mon[47009]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:03:52.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:51 smithi162 ceph-mon[47009]: pgmap v244: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T04:03:52.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:51 smithi136 ceph-mon[47443]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-06-02T04:03:52.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:51 smithi136 ceph-mon[47443]: pgmap v244: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T04:03:52.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.415+0000 7f16c766c700 1 -- 172.21.15.123:0/1633963631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16c0105f00 msgr2=0x7f16c01062e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:52.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.415+0000 7f16c766c700 1 --2- 172.21.15.123:0/1633963631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16c0105f00 0x7f16c01062e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009990 tx=0x7f16bc009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:52.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.416+0000 7f16c766c700 1 -- 172.21.15.123:0/1633963631 shutdown_connections 2024-06-02T04:03:52.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.416+0000 7f16c766c700 1 --2- 172.21.15.123:0/1633963631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16c0100890 0x7f16c010cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:52.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.416+0000 7f16c766c700 1 --2- 172.21.15.123:0/1633963631 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16c0105f00 0x7f16c01062e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:52.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.416+0000 7f16c766c700 1 --2- 172.21.15.123:0/1633963631 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16c00ffed0 0x7f16c0100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:52.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.416+0000 7f16c766c700 1 -- 172.21.15.123:0/1633963631 >> 172.21.15.123:0/1633963631 conn(0x7f16c0075f80 msgr2=0x7f16c0076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:52.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.416+0000 7f16c766c700 1 -- 172.21.15.123:0/1633963631 shutdown_connections 2024-06-02T04:03:52.416 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.416+0000 7f16c766c700 1 -- 172.21.15.123:0/1633963631 wait complete. 2024-06-02T04:03:52.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.416+0000 7f16c766c700 1 Processor -- start 2024-06-02T04:03:52.418 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.416+0000 7f16c766c700 1 -- start start 2024-06-02T04:03:52.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.416+0000 7f16c766c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16c00ffed0 0x7f16c0197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:52.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.416+0000 7f16c766c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16c0100890 0x7f16c0197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:52.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.416+0000 7f16c766c700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16c0105f00 0x7f16c019bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:52.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.416+0000 7f16c766c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c019c340 con 0x7f16c00ffed0 2024-06-02T04:03:52.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.416+0000 7f16c766c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c019c4b0 con 0x7f16c0100890 2024-06-02T04:03:52.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.416+0000 7f16c766c700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c019c670 con 0x7f16c0105f00 2024-06-02T04:03:52.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.417+0000 7f16c5408700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16c00ffed0 0x7f16c0197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:52.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.417+0000 7f16c5408700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16c00ffed0 0x7f16c0197440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41388/0 (socket says 172.21.15.123:41388) 2024-06-02T04:03:52.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.417+0000 7f16c5408700 1 -- 172.21.15.123:0/2220180694 learned_addr learned my addr 172.21.15.123:0/2220180694 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:52.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.417+0000 7f16c5c09700 1 --2- 172.21.15.123:0/2220180694 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16c0105f00 0x7f16c019bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:52.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.417+0000 7f16c4c07700 1 --2- 172.21.15.123:0/2220180694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16c0100890 0x7f16c0197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:52.419 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.417+0000 7f16c5408700 1 -- 172.21.15.123:0/2220180694 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16c0105f00 msgr2=0x7f16c019bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:52.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.417+0000 7f16c5408700 1 --2- 172.21.15.123:0/2220180694 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16c0105f00 0x7f16c019bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:52.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.417+0000 7f16c5408700 1 -- 172.21.15.123:0/2220180694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16c0100890 msgr2=0x7f16c0197980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:52.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.417+0000 7f16c5408700 1 --2- 172.21.15.123:0/2220180694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16c0100890 0x7f16c0197980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:52.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.417+0000 7f16c5408700 1 -- 172.21.15.123:0/2220180694 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16bc0095f0 con 0x7f16c00ffed0 2024-06-02T04:03:52.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.417+0000 7f16c5408700 1 --2- 172.21.15.123:0/2220180694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16c00ffed0 0x7f16c0197440 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f16bc000c00 tx=0x7f16bc00f700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:52.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.417+0000 7f16b67fc700 1 -- 172.21.15.123:0/2220180694 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc01d070 con 0x7f16c00ffed0 2024-06-02T04:03:52.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.417+0000 7f16c766c700 1 -- 172.21.15.123:0/2220180694 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c019c8f0 con 0x7f16c00ffed0 2024-06-02T04:03:52.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.417+0000 7f16b67fc700 1 -- 172.21.15.123:0/2220180694 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16bc00fbf0 con 0x7f16c00ffed0 2024-06-02T04:03:52.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.417+0000 7f16b67fc700 1 -- 172.21.15.123:0/2220180694 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc0176e0 con 0x7f16c00ffed0 2024-06-02T04:03:52.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.417+0000 7f16c766c700 1 -- 172.21.15.123:0/2220180694 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c01a41b0 con 0x7f16c00ffed0 2024-06-02T04:03:52.420 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.418+0000 7f16c766c700 1 -- 172.21.15.123:0/2220180694 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c01015b0 con 0x7f16c00ffed0 2024-06-02T04:03:52.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.419+0000 7f16b67fc700 1 -- 172.21.15.123:0/2220180694 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f16bc0229c0 con 0x7f16c00ffed0 2024-06-02T04:03:52.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.420+0000 7f16b67fc700 1 --2- 172.21.15.123:0/2220180694 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f16ac0a11b0 0x7f16ac0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:52.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.420+0000 7f16c4c07700 1 --2- 172.21.15.123:0/2220180694 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f16ac0a11b0 0x7f16ac0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:52.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.420+0000 7f16b67fc700 1 -- 172.21.15.123:0/2220180694 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f16bc0ce3e0 con 0x7f16c00ffed0 2024-06-02T04:03:52.421 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.420+0000 7f16c4c07700 1 --2- 172.21.15.123:0/2220180694 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f16ac0a11b0 0x7f16ac0a3670 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f16b0005fd0 tx=0x7f16b000a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:52.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.423+0000 7f16b67fc700 1 -- 172.21.15.123:0/2220180694 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f16bc097c50 con 0x7f16c00ffed0 2024-06-02T04:03:52.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.658+0000 7f16c766c700 1 -- 172.21.15.123:0/2220180694 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f16c004ec60 con 0x7f16c00ffed0 2024-06-02T04:03:52.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.659+0000 7f16b67fc700 1 -- 172.21.15.123:0/2220180694 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f16bc09b270 con 0x7f16c00ffed0 2024-06-02T04:03:52.659 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:03:52.659 INFO:teuthology.orchestra.run.smithi123.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-06-02T04:03:52.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.661+0000 7f16c766c700 1 -- 172.21.15.123:0/2220180694 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f16ac0a11b0 msgr2=0x7f16ac0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:52.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.661+0000 7f16c766c700 1 --2- 172.21.15.123:0/2220180694 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f16ac0a11b0 0x7f16ac0a3670 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f16b0005fd0 tx=0x7f16b000a560 comp rx=0 tx=0).stop 2024-06-02T04:03:52.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.661+0000 7f16c766c700 1 -- 172.21.15.123:0/2220180694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16c00ffed0 msgr2=0x7f16c0197440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:52.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.661+0000 7f16c766c700 1 --2- 172.21.15.123:0/2220180694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16c00ffed0 0x7f16c0197440 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f16bc000c00 tx=0x7f16bc00f700 comp rx=0 tx=0).stop 2024-06-02T04:03:52.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.661+0000 7f16c766c700 1 -- 172.21.15.123:0/2220180694 shutdown_connections 2024-06-02T04:03:52.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.661+0000 7f16c766c700 1 --2- 172.21.15.123:0/2220180694 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16c0105f00 0x7f16c019bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:52.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.661+0000 7f16c766c700 1 --2- 172.21.15.123:0/2220180694 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f16c00ffed0 0x7f16c0197440 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:52.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.661+0000 7f16c766c700 1 --2- 172.21.15.123:0/2220180694 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f16ac0a11b0 0x7f16ac0a3670 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:52.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.661+0000 7f16c766c700 1 --2- 172.21.15.123:0/2220180694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f16c0100890 0x7f16c0197980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:52.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.661+0000 7f16c766c700 1 -- 172.21.15.123:0/2220180694 >> 172.21.15.123:0/2220180694 conn(0x7f16c0075f80 msgr2=0x7f16c0068bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:52.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.661+0000 7f16c766c700 1 -- 172.21.15.123:0/2220180694 shutdown_connections 2024-06-02T04:03:52.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:52.661+0000 7f16c766c700 1 -- 172.21.15.123:0/2220180694 wait complete. 2024-06-02T04:03:53.020 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-06-02T04:03:53.020 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:03:53.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.148+0000 7f4f7fa20700 1 -- 172.21.15.123:0/2567237225 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f78101360 msgr2=0x7f4f78101780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:53.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.148+0000 7f4f7fa20700 1 --2- 172.21.15.123:0/2567237225 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f78101360 0x7f4f78101780 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4f68009990 tx=0x7f4f68009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:53.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.148+0000 7f4f7fa20700 1 -- 172.21.15.123:0/2567237225 shutdown_connections 2024-06-02T04:03:53.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.148+0000 7f4f7fa20700 1 --2- 172.21.15.123:0/2567237225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f78100970 0x7f4f78108210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:53.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.148+0000 7f4f7fa20700 1 --2- 172.21.15.123:0/2567237225 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f78101360 0x7f4f78101780 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:53.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.148+0000 7f4f7fa20700 1 --2- 172.21.15.123:0/2567237225 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f780fffb0 0x7f4f78100430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:53.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.148+0000 7f4f7fa20700 1 -- 172.21.15.123:0/2567237225 >> 172.21.15.123:0/2567237225 conn(0x7f4f780faaa0 msgr2=0x7f4f780fcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:53.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.148+0000 7f4f7fa20700 1 -- 172.21.15.123:0/2567237225 shutdown_connections 2024-06-02T04:03:53.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.148+0000 7f4f7fa20700 1 -- 172.21.15.123:0/2567237225 wait complete. 2024-06-02T04:03:53.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.148+0000 7f4f7fa20700 1 Processor -- start 2024-06-02T04:03:53.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.149+0000 7f4f7fa20700 1 -- start start 2024-06-02T04:03:53.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.149+0000 7f4f7fa20700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f780fffb0 0x7f4f78103d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:53.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.149+0000 7f4f7fa20700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f78100970 0x7f4f781023a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:53.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.149+0000 7f4f7fa20700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f78101360 0x7f4f781028e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:53.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.149+0000 7f4f7fa20700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f78103080 con 0x7f4f78101360 2024-06-02T04:03:53.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.149+0000 7f4f7fa20700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f781031f0 con 0x7f4f78100970 2024-06-02T04:03:53.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.149+0000 7f4f7fa20700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f781a0e10 con 0x7f4f780fffb0 2024-06-02T04:03:53.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.149+0000 7f4f7dfbd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f78101360 0x7f4f781028e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:53.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.149+0000 7f4f7dfbd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f78101360 0x7f4f781028e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41410/0 (socket says 172.21.15.123:41410) 2024-06-02T04:03:53.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.149+0000 7f4f7dfbd700 1 -- 172.21.15.123:0/553987986 learned_addr learned my addr 172.21.15.123:0/553987986 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:53.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.149+0000 7f4f7d7bc700 1 --2- 172.21.15.123:0/553987986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f780fffb0 0x7f4f78103d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:53.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.149+0000 7f4f7cfbb700 1 --2- 172.21.15.123:0/553987986 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f78100970 0x7f4f781023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:53.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.149+0000 7f4f7dfbd700 1 -- 172.21.15.123:0/553987986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f780fffb0 msgr2=0x7f4f78103d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:53.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.149+0000 7f4f7dfbd700 1 --2- 172.21.15.123:0/553987986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f780fffb0 0x7f4f78103d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:53.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.149+0000 7f4f7dfbd700 1 -- 172.21.15.123:0/553987986 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f78100970 msgr2=0x7f4f781023a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:53.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.149+0000 7f4f7dfbd700 1 --2- 172.21.15.123:0/553987986 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f78100970 0x7f4f781023a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:53.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.149+0000 7f4f7dfbd700 1 -- 172.21.15.123:0/553987986 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f680095f0 con 0x7f4f78101360 2024-06-02T04:03:53.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.149+0000 7f4f7cfbb700 1 --2- 172.21.15.123:0/553987986 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f78100970 0x7f4f781023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:03:53.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.149+0000 7f4f7dfbd700 1 --2- 172.21.15.123:0/553987986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f78101360 0x7f4f781028e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4f7000ef30 tx=0x7f4f7000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:53.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.149+0000 7f4f6e7fc700 1 -- 172.21.15.123:0/553987986 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f70018070 con 0x7f4f78101360 2024-06-02T04:03:53.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.149+0000 7f4f6e7fc700 1 -- 172.21.15.123:0/553987986 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f7000f040 con 0x7f4f78101360 2024-06-02T04:03:53.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.149+0000 7f4f7fa20700 1 -- 172.21.15.123:0/553987986 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f781a1040 con 0x7f4f78101360 2024-06-02T04:03:53.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.149+0000 7f4f6e7fc700 1 -- 172.21.15.123:0/553987986 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7000cd50 con 0x7f4f78101360 2024-06-02T04:03:53.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.149+0000 7f4f7fa20700 1 -- 172.21.15.123:0/553987986 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f781a1550 con 0x7f4f78101360 2024-06-02T04:03:53.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.150+0000 7f4f7fa20700 1 -- 172.21.15.123:0/553987986 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f78068060 con 0x7f4f78101360 2024-06-02T04:03:53.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.152+0000 7f4f6e7fc700 1 -- 172.21.15.123:0/553987986 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f4f70003a00 con 0x7f4f78101360 2024-06-02T04:03:53.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.152+0000 7f4f6e7fc700 1 --2- 172.21.15.123:0/553987986 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f4f640a1230 0x7f4f640a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:53.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.152+0000 7f4f7d7bc700 1 --2- 172.21.15.123:0/553987986 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f4f640a1230 0x7f4f640a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:53.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.152+0000 7f4f6e7fc700 1 -- 172.21.15.123:0/553987986 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4f700ccdb0 con 0x7f4f78101360 2024-06-02T04:03:53.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.153+0000 7f4f7d7bc700 1 --2- 172.21.15.123:0/553987986 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f4f640a1230 0x7f4f640a36f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4f6800b2e0 tx=0x7f4f6800b6f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:53.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.156+0000 7f4f6e7fc700 1 -- 172.21.15.123:0/553987986 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4f70096620 con 0x7f4f78101360 2024-06-02T04:03:53.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:52 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/2220180694' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-06-02T04:03:53.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:52 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2220180694' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-06-02T04:03:53.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:52 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/2220180694' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-06-02T04:03:53.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.358+0000 7f4f7fa20700 1 -- 172.21.15.123:0/553987986 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f7810b7e0 con 0x7f4f78101360 2024-06-02T04:03:53.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.359+0000 7f4f6e7fc700 1 -- 172.21.15.123:0/553987986 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22175 (secure 0 0 0) 0x7f4f70099c40 con 0x7f4f78101360 2024-06-02T04:03:53.359 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:03:53.359 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":82,"fsid":"1b432ae0-2094-11ef-bc9b-c7b262605968","created":"2024-06-02T03:57:17.383774+0000","modified":"2024-06-02T04:03:07.669997+0000","last_up_change":"2024-06-02T04:02:34.535591+0000","last_in_change":"2024-06-02T04:02:18.346560+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T03:59:57.079448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:03:05.199881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:03:05.853741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d9d8fb5a-dac5-4b14-98e5-665bdbc696ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6803","nonce":2763421276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6805","nonce":2763421276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6809","nonce":2763421276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6807","nonce":2763421276}]},"public_addr":"172.21.15.123:6803/2763421276","cluster_addr":"172.21.15.123:6805/2763421276","heartbeat_back_addr":"172.21.15.123:6809/2763421276","heartbeat_front_addr":"172.21.15.123:6807/2763421276","state":["exists","up"]},{"osd":1,"uuid":"121bbe3c-bb76-4ec4-9596-37db68fbf1ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6801","nonce":956325510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6803","nonce":956325510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6807","nonce":956325510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6805","nonce":956325510}]},"public_addr":"172.21.15.136:6801/956325510","cluster_addr":"172.21.15.136:6803/956325510","heartbeat_back_addr":"172.21.15.136:6807/956325510","heartbeat_front_addr":"172.21.15.136:6805/956325510","state":["exists","up"]},{"osd":2,"uuid":"df9edf0d-f9f0-4699-a6ed-bbcf2dfb1b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6801","nonce":2915749676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6803","nonce":2915749676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6807","nonce":2915749676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6805","nonce":2915749676}]},"public_addr":"172.21.15.162:6801/2915749676","cluster_addr":"172.21.15.162:6803/2915749676","heartbeat_back_addr":"172.21.15.162:6807/2915749676","heartbeat_front_addr":"172.21.15.162:6805/2915749676","state":["exists","up"]},{"osd":3,"uuid":"3e070364-12c6-4780-b2be-f6e933e65773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6811","nonce":1403773143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6813","nonce":1403773143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6817","nonce":1403773143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6815","nonce":1403773143}]},"public_addr":"172.21.15.123:6811/1403773143","cluster_addr":"172.21.15.123:6813/1403773143","heartbeat_back_addr":"172.21.15.123:6817/1403773143","heartbeat_front_addr":"172.21.15.123:6815/1403773143","state":["exists","up"]},{"osd":4,"uuid":"87dd92dd-73c8-4785-bf8a-3756d79dee90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6809","nonce":1403526782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6811","nonce":1403526782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6815","nonce":1403526782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6813","nonce":1403526782}]},"public_addr":"172.21.15.136:6809/1403526782","cluster_addr":"172.21.15.136:6811/1403526782","heartbeat_back_addr":"172.21.15.136:6815/1403526782","heartbeat_front_addr":"172.21.15.136:6813/1403526782","state":["exists","up"]},{"osd":5,"uuid":"1a730863-6b56-43b7-a115-c80d3c8f3ee3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6809","nonce":3094256489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6811","nonce":3094256489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6815","nonce":3094256489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6813","nonce":3094256489}]},"public_addr":"172.21.15.162:6809/3094256489","cluster_addr":"172.21.15.162:6811/3094256489","heartbeat_back_addr":"172.21.15.162:6815/3094256489","heartbeat_front_addr":"172.21.15.162:6813/3094256489","state":["exists","up"]},{"osd":6,"uuid":"6f170b85-6c47-49ff-ba5b-7fe0596a4ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6819","nonce":3025820432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6821","nonce":3025820432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6825","nonce":3025820432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6823","nonce":3025820432}]},"public_addr":"172.21.15.123:6819/3025820432","cluster_addr":"172.21.15.123:6821/3025820432","heartbeat_back_addr":"172.21.15.123:6825/3025820432","heartbeat_front_addr":"172.21.15.123:6823/3025820432","state":["exists","up"]},{"osd":7,"uuid":"ee66bb7a-6c0d-4e5a-b717-258a39f93a87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6817","nonce":1948829505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6819","nonce":1948829505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6823","nonce":1948829505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6821","nonce":1948829505}]},"public_addr":"172.21.15.136:6817/1948829505","cluster_addr":"172.21.15.136:6819/1948829505","heartbeat_back_addr":"172.21.15.136:6823/1948829505","heartbeat_front_addr":"172.21.15.136:6821/1948829505","state":["exists","up"]},{"osd":8,"uuid":"0ff77e33-53a5-43ef-85da-2036a1fcdb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6817","nonce":1590839230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6819","nonce":1590839230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6823","nonce":1590839230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6821","nonce":1590839230}]},"public_addr":"172.21.15.162:6817/1590839230","cluster_addr":"172.21.15.162:6819/1590839230","heartbeat_back_addr":"172.21.15.162:6823/1590839230","heartbeat_front_addr":"172.21.15.162:6821/1590839230","state":["exists","up"]},{"osd":9,"uuid":"1670731c-5e8f-4cbc-8f35-6aeb14ea3075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6827","nonce":608720685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6829","nonce":608720685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6833","nonce":608720685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6831","nonce":608720685}]},"public_addr":"172.21.15.123:6827/608720685","cluster_addr":"172.21.15.123:6829/608720685","heartbeat_back_addr":"172.21.15.123:6833/608720685","heartbeat_front_addr":"172.21.15.123:6831/608720685","state":["exists","up"]},{"osd":10,"uuid":"ae138b96-13e7-46ac-9d4d-48308132465d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6825","nonce":3777263126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6827","nonce":3777263126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6831","nonce":3777263126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6829","nonce":3777263126}]},"public_addr":"172.21.15.136:6825/3777263126","cluster_addr":"172.21.15.136:6827/3777263126","heartbeat_back_addr":"172.21.15.136:6831/3777263126","heartbeat_front_addr":"172.21.15.136:6829/3777263126","state":["exists","up"]},{"osd":11,"uuid":"69f4ede0-7e9b-4edb-be54-01f74f002a06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6825","nonce":704809754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6827","nonce":704809754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6831","nonce":704809754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6829","nonce":704809754}]},"public_addr":"172.21.15.162:6825/704809754","cluster_addr":"172.21.15.162:6827/704809754","heartbeat_back_addr":"172.21.15.162:6831/704809754","heartbeat_front_addr":"172.21.15.162:6829/704809754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:19.188506+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:36.535261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:54.242294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:11.815314+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:29.512086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:46.874319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:04.437358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:22.312520+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:39.917998+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:57.340043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:15.252797+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:32.898924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:0/69783025":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/10165744":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/2081407856":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/4026642298":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/1442330765":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/1595718606":"2024-06-03T03:57:45.611046+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:03:53.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.361+0000 7f4f7fa20700 1 -- 172.21.15.123:0/553987986 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f4f640a1230 msgr2=0x7f4f640a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:53.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.361+0000 7f4f7fa20700 1 --2- 172.21.15.123:0/553987986 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f4f640a1230 0x7f4f640a36f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4f6800b2e0 tx=0x7f4f6800b6f0 comp rx=0 tx=0).stop 2024-06-02T04:03:53.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.361+0000 7f4f7fa20700 1 -- 172.21.15.123:0/553987986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f78101360 msgr2=0x7f4f781028e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:53.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.361+0000 7f4f7fa20700 1 --2- 172.21.15.123:0/553987986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f78101360 0x7f4f781028e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4f7000ef30 tx=0x7f4f7000c3a0 comp rx=0 tx=0).stop 2024-06-02T04:03:53.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.362+0000 7f4f7fa20700 1 -- 172.21.15.123:0/553987986 shutdown_connections 2024-06-02T04:03:53.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.362+0000 7f4f7fa20700 1 --2- 172.21.15.123:0/553987986 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4f78101360 0x7f4f781028e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:53.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.362+0000 7f4f7fa20700 1 --2- 172.21.15.123:0/553987986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f780fffb0 0x7f4f78103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:53.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.362+0000 7f4f7fa20700 1 --2- 172.21.15.123:0/553987986 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f4f640a1230 0x7f4f640a36f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:53.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.362+0000 7f4f7fa20700 1 --2- 172.21.15.123:0/553987986 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4f78100970 0x7f4f781023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:53.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.362+0000 7f4f7fa20700 1 -- 172.21.15.123:0/553987986 >> 172.21.15.123:0/553987986 conn(0x7f4f780faaa0 msgr2=0x7f4f780fc580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:53.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.362+0000 7f4f7fa20700 1 -- 172.21.15.123:0/553987986 shutdown_connections 2024-06-02T04:03:53.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.362+0000 7f4f7fa20700 1 -- 172.21.15.123:0/553987986 wait complete. 2024-06-02T04:03:53.374 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T03:59:57.079448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-02T04:03:05.199881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-02T04:03:05.853741+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-02T04:03:53.375 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-02T04:03:53.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.500+0000 7f00738e6700 1 -- 172.21.15.123:0/4267830421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f006c100fb0 msgr2=0x7f006c101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:53.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.500+0000 7f00738e6700 1 --2- 172.21.15.123:0/4267830421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f006c100fb0 0x7f006c101430 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0068009990 tx=0x7f0068009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:53.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.500+0000 7f00738e6700 1 -- 172.21.15.123:0/4267830421 shutdown_connections 2024-06-02T04:03:53.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.500+0000 7f00738e6700 1 --2- 172.21.15.123:0/4267830421 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f006c101970 0x7f006c108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:53.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.500+0000 7f00738e6700 1 --2- 172.21.15.123:0/4267830421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f006c0ffe60 0x7f006c100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:53.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.500+0000 7f00738e6700 1 --2- 172.21.15.123:0/4267830421 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f006c100fb0 0x7f006c101430 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:53.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.500+0000 7f00738e6700 1 -- 172.21.15.123:0/4267830421 >> 172.21.15.123:0/4267830421 conn(0x7f006c0fb3f0 msgr2=0x7f006c0fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:53.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.500+0000 7f00738e6700 1 -- 172.21.15.123:0/4267830421 shutdown_connections 2024-06-02T04:03:53.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.500+0000 7f00738e6700 1 -- 172.21.15.123:0/4267830421 wait complete. 2024-06-02T04:03:53.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.501+0000 7f00738e6700 1 Processor -- start 2024-06-02T04:03:53.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.501+0000 7f00738e6700 1 -- start start 2024-06-02T04:03:53.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.501+0000 7f00738e6700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f006c0ffe60 0x7f006c196f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:53.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.501+0000 7f00738e6700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f006c100fb0 0x7f006c1974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:53.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.501+0000 7f00738e6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f006c101970 0x7f006c19e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:53.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.501+0000 7f00738e6700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006c19ea90 con 0x7f006c101970 2024-06-02T04:03:53.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.501+0000 7f00738e6700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006c19ebd0 con 0x7f006c0ffe60 2024-06-02T04:03:53.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.501+0000 7f00738e6700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006c19ed60 con 0x7f006c100fb0 2024-06-02T04:03:53.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.501+0000 7f0071e83700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f006c101970 0x7f006c19e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:53.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.501+0000 7f0071e83700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f006c101970 0x7f006c19e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41430/0 (socket says 172.21.15.123:41430) 2024-06-02T04:03:53.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.501+0000 7f0071e83700 1 -- 172.21.15.123:0/2194321908 learned_addr learned my addr 172.21.15.123:0/2194321908 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:53.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.501+0000 7f0070e81700 1 --2- 172.21.15.123:0/2194321908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f006c100fb0 0x7f006c1974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:53.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.501+0000 7f0071682700 1 --2- 172.21.15.123:0/2194321908 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f006c0ffe60 0x7f006c196f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:53.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.501+0000 7f0071e83700 1 -- 172.21.15.123:0/2194321908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f006c100fb0 msgr2=0x7f006c1974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:53.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.501+0000 7f0071e83700 1 --2- 172.21.15.123:0/2194321908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f006c100fb0 0x7f006c1974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:53.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.501+0000 7f0071e83700 1 -- 172.21.15.123:0/2194321908 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f006c0ffe60 msgr2=0x7f006c196f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:53.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.501+0000 7f0071e83700 1 --2- 172.21.15.123:0/2194321908 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f006c0ffe60 0x7f006c196f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:53.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.501+0000 7f0071e83700 1 -- 172.21.15.123:0/2194321908 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00680095f0 con 0x7f006c101970 2024-06-02T04:03:53.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.501+0000 7f0070e81700 1 --2- 172.21.15.123:0/2194321908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f006c100fb0 0x7f006c1974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:03:53.504 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.501+0000 7f0071e83700 1 --2- 172.21.15.123:0/2194321908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f006c101970 0x7f006c19e4c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f006400ada0 tx=0x7f006400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:53.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.501+0000 7f00627fc700 1 -- 172.21.15.123:0/2194321908 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006400f070 con 0x7f006c101970 2024-06-02T04:03:53.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.502+0000 7f00627fc700 1 -- 172.21.15.123:0/2194321908 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0064007b30 con 0x7f006c101970 2024-06-02T04:03:53.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.502+0000 7f00738e6700 1 -- 172.21.15.123:0/2194321908 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f006c19efe0 con 0x7f006c101970 2024-06-02T04:03:53.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.502+0000 7f00627fc700 1 -- 172.21.15.123:0/2194321908 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0064005440 con 0x7f006c101970 2024-06-02T04:03:53.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.502+0000 7f00738e6700 1 -- 172.21.15.123:0/2194321908 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f006c19f470 con 0x7f006c101970 2024-06-02T04:03:53.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.502+0000 7f00738e6700 1 -- 172.21.15.123:0/2194321908 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f006c067cf0 con 0x7f006c101970 2024-06-02T04:03:53.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.503+0000 7f00627fc700 1 -- 172.21.15.123:0/2194321908 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f0064004ad0 con 0x7f006c101970 2024-06-02T04:03:53.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.504+0000 7f00627fc700 1 --2- 172.21.15.123:0/2194321908 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f00580a11b0 0x7f00580a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:53.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.504+0000 7f0071682700 1 --2- 172.21.15.123:0/2194321908 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f00580a11b0 0x7f00580a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:53.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.504+0000 7f00627fc700 1 -- 172.21.15.123:0/2194321908 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f00640cbfa0 con 0x7f006c101970 2024-06-02T04:03:53.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.505+0000 7f0071682700 1 --2- 172.21.15.123:0/2194321908 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f00580a11b0 0x7f00580a3670 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f005c005fd0 tx=0x7f005c00a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:53.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.508+0000 7f00627fc700 1 -- 172.21.15.123:0/2194321908 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0064095810 con 0x7f006c101970 2024-06-02T04:03:53.703 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.704+0000 7f00738e6700 1 -- 172.21.15.123:0/2194321908 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f006c10b6b0 con 0x7f006c101970 2024-06-02T04:03:53.704 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.704+0000 7f00627fc700 1 -- 172.21.15.123:0/2194321908 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f006c10b6b0 con 0x7f006c101970 2024-06-02T04:03:53.704 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-06-02T04:03:53.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.706+0000 7f00738e6700 1 -- 172.21.15.123:0/2194321908 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f00580a11b0 msgr2=0x7f00580a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:53.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.706+0000 7f00738e6700 1 --2- 172.21.15.123:0/2194321908 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f00580a11b0 0x7f00580a3670 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f005c005fd0 tx=0x7f005c00a560 comp rx=0 tx=0).stop 2024-06-02T04:03:53.706 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.706+0000 7f00738e6700 1 -- 172.21.15.123:0/2194321908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f006c101970 msgr2=0x7f006c19e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:53.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.706+0000 7f00738e6700 1 --2- 172.21.15.123:0/2194321908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f006c101970 0x7f006c19e4c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f006400ada0 tx=0x7f006400c330 comp rx=0 tx=0).stop 2024-06-02T04:03:53.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.706+0000 7f00738e6700 1 -- 172.21.15.123:0/2194321908 shutdown_connections 2024-06-02T04:03:53.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.706+0000 7f00738e6700 1 --2- 172.21.15.123:0/2194321908 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f006c101970 0x7f006c19e4c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:53.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.706+0000 7f00738e6700 1 --2- 172.21.15.123:0/2194321908 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f00580a11b0 0x7f00580a3670 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:53.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.706+0000 7f00738e6700 1 --2- 172.21.15.123:0/2194321908 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f006c0ffe60 0x7f006c196f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:53.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.706+0000 7f00738e6700 1 --2- 172.21.15.123:0/2194321908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f006c100fb0 0x7f006c1974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:53.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.706+0000 7f00738e6700 1 -- 172.21.15.123:0/2194321908 >> 172.21.15.123:0/2194321908 conn(0x7f006c0fb3f0 msgr2=0x7f006c068040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:53.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.706+0000 7f00738e6700 1 -- 172.21.15.123:0/2194321908 shutdown_connections 2024-06-02T04:03:53.707 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.706+0000 7f00738e6700 1 -- 172.21.15.123:0/2194321908 wait complete. 2024-06-02T04:03:53.719 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-02T04:03:53.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.843+0000 7fa8d0e31700 1 -- 172.21.15.123:0/2853674790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8cc1020f0 msgr2=0x7fa8cc102570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:53.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.843+0000 7fa8d0e31700 1 --2- 172.21.15.123:0/2853674790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8cc1020f0 0x7fa8cc102570 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc009990 tx=0x7fa8bc009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:53.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.843+0000 7fa8d0e31700 1 -- 172.21.15.123:0/2853674790 shutdown_connections 2024-06-02T04:03:53.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.843+0000 7fa8d0e31700 1 --2- 172.21.15.123:0/2853674790 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa8cc102ab0 0x7fa8cc1093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:53.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.843+0000 7fa8d0e31700 1 --2- 172.21.15.123:0/2853674790 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8cc100f20 0x7fa8cc101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:53.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.843+0000 7fa8d0e31700 1 --2- 172.21.15.123:0/2853674790 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8cc1020f0 0x7fa8cc102570 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:53.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.843+0000 7fa8d0e31700 1 -- 172.21.15.123:0/2853674790 >> 172.21.15.123:0/2853674790 conn(0x7fa8cc0fc4e0 msgr2=0x7fa8cc0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:53.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.843+0000 7fa8d0e31700 1 -- 172.21.15.123:0/2853674790 shutdown_connections 2024-06-02T04:03:53.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.843+0000 7fa8d0e31700 1 -- 172.21.15.123:0/2853674790 wait complete. 2024-06-02T04:03:53.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.844+0000 7fa8d0e31700 1 Processor -- start 2024-06-02T04:03:53.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.844+0000 7fa8d0e31700 1 -- start start 2024-06-02T04:03:53.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.844+0000 7fa8d0e31700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8cc100f20 0x7fa8cc196f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:53.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.844+0000 7fa8d0e31700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8cc1020f0 0x7fa8cc197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:53.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.844+0000 7fa8d0e31700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa8cc102ab0 0x7fa8cc19e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:53.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.844+0000 7fa8d0e31700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc19ea60 con 0x7fa8cc100f20 2024-06-02T04:03:53.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.844+0000 7fa8d0e31700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc19eba0 con 0x7fa8cc102ab0 2024-06-02T04:03:53.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.844+0000 7fa8d0e31700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc19ed30 con 0x7fa8cc1020f0 2024-06-02T04:03:53.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.844+0000 7fa8ca59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8cc100f20 0x7fa8cc196f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:53.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.844+0000 7fa8ca59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8cc100f20 0x7fa8cc196f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41440/0 (socket says 172.21.15.123:41440) 2024-06-02T04:03:53.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.844+0000 7fa8ca59c700 1 -- 172.21.15.123:0/1595044412 learned_addr learned my addr 172.21.15.123:0/1595044412 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:53.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.844+0000 7fa8cad9d700 1 --2- 172.21.15.123:0/1595044412 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa8cc102ab0 0x7fa8cc19e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:53.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.844+0000 7fa8c9d9b700 1 --2- 172.21.15.123:0/1595044412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8cc1020f0 0x7fa8cc197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:53.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.844+0000 7fa8ca59c700 1 -- 172.21.15.123:0/1595044412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8cc1020f0 msgr2=0x7fa8cc197470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:53.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.844+0000 7fa8ca59c700 1 --2- 172.21.15.123:0/1595044412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8cc1020f0 0x7fa8cc197470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:53.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.844+0000 7fa8ca59c700 1 -- 172.21.15.123:0/1595044412 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa8cc102ab0 msgr2=0x7fa8cc19e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:53.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.844+0000 7fa8ca59c700 1 --2- 172.21.15.123:0/1595044412 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa8cc102ab0 0x7fa8cc19e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:53.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.844+0000 7fa8ca59c700 1 -- 172.21.15.123:0/1595044412 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8bc0095f0 con 0x7fa8cc100f20 2024-06-02T04:03:53.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.845+0000 7fa8ca59c700 1 --2- 172.21.15.123:0/1595044412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8cc100f20 0x7fa8cc196f30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000d980 tx=0x7fa8c000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:53.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.845+0000 7fa8bb7fe700 1 -- 172.21.15.123:0/1595044412 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0004020 con 0x7fa8cc100f20 2024-06-02T04:03:53.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.845+0000 7fa8bb7fe700 1 -- 172.21.15.123:0/1595044412 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa8c000f690 con 0x7fa8cc100f20 2024-06-02T04:03:53.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.845+0000 7fa8d0e31700 1 -- 172.21.15.123:0/1595044412 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8cc19efb0 con 0x7fa8cc100f20 2024-06-02T04:03:53.854 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.845+0000 7fa8bb7fe700 1 -- 172.21.15.123:0/1595044412 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0003a60 con 0x7fa8cc100f20 2024-06-02T04:03:53.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.845+0000 7fa8d0e31700 1 -- 172.21.15.123:0/1595044412 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8cc19f430 con 0x7fa8cc100f20 2024-06-02T04:03:53.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.846+0000 7fa8d0e31700 1 -- 172.21.15.123:0/1595044412 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8cc108460 con 0x7fa8cc100f20 2024-06-02T04:03:53.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.847+0000 7fa8bb7fe700 1 -- 172.21.15.123:0/1595044412 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fa8c000fb00 con 0x7fa8cc100f20 2024-06-02T04:03:53.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.848+0000 7fa8bb7fe700 1 --2- 172.21.15.123:0/1595044412 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa8b40a11b0 0x7fa8b40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:53.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.848+0000 7fa8c9d9b700 1 --2- 172.21.15.123:0/1595044412 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa8b40a11b0 0x7fa8b40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:53.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.848+0000 7fa8bb7fe700 1 -- 172.21.15.123:0/1595044412 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa8c00cc7a0 con 0x7fa8cc100f20 2024-06-02T04:03:53.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.848+0000 7fa8c9d9b700 1 --2- 172.21.15.123:0/1595044412 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa8b40a11b0 0x7fa8b40a3670 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc00b5c0 tx=0x7fa8bc005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:53.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:53.851+0000 7fa8bb7fe700 1 -- 172.21.15.123:0/1595044412 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa8c0095f80 con 0x7fa8cc100f20 2024-06-02T04:03:54.047 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.048+0000 7fa8d0e31700 1 -- 172.21.15.123:0/1595044412 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa8cc10c7e0 con 0x7fa8cc100f20 2024-06-02T04:03:54.048 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.048+0000 7fa8bb7fe700 1 -- 172.21.15.123:0/1595044412 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa8c00995a0 con 0x7fa8cc100f20 2024-06-02T04:03:54.048 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-06-02T04:03:54.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.050+0000 7fa8d0e31700 1 -- 172.21.15.123:0/1595044412 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa8b40a11b0 msgr2=0x7fa8b40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:54.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.050+0000 7fa8d0e31700 1 --2- 172.21.15.123:0/1595044412 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa8b40a11b0 0x7fa8b40a3670 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc00b5c0 tx=0x7fa8bc005fd0 comp rx=0 tx=0).stop 2024-06-02T04:03:54.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.050+0000 7fa8d0e31700 1 -- 172.21.15.123:0/1595044412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8cc100f20 msgr2=0x7fa8cc196f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:54.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.050+0000 7fa8d0e31700 1 --2- 172.21.15.123:0/1595044412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8cc100f20 0x7fa8cc196f30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa8c000d980 tx=0x7fa8c000dc90 comp rx=0 tx=0).stop 2024-06-02T04:03:54.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.050+0000 7fa8d0e31700 1 -- 172.21.15.123:0/1595044412 shutdown_connections 2024-06-02T04:03:54.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.050+0000 7fa8d0e31700 1 --2- 172.21.15.123:0/1595044412 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa8b40a11b0 0x7fa8b40a3670 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:54.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.050+0000 7fa8d0e31700 1 --2- 172.21.15.123:0/1595044412 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa8cc102ab0 0x7fa8cc19e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:54.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.050+0000 7fa8d0e31700 1 --2- 172.21.15.123:0/1595044412 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa8cc100f20 0x7fa8cc196f30 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:54.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.050+0000 7fa8d0e31700 1 --2- 172.21.15.123:0/1595044412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8cc1020f0 0x7fa8cc197470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:54.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.050+0000 7fa8d0e31700 1 -- 172.21.15.123:0/1595044412 >> 172.21.15.123:0/1595044412 conn(0x7fa8cc0fc4e0 msgr2=0x7fa8cc1055a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:54.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.050+0000 7fa8d0e31700 1 -- 172.21.15.123:0/1595044412 shutdown_connections 2024-06-02T04:03:54.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.050+0000 7fa8d0e31700 1 -- 172.21.15.123:0/1595044412 wait complete. 2024-06-02T04:03:54.061 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:53 smithi123 ceph-mon[42885]: pgmap v245: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T04:03:54.061 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:53 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/553987986' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:03:54.062 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:53 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2194321908' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:03:54.063 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-02T04:03:54.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.188+0000 7f5764ef3700 1 -- 172.21.15.123:0/2334010433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5760101990 msgr2=0x7f57601082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:54.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.188+0000 7f5764ef3700 1 --2- 172.21.15.123:0/2334010433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5760101990 0x7f57601082b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f575800b0a0 tx=0x7f575800b3b0 comp rx=0 tx=0).stop 2024-06-02T04:03:54.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.189+0000 7f5764ef3700 1 -- 172.21.15.123:0/2334010433 shutdown_connections 2024-06-02T04:03:54.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.189+0000 7f5764ef3700 1 --2- 172.21.15.123:0/2334010433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5760101990 0x7f57601082b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:54.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.189+0000 7f5764ef3700 1 --2- 172.21.15.123:0/2334010433 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f57600ffe80 0x7f57601002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:54.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.189+0000 7f5764ef3700 1 --2- 172.21.15.123:0/2334010433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5760100fd0 0x7f5760101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:54.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.189+0000 7f5764ef3700 1 -- 172.21.15.123:0/2334010433 >> 172.21.15.123:0/2334010433 conn(0x7f57600fb3f0 msgr2=0x7f57600fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:54.195 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.189+0000 7f5764ef3700 1 -- 172.21.15.123:0/2334010433 shutdown_connections 2024-06-02T04:03:54.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.189+0000 7f5764ef3700 1 -- 172.21.15.123:0/2334010433 wait complete. 2024-06-02T04:03:54.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.189+0000 7f5764ef3700 1 Processor -- start 2024-06-02T04:03:54.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.189+0000 7f5764ef3700 1 -- start start 2024-06-02T04:03:54.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.190+0000 7f5764ef3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57600ffe80 0x7f5760069fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:54.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.190+0000 7f5764ef3700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5760100fd0 0x7f576019bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:54.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.190+0000 7f5764ef3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5760101990 0x7f576019e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:54.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.190+0000 7f5764ef3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576019eb20 con 0x7f57600ffe80 2024-06-02T04:03:54.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.190+0000 7f5764ef3700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576019ec90 con 0x7f5760101990 2024-06-02T04:03:54.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.190+0000 7f5764ef3700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576019ee50 con 0x7f5760100fd0 2024-06-02T04:03:54.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.190+0000 7f575e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57600ffe80 0x7f5760069fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:54.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.190+0000 7f575e59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57600ffe80 0x7f5760069fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:41464/0 (socket says 172.21.15.123:41464) 2024-06-02T04:03:54.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.190+0000 7f575e59c700 1 -- 172.21.15.123:0/3650511929 learned_addr learned my addr 172.21.15.123:0/3650511929 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:54.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.190+0000 7f575dd9b700 1 --2- 172.21.15.123:0/3650511929 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5760100fd0 0x7f576019bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:54.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.190+0000 7f575e59c700 1 -- 172.21.15.123:0/3650511929 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5760100fd0 msgr2=0x7f576019bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:54.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.190+0000 7f575e59c700 1 --2- 172.21.15.123:0/3650511929 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5760100fd0 0x7f576019bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:54.198 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.190+0000 7f575ed9d700 1 --2- 172.21.15.123:0/3650511929 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5760101990 0x7f576019e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:54.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.190+0000 7f575e59c700 1 -- 172.21.15.123:0/3650511929 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5760101990 msgr2=0x7f576019e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:54.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.190+0000 7f575e59c700 1 --2- 172.21.15.123:0/3650511929 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5760101990 0x7f576019e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:54.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.190+0000 7f575e59c700 1 -- 172.21.15.123:0/3650511929 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5758009d00 con 0x7f57600ffe80 2024-06-02T04:03:54.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.190+0000 7f575e59c700 1 --2- 172.21.15.123:0/3650511929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57600ffe80 0x7f5760069fd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f575400b530 tx=0x7f575400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:54.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.190+0000 7f574f7fe700 1 -- 172.21.15.123:0/3650511929 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5754011830 con 0x7f57600ffe80 2024-06-02T04:03:54.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.190+0000 7f574f7fe700 1 -- 172.21.15.123:0/3650511929 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5754011e50 con 0x7f57600ffe80 2024-06-02T04:03:54.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.190+0000 7f5764ef3700 1 -- 172.21.15.123:0/3650511929 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f576019f130 con 0x7f57600ffe80 2024-06-02T04:03:54.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.190+0000 7f574f7fe700 1 -- 172.21.15.123:0/3650511929 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575400f2e0 con 0x7f57600ffe80 2024-06-02T04:03:54.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.190+0000 7f5764ef3700 1 -- 172.21.15.123:0/3650511929 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f576019f640 con 0x7f57600ffe80 2024-06-02T04:03:54.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.192+0000 7f5764ef3700 1 -- 172.21.15.123:0/3650511929 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57601071c0 con 0x7f57600ffe80 2024-06-02T04:03:54.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.192+0000 7f574f7fe700 1 -- 172.21.15.123:0/3650511929 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f5754010580 con 0x7f57600ffe80 2024-06-02T04:03:54.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.193+0000 7f574f7fe700 1 --2- 172.21.15.123:0/3650511929 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f57480a11b0 0x7f57480a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:54.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.193+0000 7f574f7fe700 1 -- 172.21.15.123:0/3650511929 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f57540cc2f0 con 0x7f57600ffe80 2024-06-02T04:03:54.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.193+0000 7f575dd9b700 1 --2- 172.21.15.123:0/3650511929 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f57480a11b0 0x7f57480a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:54.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.193+0000 7f575dd9b700 1 --2- 172.21.15.123:0/3650511929 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f57480a11b0 0x7f57480a3670 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5750005ea0 tx=0x7f5750005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:54.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.197+0000 7f574f7fe700 1 -- 172.21.15.123:0/3650511929 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5754095be0 con 0x7f57600ffe80 2024-06-02T04:03:54.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:53 smithi162 ceph-mon[47009]: pgmap v245: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T04:03:54.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:53 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/553987986' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:03:54.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:53 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/2194321908' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:03:54.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:53 smithi136 ceph-mon[47443]: pgmap v245: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T04:03:54.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:53 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/553987986' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:03:54.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:53 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/2194321908' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:03:54.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.397+0000 7f5764ef3700 1 -- 172.21.15.123:0/3650511929 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f576010b810 con 0x7f57600ffe80 2024-06-02T04:03:54.397 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.397+0000 7f574f7fe700 1 -- 172.21.15.123:0/3650511929 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5754099200 con 0x7f57600ffe80 2024-06-02T04:03:54.397 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-06-02T04:03:54.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.399+0000 7f5764ef3700 1 -- 172.21.15.123:0/3650511929 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f57480a11b0 msgr2=0x7f57480a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:54.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.399+0000 7f5764ef3700 1 --2- 172.21.15.123:0/3650511929 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f57480a11b0 0x7f57480a3670 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5750005ea0 tx=0x7f5750005e30 comp rx=0 tx=0).stop 2024-06-02T04:03:54.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.399+0000 7f5764ef3700 1 -- 172.21.15.123:0/3650511929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57600ffe80 msgr2=0x7f5760069fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:54.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.399+0000 7f5764ef3700 1 --2- 172.21.15.123:0/3650511929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57600ffe80 0x7f5760069fd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f575400b530 tx=0x7f575400b8f0 comp rx=0 tx=0).stop 2024-06-02T04:03:54.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.400+0000 7f5764ef3700 1 -- 172.21.15.123:0/3650511929 shutdown_connections 2024-06-02T04:03:54.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.400+0000 7f5764ef3700 1 --2- 172.21.15.123:0/3650511929 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f57480a11b0 0x7f57480a3670 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:54.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.400+0000 7f5764ef3700 1 --2- 172.21.15.123:0/3650511929 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5760101990 0x7f576019e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:54.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.400+0000 7f5764ef3700 1 --2- 172.21.15.123:0/3650511929 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f57600ffe80 0x7f5760069fd0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:54.400 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.400+0000 7f5764ef3700 1 --2- 172.21.15.123:0/3650511929 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5760100fd0 0x7f576019bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:54.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.400+0000 7f5764ef3700 1 -- 172.21.15.123:0/3650511929 >> 172.21.15.123:0/3650511929 conn(0x7f57600fb3f0 msgr2=0x7f5760104300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:54.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.400+0000 7f5764ef3700 1 -- 172.21.15.123:0/3650511929 shutdown_connections 2024-06-02T04:03:54.401 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.400+0000 7f5764ef3700 1 -- 172.21.15.123:0/3650511929 wait complete. 2024-06-02T04:03:54.412 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:03:54.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.535+0000 7fe3680c4700 1 -- 172.21.15.123:0/3669771141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe360102980 msgr2=0x7fe3601092a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:54.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.535+0000 7fe3680c4700 1 --2- 172.21.15.123:0/3669771141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe360102980 0x7fe3601092a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe35800b0a0 tx=0x7fe35800b3b0 comp rx=0 tx=0).stop 2024-06-02T04:03:54.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.535+0000 7fe3680c4700 1 -- 172.21.15.123:0/3669771141 shutdown_connections 2024-06-02T04:03:54.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.535+0000 7fe3680c4700 1 --2- 172.21.15.123:0/3669771141 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe360102980 0x7fe3601092a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:54.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.535+0000 7fe3680c4700 1 --2- 172.21.15.123:0/3669771141 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe360100e70 0x7fe360101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:54.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.535+0000 7fe3680c4700 1 --2- 172.21.15.123:0/3669771141 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe360101fc0 0x7fe360102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:54.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.535+0000 7fe3680c4700 1 -- 172.21.15.123:0/3669771141 >> 172.21.15.123:0/3669771141 conn(0x7fe3600fc400 msgr2=0x7fe3600fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:54.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.535+0000 7fe3680c4700 1 -- 172.21.15.123:0/3669771141 shutdown_connections 2024-06-02T04:03:54.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.535+0000 7fe3680c4700 1 -- 172.21.15.123:0/3669771141 wait complete. 2024-06-02T04:03:54.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.535+0000 7fe3680c4700 1 Processor -- start 2024-06-02T04:03:54.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.535+0000 7fe3680c4700 1 -- start start 2024-06-02T04:03:54.538 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.535+0000 7fe3680c4700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe360100e70 0x7fe360196eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:54.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.535+0000 7fe3680c4700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe360101fc0 0x7fe3601973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:54.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.535+0000 7fe3680c4700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe360102980 0x7fe36019e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:54.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.535+0000 7fe3680c4700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36019e9e0 con 0x7fe360102980 2024-06-02T04:03:54.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.535+0000 7fe3680c4700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36019eb20 con 0x7fe360101fc0 2024-06-02T04:03:54.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.535+0000 7fe3680c4700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36019ecb0 con 0x7fe360100e70 2024-06-02T04:03:54.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.536+0000 7fe366661700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe360102980 0x7fe36019e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:54.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.536+0000 7fe366661700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe360102980 0x7fe36019e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42804/0 (socket says 172.21.15.123:42804) 2024-06-02T04:03:54.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.536+0000 7fe366661700 1 -- 172.21.15.123:0/617733460 learned_addr learned my addr 172.21.15.123:0/617733460 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:54.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.536+0000 7fe365e60700 1 --2- 172.21.15.123:0/617733460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe360100e70 0x7fe360196eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:54.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.536+0000 7fe36565f700 1 --2- 172.21.15.123:0/617733460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe360101fc0 0x7fe3601973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:54.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.536+0000 7fe366661700 1 -- 172.21.15.123:0/617733460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe360100e70 msgr2=0x7fe360196eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:54.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.536+0000 7fe366661700 1 --2- 172.21.15.123:0/617733460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe360100e70 0x7fe360196eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:54.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.536+0000 7fe366661700 1 -- 172.21.15.123:0/617733460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe360101fc0 msgr2=0x7fe3601973f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:54.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.536+0000 7fe366661700 1 --2- 172.21.15.123:0/617733460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe360101fc0 0x7fe3601973f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:54.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.536+0000 7fe366661700 1 -- 172.21.15.123:0/617733460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe358009d00 con 0x7fe360102980 2024-06-02T04:03:54.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.536+0000 7fe366661700 1 --2- 172.21.15.123:0/617733460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe360102980 0x7fe36019e410 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe358006070 tx=0x7fe358004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:54.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.536+0000 7fe356ffd700 1 -- 172.21.15.123:0/617733460 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35800e040 con 0x7fe360102980 2024-06-02T04:03:54.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.536+0000 7fe356ffd700 1 -- 172.21.15.123:0/617733460 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe35801db50 con 0x7fe360102980 2024-06-02T04:03:54.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.536+0000 7fe3680c4700 1 -- 172.21.15.123:0/617733460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe36019ef30 con 0x7fe360102980 2024-06-02T04:03:54.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.536+0000 7fe356ffd700 1 -- 172.21.15.123:0/617733460 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35801bac0 con 0x7fe360102980 2024-06-02T04:03:54.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.536+0000 7fe3680c4700 1 -- 172.21.15.123:0/617733460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe36019f350 con 0x7fe360102980 2024-06-02T04:03:54.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.537+0000 7fe3680c4700 1 -- 172.21.15.123:0/617733460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe360108210 con 0x7fe360102980 2024-06-02T04:03:54.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.538+0000 7fe356ffd700 1 -- 172.21.15.123:0/617733460 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fe35801dcc0 con 0x7fe360102980 2024-06-02T04:03:54.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.538+0000 7fe356ffd700 1 --2- 172.21.15.123:0/617733460 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe34c0a11b0 0x7fe34c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:54.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.539+0000 7fe365e60700 1 --2- 172.21.15.123:0/617733460 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe34c0a11b0 0x7fe34c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:54.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.539+0000 7fe356ffd700 1 -- 172.21.15.123:0/617733460 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe3580ce580 con 0x7fe360102980 2024-06-02T04:03:54.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.539+0000 7fe365e60700 1 --2- 172.21.15.123:0/617733460 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe34c0a11b0 0x7fe34c0a3670 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe350005950 tx=0x7fe35000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:54.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.543+0000 7fe356ffd700 1 -- 172.21.15.123:0/617733460 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe358097df0 con 0x7fe360102980 2024-06-02T04:03:54.795 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.795+0000 7fe3680c4700 1 -- 172.21.15.123:0/617733460 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe360068060 con 0x7fe360102980 2024-06-02T04:03:54.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.796+0000 7fe356ffd700 1 -- 172.21.15.123:0/617733460 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10930 (secure 0 0 0) 0x7fe35809b410 con 0x7fe360102980 2024-06-02T04:03:54.837 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:03:54.838 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1940848601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1940848601},{"type":"v1","addr":"172.21.15.123:6835","nonce":1940848601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/54447879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":54447879},{"type":"v1","addr":"172.21.15.123:6837","nonce":54447879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T04:03:06.667888+0000","modified":"2024-06-02T04:03:13.099282+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24490,"mds_2":24473,"mds_3":24439,"mds_4":24437},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6839/3806973328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":3806973328},{"type":"v1","addr":"172.21.15.123:6839","nonce":3806973328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14619":{"gid":14619,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6841/4032992994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":4032992994},{"type":"v1","addr":"172.21.15.123:6841","nonce":4032992994}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24437":{"gid":24437,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6833/2006585076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2006585076},{"type":"v1","addr":"172.21.15.136:6833","nonce":2006585076}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.162:6833/3583622784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3583622784},{"type":"v1","addr":"172.21.15.162:6833","nonce":3583622784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/2894031422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2894031422},{"type":"v1","addr":"172.21.15.136:6835","nonce":2894031422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24463":{"gid":24463,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2478943987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2478943987},{"type":"v1","addr":"172.21.15.162:6835","nonce":2478943987}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3402138468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3402138468},{"type":"v1","addr":"172.21.15.162:6837","nonce":3402138468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.136:6837/2572418263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2572418263},{"type":"v1","addr":"172.21.15.136:6837","nonce":2572418263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/2588884232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2588884232},{"type":"v1","addr":"172.21.15.162:6839","nonce":2588884232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6839/952830191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":952830191},{"type":"v1","addr":"172.21.15.136:6839","nonce":952830191}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-06-02T04:03:54.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.798+0000 7fe3680c4700 1 -- 172.21.15.123:0/617733460 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe34c0a11b0 msgr2=0x7fe34c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:54.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.798+0000 7fe3680c4700 1 --2- 172.21.15.123:0/617733460 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe34c0a11b0 0x7fe34c0a3670 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe350005950 tx=0x7fe35000b410 comp rx=0 tx=0).stop 2024-06-02T04:03:54.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.798+0000 7fe3680c4700 1 -- 172.21.15.123:0/617733460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe360102980 msgr2=0x7fe36019e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:54.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.798+0000 7fe3680c4700 1 --2- 172.21.15.123:0/617733460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe360102980 0x7fe36019e410 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe358006070 tx=0x7fe358004d00 comp rx=0 tx=0).stop 2024-06-02T04:03:54.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.798+0000 7fe3680c4700 1 -- 172.21.15.123:0/617733460 shutdown_connections 2024-06-02T04:03:54.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.798+0000 7fe3680c4700 1 --2- 172.21.15.123:0/617733460 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe360102980 0x7fe36019e410 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:54.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.798+0000 7fe3680c4700 1 --2- 172.21.15.123:0/617733460 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe360100e70 0x7fe360196eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:54.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.798+0000 7fe3680c4700 1 --2- 172.21.15.123:0/617733460 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe34c0a11b0 0x7fe34c0a3670 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:54.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.798+0000 7fe3680c4700 1 --2- 172.21.15.123:0/617733460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe360101fc0 0x7fe3601973f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:54.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.798+0000 7fe3680c4700 1 -- 172.21.15.123:0/617733460 >> 172.21.15.123:0/617733460 conn(0x7fe3600fc400 msgr2=0x7fe360105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:54.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.798+0000 7fe3680c4700 1 -- 172.21.15.123:0/617733460 shutdown_connections 2024-06-02T04:03:54.840 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.798+0000 7fe3680c4700 1 -- 172.21.15.123:0/617733460 wait complete. 2024-06-02T04:03:54.840 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 27 2024-06-02T04:03:54.841 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:03:54.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.967+0000 7f9788d25700 1 -- 172.21.15.123:0/1050666580 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9784104210 msgr2=0x7f9784106600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:54.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.967+0000 7f9788d25700 1 --2- 172.21.15.123:0/1050666580 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9784104210 0x7f9784106600 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9774009990 tx=0x7f9774009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:54.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.967+0000 7f9788d25700 1 -- 172.21.15.123:0/1050666580 shutdown_connections 2024-06-02T04:03:54.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.967+0000 7f9788d25700 1 --2- 172.21.15.123:0/1050666580 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9784106b40 0x7f9784108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:54.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.967+0000 7f9788d25700 1 --2- 172.21.15.123:0/1050666580 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97841018e0 0x7f9784103cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:54.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.967+0000 7f9788d25700 1 --2- 172.21.15.123:0/1050666580 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9784104210 0x7f9784106600 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:54.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.967+0000 7f9788d25700 1 -- 172.21.15.123:0/1050666580 >> 172.21.15.123:0/1050666580 conn(0x7f97840fb2f0 msgr2=0x7f97840fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:54.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.967+0000 7f9788d25700 1 -- 172.21.15.123:0/1050666580 shutdown_connections 2024-06-02T04:03:54.967 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.967+0000 7f9788d25700 1 -- 172.21.15.123:0/1050666580 wait complete. 2024-06-02T04:03:54.969 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.968+0000 7f9788d25700 1 Processor -- start 2024-06-02T04:03:54.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.968+0000 7f9788d25700 1 -- start start 2024-06-02T04:03:54.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.968+0000 7f9788d25700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97841018e0 0x7f9784196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:54.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.968+0000 7f9788d25700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9784104210 0x7f9784197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:54.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.968+0000 7f9788d25700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9784106b40 0x7f978419e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:54.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.968+0000 7f9788d25700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978419e830 con 0x7f97841018e0 2024-06-02T04:03:54.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.968+0000 7f9788d25700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978419e9a0 con 0x7f9784106b40 2024-06-02T04:03:54.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.968+0000 7f9788d25700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978419eb60 con 0x7f9784104210 2024-06-02T04:03:54.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.968+0000 7f978259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97841018e0 0x7f9784196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:54.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.968+0000 7f978259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97841018e0 0x7f9784196d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42818/0 (socket says 172.21.15.123:42818) 2024-06-02T04:03:54.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.968+0000 7f978259c700 1 -- 172.21.15.123:0/2019106036 learned_addr learned my addr 172.21.15.123:0/2019106036 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:54.970 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.968+0000 7f9781d9b700 1 --2- 172.21.15.123:0/2019106036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9784104210 0x7f9784197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:54.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.968+0000 7f9782d9d700 1 --2- 172.21.15.123:0/2019106036 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9784106b40 0x7f978419e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:54.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.968+0000 7f978259c700 1 -- 172.21.15.123:0/2019106036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9784104210 msgr2=0x7f9784197250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:54.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.968+0000 7f978259c700 1 --2- 172.21.15.123:0/2019106036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9784104210 0x7f9784197250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:54.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.968+0000 7f978259c700 1 -- 172.21.15.123:0/2019106036 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9784106b40 msgr2=0x7f978419e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:54.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.968+0000 7f978259c700 1 --2- 172.21.15.123:0/2019106036 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9784106b40 0x7f978419e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:54.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.968+0000 7f978259c700 1 -- 172.21.15.123:0/2019106036 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97740095f0 con 0x7f97841018e0 2024-06-02T04:03:54.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.968+0000 7f9782d9d700 1 --2- 172.21.15.123:0/2019106036 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9784106b40 0x7f978419e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:03:54.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.968+0000 7f9781d9b700 1 --2- 172.21.15.123:0/2019106036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9784104210 0x7f9784197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:03:54.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.968+0000 7f978259c700 1 --2- 172.21.15.123:0/2019106036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97841018e0 0x7f9784196d10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f977800d950 tx=0x7f977800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:54.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.968+0000 7f97737fe700 1 -- 172.21.15.123:0/2019106036 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9778009b40 con 0x7f97841018e0 2024-06-02T04:03:54.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.968+0000 7f9788d25700 1 -- 172.21.15.123:0/2019106036 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f978419ee40 con 0x7f97841018e0 2024-06-02T04:03:54.971 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.968+0000 7f97737fe700 1 -- 172.21.15.123:0/2019106036 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9778009ca0 con 0x7f97841018e0 2024-06-02T04:03:54.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.968+0000 7f97737fe700 1 -- 172.21.15.123:0/2019106036 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977800f620 con 0x7f97841018e0 2024-06-02T04:03:54.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.968+0000 7f9788d25700 1 -- 172.21.15.123:0/2019106036 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f978419f270 con 0x7f97841018e0 2024-06-02T04:03:54.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.970+0000 7f9788d25700 1 -- 172.21.15.123:0/2019106036 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97840fce70 con 0x7f97841018e0 2024-06-02T04:03:54.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.970+0000 7f97737fe700 1 -- 172.21.15.123:0/2019106036 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f9778010460 con 0x7f97841018e0 2024-06-02T04:03:54.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.971+0000 7f97737fe700 1 --2- 172.21.15.123:0/2019106036 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f976c0a11b0 0x7f976c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:54.972 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.971+0000 7f9781d9b700 1 --2- 172.21.15.123:0/2019106036 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f976c0a11b0 0x7f976c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:54.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.971+0000 7f97737fe700 1 -- 172.21.15.123:0/2019106036 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f97780ccc40 con 0x7f97841018e0 2024-06-02T04:03:54.973 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.971+0000 7f9781d9b700 1 --2- 172.21.15.123:0/2019106036 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f976c0a11b0 0x7f976c0a3670 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f977400b5c0 tx=0x7f9774005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:54.975 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:54.975+0000 7f97737fe700 1 -- 172.21.15.123:0/2019106036 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9778096420 con 0x7f97841018e0 2024-06-02T04:03:55.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:54 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1595044412' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:03:55.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:54 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/3650511929' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:03:55.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:54 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/617733460' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:03:55.177 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.177+0000 7f9788d25700 1 -- 172.21.15.123:0/2019106036 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f978410c650 con 0x7f97841018e0 2024-06-02T04:03:55.179 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.179+0000 7f97737fe700 1 -- 172.21.15.123:0/2019106036 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22175 (secure 0 0 0) 0x7f9778020090 con 0x7f97841018e0 2024-06-02T04:03:55.179 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:03:55.179 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":82,"fsid":"1b432ae0-2094-11ef-bc9b-c7b262605968","created":"2024-06-02T03:57:17.383774+0000","modified":"2024-06-02T04:03:07.669997+0000","last_up_change":"2024-06-02T04:02:34.535591+0000","last_in_change":"2024-06-02T04:02:18.346560+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T03:59:57.079448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:03:05.199881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:03:05.853741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d9d8fb5a-dac5-4b14-98e5-665bdbc696ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6803","nonce":2763421276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6805","nonce":2763421276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6809","nonce":2763421276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6807","nonce":2763421276}]},"public_addr":"172.21.15.123:6803/2763421276","cluster_addr":"172.21.15.123:6805/2763421276","heartbeat_back_addr":"172.21.15.123:6809/2763421276","heartbeat_front_addr":"172.21.15.123:6807/2763421276","state":["exists","up"]},{"osd":1,"uuid":"121bbe3c-bb76-4ec4-9596-37db68fbf1ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6801","nonce":956325510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6803","nonce":956325510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6807","nonce":956325510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6805","nonce":956325510}]},"public_addr":"172.21.15.136:6801/956325510","cluster_addr":"172.21.15.136:6803/956325510","heartbeat_back_addr":"172.21.15.136:6807/956325510","heartbeat_front_addr":"172.21.15.136:6805/956325510","state":["exists","up"]},{"osd":2,"uuid":"df9edf0d-f9f0-4699-a6ed-bbcf2dfb1b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6801","nonce":2915749676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6803","nonce":2915749676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6807","nonce":2915749676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6805","nonce":2915749676}]},"public_addr":"172.21.15.162:6801/2915749676","cluster_addr":"172.21.15.162:6803/2915749676","heartbeat_back_addr":"172.21.15.162:6807/2915749676","heartbeat_front_addr":"172.21.15.162:6805/2915749676","state":["exists","up"]},{"osd":3,"uuid":"3e070364-12c6-4780-b2be-f6e933e65773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6811","nonce":1403773143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6813","nonce":1403773143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6817","nonce":1403773143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6815","nonce":1403773143}]},"public_addr":"172.21.15.123:6811/1403773143","cluster_addr":"172.21.15.123:6813/1403773143","heartbeat_back_addr":"172.21.15.123:6817/1403773143","heartbeat_front_addr":"172.21.15.123:6815/1403773143","state":["exists","up"]},{"osd":4,"uuid":"87dd92dd-73c8-4785-bf8a-3756d79dee90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6809","nonce":1403526782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6811","nonce":1403526782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6815","nonce":1403526782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6813","nonce":1403526782}]},"public_addr":"172.21.15.136:6809/1403526782","cluster_addr":"172.21.15.136:6811/1403526782","heartbeat_back_addr":"172.21.15.136:6815/1403526782","heartbeat_front_addr":"172.21.15.136:6813/1403526782","state":["exists","up"]},{"osd":5,"uuid":"1a730863-6b56-43b7-a115-c80d3c8f3ee3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6809","nonce":3094256489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6811","nonce":3094256489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6815","nonce":3094256489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6813","nonce":3094256489}]},"public_addr":"172.21.15.162:6809/3094256489","cluster_addr":"172.21.15.162:6811/3094256489","heartbeat_back_addr":"172.21.15.162:6815/3094256489","heartbeat_front_addr":"172.21.15.162:6813/3094256489","state":["exists","up"]},{"osd":6,"uuid":"6f170b85-6c47-49ff-ba5b-7fe0596a4ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6819","nonce":3025820432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6821","nonce":3025820432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6825","nonce":3025820432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6823","nonce":3025820432}]},"public_addr":"172.21.15.123:6819/3025820432","cluster_addr":"172.21.15.123:6821/3025820432","heartbeat_back_addr":"172.21.15.123:6825/3025820432","heartbeat_front_addr":"172.21.15.123:6823/3025820432","state":["exists","up"]},{"osd":7,"uuid":"ee66bb7a-6c0d-4e5a-b717-258a39f93a87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6817","nonce":1948829505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6819","nonce":1948829505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6823","nonce":1948829505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6821","nonce":1948829505}]},"public_addr":"172.21.15.136:6817/1948829505","cluster_addr":"172.21.15.136:6819/1948829505","heartbeat_back_addr":"172.21.15.136:6823/1948829505","heartbeat_front_addr":"172.21.15.136:6821/1948829505","state":["exists","up"]},{"osd":8,"uuid":"0ff77e33-53a5-43ef-85da-2036a1fcdb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6817","nonce":1590839230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6819","nonce":1590839230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6823","nonce":1590839230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6821","nonce":1590839230}]},"public_addr":"172.21.15.162:6817/1590839230","cluster_addr":"172.21.15.162:6819/1590839230","heartbeat_back_addr":"172.21.15.162:6823/1590839230","heartbeat_front_addr":"172.21.15.162:6821/1590839230","state":["exists","up"]},{"osd":9,"uuid":"1670731c-5e8f-4cbc-8f35-6aeb14ea3075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6827","nonce":608720685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6829","nonce":608720685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6833","nonce":608720685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6831","nonce":608720685}]},"public_addr":"172.21.15.123:6827/608720685","cluster_addr":"172.21.15.123:6829/608720685","heartbeat_back_addr":"172.21.15.123:6833/608720685","heartbeat_front_addr":"172.21.15.123:6831/608720685","state":["exists","up"]},{"osd":10,"uuid":"ae138b96-13e7-46ac-9d4d-48308132465d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6825","nonce":3777263126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6827","nonce":3777263126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6831","nonce":3777263126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6829","nonce":3777263126}]},"public_addr":"172.21.15.136:6825/3777263126","cluster_addr":"172.21.15.136:6827/3777263126","heartbeat_back_addr":"172.21.15.136:6831/3777263126","heartbeat_front_addr":"172.21.15.136:6829/3777263126","state":["exists","up"]},{"osd":11,"uuid":"69f4ede0-7e9b-4edb-be54-01f74f002a06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6825","nonce":704809754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6827","nonce":704809754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6831","nonce":704809754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6829","nonce":704809754}]},"public_addr":"172.21.15.162:6825/704809754","cluster_addr":"172.21.15.162:6827/704809754","heartbeat_back_addr":"172.21.15.162:6831/704809754","heartbeat_front_addr":"172.21.15.162:6829/704809754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:19.188506+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:36.535261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:54.242294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:11.815314+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:29.512086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:46.874319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:04.437358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:22.312520+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:39.917998+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:57.340043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:15.252797+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:32.898924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:0/69783025":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/10165744":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/2081407856":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/4026642298":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/1442330765":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/1595718606":"2024-06-03T03:57:45.611046+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:03:55.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.181+0000 7f9788d25700 1 -- 172.21.15.123:0/2019106036 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f976c0a11b0 msgr2=0x7f976c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:55.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.181+0000 7f9788d25700 1 --2- 172.21.15.123:0/2019106036 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f976c0a11b0 0x7f976c0a3670 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f977400b5c0 tx=0x7f9774005fb0 comp rx=0 tx=0).stop 2024-06-02T04:03:55.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.181+0000 7f9788d25700 1 -- 172.21.15.123:0/2019106036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97841018e0 msgr2=0x7f9784196d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:55.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.181+0000 7f9788d25700 1 --2- 172.21.15.123:0/2019106036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97841018e0 0x7f9784196d10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f977800d950 tx=0x7f977800dd10 comp rx=0 tx=0).stop 2024-06-02T04:03:55.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.181+0000 7f9788d25700 1 -- 172.21.15.123:0/2019106036 shutdown_connections 2024-06-02T04:03:55.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.181+0000 7f9788d25700 1 --2- 172.21.15.123:0/2019106036 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f976c0a11b0 0x7f976c0a3670 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:55.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.181+0000 7f9788d25700 1 --2- 172.21.15.123:0/2019106036 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9784106b40 0x7f978419e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:55.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.181+0000 7f9788d25700 1 --2- 172.21.15.123:0/2019106036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f97841018e0 0x7f9784196d10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:55.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.181+0000 7f9788d25700 1 --2- 172.21.15.123:0/2019106036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9784104210 0x7f9784197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:55.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.181+0000 7f9788d25700 1 -- 172.21.15.123:0/2019106036 >> 172.21.15.123:0/2019106036 conn(0x7f97840fb2f0 msgr2=0x7f9784103770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:55.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.181+0000 7f9788d25700 1 -- 172.21.15.123:0/2019106036 shutdown_connections 2024-06-02T04:03:55.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.181+0000 7f9788d25700 1 -- 172.21.15.123:0/2019106036 wait complete. 2024-06-02T04:03:55.194 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T03:59:57.079448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-02T04:03:05.199881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-02T04:03:05.853741+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-02T04:03:55.194 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-02T04:03:55.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:54 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/1595044412' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:03:55.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:54 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/3650511929' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:03:55.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:54 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/617733460' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:03:55.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.320+0000 7f84e7e96700 1 -- 172.21.15.123:0/136372984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84e00ffe60 msgr2=0x7f84e0100280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:55.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.320+0000 7f84e7e96700 1 --2- 172.21.15.123:0/136372984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84e00ffe60 0x7f84e0100280 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f84d0009990 tx=0x7f84d0009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:55.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.320+0000 7f84e7e96700 1 -- 172.21.15.123:0/136372984 shutdown_connections 2024-06-02T04:03:55.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.320+0000 7f84e7e96700 1 --2- 172.21.15.123:0/136372984 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84e0101970 0x7f84e0108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:55.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.320+0000 7f84e7e96700 1 --2- 172.21.15.123:0/136372984 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84e00ffe60 0x7f84e0100280 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:55.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.320+0000 7f84e7e96700 1 --2- 172.21.15.123:0/136372984 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84e0100fb0 0x7f84e0101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:55.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.320+0000 7f84e7e96700 1 -- 172.21.15.123:0/136372984 >> 172.21.15.123:0/136372984 conn(0x7f84e00fb3f0 msgr2=0x7f84e00fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:55.322 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.320+0000 7f84e7e96700 1 -- 172.21.15.123:0/136372984 shutdown_connections 2024-06-02T04:03:55.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.320+0000 7f84e7e96700 1 -- 172.21.15.123:0/136372984 wait complete. 2024-06-02T04:03:55.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.320+0000 7f84e7e96700 1 Processor -- start 2024-06-02T04:03:55.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.320+0000 7f84e7e96700 1 -- start start 2024-06-02T04:03:55.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.321+0000 7f84e7e96700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84e00ffe60 0x7f84e0103d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:55.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.321+0000 7f84e7e96700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84e0100fb0 0x7f84e0102420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:55.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.321+0000 7f84e7e96700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84e0101970 0x7f84e0102960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:55.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.321+0000 7f84e7e96700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e0103100 con 0x7f84e00ffe60 2024-06-02T04:03:55.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.321+0000 7f84e7e96700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e0103270 con 0x7f84e0100fb0 2024-06-02T04:03:55.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.321+0000 7f84e7e96700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e01a0f80 con 0x7f84e0101970 2024-06-02T04:03:55.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.321+0000 7f84e5c32700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84e00ffe60 0x7f84e0103d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:55.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.321+0000 7f84e5c32700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84e00ffe60 0x7f84e0103d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42834/0 (socket says 172.21.15.123:42834) 2024-06-02T04:03:55.323 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.321+0000 7f84e5c32700 1 -- 172.21.15.123:0/2466232120 learned_addr learned my addr 172.21.15.123:0/2466232120 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.321+0000 7f84e5431700 1 --2- 172.21.15.123:0/2466232120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84e0100fb0 0x7f84e0102420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.321+0000 7f84e6433700 1 --2- 172.21.15.123:0/2466232120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84e0101970 0x7f84e0102960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.321+0000 7f84e5c32700 1 -- 172.21.15.123:0/2466232120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84e0101970 msgr2=0x7f84e0102960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.321+0000 7f84e5c32700 1 --2- 172.21.15.123:0/2466232120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84e0101970 0x7f84e0102960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.321+0000 7f84e5c32700 1 -- 172.21.15.123:0/2466232120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84e0100fb0 msgr2=0x7f84e0102420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.321+0000 7f84e5c32700 1 --2- 172.21.15.123:0/2466232120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84e0100fb0 0x7f84e0102420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.321+0000 7f84e5c32700 1 -- 172.21.15.123:0/2466232120 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d00095f0 con 0x7f84e00ffe60 2024-06-02T04:03:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.321+0000 7f84e5431700 1 --2- 172.21.15.123:0/2466232120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84e0100fb0 0x7f84e0102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:03:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.321+0000 7f84e5c32700 1 --2- 172.21.15.123:0/2466232120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84e00ffe60 0x7f84e0103d90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f84d000b5c0 tx=0x7f84d0005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.321+0000 7f84d6ffd700 1 -- 172.21.15.123:0/2466232120 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d001d070 con 0x7f84e00ffe60 2024-06-02T04:03:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.321+0000 7f84e7e96700 1 -- 172.21.15.123:0/2466232120 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e01a11b0 con 0x7f84e00ffe60 2024-06-02T04:03:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.321+0000 7f84d6ffd700 1 -- 172.21.15.123:0/2466232120 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f84d0004060 con 0x7f84e00ffe60 2024-06-02T04:03:55.324 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.321+0000 7f84d6ffd700 1 -- 172.21.15.123:0/2466232120 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d0022e10 con 0x7f84e00ffe60 2024-06-02T04:03:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.321+0000 7f84e7e96700 1 -- 172.21.15.123:0/2466232120 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e01a1570 con 0x7f84e00ffe60 2024-06-02T04:03:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.322+0000 7f84e7e96700 1 -- 172.21.15.123:0/2466232120 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e0067cf0 con 0x7f84e00ffe60 2024-06-02T04:03:55.325 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.323+0000 7f84d6ffd700 1 -- 172.21.15.123:0/2466232120 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f84d0022570 con 0x7f84e00ffe60 2024-06-02T04:03:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.324+0000 7f84d6ffd700 1 --2- 172.21.15.123:0/2466232120 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f84cc0a11b0 0x7f84cc0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.324+0000 7f84e5431700 1 --2- 172.21.15.123:0/2466232120 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f84cc0a11b0 0x7f84cc0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.324+0000 7f84d6ffd700 1 -- 172.21.15.123:0/2466232120 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f84d00ce0c0 con 0x7f84e00ffe60 2024-06-02T04:03:55.326 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.324+0000 7f84e5431700 1 --2- 172.21.15.123:0/2466232120 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f84cc0a11b0 0x7f84cc0a3670 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f84dc005950 tx=0x7f84dc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:55.327 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.327+0000 7f84d6ffd700 1 -- 172.21.15.123:0/2466232120 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f84d00979c0 con 0x7f84e00ffe60 2024-06-02T04:03:55.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:54 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/1595044412' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:03:55.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:54 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/3650511929' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:03:55.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:54 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/617733460' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:03:55.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.523+0000 7f84e7e96700 1 -- 172.21.15.123:0/2466232120 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f84e010b810 con 0x7f84e00ffe60 2024-06-02T04:03:55.523 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.523+0000 7f84d6ffd700 1 -- 172.21.15.123:0/2466232120 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f84d009afe0 con 0x7f84e00ffe60 2024-06-02T04:03:55.523 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-06-02T04:03:55.525 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.525+0000 7f84e7e96700 1 -- 172.21.15.123:0/2466232120 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f84cc0a11b0 msgr2=0x7f84cc0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.525+0000 7f84e7e96700 1 --2- 172.21.15.123:0/2466232120 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f84cc0a11b0 0x7f84cc0a3670 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f84dc005950 tx=0x7f84dc0058e0 comp rx=0 tx=0).stop 2024-06-02T04:03:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.525+0000 7f84e7e96700 1 -- 172.21.15.123:0/2466232120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84e00ffe60 msgr2=0x7f84e0103d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.525+0000 7f84e7e96700 1 --2- 172.21.15.123:0/2466232120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84e00ffe60 0x7f84e0103d90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f84d000b5c0 tx=0x7f84d0005e80 comp rx=0 tx=0).stop 2024-06-02T04:03:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.525+0000 7f84e7e96700 1 -- 172.21.15.123:0/2466232120 shutdown_connections 2024-06-02T04:03:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.525+0000 7f84e7e96700 1 --2- 172.21.15.123:0/2466232120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84e0101970 0x7f84e0102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.525+0000 7f84e7e96700 1 --2- 172.21.15.123:0/2466232120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f84e00ffe60 0x7f84e0103d90 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.525+0000 7f84e7e96700 1 --2- 172.21.15.123:0/2466232120 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f84cc0a11b0 0x7f84cc0a3670 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.525+0000 7f84e7e96700 1 --2- 172.21.15.123:0/2466232120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84e0100fb0 0x7f84e0102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.525+0000 7f84e7e96700 1 -- 172.21.15.123:0/2466232120 >> 172.21.15.123:0/2466232120 conn(0x7f84e00fb3f0 msgr2=0x7f84e00680e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.525+0000 7f84e7e96700 1 -- 172.21.15.123:0/2466232120 shutdown_connections 2024-06-02T04:03:55.526 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.525+0000 7f84e7e96700 1 -- 172.21.15.123:0/2466232120 wait complete. 2024-06-02T04:03:55.538 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-02T04:03:55.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.662+0000 7f566a348700 1 -- 172.21.15.123:0/2718311384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5664100fb0 msgr2=0x7f5664101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:55.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.662+0000 7f566a348700 1 --2- 172.21.15.123:0/2718311384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5664100fb0 0x7f5664101430 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5658009990 tx=0x7f5658009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:55.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.662+0000 7f566a348700 1 -- 172.21.15.123:0/2718311384 shutdown_connections 2024-06-02T04:03:55.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.662+0000 7f566a348700 1 --2- 172.21.15.123:0/2718311384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5664101970 0x7f5664108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:55.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.662+0000 7f566a348700 1 --2- 172.21.15.123:0/2718311384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f56640ffe60 0x7f5664100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:55.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.662+0000 7f566a348700 1 --2- 172.21.15.123:0/2718311384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5664100fb0 0x7f5664101430 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:55.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.662+0000 7f566a348700 1 -- 172.21.15.123:0/2718311384 >> 172.21.15.123:0/2718311384 conn(0x7f56640fb3f0 msgr2=0x7f56640fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:55.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.662+0000 7f566a348700 1 -- 172.21.15.123:0/2718311384 shutdown_connections 2024-06-02T04:03:55.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.662+0000 7f566a348700 1 -- 172.21.15.123:0/2718311384 wait complete. 2024-06-02T04:03:55.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.663+0000 7f566a348700 1 Processor -- start 2024-06-02T04:03:55.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.663+0000 7f566a348700 1 -- start start 2024-06-02T04:03:55.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.663+0000 7f566a348700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56640ffe60 0x7f5664068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:55.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.663+0000 7f566a348700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5664100fb0 0x7f566419e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:55.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.663+0000 7f566a348700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5664101970 0x7f56641a0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:55.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.663+0000 7f566a348700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56641a0bd0 con 0x7f5664100fb0 2024-06-02T04:03:55.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.663+0000 7f566a348700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56641a0d40 con 0x7f5664101970 2024-06-02T04:03:55.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.663+0000 7f566a348700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56641a0f00 con 0x7f56640ffe60 2024-06-02T04:03:55.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.663+0000 7f56637fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5664100fb0 0x7f566419e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:55.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.663+0000 7f56637fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5664100fb0 0x7f566419e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42854/0 (socket says 172.21.15.123:42854) 2024-06-02T04:03:55.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.663+0000 7f56637fe700 1 -- 172.21.15.123:0/1717271504 learned_addr learned my addr 172.21.15.123:0/1717271504 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:55.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.663+0000 7f5663fff700 1 --2- 172.21.15.123:0/1717271504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56640ffe60 0x7f5664068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:55.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.664+0000 7f56688e5700 1 --2- 172.21.15.123:0/1717271504 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5664101970 0x7f56641a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:55.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.664+0000 7f56637fe700 1 -- 172.21.15.123:0/1717271504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56640ffe60 msgr2=0x7f5664068b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:55.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.664+0000 7f56637fe700 1 --2- 172.21.15.123:0/1717271504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56640ffe60 0x7f5664068b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:55.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.664+0000 7f56637fe700 1 -- 172.21.15.123:0/1717271504 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5664101970 msgr2=0x7f56641a0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:55.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.664+0000 7f56637fe700 1 --2- 172.21.15.123:0/1717271504 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5664101970 0x7f56641a0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:55.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.664+0000 7f56637fe700 1 -- 172.21.15.123:0/1717271504 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56580095f0 con 0x7f5664100fb0 2024-06-02T04:03:55.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.664+0000 7f56688e5700 1 --2- 172.21.15.123:0/1717271504 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5664101970 0x7f56641a0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:03:55.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.664+0000 7f56637fe700 1 --2- 172.21.15.123:0/1717271504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5664100fb0 0x7f566419e020 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f565800b5c0 tx=0x7f5658005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:55.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.664+0000 7f56617fa700 1 -- 172.21.15.123:0/1717271504 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565801d070 con 0x7f5664100fb0 2024-06-02T04:03:55.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.664+0000 7f566a348700 1 -- 172.21.15.123:0/1717271504 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56641a1180 con 0x7f5664100fb0 2024-06-02T04:03:55.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.664+0000 7f56617fa700 1 -- 172.21.15.123:0/1717271504 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5658004060 con 0x7f5664100fb0 2024-06-02T04:03:55.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.664+0000 7f56617fa700 1 -- 172.21.15.123:0/1717271504 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5658022e10 con 0x7f5664100fb0 2024-06-02T04:03:55.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.664+0000 7f566a348700 1 -- 172.21.15.123:0/1717271504 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56641a1600 con 0x7f5664100fb0 2024-06-02T04:03:55.667 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.665+0000 7f566a348700 1 -- 172.21.15.123:0/1717271504 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56641072a0 con 0x7f5664100fb0 2024-06-02T04:03:55.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.666+0000 7f56617fa700 1 -- 172.21.15.123:0/1717271504 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f5658022570 con 0x7f5664100fb0 2024-06-02T04:03:55.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.667+0000 7f56617fa700 1 --2- 172.21.15.123:0/1717271504 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f564c0a1230 0x7f564c0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:55.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.667+0000 7f5663fff700 1 --2- 172.21.15.123:0/1717271504 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f564c0a1230 0x7f564c0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:55.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.667+0000 7f56617fa700 1 -- 172.21.15.123:0/1717271504 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f56580cdc50 con 0x7f5664100fb0 2024-06-02T04:03:55.668 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.667+0000 7f5663fff700 1 --2- 172.21.15.123:0/1717271504 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f564c0a1230 0x7f564c0a36f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5654005950 tx=0x7f56540058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:55.670 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.670+0000 7f56617fa700 1 -- 172.21.15.123:0/1717271504 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f56580974c0 con 0x7f5664100fb0 2024-06-02T04:03:55.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.871+0000 7f566a348700 1 -- 172.21.15.123:0/1717271504 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f566410b770 con 0x7f5664100fb0 2024-06-02T04:03:55.871 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.871+0000 7f56617fa700 1 -- 172.21.15.123:0/1717271504 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+11 (secure 0 0 0) 0x7f565809aae0 con 0x7f5664100fb0 2024-06-02T04:03:55.871 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-06-02T04:03:55.873 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.873+0000 7f566a348700 1 -- 172.21.15.123:0/1717271504 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f564c0a1230 msgr2=0x7f564c0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:55.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.873+0000 7f566a348700 1 --2- 172.21.15.123:0/1717271504 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f564c0a1230 0x7f564c0a36f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5654005950 tx=0x7f56540058e0 comp rx=0 tx=0).stop 2024-06-02T04:03:55.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.873+0000 7f566a348700 1 -- 172.21.15.123:0/1717271504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5664100fb0 msgr2=0x7f566419e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:55.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.873+0000 7f566a348700 1 --2- 172.21.15.123:0/1717271504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5664100fb0 0x7f566419e020 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f565800b5c0 tx=0x7f5658005e80 comp rx=0 tx=0).stop 2024-06-02T04:03:55.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.873+0000 7f566a348700 1 -- 172.21.15.123:0/1717271504 shutdown_connections 2024-06-02T04:03:55.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.873+0000 7f566a348700 1 --2- 172.21.15.123:0/1717271504 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f564c0a1230 0x7f564c0a36f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:55.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.873+0000 7f566a348700 1 --2- 172.21.15.123:0/1717271504 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5664101970 0x7f56641a0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:55.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.873+0000 7f566a348700 1 --2- 172.21.15.123:0/1717271504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56640ffe60 0x7f5664068b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:55.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.873+0000 7f566a348700 1 --2- 172.21.15.123:0/1717271504 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5664100fb0 0x7f566419e020 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:55.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.873+0000 7f566a348700 1 -- 172.21.15.123:0/1717271504 >> 172.21.15.123:0/1717271504 conn(0x7f56640fb3f0 msgr2=0x7f56641043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:55.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.874+0000 7f566a348700 1 -- 172.21.15.123:0/1717271504 shutdown_connections 2024-06-02T04:03:55.874 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:55.874+0000 7f566a348700 1 -- 172.21.15.123:0/1717271504 wait complete. 2024-06-02T04:03:55.886 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-02T04:03:56.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.012+0000 7fcd93025700 1 -- 172.21.15.123:0/2942332058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd8c100fd0 msgr2=0x7fcd8c101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:56.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.012+0000 7fcd93025700 1 --2- 172.21.15.123:0/2942332058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd8c100fd0 0x7fcd8c101450 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcd78009990 tx=0x7fcd78009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:56.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.012+0000 7fcd93025700 1 -- 172.21.15.123:0/2942332058 shutdown_connections 2024-06-02T04:03:56.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.012+0000 7fcd93025700 1 --2- 172.21.15.123:0/2942332058 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd8c101990 0x7fcd8c1082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:56.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.012+0000 7fcd93025700 1 --2- 172.21.15.123:0/2942332058 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcd8c0ffe80 0x7fcd8c1002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:56.012 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.012+0000 7fcd93025700 1 --2- 172.21.15.123:0/2942332058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd8c100fd0 0x7fcd8c101450 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:56.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.012+0000 7fcd93025700 1 -- 172.21.15.123:0/2942332058 >> 172.21.15.123:0/2942332058 conn(0x7fcd8c0fb3f0 msgr2=0x7fcd8c0fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:56.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.012+0000 7fcd93025700 1 -- 172.21.15.123:0/2942332058 shutdown_connections 2024-06-02T04:03:56.013 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.012+0000 7fcd93025700 1 -- 172.21.15.123:0/2942332058 wait complete. 2024-06-02T04:03:56.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.013+0000 7fcd93025700 1 Processor -- start 2024-06-02T04:03:56.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.013+0000 7fcd93025700 1 -- start start 2024-06-02T04:03:56.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.013+0000 7fcd93025700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd8c0ffe80 0x7fcd8c069f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:56.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.013+0000 7fcd93025700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd8c100fd0 0x7fcd8c19bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:56.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.013+0000 7fcd93025700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcd8c101990 0x7fcd8c19e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:56.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.013+0000 7fcd93025700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c19ea00 con 0x7fcd8c100fd0 2024-06-02T04:03:56.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.013+0000 7fcd93025700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c19eb70 con 0x7fcd8c101990 2024-06-02T04:03:56.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.013+0000 7fcd93025700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c19ed30 con 0x7fcd8c0ffe80 2024-06-02T04:03:56.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.013+0000 7fcd8bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd8c100fd0 0x7fcd8c19bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:56.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.013+0000 7fcd8bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd8c100fd0 0x7fcd8c19bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42872/0 (socket says 172.21.15.123:42872) 2024-06-02T04:03:56.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.013+0000 7fcd8bfff700 1 -- 172.21.15.123:0/803170384 learned_addr learned my addr 172.21.15.123:0/803170384 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:56.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.013+0000 7fcd915c2700 1 --2- 172.21.15.123:0/803170384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcd8c101990 0x7fcd8c19e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:56.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.013+0000 7fcd90dc1700 1 --2- 172.21.15.123:0/803170384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd8c0ffe80 0x7fcd8c069f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:56.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.013+0000 7fcd8bfff700 1 -- 172.21.15.123:0/803170384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd8c0ffe80 msgr2=0x7fcd8c069f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:56.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.013+0000 7fcd8bfff700 1 --2- 172.21.15.123:0/803170384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd8c0ffe80 0x7fcd8c069f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:56.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.013+0000 7fcd8bfff700 1 -- 172.21.15.123:0/803170384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcd8c101990 msgr2=0x7fcd8c19e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:56.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.013+0000 7fcd8bfff700 1 --2- 172.21.15.123:0/803170384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcd8c101990 0x7fcd8c19e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:56.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.013+0000 7fcd8bfff700 1 -- 172.21.15.123:0/803170384 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd780095f0 con 0x7fcd8c100fd0 2024-06-02T04:03:56.016 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.013+0000 7fcd90dc1700 1 --2- 172.21.15.123:0/803170384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd8c0ffe80 0x7fcd8c069f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:03:56.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.013+0000 7fcd8bfff700 1 --2- 172.21.15.123:0/803170384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd8c100fd0 0x7fcd8c19bc70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fcd78005910 tx=0x7fcd78004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:56.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.014+0000 7fcd89ffb700 1 -- 172.21.15.123:0/803170384 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7801d070 con 0x7fcd8c100fd0 2024-06-02T04:03:56.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.014+0000 7fcd89ffb700 1 -- 172.21.15.123:0/803170384 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd78003f60 con 0x7fcd8c100fd0 2024-06-02T04:03:56.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.014+0000 7fcd89ffb700 1 -- 172.21.15.123:0/803170384 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd78022cc0 con 0x7fcd8c100fd0 2024-06-02T04:03:56.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.014+0000 7fcd93025700 1 -- 172.21.15.123:0/803170384 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd8c19efb0 con 0x7fcd8c100fd0 2024-06-02T04:03:56.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.014+0000 7fcd93025700 1 -- 172.21.15.123:0/803170384 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd8c19f320 con 0x7fcd8c100fd0 2024-06-02T04:03:56.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.015+0000 7fcd93025700 1 -- 172.21.15.123:0/803170384 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd8c107290 con 0x7fcd8c100fd0 2024-06-02T04:03:56.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.016+0000 7fcd89ffb700 1 -- 172.21.15.123:0/803170384 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fcd780040d0 con 0x7fcd8c100fd0 2024-06-02T04:03:56.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.017+0000 7fcd89ffb700 1 --2- 172.21.15.123:0/803170384 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fcd7c0a11b0 0x7fcd7c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:56.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.017+0000 7fcd90dc1700 1 --2- 172.21.15.123:0/803170384 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fcd7c0a11b0 0x7fcd7c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:56.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.017+0000 7fcd89ffb700 1 -- 172.21.15.123:0/803170384 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fcd780ce330 con 0x7fcd8c100fd0 2024-06-02T04:03:56.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.017+0000 7fcd90dc1700 1 --2- 172.21.15.123:0/803170384 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fcd7c0a11b0 0x7fcd7c0a3670 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fcd80005950 tx=0x7fcd800058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:56.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.020+0000 7fcd89ffb700 1 -- 172.21.15.123:0/803170384 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fcd78097aa0 con 0x7fcd8c100fd0 2024-06-02T04:03:56.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.217+0000 7fcd93025700 1 -- 172.21.15.123:0/803170384 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcd8c10b7e0 con 0x7fcd8c100fd0 2024-06-02T04:03:56.217 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.217+0000 7fcd89ffb700 1 -- 172.21.15.123:0/803170384 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcd7809b0c0 con 0x7fcd8c100fd0 2024-06-02T04:03:56.217 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-06-02T04:03:56.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.220+0000 7fcd93025700 1 -- 172.21.15.123:0/803170384 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fcd7c0a11b0 msgr2=0x7fcd7c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:56.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.220+0000 7fcd93025700 1 --2- 172.21.15.123:0/803170384 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fcd7c0a11b0 0x7fcd7c0a3670 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fcd80005950 tx=0x7fcd800058e0 comp rx=0 tx=0).stop 2024-06-02T04:03:56.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.220+0000 7fcd93025700 1 -- 172.21.15.123:0/803170384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd8c100fd0 msgr2=0x7fcd8c19bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:56.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.220+0000 7fcd93025700 1 --2- 172.21.15.123:0/803170384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd8c100fd0 0x7fcd8c19bc70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fcd78005910 tx=0x7fcd78004730 comp rx=0 tx=0).stop 2024-06-02T04:03:56.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.220+0000 7fcd93025700 1 -- 172.21.15.123:0/803170384 shutdown_connections 2024-06-02T04:03:56.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.220+0000 7fcd93025700 1 --2- 172.21.15.123:0/803170384 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fcd7c0a11b0 0x7fcd7c0a3670 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:56.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.220+0000 7fcd93025700 1 --2- 172.21.15.123:0/803170384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcd8c101990 0x7fcd8c19e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:56.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.220+0000 7fcd93025700 1 --2- 172.21.15.123:0/803170384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd8c0ffe80 0x7fcd8c069f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:56.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.220+0000 7fcd93025700 1 --2- 172.21.15.123:0/803170384 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fcd8c100fd0 0x7fcd8c19bc70 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:56.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.220+0000 7fcd93025700 1 -- 172.21.15.123:0/803170384 >> 172.21.15.123:0/803170384 conn(0x7fcd8c0fb3f0 msgr2=0x7fcd8c1043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:56.220 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.220+0000 7fcd93025700 1 -- 172.21.15.123:0/803170384 shutdown_connections 2024-06-02T04:03:56.221 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.220+0000 7fcd93025700 1 -- 172.21.15.123:0/803170384 wait complete. 2024-06-02T04:03:56.231 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:55 smithi123 ceph-mon[42885]: pgmap v246: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T04:03:56.231 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:55 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2019106036' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:03:56.231 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:55 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2466232120' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:03:56.231 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:55 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1717271504' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:03:56.232 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:03:56.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:55 smithi162 ceph-mon[47009]: pgmap v246: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T04:03:56.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:55 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/2019106036' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:03:56.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:55 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/2466232120' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:03:56.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:55 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/1717271504' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:03:56.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:55 smithi136 ceph-mon[47443]: pgmap v246: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T04:03:56.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:55 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/2019106036' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:03:56.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:55 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/2466232120' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:03:56.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:55 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/1717271504' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:03:56.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.354+0000 7f0b7642a700 1 -- 172.21.15.123:0/3934526016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b701021b0 msgr2=0x7f0b70102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:56.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.354+0000 7f0b7642a700 1 --2- 172.21.15.123:0/3934526016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b701021b0 0x7f0b70102610 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0b64009990 tx=0x7f0b64009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:56.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.354+0000 7f0b7642a700 1 -- 172.21.15.123:0/3934526016 shutdown_connections 2024-06-02T04:03:56.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.354+0000 7f0b7642a700 1 --2- 172.21.15.123:0/3934526016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b70102b50 0x7f0b70109400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:56.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.354+0000 7f0b7642a700 1 --2- 172.21.15.123:0/3934526016 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b700ff140 0x7f0b700ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:56.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.354+0000 7f0b7642a700 1 --2- 172.21.15.123:0/3934526016 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b701021b0 0x7f0b70102610 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:56.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.354+0000 7f0b7642a700 1 -- 172.21.15.123:0/3934526016 >> 172.21.15.123:0/3934526016 conn(0x7f0b700faa70 msgr2=0x7f0b700fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:56.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.355+0000 7f0b7642a700 1 -- 172.21.15.123:0/3934526016 shutdown_connections 2024-06-02T04:03:56.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.355+0000 7f0b7642a700 1 -- 172.21.15.123:0/3934526016 wait complete. 2024-06-02T04:03:56.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.355+0000 7f0b7642a700 1 Processor -- start 2024-06-02T04:03:56.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.355+0000 7f0b7642a700 1 -- start start 2024-06-02T04:03:56.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.355+0000 7f0b7642a700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b700ff140 0x7f0b70196eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:56.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.355+0000 7f0b7642a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b701021b0 0x7f0b701973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:56.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.355+0000 7f0b7642a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b70102b50 0x7f0b7019e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:56.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.355+0000 7f0b7642a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7019e9e0 con 0x7f0b70102b50 2024-06-02T04:03:56.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.355+0000 7f0b7642a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7019eb20 con 0x7f0b701021b0 2024-06-02T04:03:56.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.355+0000 7f0b7642a700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7019ecb0 con 0x7f0b700ff140 2024-06-02T04:03:56.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.356+0000 7f0b749c7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b70102b50 0x7f0b7019e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:56.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.356+0000 7f0b749c7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b70102b50 0x7f0b7019e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42888/0 (socket says 172.21.15.123:42888) 2024-06-02T04:03:56.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.356+0000 7f0b749c7700 1 -- 172.21.15.123:0/4208161458 learned_addr learned my addr 172.21.15.123:0/4208161458 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:56.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.356+0000 7f0b6ffff700 1 --2- 172.21.15.123:0/4208161458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b700ff140 0x7f0b70196eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:56.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.356+0000 7f0b6f7fe700 1 --2- 172.21.15.123:0/4208161458 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b701021b0 0x7f0b701973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:56.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.356+0000 7f0b749c7700 1 -- 172.21.15.123:0/4208161458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b700ff140 msgr2=0x7f0b70196eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:56.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.356+0000 7f0b749c7700 1 --2- 172.21.15.123:0/4208161458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b700ff140 0x7f0b70196eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:56.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.356+0000 7f0b749c7700 1 -- 172.21.15.123:0/4208161458 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b701021b0 msgr2=0x7f0b701973f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:56.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.356+0000 7f0b749c7700 1 --2- 172.21.15.123:0/4208161458 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b701021b0 0x7f0b701973f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:56.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.356+0000 7f0b749c7700 1 -- 172.21.15.123:0/4208161458 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b640095f0 con 0x7f0b70102b50 2024-06-02T04:03:56.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.356+0000 7f0b6ffff700 1 --2- 172.21.15.123:0/4208161458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b700ff140 0x7f0b70196eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:03:56.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.356+0000 7f0b6f7fe700 1 --2- 172.21.15.123:0/4208161458 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b701021b0 0x7f0b701973f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:03:56.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.356+0000 7f0b749c7700 1 --2- 172.21.15.123:0/4208161458 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b70102b50 0x7f0b7019e410 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0b6800b970 tx=0x7f0b6800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:56.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.356+0000 7f0b6d7fa700 1 -- 172.21.15.123:0/4208161458 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6800c9b0 con 0x7f0b70102b50 2024-06-02T04:03:56.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.356+0000 7f0b6d7fa700 1 -- 172.21.15.123:0/4208161458 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b68014440 con 0x7f0b70102b50 2024-06-02T04:03:56.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.356+0000 7f0b7642a700 1 -- 172.21.15.123:0/4208161458 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b7019ef90 con 0x7f0b70102b50 2024-06-02T04:03:56.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.356+0000 7f0b6d7fa700 1 -- 172.21.15.123:0/4208161458 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b680075d0 con 0x7f0b70102b50 2024-06-02T04:03:56.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.356+0000 7f0b7642a700 1 -- 172.21.15.123:0/4208161458 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b7019f490 con 0x7f0b70102b50 2024-06-02T04:03:56.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.357+0000 7f0b7642a700 1 -- 172.21.15.123:0/4208161458 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b701083e0 con 0x7f0b70102b50 2024-06-02T04:03:56.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.358+0000 7f0b6d7fa700 1 -- 172.21.15.123:0/4208161458 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f0b680145b0 con 0x7f0b70102b50 2024-06-02T04:03:56.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.359+0000 7f0b6d7fa700 1 --2- 172.21.15.123:0/4208161458 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0b580a1230 0x7f0b580a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:56.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.359+0000 7f0b6ffff700 1 --2- 172.21.15.123:0/4208161458 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0b580a1230 0x7f0b580a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:56.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.359+0000 7f0b6d7fa700 1 -- 172.21.15.123:0/4208161458 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f0b68006e40 con 0x7f0b70102b50 2024-06-02T04:03:56.361 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.359+0000 7f0b6ffff700 1 --2- 172.21.15.123:0/4208161458 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0b580a1230 0x7f0b580a36f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0b70067d30 tx=0x7f0b60008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:56.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.362+0000 7f0b6d7fa700 1 -- 172.21.15.123:0/4208161458 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0b68095b90 con 0x7f0b70102b50 2024-06-02T04:03:56.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.603+0000 7f0b7642a700 1 -- 172.21.15.123:0/4208161458 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b70067380 con 0x7f0b70102b50 2024-06-02T04:03:56.603 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.603+0000 7f0b6d7fa700 1 -- 172.21.15.123:0/4208161458 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10930 (secure 0 0 0) 0x7f0b680991b0 con 0x7f0b70102b50 2024-06-02T04:03:56.603 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:03:56.603 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1940848601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1940848601},{"type":"v1","addr":"172.21.15.123:6835","nonce":1940848601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/54447879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":54447879},{"type":"v1","addr":"172.21.15.123:6837","nonce":54447879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T04:03:06.667888+0000","modified":"2024-06-02T04:03:13.099282+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24490,"mds_2":24473,"mds_3":24439,"mds_4":24437},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6839/3806973328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":3806973328},{"type":"v1","addr":"172.21.15.123:6839","nonce":3806973328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14619":{"gid":14619,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6841/4032992994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":4032992994},{"type":"v1","addr":"172.21.15.123:6841","nonce":4032992994}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24437":{"gid":24437,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6833/2006585076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2006585076},{"type":"v1","addr":"172.21.15.136:6833","nonce":2006585076}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.162:6833/3583622784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3583622784},{"type":"v1","addr":"172.21.15.162:6833","nonce":3583622784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/2894031422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2894031422},{"type":"v1","addr":"172.21.15.136:6835","nonce":2894031422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24463":{"gid":24463,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2478943987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2478943987},{"type":"v1","addr":"172.21.15.162:6835","nonce":2478943987}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3402138468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3402138468},{"type":"v1","addr":"172.21.15.162:6837","nonce":3402138468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.136:6837/2572418263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2572418263},{"type":"v1","addr":"172.21.15.136:6837","nonce":2572418263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/2588884232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2588884232},{"type":"v1","addr":"172.21.15.162:6839","nonce":2588884232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6839/952830191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":952830191},{"type":"v1","addr":"172.21.15.136:6839","nonce":952830191}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-06-02T04:03:56.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.606+0000 7f0b7642a700 1 -- 172.21.15.123:0/4208161458 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0b580a1230 msgr2=0x7f0b580a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:56.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.606+0000 7f0b7642a700 1 --2- 172.21.15.123:0/4208161458 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0b580a1230 0x7f0b580a36f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0b70067d30 tx=0x7f0b60008040 comp rx=0 tx=0).stop 2024-06-02T04:03:56.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.606+0000 7f0b7642a700 1 -- 172.21.15.123:0/4208161458 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b70102b50 msgr2=0x7f0b7019e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:56.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.606+0000 7f0b7642a700 1 --2- 172.21.15.123:0/4208161458 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b70102b50 0x7f0b7019e410 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0b6800b970 tx=0x7f0b6800bd30 comp rx=0 tx=0).stop 2024-06-02T04:03:56.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.606+0000 7f0b7642a700 1 -- 172.21.15.123:0/4208161458 shutdown_connections 2024-06-02T04:03:56.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.606+0000 7f0b7642a700 1 --2- 172.21.15.123:0/4208161458 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0b70102b50 0x7f0b7019e410 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:56.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.606+0000 7f0b7642a700 1 --2- 172.21.15.123:0/4208161458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0b700ff140 0x7f0b70196eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:56.606 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.606+0000 7f0b7642a700 1 --2- 172.21.15.123:0/4208161458 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0b580a1230 0x7f0b580a36f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:56.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.606+0000 7f0b7642a700 1 --2- 172.21.15.123:0/4208161458 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b701021b0 0x7f0b701973f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:56.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.606+0000 7f0b7642a700 1 -- 172.21.15.123:0/4208161458 >> 172.21.15.123:0/4208161458 conn(0x7f0b700faa70 msgr2=0x7f0b70105520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:56.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.606+0000 7f0b7642a700 1 -- 172.21.15.123:0/4208161458 shutdown_connections 2024-06-02T04:03:56.607 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.606+0000 7f0b7642a700 1 -- 172.21.15.123:0/4208161458 wait complete. 2024-06-02T04:03:56.607 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 27 2024-06-02T04:03:56.618 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:03:56.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.741+0000 7fb84d6e0700 1 -- 172.21.15.123:0/977579736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb848101920 msgr2=0x7fb8481081d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:56.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.741+0000 7fb84d6e0700 1 --2- 172.21.15.123:0/977579736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb848101920 0x7fb8481081d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb84000b0d0 tx=0x7fb84000b3e0 comp rx=0 tx=0).stop 2024-06-02T04:03:56.743 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.741+0000 7fb84d6e0700 1 -- 172.21.15.123:0/977579736 shutdown_connections 2024-06-02T04:03:56.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.741+0000 7fb84d6e0700 1 --2- 172.21.15.123:0/977579736 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb848101920 0x7fb8481081d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:56.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.741+0000 7fb84d6e0700 1 --2- 172.21.15.123:0/977579736 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8480ffd90 0x7fb8481001b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:56.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.741+0000 7fb84d6e0700 1 --2- 172.21.15.123:0/977579736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb848100f80 0x7fb8481013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:56.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.741+0000 7fb84d6e0700 1 -- 172.21.15.123:0/977579736 >> 172.21.15.123:0/977579736 conn(0x7fb8480fb300 msgr2=0x7fb8480fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:56.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.741+0000 7fb84d6e0700 1 -- 172.21.15.123:0/977579736 shutdown_connections 2024-06-02T04:03:56.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.741+0000 7fb84d6e0700 1 -- 172.21.15.123:0/977579736 wait complete. 2024-06-02T04:03:56.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.742+0000 7fb84d6e0700 1 Processor -- start 2024-06-02T04:03:56.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.742+0000 7fb84d6e0700 1 -- start start 2024-06-02T04:03:56.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.742+0000 7fb84d6e0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8480ffd90 0x7fb848195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:56.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.742+0000 7fb84d6e0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb848100f80 0x7fb848196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:56.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.742+0000 7fb84d6e0700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb848101920 0x7fb84819d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:56.744 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.742+0000 7fb84d6e0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84819d8f0 con 0x7fb848100f80 2024-06-02T04:03:56.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.742+0000 7fb84d6e0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84819da30 con 0x7fb8480ffd90 2024-06-02T04:03:56.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.742+0000 7fb84d6e0700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84819dbc0 con 0x7fb848101920 2024-06-02T04:03:56.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.742+0000 7fb8467fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb848100f80 0x7fb848196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:56.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.742+0000 7fb8467fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb848100f80 0x7fb848196300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42920/0 (socket says 172.21.15.123:42920) 2024-06-02T04:03:56.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.742+0000 7fb8467fc700 1 -- 172.21.15.123:0/4038138741 learned_addr learned my addr 172.21.15.123:0/4038138741 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:56.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.742+0000 7fb846ffd700 1 --2- 172.21.15.123:0/4038138741 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8480ffd90 0x7fb848195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:56.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.742+0000 7fb8467fc700 1 -- 172.21.15.123:0/4038138741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb848101920 msgr2=0x7fb84819d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:56.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.742+0000 7fb8467fc700 1 --2- 172.21.15.123:0/4038138741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb848101920 0x7fb84819d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:56.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.742+0000 7fb8467fc700 1 -- 172.21.15.123:0/4038138741 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8480ffd90 msgr2=0x7fb848195dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:56.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.742+0000 7fb8467fc700 1 --2- 172.21.15.123:0/4038138741 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8480ffd90 0x7fb848195dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:56.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.742+0000 7fb8467fc700 1 -- 172.21.15.123:0/4038138741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb840009d00 con 0x7fb848100f80 2024-06-02T04:03:56.745 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.742+0000 7fb846ffd700 1 --2- 172.21.15.123:0/4038138741 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8480ffd90 0x7fb848195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:03:56.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.742+0000 7fb8467fc700 1 --2- 172.21.15.123:0/4038138741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb848100f80 0x7fb848196300 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb83800e9a0 tx=0x7fb83800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:56.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.743+0000 7fb82ffff700 1 -- 172.21.15.123:0/4038138741 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838009790 con 0x7fb848100f80 2024-06-02T04:03:56.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.743+0000 7fb82ffff700 1 -- 172.21.15.123:0/4038138741 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb83800cbd0 con 0x7fb848100f80 2024-06-02T04:03:56.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.743+0000 7fb84d6e0700 1 -- 172.21.15.123:0/4038138741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb84819dea0 con 0x7fb848100f80 2024-06-02T04:03:56.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.743+0000 7fb82ffff700 1 -- 172.21.15.123:0/4038138741 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838018680 con 0x7fb848100f80 2024-06-02T04:03:56.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.743+0000 7fb84d6e0700 1 -- 172.21.15.123:0/4038138741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb84819e320 con 0x7fb848100f80 2024-06-02T04:03:56.746 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.744+0000 7fb84d6e0700 1 -- 172.21.15.123:0/4038138741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb848107140 con 0x7fb848100f80 2024-06-02T04:03:56.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.745+0000 7fb82ffff700 1 -- 172.21.15.123:0/4038138741 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fb83800cd40 con 0x7fb848100f80 2024-06-02T04:03:56.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.746+0000 7fb82ffff700 1 --2- 172.21.15.123:0/4038138741 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb8300a11b0 0x7fb8300a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:56.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.746+0000 7fb846ffd700 1 --2- 172.21.15.123:0/4038138741 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb8300a11b0 0x7fb8300a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:56.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.746+0000 7fb82ffff700 1 -- 172.21.15.123:0/4038138741 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb838014070 con 0x7fb848100f80 2024-06-02T04:03:56.747 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.746+0000 7fb846ffd700 1 --2- 172.21.15.123:0/4038138741 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb8300a11b0 0x7fb8300a3670 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb83c005950 tx=0x7fb83c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:56.749 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.749+0000 7fb82ffff700 1 -- 172.21.15.123:0/4038138741 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb838096850 con 0x7fb848100f80 2024-06-02T04:03:56.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.947+0000 7fb84d6e0700 1 -- 172.21.15.123:0/4038138741 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb84810b5e0 con 0x7fb848100f80 2024-06-02T04:03:56.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.948+0000 7fb82ffff700 1 -- 172.21.15.123:0/4038138741 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22175 (secure 0 0 0) 0x7fb838099e70 con 0x7fb848100f80 2024-06-02T04:03:56.949 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:03:56.949 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":82,"fsid":"1b432ae0-2094-11ef-bc9b-c7b262605968","created":"2024-06-02T03:57:17.383774+0000","modified":"2024-06-02T04:03:07.669997+0000","last_up_change":"2024-06-02T04:02:34.535591+0000","last_in_change":"2024-06-02T04:02:18.346560+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T03:59:57.079448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:03:05.199881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:03:05.853741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d9d8fb5a-dac5-4b14-98e5-665bdbc696ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6803","nonce":2763421276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6805","nonce":2763421276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6809","nonce":2763421276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6807","nonce":2763421276}]},"public_addr":"172.21.15.123:6803/2763421276","cluster_addr":"172.21.15.123:6805/2763421276","heartbeat_back_addr":"172.21.15.123:6809/2763421276","heartbeat_front_addr":"172.21.15.123:6807/2763421276","state":["exists","up"]},{"osd":1,"uuid":"121bbe3c-bb76-4ec4-9596-37db68fbf1ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6801","nonce":956325510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6803","nonce":956325510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6807","nonce":956325510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6805","nonce":956325510}]},"public_addr":"172.21.15.136:6801/956325510","cluster_addr":"172.21.15.136:6803/956325510","heartbeat_back_addr":"172.21.15.136:6807/956325510","heartbeat_front_addr":"172.21.15.136:6805/956325510","state":["exists","up"]},{"osd":2,"uuid":"df9edf0d-f9f0-4699-a6ed-bbcf2dfb1b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6801","nonce":2915749676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6803","nonce":2915749676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6807","nonce":2915749676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6805","nonce":2915749676}]},"public_addr":"172.21.15.162:6801/2915749676","cluster_addr":"172.21.15.162:6803/2915749676","heartbeat_back_addr":"172.21.15.162:6807/2915749676","heartbeat_front_addr":"172.21.15.162:6805/2915749676","state":["exists","up"]},{"osd":3,"uuid":"3e070364-12c6-4780-b2be-f6e933e65773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6811","nonce":1403773143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6813","nonce":1403773143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6817","nonce":1403773143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6815","nonce":1403773143}]},"public_addr":"172.21.15.123:6811/1403773143","cluster_addr":"172.21.15.123:6813/1403773143","heartbeat_back_addr":"172.21.15.123:6817/1403773143","heartbeat_front_addr":"172.21.15.123:6815/1403773143","state":["exists","up"]},{"osd":4,"uuid":"87dd92dd-73c8-4785-bf8a-3756d79dee90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6809","nonce":1403526782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6811","nonce":1403526782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6815","nonce":1403526782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6813","nonce":1403526782}]},"public_addr":"172.21.15.136:6809/1403526782","cluster_addr":"172.21.15.136:6811/1403526782","heartbeat_back_addr":"172.21.15.136:6815/1403526782","heartbeat_front_addr":"172.21.15.136:6813/1403526782","state":["exists","up"]},{"osd":5,"uuid":"1a730863-6b56-43b7-a115-c80d3c8f3ee3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6809","nonce":3094256489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6811","nonce":3094256489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6815","nonce":3094256489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6813","nonce":3094256489}]},"public_addr":"172.21.15.162:6809/3094256489","cluster_addr":"172.21.15.162:6811/3094256489","heartbeat_back_addr":"172.21.15.162:6815/3094256489","heartbeat_front_addr":"172.21.15.162:6813/3094256489","state":["exists","up"]},{"osd":6,"uuid":"6f170b85-6c47-49ff-ba5b-7fe0596a4ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6819","nonce":3025820432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6821","nonce":3025820432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6825","nonce":3025820432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6823","nonce":3025820432}]},"public_addr":"172.21.15.123:6819/3025820432","cluster_addr":"172.21.15.123:6821/3025820432","heartbeat_back_addr":"172.21.15.123:6825/3025820432","heartbeat_front_addr":"172.21.15.123:6823/3025820432","state":["exists","up"]},{"osd":7,"uuid":"ee66bb7a-6c0d-4e5a-b717-258a39f93a87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6817","nonce":1948829505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6819","nonce":1948829505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6823","nonce":1948829505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6821","nonce":1948829505}]},"public_addr":"172.21.15.136:6817/1948829505","cluster_addr":"172.21.15.136:6819/1948829505","heartbeat_back_addr":"172.21.15.136:6823/1948829505","heartbeat_front_addr":"172.21.15.136:6821/1948829505","state":["exists","up"]},{"osd":8,"uuid":"0ff77e33-53a5-43ef-85da-2036a1fcdb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6817","nonce":1590839230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6819","nonce":1590839230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6823","nonce":1590839230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6821","nonce":1590839230}]},"public_addr":"172.21.15.162:6817/1590839230","cluster_addr":"172.21.15.162:6819/1590839230","heartbeat_back_addr":"172.21.15.162:6823/1590839230","heartbeat_front_addr":"172.21.15.162:6821/1590839230","state":["exists","up"]},{"osd":9,"uuid":"1670731c-5e8f-4cbc-8f35-6aeb14ea3075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6827","nonce":608720685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6829","nonce":608720685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6833","nonce":608720685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6831","nonce":608720685}]},"public_addr":"172.21.15.123:6827/608720685","cluster_addr":"172.21.15.123:6829/608720685","heartbeat_back_addr":"172.21.15.123:6833/608720685","heartbeat_front_addr":"172.21.15.123:6831/608720685","state":["exists","up"]},{"osd":10,"uuid":"ae138b96-13e7-46ac-9d4d-48308132465d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6825","nonce":3777263126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6827","nonce":3777263126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6831","nonce":3777263126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6829","nonce":3777263126}]},"public_addr":"172.21.15.136:6825/3777263126","cluster_addr":"172.21.15.136:6827/3777263126","heartbeat_back_addr":"172.21.15.136:6831/3777263126","heartbeat_front_addr":"172.21.15.136:6829/3777263126","state":["exists","up"]},{"osd":11,"uuid":"69f4ede0-7e9b-4edb-be54-01f74f002a06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6825","nonce":704809754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6827","nonce":704809754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6831","nonce":704809754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6829","nonce":704809754}]},"public_addr":"172.21.15.162:6825/704809754","cluster_addr":"172.21.15.162:6827/704809754","heartbeat_back_addr":"172.21.15.162:6831/704809754","heartbeat_front_addr":"172.21.15.162:6829/704809754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:19.188506+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:36.535261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:54.242294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:11.815314+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:29.512086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:46.874319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:04.437358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:22.312520+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:39.917998+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:57.340043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:15.252797+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:32.898924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:0/69783025":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/10165744":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/2081407856":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/4026642298":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/1442330765":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/1595718606":"2024-06-03T03:57:45.611046+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:03:56.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.950+0000 7fb84d6e0700 1 -- 172.21.15.123:0/4038138741 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb8300a11b0 msgr2=0x7fb8300a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:56.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.951+0000 7fb84d6e0700 1 --2- 172.21.15.123:0/4038138741 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb8300a11b0 0x7fb8300a3670 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb83c005950 tx=0x7fb83c0058e0 comp rx=0 tx=0).stop 2024-06-02T04:03:56.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.951+0000 7fb84d6e0700 1 -- 172.21.15.123:0/4038138741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb848100f80 msgr2=0x7fb848196300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:56.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.951+0000 7fb84d6e0700 1 --2- 172.21.15.123:0/4038138741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb848100f80 0x7fb848196300 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb83800e9a0 tx=0x7fb83800ed60 comp rx=0 tx=0).stop 2024-06-02T04:03:56.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.951+0000 7fb84d6e0700 1 -- 172.21.15.123:0/4038138741 shutdown_connections 2024-06-02T04:03:56.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.951+0000 7fb84d6e0700 1 --2- 172.21.15.123:0/4038138741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb848101920 0x7fb84819d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:56.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.951+0000 7fb84d6e0700 1 --2- 172.21.15.123:0/4038138741 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb8300a11b0 0x7fb8300a3670 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:56.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.951+0000 7fb84d6e0700 1 --2- 172.21.15.123:0/4038138741 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8480ffd90 0x7fb848195dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:56.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.951+0000 7fb84d6e0700 1 --2- 172.21.15.123:0/4038138741 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fb848100f80 0x7fb848196300 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:56.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.951+0000 7fb84d6e0700 1 -- 172.21.15.123:0/4038138741 >> 172.21.15.123:0/4038138741 conn(0x7fb8480fb300 msgr2=0x7fb848104280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:56.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.951+0000 7fb84d6e0700 1 -- 172.21.15.123:0/4038138741 shutdown_connections 2024-06-02T04:03:56.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:56.951+0000 7fb84d6e0700 1 -- 172.21.15.123:0/4038138741 wait complete. 2024-06-02T04:03:56.964 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:03:57.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.086+0000 7f591199e700 1 -- 172.21.15.123:0/3558258811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f590c1021d0 msgr2=0x7f590c102630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.086+0000 7f591199e700 1 --2- 172.21.15.123:0/3558258811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f590c1021d0 0x7f590c102630 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f58fc009990 tx=0x7f58fc009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.086+0000 7f591199e700 1 -- 172.21.15.123:0/3558258811 shutdown_connections 2024-06-02T04:03:57.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.086+0000 7f591199e700 1 --2- 172.21.15.123:0/3558258811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f590c102b70 0x7f590c109420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.086+0000 7f591199e700 1 --2- 172.21.15.123:0/3558258811 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f590c0ff160 0x7f590c0ff580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.086+0000 7f591199e700 1 --2- 172.21.15.123:0/3558258811 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f590c1021d0 0x7f590c102630 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.086+0000 7f591199e700 1 -- 172.21.15.123:0/3558258811 >> 172.21.15.123:0/3558258811 conn(0x7f590c0faab0 msgr2=0x7f590c0fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:57.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.086+0000 7f591199e700 1 -- 172.21.15.123:0/3558258811 shutdown_connections 2024-06-02T04:03:57.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.086+0000 7f591199e700 1 -- 172.21.15.123:0/3558258811 wait complete. 2024-06-02T04:03:57.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.087+0000 7f591199e700 1 Processor -- start 2024-06-02T04:03:57.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.087+0000 7f591199e700 1 -- start start 2024-06-02T04:03:57.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.087+0000 7f591199e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f590c0ff160 0x7f590c196dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.087+0000 7f591199e700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f590c1021d0 0x7f590c197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.087+0000 7f591199e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f590c102b70 0x7f590c19e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.087+0000 7f591199e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c19e8f0 con 0x7f590c0ff160 2024-06-02T04:03:57.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.087+0000 7f591199e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c19ea30 con 0x7f590c102b70 2024-06-02T04:03:57.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.087+0000 7f591199e700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c19ebc0 con 0x7f590c1021d0 2024-06-02T04:03:57.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.087+0000 7f590affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f590c0ff160 0x7f590c196dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.087+0000 7f590affd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f590c0ff160 0x7f590c196dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42932/0 (socket says 172.21.15.123:42932) 2024-06-02T04:03:57.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.087+0000 7f590affd700 1 -- 172.21.15.123:0/3876935797 learned_addr learned my addr 172.21.15.123:0/3876935797 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:57.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.088+0000 7f590a7fc700 1 --2- 172.21.15.123:0/3876935797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f590c1021d0 0x7f590c197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.088+0000 7f590b7fe700 1 --2- 172.21.15.123:0/3876935797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f590c102b70 0x7f590c19e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.088+0000 7f590affd700 1 -- 172.21.15.123:0/3876935797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f590c1021d0 msgr2=0x7f590c197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.088+0000 7f590affd700 1 --2- 172.21.15.123:0/3876935797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f590c1021d0 0x7f590c197300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.088+0000 7f590affd700 1 -- 172.21.15.123:0/3876935797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f590c102b70 msgr2=0x7f590c19e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.088+0000 7f590affd700 1 --2- 172.21.15.123:0/3876935797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f590c102b70 0x7f590c19e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.088+0000 7f590affd700 1 -- 172.21.15.123:0/3876935797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58fc0095f0 con 0x7f590c0ff160 2024-06-02T04:03:57.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.088+0000 7f590b7fe700 1 --2- 172.21.15.123:0/3876935797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f590c102b70 0x7f590c19e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:03:57.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.088+0000 7f590affd700 1 --2- 172.21.15.123:0/3876935797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f590c0ff160 0x7f590c196dc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f590000c970 tx=0x7f590000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:57.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.088+0000 7f591099c700 1 -- 172.21.15.123:0/3876935797 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5900004220 con 0x7f590c0ff160 2024-06-02T04:03:57.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.088+0000 7f591099c700 1 -- 172.21.15.123:0/3876935797 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5900007d60 con 0x7f590c0ff160 2024-06-02T04:03:57.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.088+0000 7f591199e700 1 -- 172.21.15.123:0/3876935797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f590c19eea0 con 0x7f590c0ff160 2024-06-02T04:03:57.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.088+0000 7f591099c700 1 -- 172.21.15.123:0/3876935797 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5900003d00 con 0x7f590c0ff160 2024-06-02T04:03:57.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.088+0000 7f591199e700 1 -- 172.21.15.123:0/3876935797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f590c19f2c0 con 0x7f590c0ff160 2024-06-02T04:03:57.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.089+0000 7f591199e700 1 -- 172.21.15.123:0/3876935797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f590c0680d0 con 0x7f590c0ff160 2024-06-02T04:03:57.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.090+0000 7f591099c700 1 -- 172.21.15.123:0/3876935797 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f5900004380 con 0x7f590c0ff160 2024-06-02T04:03:57.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.091+0000 7f591099c700 1 --2- 172.21.15.123:0/3876935797 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f58f40a11b0 0x7f58f40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.091+0000 7f590a7fc700 1 --2- 172.21.15.123:0/3876935797 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f58f40a11b0 0x7f58f40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.091+0000 7f591099c700 1 -- 172.21.15.123:0/3876935797 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f59000cc6a0 con 0x7f590c0ff160 2024-06-02T04:03:57.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.091+0000 7f590a7fc700 1 --2- 172.21.15.123:0/3876935797 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f58f40a11b0 0x7f58f40a3670 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f58fc00b5c0 tx=0x7f58fc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:57.094 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.094+0000 7f591099c700 1 -- 172.21.15.123:0/3876935797 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5900095e80 con 0x7f590c0ff160 2024-06-02T04:03:57.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:56 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/803170384' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:03:57.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:56 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/4208161458' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:03:57.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:56 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/4038138741' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:03:57.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:56 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/803170384' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:03:57.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:56 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/4208161458' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:03:57.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:56 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/4038138741' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:03:57.337 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.337+0000 7f591199e700 1 -- 172.21.15.123:0/3876935797 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f590c0680d0 con 0x7f590c0ff160 2024-06-02T04:03:57.338 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.338+0000 7f591099c700 1 -- 172.21.15.123:0/3876935797 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10930 (secure 0 0 0) 0x7f590c0680d0 con 0x7f590c0ff160 2024-06-02T04:03:57.338 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:03:57.338 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1940848601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1940848601},{"type":"v1","addr":"172.21.15.123:6835","nonce":1940848601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/54447879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":54447879},{"type":"v1","addr":"172.21.15.123:6837","nonce":54447879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T04:03:06.667888+0000","modified":"2024-06-02T04:03:13.099282+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24490,"mds_2":24473,"mds_3":24439,"mds_4":24437},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6839/3806973328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":3806973328},{"type":"v1","addr":"172.21.15.123:6839","nonce":3806973328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14619":{"gid":14619,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6841/4032992994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":4032992994},{"type":"v1","addr":"172.21.15.123:6841","nonce":4032992994}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24437":{"gid":24437,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6833/2006585076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2006585076},{"type":"v1","addr":"172.21.15.136:6833","nonce":2006585076}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.162:6833/3583622784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3583622784},{"type":"v1","addr":"172.21.15.162:6833","nonce":3583622784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/2894031422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2894031422},{"type":"v1","addr":"172.21.15.136:6835","nonce":2894031422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24463":{"gid":24463,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2478943987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2478943987},{"type":"v1","addr":"172.21.15.162:6835","nonce":2478943987}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3402138468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3402138468},{"type":"v1","addr":"172.21.15.162:6837","nonce":3402138468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.136:6837/2572418263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2572418263},{"type":"v1","addr":"172.21.15.136:6837","nonce":2572418263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/2588884232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2588884232},{"type":"v1","addr":"172.21.15.162:6839","nonce":2588884232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6839/952830191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":952830191},{"type":"v1","addr":"172.21.15.136:6839","nonce":952830191}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-06-02T04:03:57.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:56 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/803170384' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:03:57.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:56 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/4208161458' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:03:57.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:56 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/4038138741' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:03:57.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.340+0000 7f591199e700 1 -- 172.21.15.123:0/3876935797 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f58f40a11b0 msgr2=0x7f58f40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.340+0000 7f591199e700 1 --2- 172.21.15.123:0/3876935797 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f58f40a11b0 0x7f58f40a3670 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f58fc00b5c0 tx=0x7f58fc005fb0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.340+0000 7f591199e700 1 -- 172.21.15.123:0/3876935797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f590c0ff160 msgr2=0x7f590c196dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.340+0000 7f591199e700 1 --2- 172.21.15.123:0/3876935797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f590c0ff160 0x7f590c196dc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f590000c970 tx=0x7f590000cd30 comp rx=0 tx=0).stop 2024-06-02T04:03:57.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.340+0000 7f591199e700 1 -- 172.21.15.123:0/3876935797 shutdown_connections 2024-06-02T04:03:57.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.340+0000 7f591199e700 1 --2- 172.21.15.123:0/3876935797 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f58f40a11b0 0x7f58f40a3670 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.340+0000 7f591199e700 1 --2- 172.21.15.123:0/3876935797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f590c102b70 0x7f590c19e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.340+0000 7f591199e700 1 --2- 172.21.15.123:0/3876935797 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f590c0ff160 0x7f590c196dc0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.340+0000 7f591199e700 1 --2- 172.21.15.123:0/3876935797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f590c1021d0 0x7f590c197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.340+0000 7f591199e700 1 -- 172.21.15.123:0/3876935797 >> 172.21.15.123:0/3876935797 conn(0x7f590c0faab0 msgr2=0x7f590c1055c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:57.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.340+0000 7f591199e700 1 -- 172.21.15.123:0/3876935797 shutdown_connections 2024-06-02T04:03:57.341 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.340+0000 7f591199e700 1 -- 172.21.15.123:0/3876935797 wait complete. 2024-06-02T04:03:57.341 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 27 2024-06-02T04:03:57.353 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-06-02T04:03:06.667888+0000', 'modified': '2024-06-02T04:03:13.099282+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24509, 'mds_1': 24490, 'mds_2': 24473, 'mds_3': 24439, 'mds_4': 24437}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14613': {'gid': 14613, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.123:6839/3806973328', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6838', 'nonce': 3806973328}, {'type': 'v1', 'addr': '172.21.15.123:6839', 'nonce': 3806973328}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_14619': {'gid': 14619, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.123:6841/4032992994', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6840', 'nonce': 4032992994}, {'type': 'v1', 'addr': '172.21.15.123:6841', 'nonce': 4032992994}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24437': {'gid': 24437, 'name': 'k', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.136:6833/2006585076', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6832', 'nonce': 2006585076}, {'type': 'v1', 'addr': '172.21.15.136:6833', 'nonce': 2006585076}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24439': {'gid': 24439, 'name': 'l', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.162:6833/3583622784', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6832', 'nonce': 3583622784}, {'type': 'v1', 'addr': '172.21.15.162:6833', 'nonce': 3583622784}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24455': {'gid': 24455, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.136:6835/2894031422', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6834', 'nonce': 2894031422}, {'type': 'v1', 'addr': '172.21.15.136:6835', 'nonce': 2894031422}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24463': {'gid': 24463, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.162:6835/2478943987', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6834', 'nonce': 2478943987}, {'type': 'v1', 'addr': '172.21.15.162:6835', 'nonce': 2478943987}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24469': {'gid': 24469, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.162:6837/3402138468', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6836', 'nonce': 3402138468}, {'type': 'v1', 'addr': '172.21.15.162:6837', 'nonce': 3402138468}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24473': {'gid': 24473, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.136:6837/2572418263', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6836', 'nonce': 2572418263}, {'type': 'v1', 'addr': '172.21.15.136:6837', 'nonce': 2572418263}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24490': {'gid': 24490, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.162:6839/2588884232', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6838', 'nonce': 2588884232}, {'type': 'v1', 'addr': '172.21.15.162:6839', 'nonce': 2588884232}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24509': {'gid': 24509, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.136:6839/952830191', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6838', 'nonce': 952830191}, {'type': 'v1', 'addr': '172.21.15.136:6839', 'nonce': 952830191}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-06-02T04:03:57.353 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-06-02T04:03:57.353 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.k status 2024-06-02T04:03:57.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.476+0000 7fba0a610700 1 -- 172.21.15.123:0/2319445123 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba040ffe70 msgr2=0x7fba04100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.476+0000 7fba0a610700 1 --2- 172.21.15.123:0/2319445123 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba040ffe70 0x7fba04100290 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4009990 tx=0x7fb9f4009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.476+0000 7fba0a610700 1 -- 172.21.15.123:0/2319445123 shutdown_connections 2024-06-02T04:03:57.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.476+0000 7fba0a610700 1 --2- 172.21.15.123:0/2319445123 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba04101980 0x7fba041082a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.476+0000 7fba0a610700 1 --2- 172.21.15.123:0/2319445123 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba040ffe70 0x7fba04100290 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.476+0000 7fba0a610700 1 --2- 172.21.15.123:0/2319445123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba04100fc0 0x7fba04101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.476+0000 7fba0a610700 1 -- 172.21.15.123:0/2319445123 >> 172.21.15.123:0/2319445123 conn(0x7fba040fb400 msgr2=0x7fba040fd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:57.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.476+0000 7fba0a610700 1 -- 172.21.15.123:0/2319445123 shutdown_connections 2024-06-02T04:03:57.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.476+0000 7fba0a610700 1 -- 172.21.15.123:0/2319445123 wait complete. 2024-06-02T04:03:57.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.477+0000 7fba0a610700 1 Processor -- start 2024-06-02T04:03:57.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.477+0000 7fba0a610700 1 -- start start 2024-06-02T04:03:57.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.477+0000 7fba0a610700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba040ffe70 0x7fba04196f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.477+0000 7fba0a610700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba04100fc0 0x7fba041974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.477+0000 7fba0a610700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba04101980 0x7fba0419e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.477+0000 7fba0a610700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0419eab0 con 0x7fba04101980 2024-06-02T04:03:57.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.477+0000 7fba0a610700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0419ebf0 con 0x7fba04100fc0 2024-06-02T04:03:57.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.477+0000 7fba0a610700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0419ed80 con 0x7fba040ffe70 2024-06-02T04:03:57.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.477+0000 7fba08bad700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba04101980 0x7fba0419e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.477+0000 7fba08bad700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba04101980 0x7fba0419e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42952/0 (socket says 172.21.15.123:42952) 2024-06-02T04:03:57.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.477+0000 7fba08bad700 1 -- 172.21.15.123:0/453757942 learned_addr learned my addr 172.21.15.123:0/453757942 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:57.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.478+0000 7fba03fff700 1 --2- 172.21.15.123:0/453757942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba040ffe70 0x7fba04196f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.478+0000 7fba037fe700 1 --2- 172.21.15.123:0/453757942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba04100fc0 0x7fba041974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.478+0000 7fba08bad700 1 -- 172.21.15.123:0/453757942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba040ffe70 msgr2=0x7fba04196f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.478+0000 7fba08bad700 1 --2- 172.21.15.123:0/453757942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba040ffe70 0x7fba04196f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.478+0000 7fba08bad700 1 -- 172.21.15.123:0/453757942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba04100fc0 msgr2=0x7fba041974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.478+0000 7fba08bad700 1 --2- 172.21.15.123:0/453757942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba04100fc0 0x7fba041974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.478+0000 7fba08bad700 1 -- 172.21.15.123:0/453757942 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f40095f0 con 0x7fba04101980 2024-06-02T04:03:57.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.478+0000 7fba03fff700 1 --2- 172.21.15.123:0/453757942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba040ffe70 0x7fba04196f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:03:57.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.478+0000 7fba037fe700 1 --2- 172.21.15.123:0/453757942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba04100fc0 0x7fba041974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:03:57.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.478+0000 7fba08bad700 1 --2- 172.21.15.123:0/453757942 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba04101980 0x7fba0419e4e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc007ee0 tx=0x7fb9fc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:57.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.478+0000 7fba017fa700 1 -- 172.21.15.123:0/453757942 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc017070 con 0x7fba04101980 2024-06-02T04:03:57.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.478+0000 7fba017fa700 1 -- 172.21.15.123:0/453757942 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb9fc00f040 con 0x7fba04101980 2024-06-02T04:03:57.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.478+0000 7fba017fa700 1 -- 172.21.15.123:0/453757942 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc005740 con 0x7fba04101980 2024-06-02T04:03:57.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.478+0000 7fba0a610700 1 -- 172.21.15.123:0/453757942 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba0419f060 con 0x7fba04101980 2024-06-02T04:03:57.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.478+0000 7fba0a610700 1 -- 172.21.15.123:0/453757942 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba0419f520 con 0x7fba04101980 2024-06-02T04:03:57.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.480+0000 7fba017fa700 1 -- 172.21.15.123:0/453757942 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fb9fc0058a0 con 0x7fba04101980 2024-06-02T04:03:57.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.481+0000 7fba017fa700 1 --2- 172.21.15.123:0/453757942 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb9ec0a1230 0x7fb9ec0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.481+0000 7fba017fa700 1 -- 172.21.15.123:0/453757942 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb9fc0cc1e0 con 0x7fba04101980 2024-06-02T04:03:57.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.481+0000 7fba03fff700 1 --2- 172.21.15.123:0/453757942 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb9ec0a1230 0x7fb9ec0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.481+0000 7fba03fff700 1 --2- 172.21.15.123:0/453757942 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb9ec0a1230 0x7fb9ec0a36f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4006010 tx=0x7fb9f40037b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:57.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.482+0000 7fba167cbb80 1 Processor -- start 2024-06-02T04:03:57.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.482+0000 7fba167cbb80 1 -- start start 2024-06-02T04:03:57.488 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.482+0000 7fba167cbb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef7659f900 0x55ef7659fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.482+0000 7fba167cbb80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ef765a0260 0x55ef765a06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.482+0000 7fba167cbb80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef765a0c20 0x55ef765a10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.482+0000 7fba167cbb80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef764f2100 con 0x55ef765a0260 2024-06-02T04:03:57.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.482+0000 7fba167cbb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef764efac0 con 0x55ef7659f900 2024-06-02T04:03:57.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.482+0000 7fba167cbb80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef764eb3b0 con 0x55ef765a0c20 2024-06-02T04:03:57.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.482+0000 7fba037fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ef765a0260 0x55ef765a06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.482+0000 7fba037fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ef765a0260 0x55ef765a06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42966/0 (socket says 172.21.15.123:42966) 2024-06-02T04:03:57.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.482+0000 7fba037fe700 1 -- 172.21.15.123:0/788745635 learned_addr learned my addr 172.21.15.123:0/788745635 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:57.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.482+0000 7fba03fff700 1 --2- 172.21.15.123:0/788745635 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef7659f900 0x55ef7659fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.482+0000 7fba08bad700 1 --2- 172.21.15.123:0/788745635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef765a0c20 0x55ef765a10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.482+0000 7fba037fe700 1 -- 172.21.15.123:0/788745635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef765a0c20 msgr2=0x55ef765a10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:57.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.482+0000 7fba037fe700 1 --2- 172.21.15.123:0/788745635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef765a0c20 0x55ef765a10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.489 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.482+0000 7fba037fe700 1 -- 172.21.15.123:0/788745635 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef7659f900 msgr2=0x55ef7659fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:57.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.482+0000 7fba037fe700 1 --2- 172.21.15.123:0/788745635 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef7659f900 0x55ef7659fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.482+0000 7fba037fe700 1 -- 172.21.15.123:0/788745635 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef7636c360 con 0x55ef765a0260 2024-06-02T04:03:57.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.482+0000 7fba08bad700 1 --2- 172.21.15.123:0/788745635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef765a0c20 0x55ef765a10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:03:57.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.482+0000 7fba03fff700 1 --2- 172.21.15.123:0/788745635 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef7659f900 0x55ef7659fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:03:57.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.482+0000 7fba037fe700 1 --2- 172.21.15.123:0/788745635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ef765a0260 0x55ef765a06e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8009ce0 tx=0x7fb9f800e2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a9e8da9145433df server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:57.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.483+0000 7fb9ea7fc700 1 -- 172.21.15.123:0/788745635 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f800ec20 con 0x55ef765a0260 2024-06-02T04:03:57.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.483+0000 7fb9ea7fc700 1 -- 172.21.15.123:0/788745635 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb9f800ed80 con 0x55ef765a0260 2024-06-02T04:03:57.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.483+0000 7fb9ea7fc700 1 -- 172.21.15.123:0/788745635 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8010720 con 0x55ef765a0260 2024-06-02T04:03:57.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.483+0000 7fba167cbb80 1 -- 172.21.15.123:0/788745635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ef765a0260 msgr2=0x55ef765a06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.483+0000 7fba167cbb80 1 --2- 172.21.15.123:0/788745635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ef765a0260 0x55ef765a06e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8009ce0 tx=0x7fb9f800e2f0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.483+0000 7fba167cbb80 1 -- 172.21.15.123:0/788745635 shutdown_connections 2024-06-02T04:03:57.490 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.483+0000 7fba167cbb80 1 --2- 172.21.15.123:0/788745635 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef765a0c20 0x55ef765a10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.483+0000 7fba167cbb80 1 --2- 172.21.15.123:0/788745635 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef7659f900 0x55ef7659fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.483+0000 7fba167cbb80 1 --2- 172.21.15.123:0/788745635 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ef765a0260 0x55ef765a06e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.483+0000 7fba167cbb80 1 -- 172.21.15.123:0/788745635 >> 172.21.15.123:0/788745635 conn(0x55ef764f91c0 msgr2=0x55ef76595d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:57.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.483+0000 7fba167cbb80 1 -- 172.21.15.123:0/788745635 shutdown_connections 2024-06-02T04:03:57.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.483+0000 7fba167cbb80 1 -- 172.21.15.123:0/788745635 wait complete. 2024-06-02T04:03:57.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.484+0000 7fba167cbb80 1 -- start start 2024-06-02T04:03:57.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.484+0000 7fba167cbb80 1 Processor -- start 2024-06-02T04:03:57.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.484+0000 7fba167cbb80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef7659f900 0x55ef765a9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.484+0000 7fba167cbb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef765a0260 0x55ef765a96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.484+0000 7fba167cbb80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ef765a0c20 0x55ef765b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.484+0000 7fba167cbb80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef76487510 con 0x55ef765a0c20 2024-06-02T04:03:57.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.484+0000 7fba167cbb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef764871b0 con 0x55ef765a0260 2024-06-02T04:03:57.491 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.484+0000 7fba167cbb80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef7636e650 con 0x55ef7659f900 2024-06-02T04:03:57.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.484+0000 7fba167cbb80 10 client.0 _ll_register_callbacks cb 0x55ef76490ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:03:57.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.484+0000 7fba08bad700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ef765a0c20 0x55ef765b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.484+0000 7fba08bad700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ef765a0c20 0x55ef765b0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42978/0 (socket says 172.21.15.123:42978) 2024-06-02T04:03:57.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.484+0000 7fba08bad700 1 -- 172.21.15.123:0/328329704 learned_addr learned my addr 172.21.15.123:0/328329704 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:57.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.484+0000 7fba037fe700 1 --2- 172.21.15.123:0/328329704 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef765a0260 0x55ef765a96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.484+0000 7fba03fff700 1 --2- 172.21.15.123:0/328329704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef7659f900 0x55ef765a9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.485+0000 7fba08bad700 1 -- 172.21.15.123:0/328329704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef7659f900 msgr2=0x55ef765a9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:57.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.485+0000 7fba08bad700 1 --2- 172.21.15.123:0/328329704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef7659f900 0x55ef765a9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.485+0000 7fba08bad700 1 -- 172.21.15.123:0/328329704 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef765a0260 msgr2=0x55ef765a96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:57.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.485+0000 7fba08bad700 1 --2- 172.21.15.123:0/328329704 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef765a0260 0x55ef765a96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.485+0000 7fba08bad700 1 -- 172.21.15.123:0/328329704 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f8009940 con 0x55ef765a0c20 2024-06-02T04:03:57.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.485+0000 7fba03fff700 1 --2- 172.21.15.123:0/328329704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef7659f900 0x55ef765a9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:03:57.492 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.485+0000 7fba08bad700 1 --2- 172.21.15.123:0/328329704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ef765a0c20 0x55ef765b0700 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc095a80 tx=0x7fb9fc098fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b4eacf3c75cc63 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:57.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.485+0000 7fb9e37fe700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-06-02T04:03:57.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.485+0000 7fb9e37fe700 1 -- 172.21.15.123:0/328329704 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc0842c0 con 0x55ef765a0c20 2024-06-02T04:03:57.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.485+0000 7fb9e37fe700 1 -- 172.21.15.123:0/328329704 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb9fc095040 con 0x55ef765a0c20 2024-06-02T04:03:57.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.485+0000 7fba167cbb80 1 -- 172.21.15.123:0/328329704 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ef76444220 con 0x55ef765a0c20 2024-06-02T04:03:57.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.485+0000 7fb9e37fe700 1 -- 172.21.15.123:0/328329704 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9fc09d3b0 con 0x55ef765a0c20 2024-06-02T04:03:57.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.485+0000 7fba167cbb80 10 client.15036 fetch_fsmap learned FSMap version 27 2024-06-02T04:03:57.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.485+0000 7fba167cbb80 1 -- 172.21.15.123:0/328329704 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55ef76318b10 con 0x55ef765a0c20 2024-06-02T04:03:57.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.485+0000 7fb9e37fe700 1 -- 172.21.15.123:0/328329704 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ef76444220 con 0x55ef765a0c20 2024-06-02T04:03:57.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.485+0000 7fb9e37fe700 1 -- 172.21.15.123:0/328329704 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb9fc0997e0 con 0x55ef765a0c20 2024-06-02T04:03:57.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.485+0000 7fba167cbb80 10 client.15036 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:03:57.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.485+0000 7fba167cbb80 10 client.15036 resolve_mds: resolved name 'k' to daemon mds.k 2024-06-02T04:03:57.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.485+0000 7fba167cbb80 20 client.15036 populate_metadata read hostname 'smithi123' 2024-06-02T04:03:57.493 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.485+0000 7fba167cbb80 1 --2- 172.21.15.123:0/328329704 >> [v2:172.21.15.136:6832/2006585076,v1:172.21.15.136:6833/2006585076] conn(0x55ef765b3da0 0x55ef765b9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.485+0000 7fba167cbb80 4 client.15036 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:03:57.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.485+0000 7fba167cbb80 1 -- 172.21.15.123:0/328329704 --> [v2:172.21.15.136:6832/2006585076,v1:172.21.15.136:6833/2006585076] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ef7656a7c0 con 0x55ef765b3da0 2024-06-02T04:03:57.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.486+0000 7fba03fff700 1 --2- 172.21.15.123:0/328329704 >> [v2:172.21.15.136:6832/2006585076,v1:172.21.15.136:6833/2006585076] conn(0x55ef765b3da0 0x55ef765b9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.486+0000 7fb9e37fe700 10 client.15036 ms_handle_connect on v2:172.21.15.136:6832/2006585076 2024-06-02T04:03:57.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.486+0000 7fba03fff700 1 --2- 172.21.15.123:0/328329704 >> [v2:172.21.15.136:6832/2006585076,v1:172.21.15.136:6833/2006585076] conn(0x55ef765b3da0 0x55ef765b9690 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=11bb8e3919fe9b51 server_cookie=469e526d6df32b30 in_seq=0 out_seq=0 2024-06-02T04:03:57.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.487+0000 7fb9e37fe700 1 -- 172.21.15.123:0/328329704 <== mds.4 v2:172.21.15.136:6832/2006585076 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ef7656a7c0 con 0x55ef765b3da0 2024-06-02T04:03:57.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.487+0000 7fb9e37fe700 10 client.15036 handle_command_reply: tid=0 2024-06-02T04:03:57.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.487+0000 7fba167cbb80 1 client.15036 shutdown 2024-06-02T04:03:57.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.487+0000 7fba167cbb80 1 -- 172.21.15.123:0/328329704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ef765a0c20 msgr2=0x55ef765b0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.487+0000 7fba167cbb80 1 --2- 172.21.15.123:0/328329704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ef765a0c20 0x55ef765b0700 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc095a80 tx=0x7fb9fc098fe0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.487+0000 7fba167cbb80 1 -- 172.21.15.123:0/328329704 shutdown_connections 2024-06-02T04:03:57.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.487+0000 7fba167cbb80 1 --2- 172.21.15.123:0/328329704 >> [v2:172.21.15.136:6832/2006585076,v1:172.21.15.136:6833/2006585076] conn(0x55ef765b3da0 0x55ef765b9690 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.487+0000 7fba167cbb80 1 --2- 172.21.15.123:0/328329704 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ef765a0c20 0x55ef765b0700 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.487+0000 7fb9e37fe700 0 client.15036 ms_handle_reset on v2:172.21.15.136:6832/2006585076 2024-06-02T04:03:57.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.487+0000 7fba167cbb80 1 --2- 172.21.15.123:0/328329704 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef7659f900 0x55ef765a9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.487+0000 7fba167cbb80 1 --2- 172.21.15.123:0/328329704 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef765a0260 0x55ef765a96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.487+0000 7fba167cbb80 1 -- 172.21.15.123:0/328329704 >> 172.21.15.123:0/328329704 conn(0x55ef764f91c0 msgr2=0x55ef76595550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:57.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.487+0000 7fba167cbb80 1 -- 172.21.15.123:0/328329704 shutdown_connections 2024-06-02T04:03:57.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.487+0000 7fba167cbb80 1 -- 172.21.15.123:0/328329704 wait complete. 2024-06-02T04:03:57.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.487+0000 7fba167cbb80 20 client.15036 trim_cache size 0 max 16384 2024-06-02T04:03:57.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.505+0000 7fba167cbb80 1 Processor -- start 2024-06-02T04:03:57.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.505+0000 7fba167cbb80 1 -- start start 2024-06-02T04:03:57.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.505+0000 7fba167cbb80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef7659f900 0x55ef765b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.505+0000 7fba167cbb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef765a0260 0x55ef765a97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.505+0000 7fba167cbb80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ef765a0c20 0x55ef7659fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.505+0000 7fba167cbb80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef7648a5a0 con 0x55ef765a0c20 2024-06-02T04:03:57.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.505+0000 7fba167cbb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef764a92b0 con 0x55ef765a0260 2024-06-02T04:03:57.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.505+0000 7fba167cbb80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef765a8cf0 con 0x55ef7659f900 2024-06-02T04:03:57.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.505+0000 7fba08bad700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ef765a0c20 0x55ef7659fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.505+0000 7fba08bad700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ef765a0c20 0x55ef7659fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42992/0 (socket says 172.21.15.123:42992) 2024-06-02T04:03:57.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.505+0000 7fba08bad700 1 -- 172.21.15.123:0/46202192 learned_addr learned my addr 172.21.15.123:0/46202192 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:57.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.505+0000 7fba08bad700 1 -- 172.21.15.123:0/46202192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef7659f900 msgr2=0x55ef765b14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:57.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.505+0000 7fba08bad700 1 --2- 172.21.15.123:0/46202192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef7659f900 0x55ef765b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.505+0000 7fba08bad700 1 -- 172.21.15.123:0/46202192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef765a0260 msgr2=0x55ef765a97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:57.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.505+0000 7fba08bad700 1 --2- 172.21.15.123:0/46202192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef765a0260 0x55ef765a97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.505+0000 7fba08bad700 1 -- 172.21.15.123:0/46202192 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef765aa2f0 con 0x55ef765a0c20 2024-06-02T04:03:57.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.505+0000 7fba08bad700 1 --2- 172.21.15.123:0/46202192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ef765a0c20 0x55ef7659fce0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc00dfd0 tx=0x7fb9fc099350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d37b2cbba9824a1d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:57.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.506+0000 7fb9eaffd700 1 -- 172.21.15.123:0/46202192 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc0b3070 con 0x55ef765a0c20 2024-06-02T04:03:57.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.506+0000 7fb9eaffd700 1 -- 172.21.15.123:0/46202192 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb9fc09d3b0 con 0x55ef765a0c20 2024-06-02T04:03:57.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.506+0000 7fb9eaffd700 1 -- 172.21.15.123:0/46202192 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc0997e0 con 0x55ef765a0c20 2024-06-02T04:03:57.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.506+0000 7fba167cbb80 1 -- 172.21.15.123:0/46202192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ef765a0c20 msgr2=0x55ef7659fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.506+0000 7fba167cbb80 1 --2- 172.21.15.123:0/46202192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ef765a0c20 0x55ef7659fce0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc00dfd0 tx=0x7fb9fc099350 comp rx=0 tx=0).stop 2024-06-02T04:03:57.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.506+0000 7fba167cbb80 1 -- 172.21.15.123:0/46202192 shutdown_connections 2024-06-02T04:03:57.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.506+0000 7fba167cbb80 1 --2- 172.21.15.123:0/46202192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ef765a0c20 0x55ef7659fce0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.506+0000 7fba167cbb80 1 --2- 172.21.15.123:0/46202192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef7659f900 0x55ef765b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.506+0000 7fba167cbb80 1 --2- 172.21.15.123:0/46202192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef765a0260 0x55ef765a97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.506+0000 7fba167cbb80 1 -- 172.21.15.123:0/46202192 >> 172.21.15.123:0/46202192 conn(0x55ef764f91c0 msgr2=0x55ef765921c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:57.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.506+0000 7fba167cbb80 1 -- 172.21.15.123:0/46202192 shutdown_connections 2024-06-02T04:03:57.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.506+0000 7fba167cbb80 1 -- 172.21.15.123:0/46202192 wait complete. 2024-06-02T04:03:57.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.506+0000 7fba167cbb80 1 -- start start 2024-06-02T04:03:57.509 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.507+0000 7fba167cbb80 1 Processor -- start 2024-06-02T04:03:57.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.507+0000 7fba167cbb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef7659f900 0x55ef765aa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.512 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.507+0000 7fba167cbb80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef765a0260 0x55ef765aaf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.507+0000 7fba167cbb80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ef765a0c20 0x55ef765afe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.507+0000 7fba167cbb80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef765b03a0 con 0x55ef765a0c20 2024-06-02T04:03:57.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.507+0000 7fba167cbb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef765b0510 con 0x55ef7659f900 2024-06-02T04:03:57.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.507+0000 7fba167cbb80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef765b06d0 con 0x55ef765a0260 2024-06-02T04:03:57.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.507+0000 7fba167cbb80 10 client.0 _ll_register_callbacks cb 0x7fb9fc0993f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:03:57.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.507+0000 7fba08bad700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ef765a0c20 0x55ef765afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.507+0000 7fba08bad700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ef765a0c20 0x55ef765afe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43004/0 (socket says 172.21.15.123:43004) 2024-06-02T04:03:57.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.507+0000 7fba08bad700 1 -- 172.21.15.123:0/1323330042 learned_addr learned my addr 172.21.15.123:0/1323330042 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:57.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.507+0000 7fba03fff700 1 --2- 172.21.15.123:0/1323330042 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef7659f900 0x55ef765aa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.507+0000 7fba037fe700 1 --2- 172.21.15.123:0/1323330042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef765a0260 0x55ef765aaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.507+0000 7fba08bad700 1 -- 172.21.15.123:0/1323330042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef765a0260 msgr2=0x55ef765aaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:57.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.507+0000 7fba08bad700 1 --2- 172.21.15.123:0/1323330042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef765a0260 0x55ef765aaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.513 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.507+0000 7fba08bad700 1 -- 172.21.15.123:0/1323330042 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef7659f900 msgr2=0x55ef765aa9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:57.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.507+0000 7fba08bad700 1 --2- 172.21.15.123:0/1323330042 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef7659f900 0x55ef765aa9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.507+0000 7fba08bad700 1 -- 172.21.15.123:0/1323330042 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ef76318b10 con 0x55ef765a0c20 2024-06-02T04:03:57.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.507+0000 7fba037fe700 1 --2- 172.21.15.123:0/1323330042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef765a0260 0x55ef765aaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:03:57.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.508+0000 7fba08bad700 1 --2- 172.21.15.123:0/1323330042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ef765a0c20 0x55ef765afe60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0225d0 tx=0x7fb9fc00de00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65282869ca4b5b00 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:57.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.508+0000 7fb9e37fe700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-06-02T04:03:57.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.508+0000 7fb9e37fe700 1 -- 172.21.15.123:0/1323330042 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc0b3070 con 0x55ef765a0c20 2024-06-02T04:03:57.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.508+0000 7fb9e37fe700 1 -- 172.21.15.123:0/1323330042 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb9fc095040 con 0x55ef765a0c20 2024-06-02T04:03:57.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.508+0000 7fba167cbb80 1 -- 172.21.15.123:0/1323330042 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb9f800ed80 con 0x55ef765a0c20 2024-06-02T04:03:57.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.508+0000 7fb9e37fe700 1 -- 172.21.15.123:0/1323330042 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9fc098d30 con 0x55ef765a0c20 2024-06-02T04:03:57.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.508+0000 7fba167cbb80 10 client.15042 fetch_fsmap learned FSMap version 27 2024-06-02T04:03:57.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.508+0000 7fba167cbb80 1 -- 172.21.15.123:0/1323330042 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55ef764b1510 con 0x55ef765a0c20 2024-06-02T04:03:57.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.508+0000 7fb9e37fe700 1 -- 172.21.15.123:0/1323330042 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb9f800ed80 con 0x55ef765a0c20 2024-06-02T04:03:57.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.508+0000 7fb9e37fe700 1 -- 172.21.15.123:0/1323330042 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb9fc0b7b70 con 0x55ef765a0c20 2024-06-02T04:03:57.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.508+0000 7fba167cbb80 10 client.15042 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:03:57.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.508+0000 7fba167cbb80 10 client.15042 resolve_mds: resolved name 'k' to daemon mds.k 2024-06-02T04:03:57.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.508+0000 7fba167cbb80 20 client.15042 populate_metadata read hostname 'smithi123' 2024-06-02T04:03:57.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.508+0000 7fba167cbb80 1 --2- 172.21.15.123:0/1323330042 >> [v2:172.21.15.136:6832/2006585076,v1:172.21.15.136:6833/2006585076] conn(0x55ef7660f390 0x55ef7660bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.508+0000 7fba167cbb80 4 client.15042 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T04:03:57.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.508+0000 7fba167cbb80 1 -- 172.21.15.123:0/1323330042 --> [v2:172.21.15.136:6832/2006585076,v1:172.21.15.136:6833/2006585076] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ef764e3e70 con 0x55ef7660f390 2024-06-02T04:03:57.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.508+0000 7fba03fff700 1 --2- 172.21.15.123:0/1323330042 >> [v2:172.21.15.136:6832/2006585076,v1:172.21.15.136:6833/2006585076] conn(0x55ef7660f390 0x55ef7660bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.509+0000 7fb9e37fe700 10 client.15042 ms_handle_connect on v2:172.21.15.136:6832/2006585076 2024-06-02T04:03:57.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.509+0000 7fba03fff700 1 --2- 172.21.15.123:0/1323330042 >> [v2:172.21.15.136:6832/2006585076,v1:172.21.15.136:6833/2006585076] conn(0x55ef7660f390 0x55ef7660bfb0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b4df0e1cecb5b21a server_cookie=2ea75e0ca1824844 in_seq=0 out_seq=0 2024-06-02T04:03:57.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.509+0000 7fb9e37fe700 1 -- 172.21.15.123:0/1323330042 <== mds.4 v2:172.21.15.136:6832/2006585076 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55ef764e3e70 con 0x55ef7660f390 2024-06-02T04:03:57.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.509+0000 7fb9e37fe700 10 client.15042 handle_command_reply: tid=0 2024-06-02T04:03:57.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.509+0000 7fba167cbb80 1 client.15042 shutdown 2024-06-02T04:03:57.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.509+0000 7fba167cbb80 1 -- 172.21.15.123:0/1323330042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ef765a0c20 msgr2=0x55ef765afe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.509+0000 7fba167cbb80 1 --2- 172.21.15.123:0/1323330042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ef765a0c20 0x55ef765afe60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0225d0 tx=0x7fb9fc00de00 comp rx=0 tx=0).stop 2024-06-02T04:03:57.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.509+0000 7fba167cbb80 1 -- 172.21.15.123:0/1323330042 shutdown_connections 2024-06-02T04:03:57.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.509+0000 7fba167cbb80 1 --2- 172.21.15.123:0/1323330042 >> [v2:172.21.15.136:6832/2006585076,v1:172.21.15.136:6833/2006585076] conn(0x55ef7660f390 0x55ef7660bfb0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.509+0000 7fba167cbb80 1 --2- 172.21.15.123:0/1323330042 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55ef765a0c20 0x55ef765afe60 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.509+0000 7fba167cbb80 1 --2- 172.21.15.123:0/1323330042 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55ef7659f900 0x55ef765aa9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.509+0000 7fb9e37fe700 0 client.15042 ms_handle_reset on v2:172.21.15.136:6832/2006585076 2024-06-02T04:03:57.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.509+0000 7fba167cbb80 1 --2- 172.21.15.123:0/1323330042 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ef765a0260 0x55ef765aaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.509+0000 7fba167cbb80 1 -- 172.21.15.123:0/1323330042 >> 172.21.15.123:0/1323330042 conn(0x55ef764f91c0 msgr2=0x55ef765b0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:57.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.509+0000 7fba167cbb80 1 -- 172.21.15.123:0/1323330042 shutdown_connections 2024-06-02T04:03:57.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.509+0000 7fba167cbb80 1 -- 172.21.15.123:0/1323330042 wait complete. 2024-06-02T04:03:57.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.509+0000 7fba167cbb80 20 client.15042 trim_cache size 0 max 16384 2024-06-02T04:03:57.517 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-06-02T04:03:57.517 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "1b432ae0-2094-11ef-bc9b-c7b262605968", 2024-06-02T04:03:57.517 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 4, 2024-06-02T04:03:57.517 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 24437, 2024-06-02T04:03:57.517 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-06-02T04:03:57.517 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-06-02T04:03:57.517 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-06-02T04:03:57.517 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 45.423488151999997, 2024-06-02T04:03:57.518 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 27, 2024-06-02T04:03:57.518 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 82, 2024-06-02T04:03:57.518 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 82, 2024-06-02T04:03:57.518 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 73.582486728999996 2024-06-02T04:03:57.518 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-06-02T04:03:57.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.510+0000 7fba0a610700 1 -- 172.21.15.123:0/453757942 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb9ec0a1230 msgr2=0x7fb9ec0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.510+0000 7fba0a610700 1 --2- 172.21.15.123:0/453757942 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb9ec0a1230 0x7fb9ec0a36f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4006010 tx=0x7fb9f40037b0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.510+0000 7fba0a610700 1 -- 172.21.15.123:0/453757942 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba04101980 msgr2=0x7fba0419e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.510+0000 7fba0a610700 1 --2- 172.21.15.123:0/453757942 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba04101980 0x7fba0419e4e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc007ee0 tx=0x7fb9fc00d3b0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.510+0000 7fba0a610700 1 -- 172.21.15.123:0/453757942 shutdown_connections 2024-06-02T04:03:57.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.510+0000 7fba0a610700 1 --2- 172.21.15.123:0/453757942 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fba04101980 0x7fba0419e4e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.510+0000 7fba0a610700 1 --2- 172.21.15.123:0/453757942 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fba040ffe70 0x7fba04196f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.510+0000 7fba0a610700 1 --2- 172.21.15.123:0/453757942 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fb9ec0a1230 0x7fb9ec0a36f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.510+0000 7fba0a610700 1 --2- 172.21.15.123:0/453757942 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba04100fc0 0x7fba041974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.510+0000 7fba0a610700 1 -- 172.21.15.123:0/453757942 >> 172.21.15.123:0/453757942 conn(0x7fba040fb400 msgr2=0x7fba04069500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:57.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.510+0000 7fba0a610700 1 -- 172.21.15.123:0/453757942 shutdown_connections 2024-06-02T04:03:57.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.510+0000 7fba0a610700 1 -- 172.21.15.123:0/453757942 wait complete. 2024-06-02T04:03:57.522 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.l status 2024-06-02T04:03:57.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.645+0000 7f08e55ce700 1 -- 172.21.15.123:0/730755679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08e0101a60 msgr2=0x7f08e0103e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.645+0000 7f08e55ce700 1 --2- 172.21.15.123:0/730755679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08e0101a60 0x7f08e0103e50 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f08d4009990 tx=0x7f08d4009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.645+0000 7f08e55ce700 1 -- 172.21.15.123:0/730755679 shutdown_connections 2024-06-02T04:03:57.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.645+0000 7f08e55ce700 1 --2- 172.21.15.123:0/730755679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08e0106cc0 0x7f08e01090d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.645+0000 7f08e55ce700 1 --2- 172.21.15.123:0/730755679 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08e0101a60 0x7f08e0103e50 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.645+0000 7f08e55ce700 1 --2- 172.21.15.123:0/730755679 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08e0104390 0x7f08e0106780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.645+0000 7f08e55ce700 1 -- 172.21.15.123:0/730755679 >> 172.21.15.123:0/730755679 conn(0x7f08e00fb3f0 msgr2=0x7f08e00fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:57.647 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.645+0000 7f08e55ce700 1 -- 172.21.15.123:0/730755679 shutdown_connections 2024-06-02T04:03:57.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.645+0000 7f08e55ce700 1 -- 172.21.15.123:0/730755679 wait complete. 2024-06-02T04:03:57.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.645+0000 7f08e55ce700 1 Processor -- start 2024-06-02T04:03:57.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.646+0000 7f08e55ce700 1 -- start start 2024-06-02T04:03:57.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.646+0000 7f08e55ce700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08e0101a60 0x7f08e0196e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.646+0000 7f08e55ce700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08e0104390 0x7f08e01973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.646+0000 7f08e55ce700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08e0106cc0 0x7f08e019e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.646+0000 7f08e55ce700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e019e9a0 con 0x7f08e0101a60 2024-06-02T04:03:57.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.646+0000 7f08e55ce700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e019eae0 con 0x7f08e0106cc0 2024-06-02T04:03:57.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.646+0000 7f08e55ce700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e019ec70 con 0x7f08e0104390 2024-06-02T04:03:57.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.646+0000 7f08deffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08e0101a60 0x7f08e0196e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.646+0000 7f08deffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08e0101a60 0x7f08e0196e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43030/0 (socket says 172.21.15.123:43030) 2024-06-02T04:03:57.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.646+0000 7f08deffd700 1 -- 172.21.15.123:0/3846823297 learned_addr learned my addr 172.21.15.123:0/3846823297 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:57.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.646+0000 7f08df7fe700 1 --2- 172.21.15.123:0/3846823297 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08e0106cc0 0x7f08e019e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.646+0000 7f08deffd700 1 -- 172.21.15.123:0/3846823297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08e0104390 msgr2=0x7f08e01973b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.646+0000 7f08deffd700 1 --2- 172.21.15.123:0/3846823297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08e0104390 0x7f08e01973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.646+0000 7f08deffd700 1 -- 172.21.15.123:0/3846823297 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08e0106cc0 msgr2=0x7f08e019e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.646+0000 7f08deffd700 1 --2- 172.21.15.123:0/3846823297 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08e0106cc0 0x7f08e019e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.646+0000 7f08deffd700 1 -- 172.21.15.123:0/3846823297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d40095f0 con 0x7f08e0101a60 2024-06-02T04:03:57.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.646+0000 7f08df7fe700 1 --2- 172.21.15.123:0/3846823297 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08e0106cc0 0x7f08e019e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:03:57.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.646+0000 7f08deffd700 1 --2- 172.21.15.123:0/3846823297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08e0101a60 0x7f08e0196e70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f08d40095c0 tx=0x7f08d400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:57.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.646+0000 7f08c7fff700 1 -- 172.21.15.123:0/3846823297 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d401d070 con 0x7f08e0101a60 2024-06-02T04:03:57.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.646+0000 7f08c7fff700 1 -- 172.21.15.123:0/3846823297 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f08d400fb80 con 0x7f08e0101a60 2024-06-02T04:03:57.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.646+0000 7f08e55ce700 1 -- 172.21.15.123:0/3846823297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e019eef0 con 0x7f08e0101a60 2024-06-02T04:03:57.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.646+0000 7f08c7fff700 1 -- 172.21.15.123:0/3846823297 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d4017650 con 0x7f08e0101a60 2024-06-02T04:03:57.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.646+0000 7f08e55ce700 1 -- 172.21.15.123:0/3846823297 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e019f2b0 con 0x7f08e0101a60 2024-06-02T04:03:57.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.648+0000 7f08c7fff700 1 -- 172.21.15.123:0/3846823297 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f08d400fcf0 con 0x7f08e0101a60 2024-06-02T04:03:57.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.649+0000 7f08c7fff700 1 --2- 172.21.15.123:0/3846823297 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f08c80a11b0 0x7f08c80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.649+0000 7f08c7fff700 1 -- 172.21.15.123:0/3846823297 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f08d40cdd60 con 0x7f08e0101a60 2024-06-02T04:03:57.657 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.649+0000 7f08de7fc700 1 --2- 172.21.15.123:0/3846823297 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f08c80a11b0 0x7f08c80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.649+0000 7f08de7fc700 1 --2- 172.21.15.123:0/3846823297 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f08c80a11b0 0x7f08c80a3670 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f08d0005fd0 tx=0x7f08d0005d00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.650+0000 7f08f1789b80 1 Processor -- start 2024-06-02T04:03:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.650+0000 7f08f1789b80 1 -- start start 2024-06-02T04:03:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.650+0000 7f08f1789b80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc301824f0 0x55fc30182910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.650+0000 7f08f1789b80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc30182e50 0x55fc301832d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.650+0000 7f08f1789b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc30183810 0x55fc30183c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.650+0000 7f08f1789b80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc300d9100 con 0x55fc30182e50 2024-06-02T04:03:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.650+0000 7f08f1789b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc300d6ac0 con 0x55fc30183810 2024-06-02T04:03:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.650+0000 7f08f1789b80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc300d23b0 con 0x55fc301824f0 2024-06-02T04:03:57.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.650+0000 7f08de7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc30182e50 0x55fc301832d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.650+0000 7f08de7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc30182e50 0x55fc301832d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43040/0 (socket says 172.21.15.123:43040) 2024-06-02T04:03:57.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.650+0000 7f08de7fc700 1 -- 172.21.15.123:0/283537315 learned_addr learned my addr 172.21.15.123:0/283537315 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:57.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.650+0000 7f08df7fe700 1 --2- 172.21.15.123:0/283537315 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc30183810 0x55fc30183c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.650+0000 7f08de7fc700 1 -- 172.21.15.123:0/283537315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc301824f0 msgr2=0x55fc30182910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:57.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.650+0000 7f08de7fc700 1 --2- 172.21.15.123:0/283537315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc301824f0 0x55fc30182910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.650+0000 7f08de7fc700 1 -- 172.21.15.123:0/283537315 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc30183810 msgr2=0x55fc30183c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:57.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.650+0000 7f08de7fc700 1 --2- 172.21.15.123:0/283537315 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc30183810 0x55fc30183c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.650+0000 7f08de7fc700 1 -- 172.21.15.123:0/283537315 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc2ff53360 con 0x55fc30182e50 2024-06-02T04:03:57.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.650+0000 7f08de7fc700 1 --2- 172.21.15.123:0/283537315 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc30182e50 0x55fc301832d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f08d000cbf0 tx=0x7f08d000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7535fc5e821ff2 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:57.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.651+0000 7f08c57fa700 1 -- 172.21.15.123:0/283537315 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d000fcf0 con 0x55fc30182e50 2024-06-02T04:03:57.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.651+0000 7f08c57fa700 1 -- 172.21.15.123:0/283537315 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f08d000fe50 con 0x55fc30182e50 2024-06-02T04:03:57.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.651+0000 7f08c57fa700 1 -- 172.21.15.123:0/283537315 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d000e7d0 con 0x55fc30182e50 2024-06-02T04:03:57.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.651+0000 7f08f1789b80 1 -- 172.21.15.123:0/283537315 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc30182e50 msgr2=0x55fc301832d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.651+0000 7f08f1789b80 1 --2- 172.21.15.123:0/283537315 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc30182e50 0x55fc301832d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f08d000cbf0 tx=0x7f08d000f000 comp rx=0 tx=0).stop 2024-06-02T04:03:57.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.651+0000 7f08f1789b80 1 -- 172.21.15.123:0/283537315 shutdown_connections 2024-06-02T04:03:57.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.651+0000 7f08f1789b80 1 --2- 172.21.15.123:0/283537315 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc30183810 0x55fc30183c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.651+0000 7f08f1789b80 1 --2- 172.21.15.123:0/283537315 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc301824f0 0x55fc30182910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.651+0000 7f08f1789b80 1 --2- 172.21.15.123:0/283537315 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc30182e50 0x55fc301832d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.651+0000 7f08f1789b80 1 -- 172.21.15.123:0/283537315 >> 172.21.15.123:0/283537315 conn(0x55fc300e01c0 msgr2=0x55fc3017cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:57.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.651+0000 7f08f1789b80 1 -- 172.21.15.123:0/283537315 shutdown_connections 2024-06-02T04:03:57.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.651+0000 7f08f1789b80 1 -- 172.21.15.123:0/283537315 wait complete. 2024-06-02T04:03:57.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.652+0000 7f08f1789b80 1 -- start start 2024-06-02T04:03:57.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.652+0000 7f08f1789b80 1 Processor -- start 2024-06-02T04:03:57.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.652+0000 7f08f1789b80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc301824f0 0x55fc3018bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.652+0000 7f08f1789b80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc30182e50 0x55fc3018c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.652+0000 7f08f1789b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc30183810 0x55fc30193350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.652+0000 7f08f1789b80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc3006e510 con 0x55fc30182e50 2024-06-02T04:03:57.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.652+0000 7f08f1789b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc3006e1b0 con 0x55fc30183810 2024-06-02T04:03:57.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.652+0000 7f08f1789b80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc2ff55650 con 0x55fc301824f0 2024-06-02T04:03:57.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.652+0000 7f08f1789b80 10 client.0 _ll_register_callbacks cb 0x55fc30077ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:03:57.661 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.652+0000 7f08de7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc30182e50 0x55fc3018c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.652+0000 7f08de7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc30182e50 0x55fc3018c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43048/0 (socket says 172.21.15.123:43048) 2024-06-02T04:03:57.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.652+0000 7f08de7fc700 1 -- 172.21.15.123:0/1024055535 learned_addr learned my addr 172.21.15.123:0/1024055535 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:57.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.652+0000 7f08df7fe700 1 --2- 172.21.15.123:0/1024055535 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc30183810 0x55fc30193350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.652+0000 7f08deffd700 1 --2- 172.21.15.123:0/1024055535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc301824f0 0x55fc3018bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.652+0000 7f08de7fc700 1 -- 172.21.15.123:0/1024055535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc301824f0 msgr2=0x55fc3018bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:57.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.652+0000 7f08de7fc700 1 --2- 172.21.15.123:0/1024055535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc301824f0 0x55fc3018bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.652+0000 7f08de7fc700 1 -- 172.21.15.123:0/1024055535 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc30183810 msgr2=0x55fc30193350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:57.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.652+0000 7f08de7fc700 1 --2- 172.21.15.123:0/1024055535 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc30183810 0x55fc30193350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.652+0000 7f08de7fc700 1 -- 172.21.15.123:0/1024055535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d000c8a0 con 0x55fc30182e50 2024-06-02T04:03:57.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.653+0000 7f08de7fc700 1 --2- 172.21.15.123:0/1024055535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc30182e50 0x55fc3018c310 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f08d000c5b0 tx=0x7f08d001c620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66bfbf01d25ff65 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:57.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.653+0000 7f08c2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-06-02T04:03:57.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.653+0000 7f08c2ff5700 1 -- 172.21.15.123:0/1024055535 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d0004020 con 0x55fc30182e50 2024-06-02T04:03:57.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.653+0000 7f08c2ff5700 1 -- 172.21.15.123:0/1024055535 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f08d0017040 con 0x55fc30182e50 2024-06-02T04:03:57.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.653+0000 7f08f1789b80 1 -- 172.21.15.123:0/1024055535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fc3002b220 con 0x55fc30182e50 2024-06-02T04:03:57.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.653+0000 7f08c2ff5700 1 -- 172.21.15.123:0/1024055535 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08d0004180 con 0x55fc30182e50 2024-06-02T04:03:57.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.653+0000 7f08f1789b80 10 client.15054 fetch_fsmap learned FSMap version 27 2024-06-02T04:03:57.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.653+0000 7f08f1789b80 1 -- 172.21.15.123:0/1024055535 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55fc2feffb10 con 0x55fc30182e50 2024-06-02T04:03:57.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.653+0000 7f08c2ff5700 1 -- 172.21.15.123:0/1024055535 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fc3002b220 con 0x55fc30182e50 2024-06-02T04:03:57.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.653+0000 7f08c2ff5700 1 -- 172.21.15.123:0/1024055535 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f08d000e5e0 con 0x55fc30182e50 2024-06-02T04:03:57.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.653+0000 7f08f1789b80 10 client.15054 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:03:57.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.653+0000 7f08f1789b80 10 client.15054 resolve_mds: resolved name 'l' to daemon mds.l 2024-06-02T04:03:57.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.653+0000 7f08f1789b80 20 client.15054 populate_metadata read hostname 'smithi123' 2024-06-02T04:03:57.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.653+0000 7f08f1789b80 1 --2- 172.21.15.123:0/1024055535 >> [v2:172.21.15.162:6832/3583622784,v1:172.21.15.162:6833/3583622784] conn(0x55fc30196de0 0x55fc3019c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.653+0000 7f08f1789b80 4 client.15054 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:03:57.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.653+0000 7f08f1789b80 1 -- 172.21.15.123:0/1024055535 --> [v2:172.21.15.162:6832/3583622784,v1:172.21.15.162:6833/3583622784] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fc301517c0 con 0x55fc30196de0 2024-06-02T04:03:57.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.654+0000 7f08deffd700 1 --2- 172.21.15.123:0/1024055535 >> [v2:172.21.15.162:6832/3583622784,v1:172.21.15.162:6833/3583622784] conn(0x55fc30196de0 0x55fc3019c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.654+0000 7f08deffd700 1 --2- 172.21.15.123:0/1024055535 >> [v2:172.21.15.162:6832/3583622784,v1:172.21.15.162:6833/3583622784] conn(0x55fc30196de0 0x55fc3019c080 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=843979bd21eb3ace server_cookie=413e21fa275a09c9 in_seq=0 out_seq=0 2024-06-02T04:03:57.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.654+0000 7f08c2ff5700 10 client.15054 ms_handle_connect on v2:172.21.15.162:6832/3583622784 2024-06-02T04:03:57.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.655+0000 7f08c2ff5700 1 -- 172.21.15.123:0/1024055535 <== mds.3 v2:172.21.15.162:6832/3583622784 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fc301517c0 con 0x55fc30196de0 2024-06-02T04:03:57.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.655+0000 7f08c2ff5700 10 client.15054 handle_command_reply: tid=0 2024-06-02T04:03:57.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.655+0000 7f08f1789b80 1 client.15054 shutdown 2024-06-02T04:03:57.664 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.655+0000 7f08f1789b80 1 -- 172.21.15.123:0/1024055535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc30182e50 msgr2=0x55fc3018c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.655+0000 7f08f1789b80 1 --2- 172.21.15.123:0/1024055535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc30182e50 0x55fc3018c310 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f08d000c5b0 tx=0x7f08d001c620 comp rx=0 tx=0).stop 2024-06-02T04:03:57.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.655+0000 7f08f1789b80 1 -- 172.21.15.123:0/1024055535 shutdown_connections 2024-06-02T04:03:57.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.655+0000 7f08f1789b80 1 --2- 172.21.15.123:0/1024055535 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc30183810 0x55fc30193350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.655+0000 7f08f1789b80 1 --2- 172.21.15.123:0/1024055535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc301824f0 0x55fc3018bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.655+0000 7f08f1789b80 1 --2- 172.21.15.123:0/1024055535 >> [v2:172.21.15.162:6832/3583622784,v1:172.21.15.162:6833/3583622784] conn(0x55fc30196de0 0x55fc3019c080 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.655+0000 7f08f1789b80 1 --2- 172.21.15.123:0/1024055535 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc30182e50 0x55fc3018c310 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.655+0000 7f08f1789b80 1 -- 172.21.15.123:0/1024055535 >> 172.21.15.123:0/1024055535 conn(0x55fc300e01c0 msgr2=0x55fc3017c550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:57.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.655+0000 7f08c2ff5700 0 client.15054 ms_handle_reset on v2:172.21.15.162:6832/3583622784 2024-06-02T04:03:57.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.655+0000 7f08f1789b80 1 -- 172.21.15.123:0/1024055535 shutdown_connections 2024-06-02T04:03:57.665 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.655+0000 7f08f1789b80 1 -- 172.21.15.123:0/1024055535 wait complete. 2024-06-02T04:03:57.666 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.655+0000 7f08f1789b80 20 client.15054 trim_cache size 0 max 16384 2024-06-02T04:03:57.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.673+0000 7f08f1789b80 1 Processor -- start 2024-06-02T04:03:57.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.673+0000 7f08f1789b80 1 -- start start 2024-06-02T04:03:57.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.673+0000 7f08f1789b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc301824f0 0x55fc3017d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.673+0000 7f08f1789b80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc30182e50 0x55fc30193310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.673+0000 7f08f1789b80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc30183810 0x55fc3017cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.673+0000 7f08f1789b80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc3002b250 con 0x55fc30182e50 2024-06-02T04:03:57.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.673+0000 7f08f1789b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc300902e0 con 0x55fc301824f0 2024-06-02T04:03:57.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.673+0000 7f08f1789b80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc300cf010 con 0x55fc30183810 2024-06-02T04:03:57.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.673+0000 7f08de7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc30182e50 0x55fc30193310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.673+0000 7f08de7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc30182e50 0x55fc30193310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43050/0 (socket says 172.21.15.123:43050) 2024-06-02T04:03:57.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.673+0000 7f08de7fc700 1 -- 172.21.15.123:0/3631943564 learned_addr learned my addr 172.21.15.123:0/3631943564 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:57.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.673+0000 7f08df7fe700 1 --2- 172.21.15.123:0/3631943564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc30183810 0x55fc3017cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.673+0000 7f08de7fc700 1 -- 172.21.15.123:0/3631943564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc30183810 msgr2=0x55fc3017cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:57.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.673+0000 7f08de7fc700 1 --2- 172.21.15.123:0/3631943564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc30183810 0x55fc3017cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.673+0000 7f08de7fc700 1 -- 172.21.15.123:0/3631943564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc301824f0 msgr2=0x55fc3017d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:57.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.673+0000 7f08deffd700 1 --2- 172.21.15.123:0/3631943564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc301824f0 0x55fc3017d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.673+0000 7f08de7fc700 1 --2- 172.21.15.123:0/3631943564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc301824f0 0x55fc3017d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.673+0000 7f08de7fc700 1 -- 172.21.15.123:0/3631943564 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc30098510 con 0x55fc30182e50 2024-06-02T04:03:57.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.673+0000 7f08df7fe700 1 --2- 172.21.15.123:0/3631943564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc30183810 0x55fc3017cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:03:57.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.673+0000 7f08deffd700 1 --2- 172.21.15.123:0/3631943564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc301824f0 0x55fc3017d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:03:57.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.673+0000 7f08de7fc700 1 --2- 172.21.15.123:0/3631943564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc30182e50 0x55fc30193310 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f08d0011040 tx=0x7f08d0005d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81bb8b4a78b717c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:57.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.673+0000 7f08c5ffb700 1 -- 172.21.15.123:0/3631943564 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d000ebe0 con 0x55fc30182e50 2024-06-02T04:03:57.680 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.673+0000 7f08c5ffb700 1 -- 172.21.15.123:0/3631943564 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f08d0013040 con 0x55fc30182e50 2024-06-02T04:03:57.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.673+0000 7f08c5ffb700 1 -- 172.21.15.123:0/3631943564 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d0004a90 con 0x55fc30182e50 2024-06-02T04:03:57.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.674+0000 7f08f1789b80 1 -- 172.21.15.123:0/3631943564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc30182e50 msgr2=0x55fc30193310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.674+0000 7f08f1789b80 1 --2- 172.21.15.123:0/3631943564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc30182e50 0x55fc30193310 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f08d0011040 tx=0x7f08d0005d70 comp rx=0 tx=0).stop 2024-06-02T04:03:57.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.674+0000 7f08f1789b80 1 -- 172.21.15.123:0/3631943564 shutdown_connections 2024-06-02T04:03:57.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.674+0000 7f08f1789b80 1 --2- 172.21.15.123:0/3631943564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc30183810 0x55fc3017cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.674+0000 7f08f1789b80 1 --2- 172.21.15.123:0/3631943564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc301824f0 0x55fc3017d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.674+0000 7f08f1789b80 1 --2- 172.21.15.123:0/3631943564 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc30182e50 0x55fc30193310 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.674+0000 7f08f1789b80 1 -- 172.21.15.123:0/3631943564 >> 172.21.15.123:0/3631943564 conn(0x55fc300e01c0 msgr2=0x55fc30189da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:57.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.674+0000 7f08f1789b80 1 -- 172.21.15.123:0/3631943564 shutdown_connections 2024-06-02T04:03:57.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.674+0000 7f08f1789b80 1 -- 172.21.15.123:0/3631943564 wait complete. 2024-06-02T04:03:57.681 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.674+0000 7f08f1789b80 1 -- start start 2024-06-02T04:03:57.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.674+0000 7f08f1789b80 1 Processor -- start 2024-06-02T04:03:57.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.675+0000 7f08f1789b80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc301824f0 0x55fc301902a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.675+0000 7f08f1789b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc30182e50 0x55fc301927f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.675+0000 7f08f1789b80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc30183810 0x55fc30192d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.675+0000 7f08f1789b80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc30193420 con 0x55fc30183810 2024-06-02T04:03:57.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.675+0000 7f08f1789b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc30193590 con 0x55fc30182e50 2024-06-02T04:03:57.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.675+0000 7f08f1789b80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc301edd40 con 0x55fc301824f0 2024-06-02T04:03:57.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.675+0000 7f08f1789b80 10 client.0 _ll_register_callbacks cb 0x55fc30077ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:03:57.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.675+0000 7f08df7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc30183810 0x55fc30192d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.675+0000 7f08df7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc30183810 0x55fc30192d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43062/0 (socket says 172.21.15.123:43062) 2024-06-02T04:03:57.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.675+0000 7f08df7fe700 1 -- 172.21.15.123:0/1296181008 learned_addr learned my addr 172.21.15.123:0/1296181008 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:57.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.675+0000 7f08de7fc700 1 --2- 172.21.15.123:0/1296181008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc30182e50 0x55fc301927f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.675+0000 7f08deffd700 1 --2- 172.21.15.123:0/1296181008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc301824f0 0x55fc301902a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.675+0000 7f08df7fe700 1 -- 172.21.15.123:0/1296181008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc301824f0 msgr2=0x55fc301902a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:57.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.675+0000 7f08df7fe700 1 --2- 172.21.15.123:0/1296181008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc301824f0 0x55fc301902a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.675+0000 7f08df7fe700 1 -- 172.21.15.123:0/1296181008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc30182e50 msgr2=0x55fc301927f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:57.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.675+0000 7f08df7fe700 1 --2- 172.21.15.123:0/1296181008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc30182e50 0x55fc301927f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.675+0000 7f08df7fe700 1 -- 172.21.15.123:0/1296181008 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fc2feffb10 con 0x55fc30183810 2024-06-02T04:03:57.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.675+0000 7f08df7fe700 1 --2- 172.21.15.123:0/1296181008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc30183810 0x55fc30192d30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f08d8007820 tx=0x7f08d8007b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26396eaf703e77bd server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:57.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.675+0000 7f08c2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-06-02T04:03:57.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.675+0000 7f08c2ff5700 1 -- 172.21.15.123:0/1296181008 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d8018710 con 0x55fc30183810 2024-06-02T04:03:57.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.675+0000 7f08c2ff5700 1 -- 172.21.15.123:0/1296181008 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f08d8018870 con 0x55fc30183810 2024-06-02T04:03:57.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.675+0000 7f08f1789b80 1 -- 172.21.15.123:0/1296181008 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f08d000fe50 con 0x55fc30183810 2024-06-02T04:03:57.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.675+0000 7f08c2ff5700 1 -- 172.21.15.123:0/1296181008 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08d8018a30 con 0x55fc30183810 2024-06-02T04:03:57.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.676+0000 7f08f1789b80 10 client.15060 fetch_fsmap learned FSMap version 27 2024-06-02T04:03:57.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.676+0000 7f08f1789b80 1 -- 172.21.15.123:0/1296181008 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55fc2ff57c80 con 0x55fc30183810 2024-06-02T04:03:57.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.676+0000 7f08c2ff5700 1 -- 172.21.15.123:0/1296181008 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f08d000fe50 con 0x55fc30183810 2024-06-02T04:03:57.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.676+0000 7f08c2ff5700 1 -- 172.21.15.123:0/1296181008 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f08d8017cb0 con 0x55fc30183810 2024-06-02T04:03:57.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.676+0000 7f08f1789b80 10 client.15060 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:03:57.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.676+0000 7f08f1789b80 10 client.15060 resolve_mds: resolved name 'l' to daemon mds.l 2024-06-02T04:03:57.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.676+0000 7f08f1789b80 20 client.15060 populate_metadata read hostname 'smithi123' 2024-06-02T04:03:57.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.676+0000 7f08f1789b80 1 --2- 172.21.15.123:0/1296181008 >> [v2:172.21.15.162:6832/3583622784,v1:172.21.15.162:6833/3583622784] conn(0x55fc301f2ab0 0x55fc301ef440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.684 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.676+0000 7f08f1789b80 4 client.15060 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T04:03:57.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.676+0000 7f08f1789b80 1 -- 172.21.15.123:0/1296181008 --> [v2:172.21.15.162:6832/3583622784,v1:172.21.15.162:6833/3583622784] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fc300cae70 con 0x55fc301f2ab0 2024-06-02T04:03:57.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.676+0000 7f08deffd700 1 --2- 172.21.15.123:0/1296181008 >> [v2:172.21.15.162:6832/3583622784,v1:172.21.15.162:6833/3583622784] conn(0x55fc301f2ab0 0x55fc301ef440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.676+0000 7f08c2ff5700 10 client.15060 ms_handle_connect on v2:172.21.15.162:6832/3583622784 2024-06-02T04:03:57.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.676+0000 7f08deffd700 1 --2- 172.21.15.123:0/1296181008 >> [v2:172.21.15.162:6832/3583622784,v1:172.21.15.162:6833/3583622784] conn(0x55fc301f2ab0 0x55fc301ef440 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c40bb2b227d61709 server_cookie=c8f0570192024989 in_seq=0 out_seq=0 2024-06-02T04:03:57.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.677+0000 7f08c2ff5700 1 -- 172.21.15.123:0/1296181008 <== mds.3 v2:172.21.15.162:6832/3583622784 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55fc300cae70 con 0x55fc301f2ab0 2024-06-02T04:03:57.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.677+0000 7f08c2ff5700 10 client.15060 handle_command_reply: tid=0 2024-06-02T04:03:57.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.677+0000 7f08f1789b80 1 client.15060 shutdown 2024-06-02T04:03:57.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.677+0000 7f08f1789b80 1 -- 172.21.15.123:0/1296181008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc30183810 msgr2=0x55fc30192d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.677+0000 7f08f1789b80 1 --2- 172.21.15.123:0/1296181008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc30183810 0x55fc30192d30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f08d8007820 tx=0x7f08d8007b30 comp rx=0 tx=0).stop 2024-06-02T04:03:57.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.677+0000 7f08f1789b80 1 -- 172.21.15.123:0/1296181008 shutdown_connections 2024-06-02T04:03:57.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.677+0000 7f08f1789b80 1 --2- 172.21.15.123:0/1296181008 >> [v2:172.21.15.162:6832/3583622784,v1:172.21.15.162:6833/3583622784] conn(0x55fc301f2ab0 0x55fc301ef440 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.677+0000 7f08f1789b80 1 --2- 172.21.15.123:0/1296181008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55fc30183810 0x55fc30192d30 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.677+0000 7f08c2ff5700 0 client.15060 ms_handle_reset on v2:172.21.15.162:6832/3583622784 2024-06-02T04:03:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.677+0000 7f08f1789b80 1 --2- 172.21.15.123:0/1296181008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fc301824f0 0x55fc301902a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.677+0000 7f08f1789b80 1 --2- 172.21.15.123:0/1296181008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55fc30182e50 0x55fc301927f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.677+0000 7f08f1789b80 1 -- 172.21.15.123:0/1296181008 >> 172.21.15.123:0/1296181008 conn(0x55fc300e01c0 msgr2=0x55fc3018bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.677+0000 7f08f1789b80 1 -- 172.21.15.123:0/1296181008 shutdown_connections 2024-06-02T04:03:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.677+0000 7f08f1789b80 1 -- 172.21.15.123:0/1296181008 wait complete. 2024-06-02T04:03:57.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.677+0000 7f08f1789b80 20 client.15060 trim_cache size 0 max 16384 2024-06-02T04:03:57.686 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-06-02T04:03:57.687 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "1b432ae0-2094-11ef-bc9b-c7b262605968", 2024-06-02T04:03:57.687 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 3, 2024-06-02T04:03:57.687 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 24439, 2024-06-02T04:03:57.687 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-06-02T04:03:57.687 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-06-02T04:03:57.687 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-06-02T04:03:57.687 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 46.599898504000002, 2024-06-02T04:03:57.687 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 27, 2024-06-02T04:03:57.687 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 82, 2024-06-02T04:03:57.687 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 82, 2024-06-02T04:03:57.687 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 75.577469832999995 2024-06-02T04:03:57.688 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-06-02T04:03:57.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.677+0000 7f08e55ce700 1 -- 172.21.15.123:0/3846823297 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f08c80a11b0 msgr2=0x7f08c80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.677+0000 7f08e55ce700 1 --2- 172.21.15.123:0/3846823297 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f08c80a11b0 0x7f08c80a3670 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f08d0005fd0 tx=0x7f08d0005d00 comp rx=0 tx=0).stop 2024-06-02T04:03:57.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.677+0000 7f08e55ce700 1 -- 172.21.15.123:0/3846823297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08e0101a60 msgr2=0x7f08e0196e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.677+0000 7f08e55ce700 1 --2- 172.21.15.123:0/3846823297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08e0101a60 0x7f08e0196e70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f08d40095c0 tx=0x7f08d400f690 comp rx=0 tx=0).stop 2024-06-02T04:03:57.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.677+0000 7f08e55ce700 1 -- 172.21.15.123:0/3846823297 shutdown_connections 2024-06-02T04:03:57.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.677+0000 7f08e55ce700 1 --2- 172.21.15.123:0/3846823297 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f08c80a11b0 0x7f08c80a3670 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.677+0000 7f08e55ce700 1 --2- 172.21.15.123:0/3846823297 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08e0106cc0 0x7f08e019e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.677+0000 7f08e55ce700 1 --2- 172.21.15.123:0/3846823297 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f08e0101a60 0x7f08e0196e70 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.677+0000 7f08e55ce700 1 --2- 172.21.15.123:0/3846823297 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f08e0104390 0x7f08e01973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.677+0000 7f08e55ce700 1 -- 172.21.15.123:0/3846823297 >> 172.21.15.123:0/3846823297 conn(0x7f08e00fb3f0 msgr2=0x7f08e0102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:57.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.678+0000 7f08e55ce700 1 -- 172.21.15.123:0/3846823297 shutdown_connections 2024-06-02T04:03:57.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.678+0000 7f08e55ce700 1 -- 172.21.15.123:0/3846823297 wait complete. 2024-06-02T04:03:57.691 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-06-02T04:03:57.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.814+0000 7f9836b39700 1 -- 172.21.15.123:0/2884602254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98301019e0 msgr2=0x7f9830103dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.814+0000 7f9836b39700 1 --2- 172.21.15.123:0/2884602254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98301019e0 0x7f9830103dd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9824009990 tx=0x7f9824009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.814+0000 7f9836b39700 1 -- 172.21.15.123:0/2884602254 shutdown_connections 2024-06-02T04:03:57.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.814+0000 7f9836b39700 1 --2- 172.21.15.123:0/2884602254 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9830106c40 0x7f98301090b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.814+0000 7f9836b39700 1 --2- 172.21.15.123:0/2884602254 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f98301019e0 0x7f9830103dd0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.814+0000 7f9836b39700 1 --2- 172.21.15.123:0/2884602254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9830104310 0x7f9830106700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.814+0000 7f9836b39700 1 -- 172.21.15.123:0/2884602254 >> 172.21.15.123:0/2884602254 conn(0x7f98300fb3f0 msgr2=0x7f98300fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:57.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.814+0000 7f9836b39700 1 -- 172.21.15.123:0/2884602254 shutdown_connections 2024-06-02T04:03:57.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.814+0000 7f9836b39700 1 -- 172.21.15.123:0/2884602254 wait complete. 2024-06-02T04:03:57.816 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.814+0000 7f9836b39700 1 Processor -- start 2024-06-02T04:03:57.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.814+0000 7f9836b39700 1 -- start start 2024-06-02T04:03:57.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.815+0000 7f9836b39700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98301019e0 0x7f9830196eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.815+0000 7f9836b39700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9830104310 0x7f98301973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.815+0000 7f9836b39700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9830106c40 0x7f983019e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.815+0000 7f9836b39700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983019e9e0 con 0x7f9830104310 2024-06-02T04:03:57.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.815+0000 7f9836b39700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983019eb20 con 0x7f98301019e0 2024-06-02T04:03:57.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.815+0000 7f9836b39700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983019ecb0 con 0x7f9830106c40 2024-06-02T04:03:57.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.815+0000 7f982ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9830104310 0x7f98301973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.815+0000 7f982ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9830104310 0x7f98301973f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43092/0 (socket says 172.21.15.123:43092) 2024-06-02T04:03:57.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.815+0000 7f982ffff700 1 -- 172.21.15.123:0/57935751 learned_addr learned my addr 172.21.15.123:0/57935751 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:57.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.815+0000 7f98348d5700 1 --2- 172.21.15.123:0/57935751 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98301019e0 0x7f9830196eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.817 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.815+0000 7f982ffff700 1 -- 172.21.15.123:0/57935751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9830106c40 msgr2=0x7f983019e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.815+0000 7f982ffff700 1 --2- 172.21.15.123:0/57935751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9830106c40 0x7f983019e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.815+0000 7f982ffff700 1 -- 172.21.15.123:0/57935751 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98301019e0 msgr2=0x7f9830196eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.815+0000 7f982ffff700 1 --2- 172.21.15.123:0/57935751 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98301019e0 0x7f9830196eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.815+0000 7f982ffff700 1 -- 172.21.15.123:0/57935751 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98240095f0 con 0x7f9830104310 2024-06-02T04:03:57.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.815+0000 7f982ffff700 1 --2- 172.21.15.123:0/57935751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9830104310 0x7f98301973f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f981c00d980 tx=0x7f981c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:57.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.815+0000 7f982dffb700 1 -- 172.21.15.123:0/57935751 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c00bb60 con 0x7f9830104310 2024-06-02T04:03:57.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.815+0000 7f982dffb700 1 -- 172.21.15.123:0/57935751 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f981c007640 con 0x7f9830104310 2024-06-02T04:03:57.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.815+0000 7f9836b39700 1 -- 172.21.15.123:0/57935751 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f983019ef90 con 0x7f9830104310 2024-06-02T04:03:57.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.815+0000 7f982dffb700 1 -- 172.21.15.123:0/57935751 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c004e90 con 0x7f9830104310 2024-06-02T04:03:57.818 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.816+0000 7f9836b39700 1 -- 172.21.15.123:0/57935751 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f983019f410 con 0x7f9830104310 2024-06-02T04:03:57.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.817+0000 7f982dffb700 1 -- 172.21.15.123:0/57935751 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f981c00bcc0 con 0x7f9830104310 2024-06-02T04:03:57.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.818+0000 7f982dffb700 1 --2- 172.21.15.123:0/57935751 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f98200a1230 0x7f98200a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.818+0000 7f98348d5700 1 --2- 172.21.15.123:0/57935751 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f98200a1230 0x7f98200a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.818+0000 7f982dffb700 1 -- 172.21.15.123:0/57935751 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f981c0cc900 con 0x7f9830104310 2024-06-02T04:03:57.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.818+0000 7f98348d5700 1 --2- 172.21.15.123:0/57935751 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f98200a1230 0x7f98200a36f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f982400b5c0 tx=0x7f9824005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:57.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.819+0000 7f9842cf4b80 1 Processor -- start 2024-06-02T04:03:57.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.819+0000 7f9842cf4b80 1 -- start start 2024-06-02T04:03:57.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.819+0000 7f9842cf4b80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563b5ddaf4f0 0x563b5ddaf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.825 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.819+0000 7f9842cf4b80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b5ddafe50 0x563b5ddb02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.819+0000 7f9842cf4b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ddb0810 0x563b5ddb0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.819+0000 7f9842cf4b80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b5dd06100 con 0x563b5ddaf4f0 2024-06-02T04:03:57.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.819+0000 7f9842cf4b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b5dd03ac0 con 0x563b5ddb0810 2024-06-02T04:03:57.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.819+0000 7f9842cf4b80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b5dcff3b0 con 0x563b5ddafe50 2024-06-02T04:03:57.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.819+0000 7f98348d5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563b5ddaf4f0 0x563b5ddaf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.819+0000 7f98348d5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563b5ddaf4f0 0x563b5ddaf910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43098/0 (socket says 172.21.15.123:43098) 2024-06-02T04:03:57.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.819+0000 7f98348d5700 1 -- 172.21.15.123:0/226747107 learned_addr learned my addr 172.21.15.123:0/226747107 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:57.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.819+0000 7f98350d6700 1 --2- 172.21.15.123:0/226747107 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ddb0810 0x563b5ddb0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.819+0000 7f982ffff700 1 --2- 172.21.15.123:0/226747107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b5ddafe50 0x563b5ddb02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.819+0000 7f98348d5700 1 -- 172.21.15.123:0/226747107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b5ddafe50 msgr2=0x563b5ddb02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:57.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.819+0000 7f98348d5700 1 --2- 172.21.15.123:0/226747107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b5ddafe50 0x563b5ddb02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.819+0000 7f98348d5700 1 -- 172.21.15.123:0/226747107 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ddb0810 msgr2=0x563b5ddb0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:57.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.819+0000 7f98348d5700 1 --2- 172.21.15.123:0/226747107 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ddb0810 0x563b5ddb0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.819+0000 7f98348d5700 1 -- 172.21.15.123:0/226747107 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b5db80360 con 0x563b5ddaf4f0 2024-06-02T04:03:57.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.819+0000 7f98350d6700 1 --2- 172.21.15.123:0/226747107 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ddb0810 0x563b5ddb0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:03:57.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.820+0000 7f98348d5700 1 --2- 172.21.15.123:0/226747107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563b5ddaf4f0 0x563b5ddaf910 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9824015000 tx=0x7f982401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c490bb4461ad47c5 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:57.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.820+0000 7f981affd700 1 -- 172.21.15.123:0/226747107 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982402b070 con 0x563b5ddaf4f0 2024-06-02T04:03:57.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.820+0000 7f981affd700 1 -- 172.21.15.123:0/226747107 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f982401e040 con 0x563b5ddaf4f0 2024-06-02T04:03:57.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.820+0000 7f981affd700 1 -- 172.21.15.123:0/226747107 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9824024870 con 0x563b5ddaf4f0 2024-06-02T04:03:57.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.820+0000 7f9842cf4b80 1 -- 172.21.15.123:0/226747107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563b5ddaf4f0 msgr2=0x563b5ddaf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.820+0000 7f9842cf4b80 1 --2- 172.21.15.123:0/226747107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563b5ddaf4f0 0x563b5ddaf910 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9824015000 tx=0x7f982401f000 comp rx=0 tx=0).stop 2024-06-02T04:03:57.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.820+0000 7f9842cf4b80 1 -- 172.21.15.123:0/226747107 shutdown_connections 2024-06-02T04:03:57.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.820+0000 7f9842cf4b80 1 --2- 172.21.15.123:0/226747107 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ddb0810 0x563b5ddb0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.820+0000 7f9842cf4b80 1 --2- 172.21.15.123:0/226747107 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563b5ddaf4f0 0x563b5ddaf910 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.820+0000 7f9842cf4b80 1 --2- 172.21.15.123:0/226747107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b5ddafe50 0x563b5ddb02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.820+0000 7f9842cf4b80 1 -- 172.21.15.123:0/226747107 >> 172.21.15.123:0/226747107 conn(0x563b5dd0d1c0 msgr2=0x563b5dda9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:57.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.820+0000 7f9842cf4b80 1 -- 172.21.15.123:0/226747107 shutdown_connections 2024-06-02T04:03:57.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.820+0000 7f9842cf4b80 1 -- 172.21.15.123:0/226747107 wait complete. 2024-06-02T04:03:57.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.821+0000 7f9842cf4b80 1 -- start start 2024-06-02T04:03:57.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.821+0000 7f9842cf4b80 1 Processor -- start 2024-06-02T04:03:57.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.821+0000 7f9842cf4b80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563b5ddaf4f0 0x563b5ddb8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.821+0000 7f9842cf4b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ddafe50 0x563b5ddb9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.821+0000 7f9842cf4b80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b5ddb0810 0x563b5ddc0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.821+0000 7f9842cf4b80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b5dc9b510 con 0x563b5ddaf4f0 2024-06-02T04:03:57.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.821+0000 7f9842cf4b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b5dc9b1b0 con 0x563b5ddafe50 2024-06-02T04:03:57.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.821+0000 7f9842cf4b80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b5db82650 con 0x563b5ddb0810 2024-06-02T04:03:57.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.821+0000 7f9842cf4b80 10 client.0 _ll_register_callbacks cb 0x563b5dca4ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:03:57.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.821+0000 7f98348d5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563b5ddaf4f0 0x563b5ddb8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.821+0000 7f98348d5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563b5ddaf4f0 0x563b5ddb8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43114/0 (socket says 172.21.15.123:43114) 2024-06-02T04:03:57.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.821+0000 7f98348d5700 1 -- 172.21.15.123:0/2283848996 learned_addr learned my addr 172.21.15.123:0/2283848996 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:57.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.822+0000 7f98348d5700 1 -- 172.21.15.123:0/2283848996 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b5ddb0810 msgr2=0x563b5ddc0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:57.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.822+0000 7f98348d5700 1 --2- 172.21.15.123:0/2283848996 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b5ddb0810 0x563b5ddc0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.822+0000 7f982ffff700 1 --2- 172.21.15.123:0/2283848996 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ddafe50 0x563b5ddb9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.822+0000 7f98348d5700 1 -- 172.21.15.123:0/2283848996 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ddafe50 msgr2=0x563b5ddb9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:57.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.822+0000 7f98348d5700 1 --2- 172.21.15.123:0/2283848996 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ddafe50 0x563b5ddb9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.822+0000 7f98348d5700 1 -- 172.21.15.123:0/2283848996 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9830109ca0 con 0x563b5ddaf4f0 2024-06-02T04:03:57.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.822+0000 7f98348d5700 1 --2- 172.21.15.123:0/2283848996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563b5ddaf4f0 0x563b5ddb8cc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f982400ffd0 tx=0x7f9824025e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4eaabba61effca server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:57.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.822+0000 7f980ffff700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-06-02T04:03:57.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.822+0000 7f980ffff700 1 -- 172.21.15.123:0/2283848996 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982402b050 con 0x563b5ddaf4f0 2024-06-02T04:03:57.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.822+0000 7f980ffff700 1 -- 172.21.15.123:0/2283848996 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f982400f770 con 0x563b5ddaf4f0 2024-06-02T04:03:57.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.822+0000 7f9842cf4b80 1 -- 172.21.15.123:0/2283848996 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563b5dc58220 con 0x563b5ddaf4f0 2024-06-02T04:03:57.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.822+0000 7f980ffff700 1 -- 172.21.15.123:0/2283848996 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f982400f930 con 0x563b5ddaf4f0 2024-06-02T04:03:57.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.822+0000 7f9842cf4b80 10 client.15072 fetch_fsmap learned FSMap version 27 2024-06-02T04:03:57.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.822+0000 7f9842cf4b80 1 -- 172.21.15.123:0/2283848996 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x563b5db2cb10 con 0x563b5ddaf4f0 2024-06-02T04:03:57.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.822+0000 7f980ffff700 1 -- 172.21.15.123:0/2283848996 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563b5dc58220 con 0x563b5ddaf4f0 2024-06-02T04:03:57.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.822+0000 7f980ffff700 1 -- 172.21.15.123:0/2283848996 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f9824045400 con 0x563b5ddaf4f0 2024-06-02T04:03:57.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.822+0000 7f9842cf4b80 10 client.15072 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:03:57.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.822+0000 7f9842cf4b80 10 client.15072 resolve_mds: resolved name 'h' to daemon mds.h 2024-06-02T04:03:57.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.822+0000 7f9842cf4b80 20 client.15072 populate_metadata read hostname 'smithi123' 2024-06-02T04:03:57.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.822+0000 7f9842cf4b80 1 --2- 172.21.15.123:0/2283848996 >> [v2:172.21.15.136:6836/2572418263,v1:172.21.15.136:6837/2572418263] conn(0x563b5ddc33f0 0x563b5ddc8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.822+0000 7f9842cf4b80 4 client.15072 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:03:57.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.822+0000 7f9842cf4b80 1 -- 172.21.15.123:0/2283848996 --> [v2:172.21.15.136:6836/2572418263,v1:172.21.15.136:6837/2572418263] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563b5dd7e7c0 con 0x563b5ddc33f0 2024-06-02T04:03:57.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.823+0000 7f982ffff700 1 --2- 172.21.15.123:0/2283848996 >> [v2:172.21.15.136:6836/2572418263,v1:172.21.15.136:6837/2572418263] conn(0x563b5ddc33f0 0x563b5ddc8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.823+0000 7f982ffff700 1 --2- 172.21.15.123:0/2283848996 >> [v2:172.21.15.136:6836/2572418263,v1:172.21.15.136:6837/2572418263] conn(0x563b5ddc33f0 0x563b5ddc8ce0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ca1fcf8a3468fbb5 server_cookie=b1ff6de8a916827a in_seq=0 out_seq=0 2024-06-02T04:03:57.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.823+0000 7f980ffff700 10 client.15072 ms_handle_connect on v2:172.21.15.136:6836/2572418263 2024-06-02T04:03:57.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.824+0000 7f980ffff700 1 -- 172.21.15.123:0/2283848996 <== mds.2 v2:172.21.15.136:6836/2572418263 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563b5dd7e7c0 con 0x563b5ddc33f0 2024-06-02T04:03:57.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.824+0000 7f980ffff700 10 client.15072 handle_command_reply: tid=0 2024-06-02T04:03:57.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.824+0000 7f9842cf4b80 1 client.15072 shutdown 2024-06-02T04:03:57.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.824+0000 7f9842cf4b80 1 -- 172.21.15.123:0/2283848996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563b5ddaf4f0 msgr2=0x563b5ddb8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.824+0000 7f9842cf4b80 1 --2- 172.21.15.123:0/2283848996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563b5ddaf4f0 0x563b5ddb8cc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f982400ffd0 tx=0x7f9824025e70 comp rx=0 tx=0).stop 2024-06-02T04:03:57.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.824+0000 7f9842cf4b80 1 -- 172.21.15.123:0/2283848996 shutdown_connections 2024-06-02T04:03:57.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.824+0000 7f9842cf4b80 1 --2- 172.21.15.123:0/2283848996 >> [v2:172.21.15.136:6836/2572418263,v1:172.21.15.136:6837/2572418263] conn(0x563b5ddc33f0 0x563b5ddc8ce0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.824+0000 7f9842cf4b80 1 --2- 172.21.15.123:0/2283848996 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b5ddb0810 0x563b5ddc0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.824+0000 7f9842cf4b80 1 --2- 172.21.15.123:0/2283848996 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563b5ddaf4f0 0x563b5ddb8cc0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.824+0000 7f9842cf4b80 1 --2- 172.21.15.123:0/2283848996 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ddafe50 0x563b5ddb9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.824+0000 7f9842cf4b80 1 -- 172.21.15.123:0/2283848996 >> 172.21.15.123:0/2283848996 conn(0x563b5dd0d1c0 msgr2=0x563b5dda9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:57.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.824+0000 7f980ffff700 0 client.15072 ms_handle_reset on v2:172.21.15.136:6836/2572418263 2024-06-02T04:03:57.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.824+0000 7f9842cf4b80 1 -- 172.21.15.123:0/2283848996 shutdown_connections 2024-06-02T04:03:57.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.824+0000 7f9842cf4b80 1 -- 172.21.15.123:0/2283848996 wait complete. 2024-06-02T04:03:57.832 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.824+0000 7f9842cf4b80 20 client.15072 trim_cache size 0 max 16384 2024-06-02T04:03:57.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.842+0000 7f9842cf4b80 1 Processor -- start 2024-06-02T04:03:57.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.842+0000 7f9842cf4b80 1 -- start start 2024-06-02T04:03:57.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.842+0000 7f9842cf4b80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563b5ddaf4f0 0x563b5ddaf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.842+0000 7f9842cf4b80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b5ddafe50 0x563b5ddc08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.842+0000 7f9842cf4b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ddb0810 0x563b5ddc0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.842+0000 7f9842cf4b80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b5dcbd2b0 con 0x563b5ddaf4f0 2024-06-02T04:03:57.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.842+0000 7f9842cf4b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b5dcf8150 con 0x563b5ddb0810 2024-06-02T04:03:57.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.842+0000 7f9842cf4b80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b5dc9e5a0 con 0x563b5ddafe50 2024-06-02T04:03:57.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.842+0000 7f98348d5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563b5ddaf4f0 0x563b5ddaf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.842+0000 7f98348d5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563b5ddaf4f0 0x563b5ddaf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43128/0 (socket says 172.21.15.123:43128) 2024-06-02T04:03:57.847 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.842+0000 7f98348d5700 1 -- 172.21.15.123:0/4200848487 learned_addr learned my addr 172.21.15.123:0/4200848487 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.842+0000 7f982ffff700 1 --2- 172.21.15.123:0/4200848487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b5ddafe50 0x563b5ddc08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.842+0000 7f98348d5700 1 -- 172.21.15.123:0/4200848487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b5ddafe50 msgr2=0x563b5ddc08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.842+0000 7f98348d5700 1 --2- 172.21.15.123:0/4200848487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b5ddafe50 0x563b5ddc08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.842+0000 7f98348d5700 1 -- 172.21.15.123:0/4200848487 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ddb0810 msgr2=0x563b5ddc0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.842+0000 7f98348d5700 1 --2- 172.21.15.123:0/4200848487 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ddb0810 0x563b5ddc0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.842+0000 7f98348d5700 1 -- 172.21.15.123:0/4200848487 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b5dcc5510 con 0x563b5ddaf4f0 2024-06-02T04:03:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.842+0000 7f982ffff700 1 --2- 172.21.15.123:0/4200848487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b5ddafe50 0x563b5ddc08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:03:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.842+0000 7f98348d5700 1 --2- 172.21.15.123:0/4200848487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563b5ddaf4f0 0x563b5ddaf8d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9824025fd0 tx=0x7f98240245e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f68b4aa28b7daa8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.842+0000 7f981b7fe700 1 -- 172.21.15.123:0/4200848487 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982402b070 con 0x563b5ddaf4f0 2024-06-02T04:03:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.842+0000 7f981b7fe700 1 -- 172.21.15.123:0/4200848487 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9824040020 con 0x563b5ddaf4f0 2024-06-02T04:03:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.842+0000 7f981b7fe700 1 -- 172.21.15.123:0/4200848487 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982400fbb0 con 0x563b5ddaf4f0 2024-06-02T04:03:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.843+0000 7f9842cf4b80 1 -- 172.21.15.123:0/4200848487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563b5ddaf4f0 msgr2=0x563b5ddaf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.843+0000 7f9842cf4b80 1 --2- 172.21.15.123:0/4200848487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563b5ddaf4f0 0x563b5ddaf8d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9824025fd0 tx=0x7f98240245e0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.848 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.843+0000 7f9842cf4b80 1 -- 172.21.15.123:0/4200848487 shutdown_connections 2024-06-02T04:03:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.843+0000 7f9842cf4b80 1 --2- 172.21.15.123:0/4200848487 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ddb0810 0x563b5ddc0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.843+0000 7f9842cf4b80 1 --2- 172.21.15.123:0/4200848487 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563b5ddaf4f0 0x563b5ddaf8d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.843+0000 7f9842cf4b80 1 --2- 172.21.15.123:0/4200848487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b5ddafe50 0x563b5ddc08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.843+0000 7f9842cf4b80 1 -- 172.21.15.123:0/4200848487 >> 172.21.15.123:0/4200848487 conn(0x563b5dd0d1c0 msgr2=0x563b5ddb0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.843+0000 7f9842cf4b80 1 -- 172.21.15.123:0/4200848487 shutdown_connections 2024-06-02T04:03:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.843+0000 7f9842cf4b80 1 -- 172.21.15.123:0/4200848487 wait complete. 2024-06-02T04:03:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.843+0000 7f9842cf4b80 1 -- start start 2024-06-02T04:03:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.843+0000 7f9842cf4b80 1 Processor -- start 2024-06-02T04:03:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.844+0000 7f9842cf4b80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b5ddaf4f0 0x563b5ddbc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.844+0000 7f9842cf4b80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563b5ddafe50 0x563b5ddbe690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.844+0000 7f9842cf4b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ddb0810 0x563b5ddbed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.844+0000 7f9842cf4b80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b5ddbf3f0 con 0x563b5ddafe50 2024-06-02T04:03:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.844+0000 7f9842cf4b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b5ddbf560 con 0x563b5ddb0810 2024-06-02T04:03:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.844+0000 7f9842cf4b80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b5ddbf720 con 0x563b5ddaf4f0 2024-06-02T04:03:57.849 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.844+0000 7f9842cf4b80 10 client.0 _ll_register_callbacks cb 0x563b5dca4ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:03:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.844+0000 7f982ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563b5ddafe50 0x563b5ddbe690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.844+0000 7f982ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563b5ddafe50 0x563b5ddbe690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43130/0 (socket says 172.21.15.123:43130) 2024-06-02T04:03:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.844+0000 7f982ffff700 1 -- 172.21.15.123:0/3054726119 learned_addr learned my addr 172.21.15.123:0/3054726119 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.844+0000 7f98348d5700 1 --2- 172.21.15.123:0/3054726119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b5ddaf4f0 0x563b5ddbc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.844+0000 7f98350d6700 1 --2- 172.21.15.123:0/3054726119 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ddb0810 0x563b5ddbed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.844+0000 7f982ffff700 1 -- 172.21.15.123:0/3054726119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b5ddaf4f0 msgr2=0x563b5ddbc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.844+0000 7f982ffff700 1 --2- 172.21.15.123:0/3054726119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b5ddaf4f0 0x563b5ddbc140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.844+0000 7f982ffff700 1 -- 172.21.15.123:0/3054726119 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ddb0810 msgr2=0x563b5ddbed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.844+0000 7f982ffff700 1 --2- 172.21.15.123:0/3054726119 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ddb0810 0x563b5ddbed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.844+0000 7f982ffff700 1 -- 172.21.15.123:0/3054726119 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563b5db2cb10 con 0x563b5ddafe50 2024-06-02T04:03:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.844+0000 7f98350d6700 1 --2- 172.21.15.123:0/3054726119 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ddb0810 0x563b5ddbed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:03:57.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.845+0000 7f982ffff700 1 --2- 172.21.15.123:0/3054726119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563b5ddafe50 0x563b5ddbe690 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f981c00dfd0 tx=0x7f981c099cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d35b6160db49608 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.845+0000 7f980ffff700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-06-02T04:03:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.845+0000 7f980ffff700 1 -- 172.21.15.123:0/3054726119 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c0a2120 con 0x563b5ddafe50 2024-06-02T04:03:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.845+0000 7f980ffff700 1 -- 172.21.15.123:0/3054726119 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f981c099190 con 0x563b5ddafe50 2024-06-02T04:03:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.845+0000 7f9842cf4b80 1 -- 172.21.15.123:0/3054726119 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f982401e040 con 0x563b5ddafe50 2024-06-02T04:03:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.845+0000 7f980ffff700 1 -- 172.21.15.123:0/3054726119 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f981c099350 con 0x563b5ddafe50 2024-06-02T04:03:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.845+0000 7f9842cf4b80 10 client.15078 fetch_fsmap learned FSMap version 27 2024-06-02T04:03:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.845+0000 7f9842cf4b80 1 -- 172.21.15.123:0/3054726119 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x563b5db84c80 con 0x563b5ddafe50 2024-06-02T04:03:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.845+0000 7f980ffff700 1 -- 172.21.15.123:0/3054726119 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f982401e040 con 0x563b5ddafe50 2024-06-02T04:03:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.845+0000 7f980ffff700 1 -- 172.21.15.123:0/3054726119 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f981c05fc30 con 0x563b5ddafe50 2024-06-02T04:03:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.845+0000 7f9842cf4b80 10 client.15078 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:03:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.845+0000 7f9842cf4b80 10 client.15078 resolve_mds: resolved name 'h' to daemon mds.h 2024-06-02T04:03:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.845+0000 7f9842cf4b80 20 client.15078 populate_metadata read hostname 'smithi123' 2024-06-02T04:03:57.851 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.845+0000 7f9842cf4b80 1 --2- 172.21.15.123:0/3054726119 >> [v2:172.21.15.136:6836/2572418263,v1:172.21.15.136:6837/2572418263] conn(0x563b5de1e7b0 0x563b5de1b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.845+0000 7f9842cf4b80 4 client.15078 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T04:03:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.845+0000 7f9842cf4b80 1 -- 172.21.15.123:0/3054726119 --> [v2:172.21.15.136:6836/2572418263,v1:172.21.15.136:6837/2572418263] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563b5dcf7e70 con 0x563b5de1e7b0 2024-06-02T04:03:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.845+0000 7f98348d5700 1 --2- 172.21.15.123:0/3054726119 >> [v2:172.21.15.136:6836/2572418263,v1:172.21.15.136:6837/2572418263] conn(0x563b5de1e7b0 0x563b5de1b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.846+0000 7f980ffff700 10 client.15078 ms_handle_connect on v2:172.21.15.136:6836/2572418263 2024-06-02T04:03:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.846+0000 7f98348d5700 1 --2- 172.21.15.123:0/3054726119 >> [v2:172.21.15.136:6836/2572418263,v1:172.21.15.136:6837/2572418263] conn(0x563b5de1e7b0 0x563b5de1b100 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=aa8959b0149bb8fe server_cookie=366336f5fdce8032 in_seq=0 out_seq=0 2024-06-02T04:03:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.846+0000 7f980ffff700 1 -- 172.21.15.123:0/3054726119 <== mds.2 v2:172.21.15.136:6836/2572418263 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x563b5dcf7e70 con 0x563b5de1e7b0 2024-06-02T04:03:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.846+0000 7f980ffff700 10 client.15078 handle_command_reply: tid=0 2024-06-02T04:03:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.846+0000 7f9842cf4b80 1 client.15078 shutdown 2024-06-02T04:03:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.846+0000 7f9842cf4b80 1 -- 172.21.15.123:0/3054726119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563b5ddafe50 msgr2=0x563b5ddbe690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.846+0000 7f9842cf4b80 1 --2- 172.21.15.123:0/3054726119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563b5ddafe50 0x563b5ddbe690 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f981c00dfd0 tx=0x7f981c099cf0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.846+0000 7f9842cf4b80 1 -- 172.21.15.123:0/3054726119 shutdown_connections 2024-06-02T04:03:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.846+0000 7f9842cf4b80 1 --2- 172.21.15.123:0/3054726119 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x563b5ddb0810 0x563b5ddbed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.846+0000 7f9842cf4b80 1 --2- 172.21.15.123:0/3054726119 >> [v2:172.21.15.136:6836/2572418263,v1:172.21.15.136:6837/2572418263] conn(0x563b5de1e7b0 0x563b5de1b100 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.846+0000 7f9842cf4b80 1 --2- 172.21.15.123:0/3054726119 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x563b5ddaf4f0 0x563b5ddbc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.846+0000 7f9842cf4b80 1 --2- 172.21.15.123:0/3054726119 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x563b5ddafe50 0x563b5ddbe690 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.846+0000 7f980ffff700 0 client.15078 ms_handle_reset on v2:172.21.15.136:6836/2572418263 2024-06-02T04:03:57.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.846+0000 7f9842cf4b80 1 -- 172.21.15.123:0/3054726119 >> 172.21.15.123:0/3054726119 conn(0x563b5dd0d1c0 msgr2=0x563b5ddb7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:57.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.846+0000 7f9842cf4b80 1 -- 172.21.15.123:0/3054726119 shutdown_connections 2024-06-02T04:03:57.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.846+0000 7f9842cf4b80 1 -- 172.21.15.123:0/3054726119 wait complete. 2024-06-02T04:03:57.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.846+0000 7f9842cf4b80 20 client.15078 trim_cache size 0 max 16384 2024-06-02T04:03:57.853 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-06-02T04:03:57.853 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "1b432ae0-2094-11ef-bc9b-c7b262605968", 2024-06-02T04:03:57.853 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 2, 2024-06-02T04:03:57.853 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 24473, 2024-06-02T04:03:57.854 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-06-02T04:03:57.854 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-06-02T04:03:57.854 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-06-02T04:03:57.854 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 47.139857034999999, 2024-06-02T04:03:57.854 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 27, 2024-06-02T04:03:57.854 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 82, 2024-06-02T04:03:57.854 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 82, 2024-06-02T04:03:57.854 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 62.921237038999998 2024-06-02T04:03:57.854 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-06-02T04:03:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.847+0000 7f9836b39700 1 -- 172.21.15.123:0/57935751 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f98200a1230 msgr2=0x7f98200a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.847+0000 7f9836b39700 1 --2- 172.21.15.123:0/57935751 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f98200a1230 0x7f98200a36f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f982400b5c0 tx=0x7f9824005fb0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.847+0000 7f9836b39700 1 -- 172.21.15.123:0/57935751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9830104310 msgr2=0x7f98301973f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.847+0000 7f9836b39700 1 --2- 172.21.15.123:0/57935751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9830104310 0x7f98301973f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f981c00d980 tx=0x7f981c00dd40 comp rx=0 tx=0).stop 2024-06-02T04:03:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.847+0000 7f9836b39700 1 -- 172.21.15.123:0/57935751 shutdown_connections 2024-06-02T04:03:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.847+0000 7f9836b39700 1 --2- 172.21.15.123:0/57935751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9830106c40 0x7f983019e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.847+0000 7f9836b39700 1 --2- 172.21.15.123:0/57935751 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f98200a1230 0x7f98200a36f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.847+0000 7f9836b39700 1 --2- 172.21.15.123:0/57935751 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f98301019e0 0x7f9830196eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.847+0000 7f9836b39700 1 --2- 172.21.15.123:0/57935751 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9830104310 0x7f98301973f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.855 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.847+0000 7f9836b39700 1 -- 172.21.15.123:0/57935751 >> 172.21.15.123:0/57935751 conn(0x7f98300fb3f0 msgr2=0x7f98301024a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:57.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.847+0000 7f9836b39700 1 -- 172.21.15.123:0/57935751 shutdown_connections 2024-06-02T04:03:57.856 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.847+0000 7f9836b39700 1 -- 172.21.15.123:0/57935751 wait complete. 2024-06-02T04:03:57.859 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-06-02T04:03:57.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.983+0000 7f5e2ee53700 1 -- 172.21.15.123:0/979781611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e281020f0 msgr2=0x7f5e28102570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.983+0000 7f5e2ee53700 1 --2- 172.21.15.123:0/979781611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e281020f0 0x7f5e28102570 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5e14009990 tx=0x7f5e14009ca0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.983+0000 7f5e2ee53700 1 -- 172.21.15.123:0/979781611 shutdown_connections 2024-06-02T04:03:57.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.983+0000 7f5e2ee53700 1 --2- 172.21.15.123:0/979781611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e28102ab0 0x7f5e281093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.983+0000 7f5e2ee53700 1 --2- 172.21.15.123:0/979781611 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e28100f20 0x7f5e28101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.983+0000 7f5e2ee53700 1 --2- 172.21.15.123:0/979781611 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e281020f0 0x7f5e28102570 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.983+0000 7f5e2ee53700 1 -- 172.21.15.123:0/979781611 >> 172.21.15.123:0/979781611 conn(0x7f5e280fc4e0 msgr2=0x7f5e280fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:57.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.984+0000 7f5e2ee53700 1 -- 172.21.15.123:0/979781611 shutdown_connections 2024-06-02T04:03:57.986 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.984+0000 7f5e2ee53700 1 -- 172.21.15.123:0/979781611 wait complete. 2024-06-02T04:03:57.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.984+0000 7f5e2ee53700 1 Processor -- start 2024-06-02T04:03:57.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.984+0000 7f5e2ee53700 1 -- start start 2024-06-02T04:03:57.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.984+0000 7f5e2ee53700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e28100f20 0x7f5e28196ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.984+0000 7f5e2ee53700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e281020f0 0x7f5e28197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.984+0000 7f5e2ee53700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e28102ab0 0x7f5e2819e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.984+0000 7f5e2ee53700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2819ea10 con 0x7f5e28100f20 2024-06-02T04:03:57.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.984+0000 7f5e2ee53700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2819eb50 con 0x7f5e28102ab0 2024-06-02T04:03:57.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.984+0000 7f5e2ee53700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2819ece0 con 0x7f5e281020f0 2024-06-02T04:03:57.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.984+0000 7f5e2cbef700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e28100f20 0x7f5e28196ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.984+0000 7f5e2cbef700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e28100f20 0x7f5e28196ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43142/0 (socket says 172.21.15.123:43142) 2024-06-02T04:03:57.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.984+0000 7f5e2cbef700 1 -- 172.21.15.123:0/2752964955 learned_addr learned my addr 172.21.15.123:0/2752964955 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:57.987 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.985+0000 7f5e27fff700 1 --2- 172.21.15.123:0/2752964955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e281020f0 0x7f5e28197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.985+0000 7f5e2cbef700 1 -- 172.21.15.123:0/2752964955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e281020f0 msgr2=0x7f5e28197420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.985+0000 7f5e2cbef700 1 --2- 172.21.15.123:0/2752964955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e281020f0 0x7f5e28197420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.985+0000 7f5e2cbef700 1 -- 172.21.15.123:0/2752964955 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e28102ab0 msgr2=0x7f5e2819e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.985+0000 7f5e2d3f0700 1 --2- 172.21.15.123:0/2752964955 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e28102ab0 0x7f5e2819e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.985+0000 7f5e2cbef700 1 --2- 172.21.15.123:0/2752964955 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e28102ab0 0x7f5e2819e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.985+0000 7f5e2cbef700 1 -- 172.21.15.123:0/2752964955 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e140095f0 con 0x7f5e28100f20 2024-06-02T04:03:57.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.985+0000 7f5e27fff700 1 --2- 172.21.15.123:0/2752964955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e281020f0 0x7f5e28197420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:03:57.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.985+0000 7f5e2cbef700 1 --2- 172.21.15.123:0/2752964955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e28100f20 0x7f5e28196ee0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c00d980 tx=0x7f5e1c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:57.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.985+0000 7f5e25ffb700 1 -- 172.21.15.123:0/2752964955 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c00de60 con 0x7f5e28100f20 2024-06-02T04:03:57.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.985+0000 7f5e25ffb700 1 -- 172.21.15.123:0/2752964955 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e1c0044e0 con 0x7f5e28100f20 2024-06-02T04:03:57.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.985+0000 7f5e2ee53700 1 -- 172.21.15.123:0/2752964955 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e2819efc0 con 0x7f5e28100f20 2024-06-02T04:03:57.988 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.985+0000 7f5e25ffb700 1 -- 172.21.15.123:0/2752964955 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c003be0 con 0x7f5e28100f20 2024-06-02T04:03:57.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.985+0000 7f5e2ee53700 1 -- 172.21.15.123:0/2752964955 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e2819f3e0 con 0x7f5e28100f20 2024-06-02T04:03:57.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.988+0000 7f5e25ffb700 1 -- 172.21.15.123:0/2752964955 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f5e1c009bb0 con 0x7f5e28100f20 2024-06-02T04:03:57.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.988+0000 7f5e25ffb700 1 --2- 172.21.15.123:0/2752964955 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f5e180a11b0 0x7f5e180a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.988+0000 7f5e25ffb700 1 -- 172.21.15.123:0/2752964955 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5e1c0cc670 con 0x7f5e28100f20 2024-06-02T04:03:57.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.988+0000 7f5e27fff700 1 --2- 172.21.15.123:0/2752964955 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f5e180a11b0 0x7f5e180a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.989+0000 7f5e27fff700 1 --2- 172.21.15.123:0/2752964955 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f5e180a11b0 0x7f5e180a3670 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5e14000c00 tx=0x7f5e14005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:57.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.989+0000 7f5e3b00eb80 1 Processor -- start 2024-06-02T04:03:57.995 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.989+0000 7f5e3b00eb80 1 -- start start 2024-06-02T04:03:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.989+0000 7f5e3b00eb80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5616ec2b24f0 0x5616ec2b2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.989+0000 7f5e3b00eb80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616ec2b2e50 0x5616ec2b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.989+0000 7f5e3b00eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616ec2b3810 0x5616ec2b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.989+0000 7f5e3b00eb80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ec209100 con 0x5616ec2b24f0 2024-06-02T04:03:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.989+0000 7f5e3b00eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ec206ac0 con 0x5616ec2b3810 2024-06-02T04:03:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.989+0000 7f5e3b00eb80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ec2023b0 con 0x5616ec2b2e50 2024-06-02T04:03:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.989+0000 7f5e2cbef700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5616ec2b24f0 0x5616ec2b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.989+0000 7f5e2cbef700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5616ec2b24f0 0x5616ec2b2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43150/0 (socket says 172.21.15.123:43150) 2024-06-02T04:03:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.989+0000 7f5e2cbef700 1 -- 172.21.15.123:0/1486632699 learned_addr learned my addr 172.21.15.123:0/1486632699 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.990+0000 7f5e27fff700 1 --2- 172.21.15.123:0/1486632699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616ec2b2e50 0x5616ec2b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.990+0000 7f5e2cbef700 1 -- 172.21.15.123:0/1486632699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616ec2b2e50 msgr2=0x5616ec2b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.990+0000 7f5e2cbef700 1 --2- 172.21.15.123:0/1486632699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616ec2b2e50 0x5616ec2b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.996 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.990+0000 7f5e2cbef700 1 -- 172.21.15.123:0/1486632699 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616ec2b3810 msgr2=0x5616ec2b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:57.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.990+0000 7f5e2d3f0700 1 --2- 172.21.15.123:0/1486632699 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616ec2b3810 0x5616ec2b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.990+0000 7f5e2cbef700 1 --2- 172.21.15.123:0/1486632699 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616ec2b3810 0x5616ec2b3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.990+0000 7f5e2cbef700 1 -- 172.21.15.123:0/1486632699 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616ec083360 con 0x5616ec2b24f0 2024-06-02T04:03:57.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.990+0000 7f5e2cbef700 1 --2- 172.21.15.123:0/1486632699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5616ec2b24f0 0x5616ec2b2910 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c0a1a60 tx=0x7f5e1c099780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc7055f93481e5c server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:57.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.990+0000 7f5e12ffd700 1 -- 172.21.15.123:0/1486632699 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c099b10 con 0x5616ec2b24f0 2024-06-02T04:03:57.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.990+0000 7f5e12ffd700 1 -- 172.21.15.123:0/1486632699 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e1c09d940 con 0x5616ec2b24f0 2024-06-02T04:03:57.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.990+0000 7f5e12ffd700 1 -- 172.21.15.123:0/1486632699 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c0a1d40 con 0x5616ec2b24f0 2024-06-02T04:03:57.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.991+0000 7f5e3b00eb80 1 -- 172.21.15.123:0/1486632699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5616ec2b24f0 msgr2=0x5616ec2b2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:57.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.991+0000 7f5e3b00eb80 1 --2- 172.21.15.123:0/1486632699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5616ec2b24f0 0x5616ec2b2910 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c0a1a60 tx=0x7f5e1c099780 comp rx=0 tx=0).stop 2024-06-02T04:03:57.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.991+0000 7f5e3b00eb80 1 -- 172.21.15.123:0/1486632699 shutdown_connections 2024-06-02T04:03:57.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.991+0000 7f5e3b00eb80 1 --2- 172.21.15.123:0/1486632699 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616ec2b3810 0x5616ec2b3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.991+0000 7f5e3b00eb80 1 --2- 172.21.15.123:0/1486632699 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5616ec2b24f0 0x5616ec2b2910 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.991+0000 7f5e3b00eb80 1 --2- 172.21.15.123:0/1486632699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616ec2b2e50 0x5616ec2b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.997 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.991+0000 7f5e3b00eb80 1 -- 172.21.15.123:0/1486632699 >> 172.21.15.123:0/1486632699 conn(0x5616ec2101c0 msgr2=0x5616ec2acd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:57.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.991+0000 7f5e3b00eb80 1 -- 172.21.15.123:0/1486632699 shutdown_connections 2024-06-02T04:03:57.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.991+0000 7f5e3b00eb80 1 -- 172.21.15.123:0/1486632699 wait complete. 2024-06-02T04:03:57.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.991+0000 7f5e3b00eb80 1 -- start start 2024-06-02T04:03:57.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.991+0000 7f5e3b00eb80 1 Processor -- start 2024-06-02T04:03:57.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.992+0000 7f5e3b00eb80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616ec2b24f0 0x5616ec2bbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.992+0000 7f5e3b00eb80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5616ec2b2e50 0x5616ec2bc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.992+0000 7f5e3b00eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616ec2b3810 0x5616ec2c3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:57.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.992+0000 7f5e3b00eb80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ec19e510 con 0x5616ec2b2e50 2024-06-02T04:03:57.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.992+0000 7f5e3b00eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ec19e1b0 con 0x5616ec2b3810 2024-06-02T04:03:57.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.992+0000 7f5e3b00eb80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ec085650 con 0x5616ec2b24f0 2024-06-02T04:03:57.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.992+0000 7f5e3b00eb80 10 client.0 _ll_register_callbacks cb 0x5616ec1a7ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:03:57.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.992+0000 7f5e27fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5616ec2b2e50 0x5616ec2bc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.998 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.992+0000 7f5e27fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5616ec2b2e50 0x5616ec2bc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43160/0 (socket says 172.21.15.123:43160) 2024-06-02T04:03:57.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.992+0000 7f5e27fff700 1 -- 172.21.15.123:0/2104394218 learned_addr learned my addr 172.21.15.123:0/2104394218 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:57.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.992+0000 7f5e2cbef700 1 --2- 172.21.15.123:0/2104394218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616ec2b24f0 0x5616ec2bbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:57.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.992+0000 7f5e27fff700 1 -- 172.21.15.123:0/2104394218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616ec2b24f0 msgr2=0x5616ec2bbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:57.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.992+0000 7f5e27fff700 1 --2- 172.21.15.123:0/2104394218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616ec2b24f0 0x5616ec2bbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.992+0000 7f5e27fff700 1 -- 172.21.15.123:0/2104394218 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616ec2b3810 msgr2=0x5616ec2c3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:57.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.992+0000 7f5e27fff700 1 --2- 172.21.15.123:0/2104394218 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616ec2b3810 0x5616ec2c3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:57.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.992+0000 7f5e27fff700 1 -- 172.21.15.123:0/2104394218 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e2819f3e0 con 0x5616ec2b2e50 2024-06-02T04:03:57.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.992+0000 7f5e2cbef700 1 --2- 172.21.15.123:0/2104394218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616ec2b24f0 0x5616ec2bbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:03:57.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.992+0000 7f5e27fff700 1 --2- 172.21.15.123:0/2104394218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5616ec2b2e50 0x5616ec2bc200 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5e14015000 tx=0x7f5e1401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c4e5d2b48548fc3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:57.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.992+0000 7f5e07fff700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-06-02T04:03:57.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.992+0000 7f5e07fff700 1 -- 172.21.15.123:0/2104394218 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1402c040 con 0x5616ec2b2e50 2024-06-02T04:03:57.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.992+0000 7f5e07fff700 1 -- 172.21.15.123:0/2104394218 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5e1400f460 con 0x5616ec2b2e50 2024-06-02T04:03:57.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.992+0000 7f5e3b00eb80 1 -- 172.21.15.123:0/2104394218 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5616ec15b220 con 0x5616ec2b2e50 2024-06-02T04:03:57.999 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.992+0000 7f5e07fff700 1 -- 172.21.15.123:0/2104394218 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e14004220 con 0x5616ec2b2e50 2024-06-02T04:03:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.992+0000 7f5e3b00eb80 10 client.15090 fetch_fsmap learned FSMap version 27 2024-06-02T04:03:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.992+0000 7f5e3b00eb80 1 -- 172.21.15.123:0/2104394218 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5616ec02fb10 con 0x5616ec2b2e50 2024-06-02T04:03:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.993+0000 7f5e07fff700 1 -- 172.21.15.123:0/2104394218 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5616ec15b220 con 0x5616ec2b2e50 2024-06-02T04:03:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.993+0000 7f5e07fff700 1 -- 172.21.15.123:0/2104394218 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5e1403b070 con 0x5616ec2b2e50 2024-06-02T04:03:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.993+0000 7f5e3b00eb80 10 client.15090 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:03:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.993+0000 7f5e3b00eb80 10 client.15090 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-02T04:03:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.993+0000 7f5e3b00eb80 20 client.15090 populate_metadata read hostname 'smithi123' 2024-06-02T04:03:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.993+0000 7f5e3b00eb80 1 --2- 172.21.15.123:0/2104394218 >> [v2:172.21.15.162:6838/2588884232,v1:172.21.15.162:6839/2588884232] conn(0x5616ec2c6430 0x5616ec2cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.993+0000 7f5e3b00eb80 4 client.15090 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:03:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.993+0000 7f5e3b00eb80 1 -- 172.21.15.123:0/2104394218 --> [v2:172.21.15.162:6838/2588884232,v1:172.21.15.162:6839/2588884232] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5616ec2817c0 con 0x5616ec2c6430 2024-06-02T04:03:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.993+0000 7f5e2cbef700 1 --2- 172.21.15.123:0/2104394218 >> [v2:172.21.15.162:6838/2588884232,v1:172.21.15.162:6839/2588884232] conn(0x5616ec2c6430 0x5616ec2cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.994+0000 7f5e07fff700 10 client.15090 ms_handle_connect on v2:172.21.15.162:6838/2588884232 2024-06-02T04:03:58.000 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.994+0000 7f5e2cbef700 1 --2- 172.21.15.123:0/2104394218 >> [v2:172.21.15.162:6838/2588884232,v1:172.21.15.162:6839/2588884232] conn(0x5616ec2c6430 0x5616ec2cc2b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=45c4b92b559fd597 server_cookie=77ed468a95b106cb in_seq=0 out_seq=0 2024-06-02T04:03:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.994+0000 7f5e07fff700 1 -- 172.21.15.123:0/2104394218 <== mds.1 v2:172.21.15.162:6838/2588884232 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5616ec2817c0 con 0x5616ec2c6430 2024-06-02T04:03:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.994+0000 7f5e07fff700 10 client.15090 handle_command_reply: tid=0 2024-06-02T04:03:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.994+0000 7f5e3b00eb80 1 client.15090 shutdown 2024-06-02T04:03:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.995+0000 7f5e3b00eb80 1 -- 172.21.15.123:0/2104394218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5616ec2b2e50 msgr2=0x5616ec2bc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.995+0000 7f5e3b00eb80 1 --2- 172.21.15.123:0/2104394218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5616ec2b2e50 0x5616ec2bc200 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5e14015000 tx=0x7f5e1401e000 comp rx=0 tx=0).stop 2024-06-02T04:03:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.995+0000 7f5e3b00eb80 1 -- 172.21.15.123:0/2104394218 shutdown_connections 2024-06-02T04:03:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.995+0000 7f5e3b00eb80 1 --2- 172.21.15.123:0/2104394218 >> [v2:172.21.15.162:6838/2588884232,v1:172.21.15.162:6839/2588884232] conn(0x5616ec2c6430 0x5616ec2cc2b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.995+0000 7f5e3b00eb80 1 --2- 172.21.15.123:0/2104394218 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616ec2b3810 0x5616ec2c3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.995+0000 7f5e07fff700 0 client.15090 ms_handle_reset on v2:172.21.15.162:6838/2588884232 2024-06-02T04:03:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.995+0000 7f5e3b00eb80 1 --2- 172.21.15.123:0/2104394218 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616ec2b24f0 0x5616ec2bbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.995+0000 7f5e3b00eb80 1 --2- 172.21.15.123:0/2104394218 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5616ec2b2e50 0x5616ec2bc200 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.001 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.995+0000 7f5e3b00eb80 1 -- 172.21.15.123:0/2104394218 >> 172.21.15.123:0/2104394218 conn(0x5616ec2101c0 msgr2=0x5616ec2ac550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:58.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.995+0000 7f5e3b00eb80 1 -- 172.21.15.123:0/2104394218 shutdown_connections 2024-06-02T04:03:58.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.995+0000 7f5e3b00eb80 1 -- 172.21.15.123:0/2104394218 wait complete. 2024-06-02T04:03:58.002 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:57.995+0000 7f5e3b00eb80 20 client.15090 trim_cache size 0 max 16384 2024-06-02T04:03:58.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.013+0000 7f5e3b00eb80 1 Processor -- start 2024-06-02T04:03:58.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.013+0000 7f5e3b00eb80 1 -- start start 2024-06-02T04:03:58.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.013+0000 7f5e3b00eb80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5616ec2b24f0 0x5616ec2bb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:58.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.013+0000 7f5e3b00eb80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616ec2b2e50 0x5616ec2b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:58.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.013+0000 7f5e3b00eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616ec2b3810 0x5616ec2b6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:58.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.013+0000 7f5e3b00eb80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ec1ff010 con 0x5616ec2b24f0 2024-06-02T04:03:58.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.013+0000 7f5e3b00eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ec1a15a0 con 0x5616ec2b3810 2024-06-02T04:03:58.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.013+0000 7f5e3b00eb80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ec1c02b0 con 0x5616ec2b2e50 2024-06-02T04:03:58.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.013+0000 7f5e2cbef700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5616ec2b24f0 0x5616ec2bb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:58.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.013+0000 7f5e2cbef700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5616ec2b24f0 0x5616ec2bb1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43168/0 (socket says 172.21.15.123:43168) 2024-06-02T04:03:58.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.013+0000 7f5e2cbef700 1 -- 172.21.15.123:0/1778154559 learned_addr learned my addr 172.21.15.123:0/1778154559 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:58.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.013+0000 7f5e27fff700 1 --2- 172.21.15.123:0/1778154559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616ec2b2e50 0x5616ec2b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:58.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.013+0000 7f5e2cbef700 1 -- 172.21.15.123:0/1778154559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616ec2b2e50 msgr2=0x5616ec2b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:58.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.013+0000 7f5e2cbef700 1 --2- 172.21.15.123:0/1778154559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616ec2b2e50 0x5616ec2b66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.013+0000 7f5e2cbef700 1 -- 172.21.15.123:0/1778154559 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616ec2b3810 msgr2=0x5616ec2b6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:58.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.013+0000 7f5e2cbef700 1 --2- 172.21.15.123:0/1778154559 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616ec2b3810 0x5616ec2b6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.013+0000 7f5e2cbef700 1 -- 172.21.15.123:0/1778154559 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616ec1c8510 con 0x5616ec2b24f0 2024-06-02T04:03:58.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.013+0000 7f5e27fff700 1 --2- 172.21.15.123:0/1778154559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616ec2b2e50 0x5616ec2b66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:03:58.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.013+0000 7f5e2cbef700 1 --2- 172.21.15.123:0/1778154559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5616ec2b24f0 0x5616ec2bb1d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c096580 tx=0x7f5e1c0996e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b5c21ff0e1dfde server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:58.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.013+0000 7f5e137fe700 1 -- 172.21.15.123:0/1778154559 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c0992c0 con 0x5616ec2b24f0 2024-06-02T04:03:58.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.013+0000 7f5e137fe700 1 -- 172.21.15.123:0/1778154559 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e1c099b90 con 0x5616ec2b24f0 2024-06-02T04:03:58.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.013+0000 7f5e137fe700 1 -- 172.21.15.123:0/1778154559 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c0b24a0 con 0x5616ec2b24f0 2024-06-02T04:03:58.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.014+0000 7f5e3b00eb80 1 -- 172.21.15.123:0/1778154559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5616ec2b24f0 msgr2=0x5616ec2bb1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:58.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.014+0000 7f5e3b00eb80 1 --2- 172.21.15.123:0/1778154559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5616ec2b24f0 0x5616ec2bb1d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c096580 tx=0x7f5e1c0996e0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.014+0000 7f5e3b00eb80 1 -- 172.21.15.123:0/1778154559 shutdown_connections 2024-06-02T04:03:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.014+0000 7f5e3b00eb80 1 --2- 172.21.15.123:0/1778154559 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616ec2b3810 0x5616ec2b6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.014+0000 7f5e3b00eb80 1 --2- 172.21.15.123:0/1778154559 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5616ec2b24f0 0x5616ec2bb1d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.014+0000 7f5e3b00eb80 1 --2- 172.21.15.123:0/1778154559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616ec2b2e50 0x5616ec2b66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.014+0000 7f5e3b00eb80 1 -- 172.21.15.123:0/1778154559 >> 172.21.15.123:0/1778154559 conn(0x5616ec2101c0 msgr2=0x5616ec2b3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.014+0000 7f5e3b00eb80 1 -- 172.21.15.123:0/1778154559 shutdown_connections 2024-06-02T04:03:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.014+0000 7f5e3b00eb80 1 -- 172.21.15.123:0/1778154559 wait complete. 2024-06-02T04:03:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.014+0000 7f5e3b00eb80 1 -- start start 2024-06-02T04:03:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.014+0000 7f5e3b00eb80 1 Processor -- start 2024-06-02T04:03:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.015+0000 7f5e3b00eb80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5616ec2b24f0 0x5616ec2b90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.015+0000 7f5e3b00eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616ec2b2e50 0x5616ec2abcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.015+0000 7f5e3b00eb80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616ec2b3810 0x5616ec2ac260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.015+0000 7f5e3b00eb80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ec2ac970 con 0x5616ec2b24f0 2024-06-02T04:03:58.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.015+0000 7f5e3b00eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ec2acae0 con 0x5616ec2b2e50 2024-06-02T04:03:58.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.015+0000 7f5e3b00eb80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ec321f90 con 0x5616ec2b3810 2024-06-02T04:03:58.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.015+0000 7f5e3b00eb80 10 client.0 _ll_register_callbacks cb 0x5616ec1a7ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:03:58.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.015+0000 7f5e2cbef700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5616ec2b24f0 0x5616ec2b90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:58.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.015+0000 7f5e2cbef700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5616ec2b24f0 0x5616ec2b90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43170/0 (socket says 172.21.15.123:43170) 2024-06-02T04:03:58.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.015+0000 7f5e2cbef700 1 -- 172.21.15.123:0/330935126 learned_addr learned my addr 172.21.15.123:0/330935126 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:58.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.015+0000 7f5e2d3f0700 1 --2- 172.21.15.123:0/330935126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616ec2b3810 0x5616ec2ac260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:58.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.015+0000 7f5e2cbef700 1 -- 172.21.15.123:0/330935126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616ec2b3810 msgr2=0x5616ec2ac260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:58.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.015+0000 7f5e2cbef700 1 --2- 172.21.15.123:0/330935126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616ec2b3810 0x5616ec2ac260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.015+0000 7f5e2cbef700 1 -- 172.21.15.123:0/330935126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616ec2b2e50 msgr2=0x5616ec2abcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:58.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.015+0000 7f5e2cbef700 1 --2- 172.21.15.123:0/330935126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616ec2b2e50 0x5616ec2abcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.015+0000 7f5e2cbef700 1 -- 172.21.15.123:0/330935126 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5616ec083360 con 0x5616ec2b24f0 2024-06-02T04:03:58.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.015+0000 7f5e2d3f0700 1 --2- 172.21.15.123:0/330935126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616ec2b3810 0x5616ec2ac260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:03:58.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.015+0000 7f5e2cbef700 1 --2- 172.21.15.123:0/330935126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5616ec2b24f0 0x5616ec2b90c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c097e60 tx=0x7f5e1c0992a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5c12edce4d56a82 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:58.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.015+0000 7f5e07fff700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-06-02T04:03:58.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.015+0000 7f5e07fff700 1 -- 172.21.15.123:0/330935126 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c0b24b0 con 0x5616ec2b24f0 2024-06-02T04:03:58.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.015+0000 7f5e07fff700 1 -- 172.21.15.123:0/330935126 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5e1c0652e0 con 0x5616ec2b24f0 2024-06-02T04:03:58.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.015+0000 7f5e3b00eb80 1 -- 172.21.15.123:0/330935126 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5e1c09d940 con 0x5616ec2b24f0 2024-06-02T04:03:58.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.016+0000 7f5e07fff700 1 -- 172.21.15.123:0/330935126 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e1c0654a0 con 0x5616ec2b24f0 2024-06-02T04:03:58.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.016+0000 7f5e3b00eb80 10 client.15096 fetch_fsmap learned FSMap version 27 2024-06-02T04:03:58.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.016+0000 7f5e3b00eb80 1 -- 172.21.15.123:0/330935126 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5616ec087c80 con 0x5616ec2b24f0 2024-06-02T04:03:58.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.016+0000 7f5e07fff700 1 -- 172.21.15.123:0/330935126 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e1c09d940 con 0x5616ec2b24f0 2024-06-02T04:03:58.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.016+0000 7f5e07fff700 1 -- 172.21.15.123:0/330935126 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5e1c095ae0 con 0x5616ec2b24f0 2024-06-02T04:03:58.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.016+0000 7f5e3b00eb80 10 client.15096 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:03:58.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.016+0000 7f5e3b00eb80 10 client.15096 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-02T04:03:58.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.016+0000 7f5e3b00eb80 20 client.15096 populate_metadata read hostname 'smithi123' 2024-06-02T04:03:58.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.016+0000 7f5e3b00eb80 1 --2- 172.21.15.123:0/330935126 >> [v2:172.21.15.162:6838/2588884232,v1:172.21.15.162:6839/2588884232] conn(0x5616ec326820 0x5616ec3231c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:58.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.016+0000 7f5e3b00eb80 4 client.15096 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T04:03:58.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.016+0000 7f5e3b00eb80 1 -- 172.21.15.123:0/330935126 --> [v2:172.21.15.162:6838/2588884232,v1:172.21.15.162:6839/2588884232] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5616ec1fae70 con 0x5616ec326820 2024-06-02T04:03:58.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.016+0000 7f5e27fff700 1 --2- 172.21.15.123:0/330935126 >> [v2:172.21.15.162:6838/2588884232,v1:172.21.15.162:6839/2588884232] conn(0x5616ec326820 0x5616ec3231c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:58.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.017+0000 7f5e07fff700 10 client.15096 ms_handle_connect on v2:172.21.15.162:6838/2588884232 2024-06-02T04:03:58.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.017+0000 7f5e27fff700 1 --2- 172.21.15.123:0/330935126 >> [v2:172.21.15.162:6838/2588884232,v1:172.21.15.162:6839/2588884232] conn(0x5616ec326820 0x5616ec3231c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=54ddee6d192a1028 server_cookie=3cf0959aba1a519d in_seq=0 out_seq=0 2024-06-02T04:03:58.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.017+0000 7f5e07fff700 1 -- 172.21.15.123:0/330935126 <== mds.1 v2:172.21.15.162:6838/2588884232 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5616ec1fae70 con 0x5616ec326820 2024-06-02T04:03:58.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.017+0000 7f5e07fff700 10 client.15096 handle_command_reply: tid=0 2024-06-02T04:03:58.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.017+0000 7f5e3b00eb80 1 client.15096 shutdown 2024-06-02T04:03:58.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.017+0000 7f5e3b00eb80 1 -- 172.21.15.123:0/330935126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5616ec2b24f0 msgr2=0x5616ec2b90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:58.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.017+0000 7f5e3b00eb80 1 --2- 172.21.15.123:0/330935126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5616ec2b24f0 0x5616ec2b90c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c097e60 tx=0x7f5e1c0992a0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.023 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.017+0000 7f5e3b00eb80 1 -- 172.21.15.123:0/330935126 shutdown_connections 2024-06-02T04:03:58.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.017+0000 7f5e3b00eb80 1 --2- 172.21.15.123:0/330935126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5616ec2b3810 0x5616ec2ac260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.017+0000 7f5e3b00eb80 1 --2- 172.21.15.123:0/330935126 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5616ec2b24f0 0x5616ec2b90c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.017+0000 7f5e3b00eb80 1 --2- 172.21.15.123:0/330935126 >> [v2:172.21.15.162:6838/2588884232,v1:172.21.15.162:6839/2588884232] conn(0x5616ec326820 0x5616ec3231c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.017+0000 7f5e3b00eb80 1 --2- 172.21.15.123:0/330935126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5616ec2b2e50 0x5616ec2abcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.017+0000 7f5e07fff700 0 client.15096 ms_handle_reset on v2:172.21.15.162:6838/2588884232 2024-06-02T04:03:58.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.017+0000 7f5e3b00eb80 1 -- 172.21.15.123:0/330935126 >> 172.21.15.123:0/330935126 conn(0x5616ec2101c0 msgr2=0x5616ec2bb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:58.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.017+0000 7f5e3b00eb80 1 -- 172.21.15.123:0/330935126 shutdown_connections 2024-06-02T04:03:58.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.017+0000 7f5e3b00eb80 1 -- 172.21.15.123:0/330935126 wait complete. 2024-06-02T04:03:58.024 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.017+0000 7f5e3b00eb80 20 client.15096 trim_cache size 0 max 16384 2024-06-02T04:03:58.024 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-06-02T04:03:58.024 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "1b432ae0-2094-11ef-bc9b-c7b262605968", 2024-06-02T04:03:58.025 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 1, 2024-06-02T04:03:58.025 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 24490, 2024-06-02T04:03:58.025 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-06-02T04:03:58.025 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-06-02T04:03:58.025 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-06-02T04:03:58.025 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 48.318691887999996, 2024-06-02T04:03:58.025 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 27, 2024-06-02T04:03:58.025 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 82, 2024-06-02T04:03:58.025 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 82, 2024-06-02T04:03:58.025 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 61.261868773000003 2024-06-02T04:03:58.025 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-06-02T04:03:58.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.018+0000 7f5e2ee53700 1 -- 172.21.15.123:0/2752964955 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f5e180a11b0 msgr2=0x7f5e180a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:58.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.018+0000 7f5e2ee53700 1 --2- 172.21.15.123:0/2752964955 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f5e180a11b0 0x7f5e180a3670 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5e14000c00 tx=0x7f5e14005fb0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.018+0000 7f5e2ee53700 1 -- 172.21.15.123:0/2752964955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e28100f20 msgr2=0x7f5e28196ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:58.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.018+0000 7f5e2ee53700 1 --2- 172.21.15.123:0/2752964955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e28100f20 0x7f5e28196ee0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c00d980 tx=0x7f5e1c00dd40 comp rx=0 tx=0).stop 2024-06-02T04:03:58.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.018+0000 7f5e2ee53700 1 -- 172.21.15.123:0/2752964955 shutdown_connections 2024-06-02T04:03:58.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.018+0000 7f5e2ee53700 1 --2- 172.21.15.123:0/2752964955 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f5e180a11b0 0x7f5e180a3670 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.018+0000 7f5e2ee53700 1 --2- 172.21.15.123:0/2752964955 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5e28102ab0 0x7f5e2819e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.018+0000 7f5e2ee53700 1 --2- 172.21.15.123:0/2752964955 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5e28100f20 0x7f5e28196ee0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.018+0000 7f5e2ee53700 1 --2- 172.21.15.123:0/2752964955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e281020f0 0x7f5e28197420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.018+0000 7f5e2ee53700 1 -- 172.21.15.123:0/2752964955 >> 172.21.15.123:0/2752964955 conn(0x7f5e280fc4e0 msgr2=0x7f5e281054f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:58.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.018+0000 7f5e2ee53700 1 -- 172.21.15.123:0/2752964955 shutdown_connections 2024-06-02T04:03:58.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.018+0000 7f5e2ee53700 1 -- 172.21.15.123:0/2752964955 wait complete. 2024-06-02T04:03:58.030 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-06-02T04:03:58.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.153+0000 7f9e5410c700 1 -- 172.21.15.123:0/285101978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e4c102ab0 msgr2=0x7f9e4c1093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:58.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.153+0000 7f9e5410c700 1 --2- 172.21.15.123:0/285101978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e4c102ab0 0x7f9e4c1093d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9e4400b0a0 tx=0x7f9e4400b3b0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.153+0000 7f9e5410c700 1 -- 172.21.15.123:0/285101978 shutdown_connections 2024-06-02T04:03:58.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.153+0000 7f9e5410c700 1 --2- 172.21.15.123:0/285101978 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e4c102ab0 0x7f9e4c1093d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.153+0000 7f9e5410c700 1 --2- 172.21.15.123:0/285101978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e4c100f20 0x7f9e4c101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.153+0000 7f9e5410c700 1 --2- 172.21.15.123:0/285101978 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e4c1020f0 0x7f9e4c102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.153+0000 7f9e5410c700 1 -- 172.21.15.123:0/285101978 >> 172.21.15.123:0/285101978 conn(0x7f9e4c0fc4e0 msgr2=0x7f9e4c0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:58.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.153+0000 7f9e5410c700 1 -- 172.21.15.123:0/285101978 shutdown_connections 2024-06-02T04:03:58.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.153+0000 7f9e5410c700 1 -- 172.21.15.123:0/285101978 wait complete. 2024-06-02T04:03:58.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.154+0000 7f9e5410c700 1 Processor -- start 2024-06-02T04:03:58.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.154+0000 7f9e5410c700 1 -- start start 2024-06-02T04:03:58.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.154+0000 7f9e5410c700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e4c100f20 0x7f9e4c196fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:58.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.154+0000 7f9e5410c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e4c1020f0 0x7f9e4c1974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:58.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.154+0000 7f9e5410c700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e4c102ab0 0x7f9e4c19e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:58.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.154+0000 7f9e5410c700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4c19ead0 con 0x7f9e4c1020f0 2024-06-02T04:03:58.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.154+0000 7f9e5410c700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4c19ec10 con 0x7f9e4c102ab0 2024-06-02T04:03:58.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.154+0000 7f9e5410c700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4c19eda0 con 0x7f9e4c100f20 2024-06-02T04:03:58.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.154+0000 7f9e516a7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e4c1020f0 0x7f9e4c1974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:58.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.154+0000 7f9e516a7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e4c1020f0 0x7f9e4c1974e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43194/0 (socket says 172.21.15.123:43194) 2024-06-02T04:03:58.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.154+0000 7f9e516a7700 1 -- 172.21.15.123:0/1456671041 learned_addr learned my addr 172.21.15.123:0/1456671041 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.154+0000 7f9e51ea8700 1 --2- 172.21.15.123:0/1456671041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e4c100f20 0x7f9e4c196fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.154+0000 7f9e526a9700 1 --2- 172.21.15.123:0/1456671041 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e4c102ab0 0x7f9e4c19e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.154+0000 7f9e516a7700 1 -- 172.21.15.123:0/1456671041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e4c100f20 msgr2=0x7f9e4c196fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.154+0000 7f9e516a7700 1 --2- 172.21.15.123:0/1456671041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e4c100f20 0x7f9e4c196fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.154+0000 7f9e516a7700 1 -- 172.21.15.123:0/1456671041 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e4c102ab0 msgr2=0x7f9e4c19e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.154+0000 7f9e516a7700 1 --2- 172.21.15.123:0/1456671041 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e4c102ab0 0x7f9e4c19e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.154+0000 7f9e516a7700 1 -- 172.21.15.123:0/1456671041 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e44009d00 con 0x7f9e4c1020f0 2024-06-02T04:03:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.154+0000 7f9e51ea8700 1 --2- 172.21.15.123:0/1456671041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e4c100f20 0x7f9e4c196fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:03:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.154+0000 7f9e516a7700 1 --2- 172.21.15.123:0/1456671041 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e4c1020f0 0x7f9e4c1974e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9e4800d950 tx=0x7f9e4800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.155+0000 7f9e42ffd700 1 -- 172.21.15.123:0/1456671041 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e48009b40 con 0x7f9e4c1020f0 2024-06-02T04:03:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.155+0000 7f9e5410c700 1 -- 172.21.15.123:0/1456671041 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e4c19f080 con 0x7f9e4c1020f0 2024-06-02T04:03:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.155+0000 7f9e42ffd700 1 -- 172.21.15.123:0/1456671041 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9e48009ca0 con 0x7f9e4c1020f0 2024-06-02T04:03:58.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.155+0000 7f9e42ffd700 1 -- 172.21.15.123:0/1456671041 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4800f620 con 0x7f9e4c1020f0 2024-06-02T04:03:58.158 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.155+0000 7f9e5410c700 1 -- 172.21.15.123:0/1456671041 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e4c19f5e0 con 0x7f9e4c1020f0 2024-06-02T04:03:58.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.157+0000 7f9e42ffd700 1 -- 172.21.15.123:0/1456671041 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f9e48010460 con 0x7f9e4c1020f0 2024-06-02T04:03:58.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.157+0000 7f9e42ffd700 1 --2- 172.21.15.123:0/1456671041 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9e380a11b0 0x7f9e380a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:58.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.157+0000 7f9e42ffd700 1 -- 172.21.15.123:0/1456671041 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9e480ccc20 con 0x7f9e4c1020f0 2024-06-02T04:03:58.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.157+0000 7f9e51ea8700 1 --2- 172.21.15.123:0/1456671041 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9e380a11b0 0x7f9e380a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:58.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.158+0000 7f9e51ea8700 1 --2- 172.21.15.123:0/1456671041 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9e380a11b0 0x7f9e380a3670 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c100c40 tx=0x7f9e3c00b670 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:58.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.158+0000 7f9e602c7b80 1 Processor -- start 2024-06-02T04:03:58.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.158+0000 7f9e602c7b80 1 -- start start 2024-06-02T04:03:58.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.158+0000 7f9e602c7b80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e14bc44f0 0x562e14bc4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:58.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.158+0000 7f9e602c7b80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e14bc4e50 0x562e14bc52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.158+0000 7f9e602c7b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e14bc5810 0x562e14bc5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.158+0000 7f9e602c7b80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e14b1b100 con 0x562e14bc4e50 2024-06-02T04:03:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.158+0000 7f9e602c7b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e14b18ac0 con 0x562e14bc5810 2024-06-02T04:03:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.158+0000 7f9e602c7b80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e14b143b0 con 0x562e14bc44f0 2024-06-02T04:03:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.158+0000 7f9e516a7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e14bc4e50 0x562e14bc52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.158+0000 7f9e516a7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e14bc4e50 0x562e14bc52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43208/0 (socket says 172.21.15.123:43208) 2024-06-02T04:03:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.158+0000 7f9e516a7700 1 -- 172.21.15.123:0/1492484206 learned_addr learned my addr 172.21.15.123:0/1492484206 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.159+0000 7f9e51ea8700 1 --2- 172.21.15.123:0/1492484206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e14bc44f0 0x562e14bc4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.159+0000 7f9e526a9700 1 --2- 172.21.15.123:0/1492484206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e14bc5810 0x562e14bc5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.159+0000 7f9e516a7700 1 -- 172.21.15.123:0/1492484206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e14bc44f0 msgr2=0x562e14bc4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.159+0000 7f9e516a7700 1 --2- 172.21.15.123:0/1492484206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e14bc44f0 0x562e14bc4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.165 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.159+0000 7f9e516a7700 1 -- 172.21.15.123:0/1492484206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e14bc5810 msgr2=0x562e14bc5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:58.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.159+0000 7f9e516a7700 1 --2- 172.21.15.123:0/1492484206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e14bc5810 0x562e14bc5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.159+0000 7f9e516a7700 1 -- 172.21.15.123:0/1492484206 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e14995360 con 0x562e14bc4e50 2024-06-02T04:03:58.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.159+0000 7f9e516a7700 1 --2- 172.21.15.123:0/1492484206 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e14bc4e50 0x562e14bc52d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9e480ca7d0 tx=0x7f9e48096530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=370fba6ff6f3f027 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:58.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.159+0000 7f9e37fff700 1 -- 172.21.15.123:0/1492484206 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4809d070 con 0x562e14bc4e50 2024-06-02T04:03:58.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.159+0000 7f9e37fff700 1 -- 172.21.15.123:0/1492484206 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9e4809a0c0 con 0x562e14bc4e50 2024-06-02T04:03:58.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.159+0000 7f9e37fff700 1 -- 172.21.15.123:0/1492484206 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4809a540 con 0x562e14bc4e50 2024-06-02T04:03:58.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.160+0000 7f9e602c7b80 1 -- 172.21.15.123:0/1492484206 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e14bc4e50 msgr2=0x562e14bc52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:58.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.160+0000 7f9e602c7b80 1 --2- 172.21.15.123:0/1492484206 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e14bc4e50 0x562e14bc52d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9e480ca7d0 tx=0x7f9e48096530 comp rx=0 tx=0).stop 2024-06-02T04:03:58.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.160+0000 7f9e602c7b80 1 -- 172.21.15.123:0/1492484206 shutdown_connections 2024-06-02T04:03:58.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.160+0000 7f9e602c7b80 1 --2- 172.21.15.123:0/1492484206 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e14bc5810 0x562e14bc5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.160+0000 7f9e602c7b80 1 --2- 172.21.15.123:0/1492484206 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e14bc44f0 0x562e14bc4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.160+0000 7f9e602c7b80 1 --2- 172.21.15.123:0/1492484206 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e14bc4e50 0x562e14bc52d0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.160+0000 7f9e602c7b80 1 -- 172.21.15.123:0/1492484206 >> 172.21.15.123:0/1492484206 conn(0x562e14b221c0 msgr2=0x562e14bbed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:58.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.160+0000 7f9e602c7b80 1 -- 172.21.15.123:0/1492484206 shutdown_connections 2024-06-02T04:03:58.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.160+0000 7f9e602c7b80 1 -- 172.21.15.123:0/1492484206 wait complete. 2024-06-02T04:03:58.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.160+0000 7f9e602c7b80 1 -- start start 2024-06-02T04:03:58.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.160+0000 7f9e602c7b80 1 Processor -- start 2024-06-02T04:03:58.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.161+0000 7f9e602c7b80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e14bc44f0 0x562e14bcddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:58.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.161+0000 7f9e602c7b80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e14bc4e50 0x562e14bce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:58.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.161+0000 7f9e602c7b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e14bc5810 0x562e14bd5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:58.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.161+0000 7f9e602c7b80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e14ab0510 con 0x562e14bc4e50 2024-06-02T04:03:58.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.161+0000 7f9e602c7b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e14ab01b0 con 0x562e14bc5810 2024-06-02T04:03:58.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.161+0000 7f9e602c7b80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e14997650 con 0x562e14bc44f0 2024-06-02T04:03:58.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.161+0000 7f9e602c7b80 10 client.0 _ll_register_callbacks cb 0x562e14ab9ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:03:58.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.161+0000 7f9e516a7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e14bc4e50 0x562e14bce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:58.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.161+0000 7f9e516a7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e14bc4e50 0x562e14bce300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43218/0 (socket says 172.21.15.123:43218) 2024-06-02T04:03:58.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.161+0000 7f9e516a7700 1 -- 172.21.15.123:0/3270100390 learned_addr learned my addr 172.21.15.123:0/3270100390 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:58.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.161+0000 7f9e526a9700 1 --2- 172.21.15.123:0/3270100390 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e14bc5810 0x562e14bd5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:58.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.161+0000 7f9e51ea8700 1 --2- 172.21.15.123:0/3270100390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e14bc44f0 0x562e14bcddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:58.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.161+0000 7f9e516a7700 1 -- 172.21.15.123:0/3270100390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e14bc44f0 msgr2=0x562e14bcddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:58.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.161+0000 7f9e516a7700 1 --2- 172.21.15.123:0/3270100390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e14bc44f0 0x562e14bcddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.161+0000 7f9e516a7700 1 -- 172.21.15.123:0/3270100390 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e14bc5810 msgr2=0x562e14bd5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:58.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.161+0000 7f9e516a7700 1 --2- 172.21.15.123:0/3270100390 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e14bc5810 0x562e14bd5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.161+0000 7f9e516a7700 1 -- 172.21.15.123:0/3270100390 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e4c19f5e0 con 0x562e14bc4e50 2024-06-02T04:03:58.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.161+0000 7f9e51ea8700 1 --2- 172.21.15.123:0/3270100390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e14bc44f0 0x562e14bcddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:03:58.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.161+0000 7f9e516a7700 1 --2- 172.21.15.123:0/3270100390 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e14bc4e50 0x562e14bce300 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9e48009f50 tx=0x7f9e48010bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc245e937ef24a3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:58.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.161+0000 7f9e357fa700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-06-02T04:03:58.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.161+0000 7f9e357fa700 1 -- 172.21.15.123:0/3270100390 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e480b8070 con 0x562e14bc4e50 2024-06-02T04:03:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.161+0000 7f9e357fa700 1 -- 172.21.15.123:0/3270100390 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9e4809def0 con 0x562e14bc4e50 2024-06-02T04:03:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.161+0000 7f9e602c7b80 1 -- 172.21.15.123:0/3270100390 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562e14a6d220 con 0x562e14bc4e50 2024-06-02T04:03:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.161+0000 7f9e357fa700 1 -- 172.21.15.123:0/3270100390 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e4809d070 con 0x562e14bc4e50 2024-06-02T04:03:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.161+0000 7f9e602c7b80 10 client.15108 fetch_fsmap learned FSMap version 27 2024-06-02T04:03:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.161+0000 7f9e602c7b80 1 -- 172.21.15.123:0/3270100390 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x562e14941b10 con 0x562e14bc4e50 2024-06-02T04:03:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.162+0000 7f9e357fa700 1 -- 172.21.15.123:0/3270100390 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562e14a6d220 con 0x562e14bc4e50 2024-06-02T04:03:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.162+0000 7f9e357fa700 1 -- 172.21.15.123:0/3270100390 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f9e480b81d0 con 0x562e14bc4e50 2024-06-02T04:03:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.162+0000 7f9e602c7b80 10 client.15108 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:03:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.162+0000 7f9e602c7b80 10 client.15108 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-02T04:03:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.162+0000 7f9e602c7b80 20 client.15108 populate_metadata read hostname 'smithi123' 2024-06-02T04:03:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.162+0000 7f9e602c7b80 1 --2- 172.21.15.123:0/3270100390 >> [v2:172.21.15.136:6838/952830191,v1:172.21.15.136:6839/952830191] conn(0x562e14bd8aa0 0x562e14bddd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.162+0000 7f9e602c7b80 4 client.15108 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:03:58.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.162+0000 7f9e602c7b80 1 -- 172.21.15.123:0/3270100390 --> [v2:172.21.15.136:6838/952830191,v1:172.21.15.136:6839/952830191] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562e14b937c0 con 0x562e14bd8aa0 2024-06-02T04:03:58.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.162+0000 7f9e51ea8700 1 --2- 172.21.15.123:0/3270100390 >> [v2:172.21.15.136:6838/952830191,v1:172.21.15.136:6839/952830191] conn(0x562e14bd8aa0 0x562e14bddd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:58.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.163+0000 7f9e357fa700 10 client.15108 ms_handle_connect on v2:172.21.15.136:6838/952830191 2024-06-02T04:03:58.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.163+0000 7f9e51ea8700 1 --2- 172.21.15.123:0/3270100390 >> [v2:172.21.15.136:6838/952830191,v1:172.21.15.136:6839/952830191] conn(0x562e14bd8aa0 0x562e14bddd40 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a4142bd7c06ad0c server_cookie=cdf76d3fa670769d in_seq=0 out_seq=0 2024-06-02T04:03:58.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.163+0000 7f9e357fa700 1 -- 172.21.15.123:0/3270100390 <== mds.0 v2:172.21.15.136:6838/952830191 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562e14b937c0 con 0x562e14bd8aa0 2024-06-02T04:03:58.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.163+0000 7f9e357fa700 10 client.15108 handle_command_reply: tid=0 2024-06-02T04:03:58.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.163+0000 7f9e602c7b80 1 client.15108 shutdown 2024-06-02T04:03:58.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.163+0000 7f9e602c7b80 1 -- 172.21.15.123:0/3270100390 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e14bc4e50 msgr2=0x562e14bce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:58.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.163+0000 7f9e602c7b80 1 --2- 172.21.15.123:0/3270100390 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e14bc4e50 0x562e14bce300 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9e48009f50 tx=0x7f9e48010bb0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.164+0000 7f9e602c7b80 1 -- 172.21.15.123:0/3270100390 shutdown_connections 2024-06-02T04:03:58.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.164+0000 7f9e602c7b80 1 --2- 172.21.15.123:0/3270100390 >> [v2:172.21.15.136:6838/952830191,v1:172.21.15.136:6839/952830191] conn(0x562e14bd8aa0 0x562e14bddd40 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.164+0000 7f9e602c7b80 1 --2- 172.21.15.123:0/3270100390 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e14bc5810 0x562e14bd5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.164+0000 7f9e602c7b80 1 --2- 172.21.15.123:0/3270100390 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e14bc44f0 0x562e14bcddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.164+0000 7f9e602c7b80 1 --2- 172.21.15.123:0/3270100390 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e14bc4e50 0x562e14bce300 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.164+0000 7f9e357fa700 0 client.15108 ms_handle_reset on v2:172.21.15.136:6838/952830191 2024-06-02T04:03:58.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.164+0000 7f9e602c7b80 1 -- 172.21.15.123:0/3270100390 >> 172.21.15.123:0/3270100390 conn(0x562e14b221c0 msgr2=0x562e14bbe550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:58.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.164+0000 7f9e602c7b80 1 -- 172.21.15.123:0/3270100390 shutdown_connections 2024-06-02T04:03:58.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.164+0000 7f9e602c7b80 1 -- 172.21.15.123:0/3270100390 wait complete. 2024-06-02T04:03:58.171 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.164+0000 7f9e602c7b80 20 client.15108 trim_cache size 0 max 16384 2024-06-02T04:03:58.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.182+0000 7f9e602c7b80 1 Processor -- start 2024-06-02T04:03:58.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.182+0000 7f9e602c7b80 1 -- start start 2024-06-02T04:03:58.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.182+0000 7f9e602c7b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e14bc44f0 0x562e14bc48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:58.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.182+0000 7f9e602c7b80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e14bc4e50 0x562e14bcd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:58.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.182+0000 7f9e602c7b80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e14bc5810 0x562e14bd5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:58.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.182+0000 7f9e602c7b80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e14b937c0 con 0x562e14bc5810 2024-06-02T04:03:58.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.182+0000 7f9e602c7b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e14a6d220 con 0x562e14bc44f0 2024-06-02T04:03:58.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.182+0000 7f9e602c7b80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e14ad22b0 con 0x562e14bc4e50 2024-06-02T04:03:58.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.182+0000 7f9e526a9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e14bc5810 0x562e14bd5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:58.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.182+0000 7f9e526a9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e14bc5810 0x562e14bd5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43222/0 (socket says 172.21.15.123:43222) 2024-06-02T04:03:58.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.182+0000 7f9e526a9700 1 -- 172.21.15.123:0/3235863926 learned_addr learned my addr 172.21.15.123:0/3235863926 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:58.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.183+0000 7f9e51ea8700 1 --2- 172.21.15.123:0/3235863926 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e14bc44f0 0x562e14bc48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:58.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.183+0000 7f9e516a7700 1 --2- 172.21.15.123:0/3235863926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e14bc4e50 0x562e14bcd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:58.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.183+0000 7f9e526a9700 1 -- 172.21.15.123:0/3235863926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e14bc4e50 msgr2=0x562e14bcd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:58.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.183+0000 7f9e526a9700 1 --2- 172.21.15.123:0/3235863926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e14bc4e50 0x562e14bcd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.183+0000 7f9e526a9700 1 -- 172.21.15.123:0/3235863926 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e14bc44f0 msgr2=0x562e14bc48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:58.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.183+0000 7f9e526a9700 1 --2- 172.21.15.123:0/3235863926 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e14bc44f0 0x562e14bc48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.183+0000 7f9e526a9700 1 -- 172.21.15.123:0/3235863926 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e14ada510 con 0x562e14bc5810 2024-06-02T04:03:58.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.183+0000 7f9e516a7700 1 --2- 172.21.15.123:0/3235863926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e14bc4e50 0x562e14bcd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:03:58.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.183+0000 7f9e526a9700 1 --2- 172.21.15.123:0/3235863926 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e14bc5810 0x562e14bd5300 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9e4400d010 tx=0x7f9e44007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d28ddbb274714190 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:58.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.183+0000 7f9e40ff9700 1 -- 172.21.15.123:0/3235863926 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4400e040 con 0x562e14bc5810 2024-06-02T04:03:58.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.183+0000 7f9e40ff9700 1 -- 172.21.15.123:0/3235863926 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9e44021070 con 0x562e14bc5810 2024-06-02T04:03:58.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.183+0000 7f9e40ff9700 1 -- 172.21.15.123:0/3235863926 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e44005490 con 0x562e14bc5810 2024-06-02T04:03:58.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.184+0000 7f9e602c7b80 1 -- 172.21.15.123:0/3235863926 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e14bc5810 msgr2=0x562e14bd5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:58.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.184+0000 7f9e602c7b80 1 --2- 172.21.15.123:0/3235863926 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e14bc5810 0x562e14bd5300 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9e4400d010 tx=0x7f9e44007590 comp rx=0 tx=0).stop 2024-06-02T04:03:58.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.184+0000 7f9e602c7b80 1 -- 172.21.15.123:0/3235863926 shutdown_connections 2024-06-02T04:03:58.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.184+0000 7f9e602c7b80 1 --2- 172.21.15.123:0/3235863926 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e14bc5810 0x562e14bd5300 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.184+0000 7f9e602c7b80 1 --2- 172.21.15.123:0/3235863926 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e14bc44f0 0x562e14bc48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.184+0000 7f9e602c7b80 1 --2- 172.21.15.123:0/3235863926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e14bc4e50 0x562e14bcd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.184+0000 7f9e602c7b80 1 -- 172.21.15.123:0/3235863926 >> 172.21.15.123:0/3235863926 conn(0x562e14b221c0 msgr2=0x562e14bc5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:58.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.184+0000 7f9e602c7b80 1 -- 172.21.15.123:0/3235863926 shutdown_connections 2024-06-02T04:03:58.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.184+0000 7f9e602c7b80 1 -- 172.21.15.123:0/3235863926 wait complete. 2024-06-02T04:03:58.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.184+0000 7f9e602c7b80 1 -- start start 2024-06-02T04:03:58.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.184+0000 7f9e602c7b80 1 Processor -- start 2024-06-02T04:03:58.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.184+0000 7f9e602c7b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e14bc44f0 0x562e14bcf950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:58.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.185+0000 7f9e602c7b80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e14bc4e50 0x562e14bcfe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:58.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.185+0000 7f9e602c7b80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e14bc5810 0x562e14bd4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:58.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.185+0000 7f9e602c7b80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e14bd5220 con 0x562e14bc5810 2024-06-02T04:03:58.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.185+0000 7f9e602c7b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e14bd5390 con 0x562e14bc44f0 2024-06-02T04:03:58.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.185+0000 7f9e602c7b80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e14bd5550 con 0x562e14bc4e50 2024-06-02T04:03:58.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.185+0000 7f9e602c7b80 10 client.0 _ll_register_callbacks cb 0x562e14ab9ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:03:58.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.185+0000 7f9e526a9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e14bc5810 0x562e14bd4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:58.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.185+0000 7f9e526a9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e14bc5810 0x562e14bd4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43230/0 (socket says 172.21.15.123:43230) 2024-06-02T04:03:58.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.185+0000 7f9e526a9700 1 -- 172.21.15.123:0/2303942040 learned_addr learned my addr 172.21.15.123:0/2303942040 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:58.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.185+0000 7f9e516a7700 1 --2- 172.21.15.123:0/2303942040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e14bc4e50 0x562e14bcfe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:58.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.185+0000 7f9e51ea8700 1 --2- 172.21.15.123:0/2303942040 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e14bc44f0 0x562e14bcf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:58.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.185+0000 7f9e526a9700 1 -- 172.21.15.123:0/2303942040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e14bc4e50 msgr2=0x562e14bcfe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:58.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.185+0000 7f9e526a9700 1 --2- 172.21.15.123:0/2303942040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e14bc4e50 0x562e14bcfe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.185+0000 7f9e526a9700 1 -- 172.21.15.123:0/2303942040 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e14bc44f0 msgr2=0x562e14bcf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:03:58.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.185+0000 7f9e526a9700 1 --2- 172.21.15.123:0/2303942040 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e14bc44f0 0x562e14bcf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.185+0000 7f9e526a9700 1 -- 172.21.15.123:0/2303942040 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e4c109d00 con 0x562e14bc5810 2024-06-02T04:03:58.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.185+0000 7f9e51ea8700 1 --2- 172.21.15.123:0/2303942040 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e14bc44f0 0x562e14bcf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:03:58.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.185+0000 7f9e526a9700 1 --2- 172.21.15.123:0/2303942040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e14bc5810 0x562e14bd4ce0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9e44009a20 tx=0x7f9e44009180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=725538f228c80979 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:58.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.185+0000 7f9e357fa700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-06-02T04:03:58.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.185+0000 7f9e357fa700 1 -- 172.21.15.123:0/2303942040 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4400e050 con 0x562e14bc5810 2024-06-02T04:03:58.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.185+0000 7f9e357fa700 1 -- 172.21.15.123:0/2303942040 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9e44023070 con 0x562e14bc5810 2024-06-02T04:03:58.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.185+0000 7f9e602c7b80 1 -- 172.21.15.123:0/2303942040 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9e4809a0c0 con 0x562e14bc5810 2024-06-02T04:03:58.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.185+0000 7f9e357fa700 1 -- 172.21.15.123:0/2303942040 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e44005410 con 0x562e14bc5810 2024-06-02T04:03:58.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.185+0000 7f9e602c7b80 10 client.15114 fetch_fsmap learned FSMap version 27 2024-06-02T04:03:58.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.185+0000 7f9e602c7b80 1 -- 172.21.15.123:0/2303942040 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x562e14999c80 con 0x562e14bc5810 2024-06-02T04:03:58.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.185+0000 7f9e357fa700 1 -- 172.21.15.123:0/2303942040 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9e4809a0c0 con 0x562e14bc5810 2024-06-02T04:03:58.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.186+0000 7f9e357fa700 1 -- 172.21.15.123:0/2303942040 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f9e44030030 con 0x562e14bc5810 2024-06-02T04:03:58.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.186+0000 7f9e602c7b80 10 client.15114 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:03:58.192 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.186+0000 7f9e602c7b80 10 client.15114 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-02T04:03:58.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.186+0000 7f9e602c7b80 20 client.15114 populate_metadata read hostname 'smithi123' 2024-06-02T04:03:58.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.186+0000 7f9e602c7b80 1 --2- 172.21.15.123:0/2303942040 >> [v2:172.21.15.136:6838/952830191,v1:172.21.15.136:6839/952830191] conn(0x562e14c34040 0x562e14c30970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:58.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.186+0000 7f9e602c7b80 4 client.15114 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T04:03:58.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.186+0000 7f9e602c7b80 1 -- 172.21.15.123:0/2303942040 --> [v2:172.21.15.136:6838/952830191,v1:172.21.15.136:6839/952830191] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562e14b0ce70 con 0x562e14c34040 2024-06-02T04:03:58.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.186+0000 7f9e51ea8700 1 --2- 172.21.15.123:0/2303942040 >> [v2:172.21.15.136:6838/952830191,v1:172.21.15.136:6839/952830191] conn(0x562e14c34040 0x562e14c30970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:58.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.186+0000 7f9e51ea8700 1 --2- 172.21.15.123:0/2303942040 >> [v2:172.21.15.136:6838/952830191,v1:172.21.15.136:6839/952830191] conn(0x562e14c34040 0x562e14c30970 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6b08d3e07534cb0 server_cookie=fbbe44dd224114e4 in_seq=0 out_seq=0 2024-06-02T04:03:58.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.186+0000 7f9e357fa700 10 client.15114 ms_handle_connect on v2:172.21.15.136:6838/952830191 2024-06-02T04:03:58.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.186+0000 7f9e357fa700 1 -- 172.21.15.123:0/2303942040 <== mds.0 v2:172.21.15.136:6838/952830191 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x562e14b0ce70 con 0x562e14c34040 2024-06-02T04:03:58.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.186+0000 7f9e357fa700 10 client.15114 handle_command_reply: tid=0 2024-06-02T04:03:58.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.186+0000 7f9e602c7b80 1 client.15114 shutdown 2024-06-02T04:03:58.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.187+0000 7f9e602c7b80 1 -- 172.21.15.123:0/2303942040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e14bc5810 msgr2=0x562e14bd4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:58.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.187+0000 7f9e602c7b80 1 --2- 172.21.15.123:0/2303942040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e14bc5810 0x562e14bd4ce0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9e44009a20 tx=0x7f9e44009180 comp rx=0 tx=0).stop 2024-06-02T04:03:58.193 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.187+0000 7f9e602c7b80 1 -- 172.21.15.123:0/2303942040 shutdown_connections 2024-06-02T04:03:58.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.187+0000 7f9e602c7b80 1 --2- 172.21.15.123:0/2303942040 >> [v2:172.21.15.136:6838/952830191,v1:172.21.15.136:6839/952830191] conn(0x562e14c34040 0x562e14c30970 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.187+0000 7f9e602c7b80 1 --2- 172.21.15.123:0/2303942040 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x562e14bc5810 0x562e14bd4ce0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.187+0000 7f9e602c7b80 1 --2- 172.21.15.123:0/2303942040 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x562e14bc44f0 0x562e14bcf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.187+0000 7f9e602c7b80 1 --2- 172.21.15.123:0/2303942040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x562e14bc4e50 0x562e14bcfe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.187+0000 7f9e357fa700 0 client.15114 ms_handle_reset on v2:172.21.15.136:6838/952830191 2024-06-02T04:03:58.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.187+0000 7f9e602c7b80 1 -- 172.21.15.123:0/2303942040 >> 172.21.15.123:0/2303942040 conn(0x562e14b221c0 msgr2=0x562e14bcdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:58.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.187+0000 7f9e602c7b80 1 -- 172.21.15.123:0/2303942040 shutdown_connections 2024-06-02T04:03:58.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.187+0000 7f9e602c7b80 1 -- 172.21.15.123:0/2303942040 wait complete. 2024-06-02T04:03:58.194 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.187+0000 7f9e602c7b80 20 client.15114 trim_cache size 0 max 16384 2024-06-02T04:03:58.194 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-06-02T04:03:58.195 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "1b432ae0-2094-11ef-bc9b-c7b262605968", 2024-06-02T04:03:58.195 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-06-02T04:03:58.195 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 24509, 2024-06-02T04:03:58.195 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-06-02T04:03:58.195 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-06-02T04:03:58.195 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-06-02T04:03:58.195 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 51.516438737999998, 2024-06-02T04:03:58.195 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 27, 2024-06-02T04:03:58.195 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 82, 2024-06-02T04:03:58.195 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 82, 2024-06-02T04:03:58.195 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 55.99601406 2024-06-02T04:03:58.195 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-06-02T04:03:58.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.187+0000 7f9e5410c700 1 -- 172.21.15.123:0/1456671041 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9e380a11b0 msgr2=0x7f9e380a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:58.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.187+0000 7f9e5410c700 1 --2- 172.21.15.123:0/1456671041 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9e380a11b0 0x7f9e380a3670 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c100c40 tx=0x7f9e3c00b670 comp rx=0 tx=0).stop 2024-06-02T04:03:58.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.187+0000 7f9e5410c700 1 -- 172.21.15.123:0/1456671041 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e4c1020f0 msgr2=0x7f9e4c1974e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:58.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.187+0000 7f9e5410c700 1 --2- 172.21.15.123:0/1456671041 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e4c1020f0 0x7f9e4c1974e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9e4800d950 tx=0x7f9e4800dd10 comp rx=0 tx=0).stop 2024-06-02T04:03:58.196 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.187+0000 7f9e5410c700 1 -- 172.21.15.123:0/1456671041 shutdown_connections 2024-06-02T04:03:58.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.187+0000 7f9e5410c700 1 --2- 172.21.15.123:0/1456671041 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9e380a11b0 0x7f9e380a3670 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.187+0000 7f9e5410c700 1 --2- 172.21.15.123:0/1456671041 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e4c102ab0 0x7f9e4c19e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.187+0000 7f9e5410c700 1 --2- 172.21.15.123:0/1456671041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e4c100f20 0x7f9e4c196fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.187+0000 7f9e5410c700 1 --2- 172.21.15.123:0/1456671041 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9e4c1020f0 0x7f9e4c1974e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:58.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.187+0000 7f9e5410c700 1 -- 172.21.15.123:0/1456671041 >> 172.21.15.123:0/1456671041 conn(0x7f9e4c0fc4e0 msgr2=0x7f9e4c105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:58.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.187+0000 7f9e5410c700 1 -- 172.21.15.123:0/1456671041 shutdown_connections 2024-06-02T04:03:58.197 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:58.187+0000 7f9e5410c700 1 -- 172.21.15.123:0/1456671041 wait complete. 2024-06-02T04:03:58.199 INFO:tasks.cephadm:Setup complete, yielding 2024-06-02T04:03:58.200 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-06-02T04:03:58.210 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi123.front.sepia.ceph.com 2024-06-02T04:03:58.211 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch status' 2024-06-02T04:03:58.234 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:57 smithi123 ceph-mon[42885]: pgmap v247: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-02T04:03:58.234 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:57 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/3876935797' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:03:58.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:57 smithi162 ceph-mon[47009]: pgmap v247: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-02T04:03:58.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:57 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/3876935797' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:03:58.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:57 smithi136 ceph-mon[47443]: pgmap v247: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-02T04:03:58.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:57 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/3876935797' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:03:58.431 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:03:59.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.441+0000 7fa794e18700 1 -- 172.21.15.123:0/3153121425 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa790101000 msgr2=0x7fa790101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:59.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.441+0000 7fa794e18700 1 --2- 172.21.15.123:0/3153121425 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa790101000 0x7fa790101420 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa7800099c0 tx=0x7fa780009cd0 comp rx=0 tx=0).stop 2024-06-02T04:03:59.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.441+0000 7fa794e18700 1 -- 172.21.15.123:0/3153121425 shutdown_connections 2024-06-02T04:03:59.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.441+0000 7fa794e18700 1 --2- 172.21.15.123:0/3153121425 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa790102ba0 0x7fa790109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:59.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.441+0000 7fa794e18700 1 --2- 172.21.15.123:0/3153121425 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa790101000 0x7fa790101420 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:59.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.441+0000 7fa794e18700 1 --2- 172.21.15.123:0/3153121425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa790102200 0x7fa790102660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:59.443 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.441+0000 7fa794e18700 1 -- 172.21.15.123:0/3153121425 >> 172.21.15.123:0/3153121425 conn(0x7fa7900fc5c0 msgr2=0x7fa7900fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:59.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.441+0000 7fa794e18700 1 -- 172.21.15.123:0/3153121425 shutdown_connections 2024-06-02T04:03:59.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.441+0000 7fa794e18700 1 -- 172.21.15.123:0/3153121425 wait complete. 2024-06-02T04:03:59.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.441+0000 7fa794e18700 1 Processor -- start 2024-06-02T04:03:59.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.442+0000 7fa794e18700 1 -- start start 2024-06-02T04:03:59.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.442+0000 7fa794e18700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa790101000 0x7fa790196f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:59.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.442+0000 7fa794e18700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa790102200 0x7fa790197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:59.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.442+0000 7fa794e18700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa790102ba0 0x7fa79019e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:59.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.442+0000 7fa794e18700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79019ea60 con 0x7fa790102ba0 2024-06-02T04:03:59.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.442+0000 7fa794e18700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79019eba0 con 0x7fa790101000 2024-06-02T04:03:59.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.442+0000 7fa794e18700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79019ed30 con 0x7fa790102200 2024-06-02T04:03:59.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.442+0000 7fa78ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa790102ba0 0x7fa79019e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:59.444 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.442+0000 7fa78ed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa790102ba0 0x7fa79019e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43246/0 (socket says 172.21.15.123:43246) 2024-06-02T04:03:59.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.442+0000 7fa78ed9d700 1 -- 172.21.15.123:0/456006826 learned_addr learned my addr 172.21.15.123:0/456006826 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:03:59.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.442+0000 7fa78e59c700 1 --2- 172.21.15.123:0/456006826 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa790101000 0x7fa790196f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:59.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.442+0000 7fa78dd9b700 1 --2- 172.21.15.123:0/456006826 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa790102200 0x7fa790197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:59.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.442+0000 7fa78ed9d700 1 -- 172.21.15.123:0/456006826 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa790102200 msgr2=0x7fa790197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:59.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.442+0000 7fa78ed9d700 1 --2- 172.21.15.123:0/456006826 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa790102200 0x7fa790197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:59.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.442+0000 7fa78ed9d700 1 -- 172.21.15.123:0/456006826 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa790101000 msgr2=0x7fa790196f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:59.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.442+0000 7fa78ed9d700 1 --2- 172.21.15.123:0/456006826 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa790101000 0x7fa790196f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:59.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.442+0000 7fa78ed9d700 1 -- 172.21.15.123:0/456006826 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7800095f0 con 0x7fa790102ba0 2024-06-02T04:03:59.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.442+0000 7fa78ed9d700 1 --2- 172.21.15.123:0/456006826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa790102ba0 0x7fa79019e490 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa788007f10 tx=0x7fa78800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:59.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.442+0000 7fa77f7fe700 1 -- 172.21.15.123:0/456006826 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa788017070 con 0x7fa790102ba0 2024-06-02T04:03:59.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.443+0000 7fa77f7fe700 1 -- 172.21.15.123:0/456006826 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa78800f040 con 0x7fa790102ba0 2024-06-02T04:03:59.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.443+0000 7fa794e18700 1 -- 172.21.15.123:0/456006826 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa79019efb0 con 0x7fa790102ba0 2024-06-02T04:03:59.445 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.443+0000 7fa77f7fe700 1 -- 172.21.15.123:0/456006826 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa788005740 con 0x7fa790102ba0 2024-06-02T04:03:59.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.443+0000 7fa794e18700 1 -- 172.21.15.123:0/456006826 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa79019f480 con 0x7fa790102ba0 2024-06-02T04:03:59.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.444+0000 7fa794e18700 1 -- 172.21.15.123:0/456006826 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa790108530 con 0x7fa790102ba0 2024-06-02T04:03:59.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.445+0000 7fa77f7fe700 1 -- 172.21.15.123:0/456006826 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fa7880058a0 con 0x7fa790102ba0 2024-06-02T04:03:59.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.445+0000 7fa77f7fe700 1 --2- 172.21.15.123:0/456006826 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa7780a1230 0x7fa7780a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:03:59.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.445+0000 7fa78e59c700 1 --2- 172.21.15.123:0/456006826 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa7780a1230 0x7fa7780a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:03:59.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.445+0000 7fa77f7fe700 1 -- 172.21.15.123:0/456006826 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa7880cbff0 con 0x7fa790102ba0 2024-06-02T04:03:59.447 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.445+0000 7fa78e59c700 1 --2- 172.21.15.123:0/456006826 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa7780a1230 0x7fa7780a36f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa780003820 tx=0x7fa780005920 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:03:59.449 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.449+0000 7fa77f7fe700 1 -- 172.21.15.123:0/456006826 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa7880957d0 con 0x7fa790102ba0 2024-06-02T04:03:59.658 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.659+0000 7fa794e18700 1 -- 172.21.15.123:0/456006826 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa79002ce10 con 0x7fa7780a1230 2024-06-02T04:03:59.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.660+0000 7fa77f7fe700 1 -- 172.21.15.123:0/456006826 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fa79002ce10 con 0x7fa7780a1230 2024-06-02T04:03:59.659 INFO:teuthology.orchestra.run.smithi123.stdout:Backend: cephadm 2024-06-02T04:03:59.660 INFO:teuthology.orchestra.run.smithi123.stdout:Available: Yes 2024-06-02T04:03:59.660 INFO:teuthology.orchestra.run.smithi123.stdout:Paused: No 2024-06-02T04:03:59.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.662+0000 7fa794e18700 1 -- 172.21.15.123:0/456006826 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa7780a1230 msgr2=0x7fa7780a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:59.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.662+0000 7fa794e18700 1 --2- 172.21.15.123:0/456006826 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa7780a1230 0x7fa7780a36f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa780003820 tx=0x7fa780005920 comp rx=0 tx=0).stop 2024-06-02T04:03:59.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.662+0000 7fa794e18700 1 -- 172.21.15.123:0/456006826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa790102ba0 msgr2=0x7fa79019e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:03:59.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.662+0000 7fa794e18700 1 --2- 172.21.15.123:0/456006826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa790102ba0 0x7fa79019e490 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa788007f10 tx=0x7fa78800d3b0 comp rx=0 tx=0).stop 2024-06-02T04:03:59.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.662+0000 7fa794e18700 1 -- 172.21.15.123:0/456006826 shutdown_connections 2024-06-02T04:03:59.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.662+0000 7fa794e18700 1 --2- 172.21.15.123:0/456006826 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa790102ba0 0x7fa79019e490 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:59.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.662+0000 7fa794e18700 1 --2- 172.21.15.123:0/456006826 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa7780a1230 0x7fa7780a36f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:59.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.662+0000 7fa794e18700 1 --2- 172.21.15.123:0/456006826 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa790101000 0x7fa790196f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:59.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.662+0000 7fa794e18700 1 --2- 172.21.15.123:0/456006826 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa790102200 0x7fa790197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:03:59.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.662+0000 7fa794e18700 1 -- 172.21.15.123:0/456006826 >> 172.21.15.123:0/456006826 conn(0x7fa7900fc5c0 msgr2=0x7fa790105670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:03:59.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.662+0000 7fa794e18700 1 -- 172.21.15.123:0/456006826 shutdown_connections 2024-06-02T04:03:59.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:03:59.662+0000 7fa794e18700 1 -- 172.21.15.123:0/456006826 wait complete. 2024-06-02T04:04:00.052 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch ps' 2024-06-02T04:04:00.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:03:59 smithi162 ceph-mon[47009]: pgmap v248: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-02T04:04:00.320 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:04:00.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:03:59 smithi123 ceph-mon[42885]: pgmap v248: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-02T04:04:00.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:03:59 smithi136 ceph-mon[47443]: pgmap v248: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-06-02T04:04:01.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:00 smithi123 ceph-mon[42885]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:04:01.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:00 smithi162 ceph-mon[47009]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:04:01.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:00 smithi136 ceph-mon[47443]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:04:01.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.374+0000 7f2fd2ade700 1 -- 172.21.15.123:0/2953978310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fcc1041d0 msgr2=0x7f2fcc1065c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:01.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.374+0000 7f2fd2ade700 1 --2- 172.21.15.123:0/2953978310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fcc1041d0 0x7f2fcc1065c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc009990 tx=0x7f2fbc009ca0 comp rx=0 tx=0).stop 2024-06-02T04:04:01.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.374+0000 7f2fd2ade700 1 -- 172.21.15.123:0/2953978310 shutdown_connections 2024-06-02T04:04:01.374 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.374+0000 7f2fd2ade700 1 --2- 172.21.15.123:0/2953978310 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fcc106b00 0x7f2fcc108f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:01.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.374+0000 7f2fd2ade700 1 --2- 172.21.15.123:0/2953978310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fcc1018a0 0x7f2fcc103c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:01.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.374+0000 7f2fd2ade700 1 --2- 172.21.15.123:0/2953978310 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fcc1041d0 0x7f2fcc1065c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:01.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.374+0000 7f2fd2ade700 1 -- 172.21.15.123:0/2953978310 >> 172.21.15.123:0/2953978310 conn(0x7f2fcc0fb2b0 msgr2=0x7f2fcc0fd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:01.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.374+0000 7f2fd2ade700 1 -- 172.21.15.123:0/2953978310 shutdown_connections 2024-06-02T04:04:01.375 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.374+0000 7f2fd2ade700 1 -- 172.21.15.123:0/2953978310 wait complete. 2024-06-02T04:04:01.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.375+0000 7f2fd2ade700 1 Processor -- start 2024-06-02T04:04:01.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.375+0000 7f2fd2ade700 1 -- start start 2024-06-02T04:04:01.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.375+0000 7f2fd2ade700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fcc1018a0 0x7f2fcc196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:01.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.375+0000 7f2fd2ade700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fcc1041d0 0x7f2fcc197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:01.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.375+0000 7f2fd2ade700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fcc106b00 0x7f2fcc19e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:01.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.375+0000 7f2fd2ade700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc19e830 con 0x7f2fcc1018a0 2024-06-02T04:04:01.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.375+0000 7f2fd2ade700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc19e970 con 0x7f2fcc106b00 2024-06-02T04:04:01.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.375+0000 7f2fd2ade700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc19eb30 con 0x7f2fcc1041d0 2024-06-02T04:04:01.377 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.375+0000 7f2fd1adc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fcc1018a0 0x7f2fcc196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:01.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.375+0000 7f2fd1adc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fcc1018a0 0x7f2fcc196d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43260/0 (socket says 172.21.15.123:43260) 2024-06-02T04:04:01.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.375+0000 7f2fd1adc700 1 -- 172.21.15.123:0/897377114 learned_addr learned my addr 172.21.15.123:0/897377114 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:01.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.375+0000 7f2fd12db700 1 --2- 172.21.15.123:0/897377114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fcc1041d0 0x7f2fcc197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:01.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.375+0000 7f2fd22dd700 1 --2- 172.21.15.123:0/897377114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fcc106b00 0x7f2fcc19e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:01.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.375+0000 7f2fd1adc700 1 -- 172.21.15.123:0/897377114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fcc1041d0 msgr2=0x7f2fcc197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:01.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.375+0000 7f2fd1adc700 1 --2- 172.21.15.123:0/897377114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fcc1041d0 0x7f2fcc197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:01.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.375+0000 7f2fd1adc700 1 -- 172.21.15.123:0/897377114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fcc106b00 msgr2=0x7f2fcc19e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:01.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.375+0000 7f2fd1adc700 1 --2- 172.21.15.123:0/897377114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fcc106b00 0x7f2fcc19e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:01.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.375+0000 7f2fd1adc700 1 -- 172.21.15.123:0/897377114 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc0095f0 con 0x7f2fcc1018a0 2024-06-02T04:04:01.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.375+0000 7f2fd12db700 1 --2- 172.21.15.123:0/897377114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fcc1041d0 0x7f2fcc197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:04:01.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.375+0000 7f2fd1adc700 1 --2- 172.21.15.123:0/897377114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fcc1018a0 0x7f2fcc196d30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2fc800d950 tx=0x7f2fc800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:01.378 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.375+0000 7f2fc2ffd700 1 -- 172.21.15.123:0/897377114 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc8009b40 con 0x7f2fcc1018a0 2024-06-02T04:04:01.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.375+0000 7f2fc2ffd700 1 -- 172.21.15.123:0/897377114 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2fc8009ca0 con 0x7f2fcc1018a0 2024-06-02T04:04:01.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.376+0000 7f2fd2ade700 1 -- 172.21.15.123:0/897377114 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fcc19ee10 con 0x7f2fcc1018a0 2024-06-02T04:04:01.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.376+0000 7f2fc2ffd700 1 -- 172.21.15.123:0/897377114 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc800f620 con 0x7f2fcc1018a0 2024-06-02T04:04:01.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.376+0000 7f2fd2ade700 1 -- 172.21.15.123:0/897377114 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fcc19f220 con 0x7f2fcc1018a0 2024-06-02T04:04:01.379 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.376+0000 7f2fd2ade700 1 -- 172.21.15.123:0/897377114 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fcc0fce30 con 0x7f2fcc1018a0 2024-06-02T04:04:01.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.378+0000 7f2fc2ffd700 1 -- 172.21.15.123:0/897377114 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f2fc8010460 con 0x7f2fcc1018a0 2024-06-02T04:04:01.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.378+0000 7f2fc2ffd700 1 --2- 172.21.15.123:0/897377114 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2fb80a11b0 0x7f2fb80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:01.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.378+0000 7f2fd12db700 1 --2- 172.21.15.123:0/897377114 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2fb80a11b0 0x7f2fb80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:01.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.378+0000 7f2fc2ffd700 1 -- 172.21.15.123:0/897377114 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2fc80ccc40 con 0x7f2fcc1018a0 2024-06-02T04:04:01.380 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.379+0000 7f2fd12db700 1 --2- 172.21.15.123:0/897377114 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2fb80a11b0 0x7f2fb80a3670 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc00b5c0 tx=0x7f2fbc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:01.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.382+0000 7f2fc2ffd700 1 -- 172.21.15.123:0/897377114 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2fc8096420 con 0x7f2fcc1018a0 2024-06-02T04:04:01.582 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.582+0000 7f2fd2ade700 1 -- 172.21.15.123:0/897377114 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2fcc02ceb0 con 0x7f2fb80a11b0 2024-06-02T04:04:01.595 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.596+0000 7f2fc2ffd700 1 -- 172.21.15.123:0/897377114 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7f2fcc02ceb0 con 0x7f2fb80a11b0 2024-06-02T04:04:01.596 INFO:teuthology.orchestra.run.smithi123.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-06-02T04:04:01.596 INFO:teuthology.orchestra.run.smithi123.stdout:mds.a smithi123 running (61s) 56s ago 61s 13.4M - 18.2.2-1381-g3bb45379 a7978103fbbe 39356571bbae 2024-06-02T04:04:01.596 INFO:teuthology.orchestra.run.smithi123.stdout:mds.b smithi136 running (59s) 56s ago 59s 15.7M - 18.2.2-1381-g3bb45379 a7978103fbbe e98c99a69da7 2024-06-02T04:04:01.596 INFO:teuthology.orchestra.run.smithi123.stdout:mds.c smithi162 running (68s) 56s ago 68s 15.7M - 18.2.2-1381-g3bb45379 a7978103fbbe 1af4c4a4e4ca 2024-06-02T04:04:01.596 INFO:teuthology.orchestra.run.smithi123.stdout:mds.d smithi123 running (74s) 56s ago 74s 14.4M - 18.2.2-1381-g3bb45379 a7978103fbbe b4853ad862cf 2024-06-02T04:04:01.596 INFO:teuthology.orchestra.run.smithi123.stdout:mds.e smithi136 running (72s) 56s ago 72s 15.7M - 18.2.2-1381-g3bb45379 a7978103fbbe 5b761a49304d 2024-06-02T04:04:01.596 INFO:teuthology.orchestra.run.smithi123.stdout:mds.f smithi162 running (70s) 56s ago 70s 15.7M - 18.2.2-1381-g3bb45379 a7978103fbbe 0888f15e05c8 2024-06-02T04:04:01.596 INFO:teuthology.orchestra.run.smithi123.stdout:mds.g smithi123 running (63s) 56s ago 63s 15.7M - 18.2.2-1381-g3bb45379 a7978103fbbe 78d9983c43e4 2024-06-02T04:04:01.596 INFO:teuthology.orchestra.run.smithi123.stdout:mds.h smithi136 running (67s) 56s ago 66s 16.0M - 18.2.2-1381-g3bb45379 a7978103fbbe ced0821ce708 2024-06-02T04:04:01.596 INFO:teuthology.orchestra.run.smithi123.stdout:mds.i smithi162 running (65s) 56s ago 64s 14.2M - 18.2.2-1381-g3bb45379 a7978103fbbe 5726bba71024 2024-06-02T04:04:01.596 INFO:teuthology.orchestra.run.smithi123.stdout:mds.j smithi123 running (76s) 56s ago 75s 14.3M - 18.2.2-1381-g3bb45379 a7978103fbbe 9b2a784010c8 2024-06-02T04:04:01.597 INFO:teuthology.orchestra.run.smithi123.stdout:mds.k smithi136 running (77s) 56s ago 77s 14.4M - 18.2.2-1381-g3bb45379 a7978103fbbe 819045821bf0 2024-06-02T04:04:01.597 INFO:teuthology.orchestra.run.smithi123.stdout:mds.l smithi162 running (79s) 56s ago 79s 16.9M - 18.2.2-1381-g3bb45379 a7978103fbbe 295f177da505 2024-06-02T04:04:01.597 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.x smithi123 *:9283,8765 running (6m) 56s ago 6m 524M - 18.2.2-1381-g3bb45379 a7978103fbbe b057390367f3 2024-06-02T04:04:01.597 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.y smithi136 *:8443,8765 running (5m) 56s ago 5m 459M - 18.2.2-1381-g3bb45379 a7978103fbbe 5bdf53e14c24 2024-06-02T04:04:01.597 INFO:teuthology.orchestra.run.smithi123.stdout:mgr.z smithi162 *:8443,8765 running (5m) 56s ago 5m 460M - 18.2.2-1381-g3bb45379 a7978103fbbe 5a0de22bba6b 2024-06-02T04:04:01.597 INFO:teuthology.orchestra.run.smithi123.stdout:mon.a smithi123 running (6m) 56s ago 6m 78.9M 2048M 18.2.2-1381-g3bb45379 a7978103fbbe 33bd4d6c762c 2024-06-02T04:04:01.597 INFO:teuthology.orchestra.run.smithi123.stdout:mon.b smithi136 running (5m) 56s ago 5m 55.9M 2048M 18.2.2-1381-g3bb45379 a7978103fbbe 984007bd512c 2024-06-02T04:04:01.597 INFO:teuthology.orchestra.run.smithi123.stdout:mon.c smithi162 running (5m) 56s ago 5m 60.6M 2048M 18.2.2-1381-g3bb45379 a7978103fbbe 714c3e6556f6 2024-06-02T04:04:01.597 INFO:teuthology.orchestra.run.smithi123.stdout:osd.0 smithi123 running (4m) 56s ago 4m 56.2M 4278M 18.2.2-1381-g3bb45379 a7978103fbbe b5d6544fb998 2024-06-02T04:04:01.597 INFO:teuthology.orchestra.run.smithi123.stdout:osd.1 smithi136 running (4m) 56s ago 4m 130M 4278M 18.2.2-1381-g3bb45379 a7978103fbbe e90d2d4c3222 2024-06-02T04:04:01.598 INFO:teuthology.orchestra.run.smithi123.stdout:osd.2 smithi162 running (4m) 56s ago 4m 128M 4278M 18.2.2-1381-g3bb45379 a7978103fbbe 6e8632a95b19 2024-06-02T04:04:01.598 INFO:teuthology.orchestra.run.smithi123.stdout:osd.3 smithi123 running (3m) 56s ago 3m 48.8M 4278M 18.2.2-1381-g3bb45379 a7978103fbbe 8fdbac7d650a 2024-06-02T04:04:01.598 INFO:teuthology.orchestra.run.smithi123.stdout:osd.4 smithi136 running (3m) 56s ago 3m 47.8M 4278M 18.2.2-1381-g3bb45379 a7978103fbbe 9ec834f2e272 2024-06-02T04:04:01.598 INFO:teuthology.orchestra.run.smithi123.stdout:osd.5 smithi162 running (3m) 56s ago 3m 123M 4278M 18.2.2-1381-g3bb45379 a7978103fbbe c88dde9a1c0e 2024-06-02T04:04:01.598 INFO:teuthology.orchestra.run.smithi123.stdout:osd.6 smithi123 running (3m) 56s ago 3m 47.0M 4278M 18.2.2-1381-g3bb45379 a7978103fbbe ab59d86aaa41 2024-06-02T04:04:01.598 INFO:teuthology.orchestra.run.smithi123.stdout:osd.7 smithi136 running (2m) 56s ago 2m 50.1M 4278M 18.2.2-1381-g3bb45379 a7978103fbbe 9d2c2b4ec2e4 2024-06-02T04:04:01.598 INFO:teuthology.orchestra.run.smithi123.stdout:osd.8 smithi162 running (2m) 56s ago 2m 118M 4278M 18.2.2-1381-g3bb45379 a7978103fbbe 0e69e43aa145 2024-06-02T04:04:01.598 INFO:teuthology.orchestra.run.smithi123.stdout:osd.9 smithi123 running (2m) 56s ago 2m 115M 4278M 18.2.2-1381-g3bb45379 a7978103fbbe ab5fa5181e2f 2024-06-02T04:04:01.598 INFO:teuthology.orchestra.run.smithi123.stdout:osd.10 smithi136 running (111s) 56s ago 111s 46.4M 4278M 18.2.2-1381-g3bb45379 a7978103fbbe c387efc73c25 2024-06-02T04:04:01.598 INFO:teuthology.orchestra.run.smithi123.stdout:osd.11 smithi162 running (93s) 56s ago 93s 117M 4278M 18.2.2-1381-g3bb45379 a7978103fbbe 43519d586dd2 2024-06-02T04:04:01.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.598+0000 7f2fd2ade700 1 -- 172.21.15.123:0/897377114 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2fb80a11b0 msgr2=0x7f2fb80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:01.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.598+0000 7f2fd2ade700 1 --2- 172.21.15.123:0/897377114 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2fb80a11b0 0x7f2fb80a3670 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc00b5c0 tx=0x7f2fbc005fb0 comp rx=0 tx=0).stop 2024-06-02T04:04:01.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.598+0000 7f2fd2ade700 1 -- 172.21.15.123:0/897377114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fcc1018a0 msgr2=0x7f2fcc196d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:01.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.598+0000 7f2fd2ade700 1 --2- 172.21.15.123:0/897377114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fcc1018a0 0x7f2fcc196d30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2fc800d950 tx=0x7f2fc800dd10 comp rx=0 tx=0).stop 2024-06-02T04:04:01.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.598+0000 7f2fd2ade700 1 -- 172.21.15.123:0/897377114 shutdown_connections 2024-06-02T04:04:01.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.598+0000 7f2fd2ade700 1 --2- 172.21.15.123:0/897377114 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2fb80a11b0 0x7f2fb80a3670 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:01.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.598+0000 7f2fd2ade700 1 --2- 172.21.15.123:0/897377114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2fcc106b00 0x7f2fcc19e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:01.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.598+0000 7f2fd2ade700 1 --2- 172.21.15.123:0/897377114 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2fcc1018a0 0x7f2fcc196d30 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:01.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.598+0000 7f2fd2ade700 1 --2- 172.21.15.123:0/897377114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fcc1041d0 0x7f2fcc197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:01.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.598+0000 7f2fd2ade700 1 -- 172.21.15.123:0/897377114 >> 172.21.15.123:0/897377114 conn(0x7f2fcc0fb2b0 msgr2=0x7f2fcc1022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:01.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.598+0000 7f2fd2ade700 1 -- 172.21.15.123:0/897377114 shutdown_connections 2024-06-02T04:04:01.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:01.598+0000 7f2fd2ade700 1 -- 172.21.15.123:0/897377114 wait complete. 2024-06-02T04:04:01.970 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch ls' 2024-06-02T04:04:02.193 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:04:02.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:01 smithi162 ceph-mon[47009]: pgmap v249: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T04:04:02.305 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:01 smithi123 ceph-mon[42885]: pgmap v249: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T04:04:02.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:01 smithi136 ceph-mon[47443]: pgmap v249: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T04:04:03.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.099+0000 7f7d9b90a700 1 -- 172.21.15.123:0/861735162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d94101060 msgr2=0x7f7d941014e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:03.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.099+0000 7f7d9b90a700 1 --2- 172.21.15.123:0/861735162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d94101060 0x7f7d941014e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009990 tx=0x7f7d90009ca0 comp rx=0 tx=0).stop 2024-06-02T04:04:03.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.099+0000 7f7d9b90a700 1 -- 172.21.15.123:0/861735162 shutdown_connections 2024-06-02T04:04:03.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.099+0000 7f7d9b90a700 1 --2- 172.21.15.123:0/861735162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d94101a20 0x7f7d94108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:03.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.099+0000 7f7d9b90a700 1 --2- 172.21.15.123:0/861735162 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7d940fff00 0x7f7d94100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:03.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.099+0000 7f7d9b90a700 1 --2- 172.21.15.123:0/861735162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d94101060 0x7f7d941014e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:03.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.099+0000 7f7d9b90a700 1 -- 172.21.15.123:0/861735162 >> 172.21.15.123:0/861735162 conn(0x7f7d940fb4a0 msgr2=0x7f7d940fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:03.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.099+0000 7f7d9b90a700 1 -- 172.21.15.123:0/861735162 shutdown_connections 2024-06-02T04:04:03.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.099+0000 7f7d9b90a700 1 -- 172.21.15.123:0/861735162 wait complete. 2024-06-02T04:04:03.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.099+0000 7f7d9b90a700 1 Processor -- start 2024-06-02T04:04:03.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.099+0000 7f7d9b90a700 1 -- start start 2024-06-02T04:04:03.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.100+0000 7f7d9b90a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d940fff00 0x7f7d94069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:03.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.100+0000 7f7d9b90a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7d94101060 0x7f7d9419bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:03.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.100+0000 7f7d9b90a700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d94101a20 0x7f7d9419e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:03.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.100+0000 7f7d9b90a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9419ea40 con 0x7f7d940fff00 2024-06-02T04:04:03.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.100+0000 7f7d9b90a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9419ebb0 con 0x7f7d94101060 2024-06-02T04:04:03.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.100+0000 7f7d9b90a700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9419ed70 con 0x7f7d94101a20 2024-06-02T04:04:03.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.100+0000 7f7d996a6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d940fff00 0x7f7d94069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:03.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.100+0000 7f7d996a6700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d940fff00 0x7f7d94069460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:43276/0 (socket says 172.21.15.123:43276) 2024-06-02T04:04:03.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.100+0000 7f7d996a6700 1 -- 172.21.15.123:0/4095100927 learned_addr learned my addr 172.21.15.123:0/4095100927 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:03.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.100+0000 7f7d99ea7700 1 --2- 172.21.15.123:0/4095100927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d94101a20 0x7f7d9419e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:03.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.100+0000 7f7d98ea5700 1 --2- 172.21.15.123:0/4095100927 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7d94101060 0x7f7d9419bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:03.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.100+0000 7f7d996a6700 1 -- 172.21.15.123:0/4095100927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d94101a20 msgr2=0x7f7d9419e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:03.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.100+0000 7f7d996a6700 1 --2- 172.21.15.123:0/4095100927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d94101a20 0x7f7d9419e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:03.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.100+0000 7f7d996a6700 1 -- 172.21.15.123:0/4095100927 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7d94101060 msgr2=0x7f7d9419bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:03.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.100+0000 7f7d996a6700 1 --2- 172.21.15.123:0/4095100927 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7d94101060 0x7f7d9419bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:03.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.100+0000 7f7d996a6700 1 -- 172.21.15.123:0/4095100927 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d900095f0 con 0x7f7d940fff00 2024-06-02T04:04:03.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.100+0000 7f7d98ea5700 1 --2- 172.21.15.123:0/4095100927 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7d94101060 0x7f7d9419bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:04:03.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.100+0000 7f7d996a6700 1 --2- 172.21.15.123:0/4095100927 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d940fff00 0x7f7d94069460 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7d8400b530 tx=0x7f7d8400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:03.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.100+0000 7f7d8a7fc700 1 -- 172.21.15.123:0/4095100927 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d84011830 con 0x7f7d940fff00 2024-06-02T04:04:03.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.100+0000 7f7d8a7fc700 1 -- 172.21.15.123:0/4095100927 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d84011e50 con 0x7f7d940fff00 2024-06-02T04:04:03.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.100+0000 7f7d9b90a700 1 -- 172.21.15.123:0/4095100927 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d9419eff0 con 0x7f7d940fff00 2024-06-02T04:04:03.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.100+0000 7f7d8a7fc700 1 -- 172.21.15.123:0/4095100927 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8400f2e0 con 0x7f7d940fff00 2024-06-02T04:04:03.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.100+0000 7f7d9b90a700 1 -- 172.21.15.123:0/4095100927 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d9419f460 con 0x7f7d940fff00 2024-06-02T04:04:03.103 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.101+0000 7f7d9b90a700 1 -- 172.21.15.123:0/4095100927 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d941072d0 con 0x7f7d940fff00 2024-06-02T04:04:03.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.102+0000 7f7d8a7fc700 1 -- 172.21.15.123:0/4095100927 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f7d84010380 con 0x7f7d940fff00 2024-06-02T04:04:03.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.103+0000 7f7d8a7fc700 1 --2- 172.21.15.123:0/4095100927 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7d800a11b0 0x7f7d800a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:03.104 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.103+0000 7f7d98ea5700 1 --2- 172.21.15.123:0/4095100927 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7d800a11b0 0x7f7d800a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:03.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.103+0000 7f7d8a7fc700 1 -- 172.21.15.123:0/4095100927 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7d840cc890 con 0x7f7d940fff00 2024-06-02T04:04:03.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.103+0000 7f7d98ea5700 1 --2- 172.21.15.123:0/4095100927 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7d800a11b0 0x7f7d800a3670 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7d90000c00 tx=0x7f7d90005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:03.106 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.106+0000 7f7d8a7fc700 1 -- 172.21.15.123:0/4095100927 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7d84096180 con 0x7f7d940fff00 2024-06-02T04:04:03.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:02 smithi162 ceph-mon[47009]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:04:03.309 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.308+0000 7f7d9b90a700 1 -- 172.21.15.123:0/4095100927 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d9402ceb0 con 0x7f7d800a11b0 2024-06-02T04:04:03.313 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.314+0000 7f7d8a7fc700 1 -- 172.21.15.123:0/4095100927 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7f7d9402ceb0 con 0x7f7d800a11b0 2024-06-02T04:04:03.314 INFO:teuthology.orchestra.run.smithi123.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-06-02T04:04:03.314 INFO:teuthology.orchestra.run.smithi123.stdout:mds.all 12/12 58s ago 83s smithi123=a;smithi123=d;smithi123=g;smithi123=j;smithi136=b;smithi136=e;smithi136=h;smithi136=k;smithi162=c;smithi162=f;smithi162=i;smithi162=l;count:12 2024-06-02T04:04:03.314 INFO:teuthology.orchestra.run.smithi123.stdout:mgr 3/3 58s ago 5m smithi123=x;smithi136=y;smithi162=z;count:3 2024-06-02T04:04:03.314 INFO:teuthology.orchestra.run.smithi123.stdout:mon 3/3 58s ago 5m smithi123:172.21.15.123=a;smithi136:172.21.15.136=b;smithi162:172.21.15.162=c;count:3 2024-06-02T04:04:03.314 INFO:teuthology.orchestra.run.smithi123.stdout:osd 12 58s ago - 2024-06-02T04:04:03.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.316+0000 7f7d9b90a700 1 -- 172.21.15.123:0/4095100927 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7d800a11b0 msgr2=0x7f7d800a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:03.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.316+0000 7f7d9b90a700 1 --2- 172.21.15.123:0/4095100927 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7d800a11b0 0x7f7d800a3670 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7d90000c00 tx=0x7f7d90005fb0 comp rx=0 tx=0).stop 2024-06-02T04:04:03.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.316+0000 7f7d9b90a700 1 -- 172.21.15.123:0/4095100927 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d940fff00 msgr2=0x7f7d94069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:03.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.316+0000 7f7d9b90a700 1 --2- 172.21.15.123:0/4095100927 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d940fff00 0x7f7d94069460 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7d8400b530 tx=0x7f7d8400b840 comp rx=0 tx=0).stop 2024-06-02T04:04:03.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.316+0000 7f7d9b90a700 1 -- 172.21.15.123:0/4095100927 shutdown_connections 2024-06-02T04:04:03.316 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.316+0000 7f7d9b90a700 1 --2- 172.21.15.123:0/4095100927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d94101a20 0x7f7d9419e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:03.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.316+0000 7f7d9b90a700 1 --2- 172.21.15.123:0/4095100927 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7d940fff00 0x7f7d94069460 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:03.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.316+0000 7f7d9b90a700 1 --2- 172.21.15.123:0/4095100927 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7d800a11b0 0x7f7d800a3670 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:03.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.316+0000 7f7d9b90a700 1 --2- 172.21.15.123:0/4095100927 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7d94101060 0x7f7d9419bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:03.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.316+0000 7f7d9b90a700 1 -- 172.21.15.123:0/4095100927 >> 172.21.15.123:0/4095100927 conn(0x7f7d940fb4a0 msgr2=0x7f7d94104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:03.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.316+0000 7f7d9b90a700 1 -- 172.21.15.123:0/4095100927 shutdown_connections 2024-06-02T04:04:03.317 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:03.316+0000 7f7d9b90a700 1 -- 172.21.15.123:0/4095100927 wait complete. 2024-06-02T04:04:03.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:02 smithi123 ceph-mon[42885]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:04:03.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:02 smithi136 ceph-mon[47443]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:04:03.685 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch host ls' 2024-06-02T04:04:03.907 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:04:04.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:03 smithi162 ceph-mon[47009]: pgmap v250: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T04:04:04.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:03 smithi123 ceph-mon[42885]: pgmap v250: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T04:04:04.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:03 smithi136 ceph-mon[47443]: pgmap v250: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-06-02T04:04:04.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.917+0000 7f0d6d175700 1 -- 172.21.15.123:0/2849662571 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d68101000 msgr2=0x7f0d68101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:04.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.917+0000 7f0d6d175700 1 --2- 172.21.15.123:0/2849662571 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d68101000 0x7f0d68101420 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c0099c0 tx=0x7f0d5c009cd0 comp rx=0 tx=0).stop 2024-06-02T04:04:04.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.917+0000 7f0d6d175700 1 -- 172.21.15.123:0/2849662571 shutdown_connections 2024-06-02T04:04:04.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.917+0000 7f0d6d175700 1 --2- 172.21.15.123:0/2849662571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0d68102ba0 0x7f0d68109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:04.917 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.917+0000 7f0d6d175700 1 --2- 172.21.15.123:0/2849662571 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d68101000 0x7f0d68101420 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:04.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.917+0000 7f0d6d175700 1 --2- 172.21.15.123:0/2849662571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d68102200 0x7f0d68102660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:04.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.917+0000 7f0d6d175700 1 -- 172.21.15.123:0/2849662571 >> 172.21.15.123:0/2849662571 conn(0x7f0d680fc5c0 msgr2=0x7f0d680fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:04.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.917+0000 7f0d6d175700 1 -- 172.21.15.123:0/2849662571 shutdown_connections 2024-06-02T04:04:04.918 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.917+0000 7f0d6d175700 1 -- 172.21.15.123:0/2849662571 wait complete. 2024-06-02T04:04:04.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.918+0000 7f0d6d175700 1 Processor -- start 2024-06-02T04:04:04.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.918+0000 7f0d6d175700 1 -- start start 2024-06-02T04:04:04.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.918+0000 7f0d6d175700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d68101000 0x7f0d68074cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:04.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.918+0000 7f0d6d175700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0d68102200 0x7f0d68073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:04.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.918+0000 7f0d6d175700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d68102ba0 0x7f0d680738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:04.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.918+0000 7f0d6d175700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d68074070 con 0x7f0d68101000 2024-06-02T04:04:04.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.918+0000 7f0d6d175700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d680741e0 con 0x7f0d68102200 2024-06-02T04:04:04.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.918+0000 7f0d6d175700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d681a1010 con 0x7f0d68102ba0 2024-06-02T04:04:04.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.918+0000 7f0d66d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d68101000 0x7f0d68074cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:04.920 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.918+0000 7f0d66d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d68101000 0x7f0d68074cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33296/0 (socket says 172.21.15.123:33296) 2024-06-02T04:04:04.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.918+0000 7f0d66d9d700 1 -- 172.21.15.123:0/3953014433 learned_addr learned my addr 172.21.15.123:0/3953014433 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:04.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.918+0000 7f0d6659c700 1 --2- 172.21.15.123:0/3953014433 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0d68102200 0x7f0d68073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:04.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.919+0000 7f0d6759e700 1 --2- 172.21.15.123:0/3953014433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d68102ba0 0x7f0d680738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:04.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.919+0000 7f0d66d9d700 1 -- 172.21.15.123:0/3953014433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d68102ba0 msgr2=0x7f0d680738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:04.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.919+0000 7f0d66d9d700 1 --2- 172.21.15.123:0/3953014433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d68102ba0 0x7f0d680738d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:04.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.919+0000 7f0d66d9d700 1 -- 172.21.15.123:0/3953014433 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0d68102200 msgr2=0x7f0d68073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:04.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.919+0000 7f0d66d9d700 1 --2- 172.21.15.123:0/3953014433 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0d68102200 0x7f0d68073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:04.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.919+0000 7f0d66d9d700 1 -- 172.21.15.123:0/3953014433 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5c0095f0 con 0x7f0d68101000 2024-06-02T04:04:04.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.919+0000 7f0d6659c700 1 --2- 172.21.15.123:0/3953014433 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0d68102200 0x7f0d68073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:04:04.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.919+0000 7f0d6759e700 1 --2- 172.21.15.123:0/3953014433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d68102ba0 0x7f0d680738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:04:04.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.919+0000 7f0d66d9d700 1 --2- 172.21.15.123:0/3953014433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d68101000 0x7f0d68074cf0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c003820 tx=0x7f0d5c005ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:04.921 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.919+0000 7f0d4ffff700 1 -- 172.21.15.123:0/3953014433 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c01d070 con 0x7f0d68101000 2024-06-02T04:04:04.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.919+0000 7f0d4ffff700 1 -- 172.21.15.123:0/3953014433 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d5c004110 con 0x7f0d68101000 2024-06-02T04:04:04.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.919+0000 7f0d6d175700 1 -- 172.21.15.123:0/3953014433 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d681a1240 con 0x7f0d68101000 2024-06-02T04:04:04.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.919+0000 7f0d4ffff700 1 -- 172.21.15.123:0/3953014433 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5c022e40 con 0x7f0d68101000 2024-06-02T04:04:04.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.919+0000 7f0d6d175700 1 -- 172.21.15.123:0/3953014433 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d681a16e0 con 0x7f0d68101000 2024-06-02T04:04:04.922 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.920+0000 7f0d6d175700 1 -- 172.21.15.123:0/3953014433 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d68108530 con 0x7f0d68101000 2024-06-02T04:04:04.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.921+0000 7f0d4ffff700 1 -- 172.21.15.123:0/3953014433 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f0d5c022570 con 0x7f0d68101000 2024-06-02T04:04:04.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.922+0000 7f0d4ffff700 1 --2- 172.21.15.123:0/3953014433 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0d500a11b0 0x7f0d500a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:04.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.922+0000 7f0d6659c700 1 --2- 172.21.15.123:0/3953014433 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0d500a11b0 0x7f0d500a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:04.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.922+0000 7f0d4ffff700 1 -- 172.21.15.123:0/3953014433 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f0d5c0cdd00 con 0x7f0d68101000 2024-06-02T04:04:04.923 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.922+0000 7f0d6659c700 1 --2- 172.21.15.123:0/3953014433 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0d500a11b0 0x7f0d500a3670 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0d580099d0 tx=0x7f0d58008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:04.926 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:04.926+0000 7f0d4ffff700 1 -- 172.21.15.123:0/3953014433 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0d5c0d1030 con 0x7f0d68101000 2024-06-02T04:04:05.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:04 smithi123 ceph-mon[42885]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:04:05.127 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:05.127+0000 7f0d6d175700 1 -- 172.21.15.123:0/3953014433 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d6810cb30 con 0x7f0d500a11b0 2024-06-02T04:04:05.128 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:05.128+0000 7f0d4ffff700 1 -- 172.21.15.123:0/3953014433 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f0d6810cb30 con 0x7f0d500a11b0 2024-06-02T04:04:05.128 INFO:teuthology.orchestra.run.smithi123.stdout:HOST ADDR LABELS STATUS 2024-06-02T04:04:05.128 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123 172.21.15.123 2024-06-02T04:04:05.128 INFO:teuthology.orchestra.run.smithi123.stdout:smithi136 172.21.15.136 2024-06-02T04:04:05.128 INFO:teuthology.orchestra.run.smithi123.stdout:smithi162 172.21.15.162 2024-06-02T04:04:05.128 INFO:teuthology.orchestra.run.smithi123.stdout:3 hosts in cluster 2024-06-02T04:04:05.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:05.130+0000 7f0d6d175700 1 -- 172.21.15.123:0/3953014433 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0d500a11b0 msgr2=0x7f0d500a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:05.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:05.130+0000 7f0d6d175700 1 --2- 172.21.15.123:0/3953014433 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0d500a11b0 0x7f0d500a3670 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0d580099d0 tx=0x7f0d58008040 comp rx=0 tx=0).stop 2024-06-02T04:04:05.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:05.130+0000 7f0d6d175700 1 -- 172.21.15.123:0/3953014433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d68101000 msgr2=0x7f0d68074cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:05.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:05.130+0000 7f0d6d175700 1 --2- 172.21.15.123:0/3953014433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d68101000 0x7f0d68074cf0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c003820 tx=0x7f0d5c005ad0 comp rx=0 tx=0).stop 2024-06-02T04:04:05.132 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:05.131+0000 7f0d6d175700 1 -- 172.21.15.123:0/3953014433 shutdown_connections 2024-06-02T04:04:05.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:05.131+0000 7f0d6d175700 1 --2- 172.21.15.123:0/3953014433 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d68102ba0 0x7f0d680738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:05.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:05.131+0000 7f0d6d175700 1 --2- 172.21.15.123:0/3953014433 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f0d68101000 0x7f0d68074cf0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:05.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:05.131+0000 7f0d6d175700 1 --2- 172.21.15.123:0/3953014433 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f0d500a11b0 0x7f0d500a3670 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:05.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:05.131+0000 7f0d6d175700 1 --2- 172.21.15.123:0/3953014433 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0d68102200 0x7f0d68073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:05.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:05.131+0000 7f0d6d175700 1 -- 172.21.15.123:0/3953014433 >> 172.21.15.123:0/3953014433 conn(0x7f0d680fc5c0 msgr2=0x7f0d68105670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:05.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:05.131+0000 7f0d6d175700 1 -- 172.21.15.123:0/3953014433 shutdown_connections 2024-06-02T04:04:05.133 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:05.131+0000 7f0d6d175700 1 -- 172.21.15.123:0/3953014433 wait complete. 2024-06-02T04:04:05.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:04 smithi162 ceph-mon[47009]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:04:05.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:04 smithi136 ceph-mon[47443]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:04:05.534 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- bash -c 'ceph orch device ls' 2024-06-02T04:04:05.815 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:04:06.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:05 smithi162 ceph-mon[47009]: pgmap v251: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T04:04:06.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:05 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:04:06.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:05 smithi123 ceph-mon[42885]: pgmap v251: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T04:04:06.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:05 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:04:06.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:05 smithi136 ceph-mon[47443]: pgmap v251: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-06-02T04:04:06.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:05 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:04:07.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.117+0000 7ff9bd650700 1 -- 172.21.15.123:0/2911800203 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9b81043c0 msgr2=0x7ff9b81067b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:07.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.117+0000 7ff9bd650700 1 --2- 172.21.15.123:0/2911800203 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9b81043c0 0x7ff9b81067b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009990 tx=0x7ff9ac009ca0 comp rx=0 tx=0).stop 2024-06-02T04:04:07.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.117+0000 7ff9bd650700 1 -- 172.21.15.123:0/2911800203 shutdown_connections 2024-06-02T04:04:07.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.117+0000 7ff9bd650700 1 --2- 172.21.15.123:0/2911800203 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9b8106cf0 0x7ff9b8109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:07.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.117+0000 7ff9bd650700 1 --2- 172.21.15.123:0/2911800203 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9b8101a90 0x7ff9b8103e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:07.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.117+0000 7ff9bd650700 1 --2- 172.21.15.123:0/2911800203 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9b81043c0 0x7ff9b81067b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:07.118 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.117+0000 7ff9bd650700 1 -- 172.21.15.123:0/2911800203 >> 172.21.15.123:0/2911800203 conn(0x7ff9b80fb4c0 msgr2=0x7ff9b80fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:07.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.117+0000 7ff9bd650700 1 -- 172.21.15.123:0/2911800203 shutdown_connections 2024-06-02T04:04:07.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.117+0000 7ff9bd650700 1 -- 172.21.15.123:0/2911800203 wait complete. 2024-06-02T04:04:07.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.117+0000 7ff9bd650700 1 Processor -- start 2024-06-02T04:04:07.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.118+0000 7ff9bd650700 1 -- start start 2024-06-02T04:04:07.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.118+0000 7ff9bd650700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9b8101a90 0x7ff9b8196f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:07.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.118+0000 7ff9bd650700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9b81043c0 0x7ff9b81974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:07.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.118+0000 7ff9bd650700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9b8106cf0 0x7ff9b819e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:07.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.118+0000 7ff9bd650700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b819eac0 con 0x7ff9b8101a90 2024-06-02T04:04:07.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.118+0000 7ff9bd650700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b819ec00 con 0x7ff9b81043c0 2024-06-02T04:04:07.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.118+0000 7ff9bd650700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b819ed90 con 0x7ff9b8106cf0 2024-06-02T04:04:07.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.118+0000 7ff9b67fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9b81043c0 0x7ff9b81974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:07.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.118+0000 7ff9b77fe700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9b8106cf0 0x7ff9b819e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:07.119 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.118+0000 7ff9b6ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9b8101a90 0x7ff9b8196f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:07.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.118+0000 7ff9b67fc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9b81043c0 0x7ff9b81974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.123:41394/0 (socket says 172.21.15.123:41394) 2024-06-02T04:04:07.120 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.118+0000 7ff9b67fc700 1 -- 172.21.15.123:0/46699668 learned_addr learned my addr 172.21.15.123:0/46699668 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:07.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.118+0000 7ff9b6ffd700 1 -- 172.21.15.123:0/46699668 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9b8106cf0 msgr2=0x7ff9b819e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:07.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.118+0000 7ff9b6ffd700 1 --2- 172.21.15.123:0/46699668 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9b8106cf0 0x7ff9b819e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:07.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.118+0000 7ff9b6ffd700 1 -- 172.21.15.123:0/46699668 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9b81043c0 msgr2=0x7ff9b81974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:07.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.118+0000 7ff9b6ffd700 1 --2- 172.21.15.123:0/46699668 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9b81043c0 0x7ff9b81974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:07.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.118+0000 7ff9b6ffd700 1 -- 172.21.15.123:0/46699668 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac0095f0 con 0x7ff9b8101a90 2024-06-02T04:04:07.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.118+0000 7ff9b67fc700 1 --2- 172.21.15.123:0/46699668 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9b81043c0 0x7ff9b81974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:04:07.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.119+0000 7ff9b6ffd700 1 --2- 172.21.15.123:0/46699668 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9b8101a90 0x7ff9b8196f80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800d980 tx=0x7ff9a800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:07.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.119+0000 7ff99ffff700 1 -- 172.21.15.123:0/46699668 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a800f890 con 0x7ff9b8101a90 2024-06-02T04:04:07.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.119+0000 7ff99ffff700 1 -- 172.21.15.123:0/46699668 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff9a8010460 con 0x7ff9b8101a90 2024-06-02T04:04:07.121 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.119+0000 7ff9bd650700 1 -- 172.21.15.123:0/46699668 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b819f070 con 0x7ff9b8101a90 2024-06-02T04:04:07.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.119+0000 7ff99ffff700 1 -- 172.21.15.123:0/46699668 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a800e610 con 0x7ff9b8101a90 2024-06-02T04:04:07.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.119+0000 7ff9bd650700 1 -- 172.21.15.123:0/46699668 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b819f570 con 0x7ff9b8101a90 2024-06-02T04:04:07.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.120+0000 7ff9bd650700 1 -- 172.21.15.123:0/46699668 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b80fd040 con 0x7ff9b8101a90 2024-06-02T04:04:07.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.122+0000 7ff99ffff700 1 -- 172.21.15.123:0/46699668 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7ff9a8010890 con 0x7ff9b8101a90 2024-06-02T04:04:07.122 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.123+0000 7ff99ffff700 1 --2- 172.21.15.123:0/46699668 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff9a00a11b0 0x7ff9a00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:07.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.123+0000 7ff9b67fc700 1 --2- 172.21.15.123:0/46699668 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff9a00a11b0 0x7ff9a00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:07.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.123+0000 7ff99ffff700 1 -- 172.21.15.123:0/46699668 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff9a80cc2c0 con 0x7ff9b8101a90 2024-06-02T04:04:07.123 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.123+0000 7ff9b67fc700 1 --2- 172.21.15.123:0/46699668 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff9a00a11b0 0x7ff9a00a3670 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac00b5c0 tx=0x7ff9ac003790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:07.125 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.125+0000 7ff99ffff700 1 -- 172.21.15.123:0/46699668 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff9a8095aa0 con 0x7ff9b8101a90 2024-06-02T04:04:07.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:06 smithi162 ceph-mon[47009]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:04:07.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:06 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:04:07.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:06 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:04:07.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:06 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:04:07.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:06 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:04:07.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:06 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-06-02T04:04:07.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:06 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-06-02T04:04:07.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:06 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-06-02T04:04:07.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:06 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-06-02T04:04:07.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:06 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-06-02T04:04:07.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:06 smithi123 ceph-mon[42885]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:04:07.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:06 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:04:07.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:06 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:04:07.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:06 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:04:07.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:06 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:04:07.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:06 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-06-02T04:04:07.326 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:06 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-06-02T04:04:07.326 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:06 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-06-02T04:04:07.326 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:06 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-06-02T04:04:07.326 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:06 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-06-02T04:04:07.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:06 smithi136 ceph-mon[47443]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:04:07.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:06 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:04:07.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:06 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:04:07.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:06 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:04:07.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:06 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:04:07.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:06 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-06-02T04:04:07.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:06 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-06-02T04:04:07.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:06 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-06-02T04:04:07.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:06 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-06-02T04:04:07.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:06 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-06-02T04:04:07.355 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.355+0000 7ff9bd650700 1 -- 172.21.15.123:0/46699668 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9b80613e0 con 0x7ff9a00a11b0 2024-06-02T04:04:07.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.357+0000 7ff99ffff700 1 -- 172.21.15.123:0/46699668 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7ff9b80613e0 con 0x7ff9a00a11b0 2024-06-02T04:04:07.357 INFO:teuthology.orchestra.run.smithi123.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-06-02T04:04:07.357 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400YK400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-06-02T04:04:07.357 INFO:teuthology.orchestra.run.smithi123.stdout:smithi136 /dev/nvme0n1 ssd INTEL_SSDPEDMX020T4_CVPD514100122P0SGN 1863G No 111s ago Has a FileSystem, LVM detected 2024-06-02T04:04:07.357 INFO:teuthology.orchestra.run.smithi123.stdout:smithi162 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300JU400BGN 372G No 94s ago Has a FileSystem, LVM detected 2024-06-02T04:04:07.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.359+0000 7ff9bd650700 1 -- 172.21.15.123:0/46699668 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff9a00a11b0 msgr2=0x7ff9a00a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:07.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.359+0000 7ff9bd650700 1 --2- 172.21.15.123:0/46699668 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff9a00a11b0 0x7ff9a00a3670 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac00b5c0 tx=0x7ff9ac003790 comp rx=0 tx=0).stop 2024-06-02T04:04:07.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.359+0000 7ff9bd650700 1 -- 172.21.15.123:0/46699668 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9b8101a90 msgr2=0x7ff9b8196f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:07.359 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.359+0000 7ff9bd650700 1 --2- 172.21.15.123:0/46699668 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9b8101a90 0x7ff9b8196f80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800d980 tx=0x7ff9a800dc90 comp rx=0 tx=0).stop 2024-06-02T04:04:07.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.359+0000 7ff9bd650700 1 -- 172.21.15.123:0/46699668 shutdown_connections 2024-06-02T04:04:07.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.359+0000 7ff9bd650700 1 --2- 172.21.15.123:0/46699668 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9b8106cf0 0x7ff9b819e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:07.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.359+0000 7ff9bd650700 1 --2- 172.21.15.123:0/46699668 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff9b8101a90 0x7ff9b8196f80 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:07.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.359+0000 7ff9bd650700 1 --2- 172.21.15.123:0/46699668 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff9a00a11b0 0x7ff9a00a3670 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:07.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.359+0000 7ff9bd650700 1 --2- 172.21.15.123:0/46699668 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff9b81043c0 0x7ff9b81974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:07.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.359+0000 7ff9bd650700 1 -- 172.21.15.123:0/46699668 >> 172.21.15.123:0/46699668 conn(0x7ff9b80fb4c0 msgr2=0x7ff9b81024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:07.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.359+0000 7ff9bd650700 1 -- 172.21.15.123:0/46699668 shutdown_connections 2024-06-02T04:04:07.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:07.359+0000 7ff9bd650700 1 -- 172.21.15.123:0/46699668 wait complete. 2024-06-02T04:04:07.709 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-06-02T04:04:07.717 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi123.front.sepia.ceph.com 2024-06-02T04:04:07.717 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- bash -c 'ceph fs dump' 2024-06-02T04:04:07.949 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:04:08.271 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:07 smithi123 ceph-mon[42885]: pgmap v252: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-02T04:04:08.271 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:07 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:04:08.271 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:07 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:04:08.271 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:07 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-06-02T04:04:08.272 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:07 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-06-02T04:04:08.272 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:07 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-06-02T04:04:08.272 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:07 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-06-02T04:04:08.272 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:07 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-06-02T04:04:08.272 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:07 smithi123 ceph-mon[42885]: osdmap e83: 12 total, 12 up, 12 in 2024-06-02T04:04:08.272 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:07 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:04:08.272 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:07 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:04:08.272 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:07 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:04:08.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:07 smithi162 ceph-mon[47009]: pgmap v252: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-02T04:04:08.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:07 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:04:08.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:07 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:04:08.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:07 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-06-02T04:04:08.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:07 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-06-02T04:04:08.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:07 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-06-02T04:04:08.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:07 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-06-02T04:04:08.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:07 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-06-02T04:04:08.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:07 smithi162 ceph-mon[47009]: osdmap e83: 12 total, 12 up, 12 in 2024-06-02T04:04:08.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:07 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:04:08.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:07 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:04:08.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:07 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:04:08.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:07 smithi136 ceph-mon[47443]: pgmap v252: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-06-02T04:04:08.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:07 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:04:08.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:07 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:04:08.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:07 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-06-02T04:04:08.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:07 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-06-02T04:04:08.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:07 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-06-02T04:04:08.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:07 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-06-02T04:04:08.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:07 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-06-02T04:04:08.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:07 smithi136 ceph-mon[47443]: osdmap e83: 12 total, 12 up, 12 in 2024-06-02T04:04:08.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:07 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:04:08.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:07 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:04:08.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:07 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:04:08.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.933+0000 7ff470597700 1 -- 172.21.15.123:0/3615817570 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff468100fe0 msgr2=0x7ff468101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:08.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.933+0000 7ff470597700 1 --2- 172.21.15.123:0/3615817570 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff468100fe0 0x7ff468101400 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff4640099c0 tx=0x7ff464009cd0 comp rx=0 tx=0).stop 2024-06-02T04:04:08.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.933+0000 7ff470597700 1 -- 172.21.15.123:0/3615817570 shutdown_connections 2024-06-02T04:04:08.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.933+0000 7ff470597700 1 --2- 172.21.15.123:0/3615817570 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff468102b80 0x7ff468109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:08.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.933+0000 7ff470597700 1 --2- 172.21.15.123:0/3615817570 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff468100fe0 0x7ff468101400 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:08.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.933+0000 7ff470597700 1 --2- 172.21.15.123:0/3615817570 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4681021e0 0x7ff468102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:08.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.933+0000 7ff470597700 1 -- 172.21.15.123:0/3615817570 >> 172.21.15.123:0/3615817570 conn(0x7ff4680fc580 msgr2=0x7ff4680fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:08.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.933+0000 7ff470597700 1 -- 172.21.15.123:0/3615817570 shutdown_connections 2024-06-02T04:04:08.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.933+0000 7ff470597700 1 -- 172.21.15.123:0/3615817570 wait complete. 2024-06-02T04:04:08.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.933+0000 7ff470597700 1 Processor -- start 2024-06-02T04:04:08.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.933+0000 7ff470597700 1 -- start start 2024-06-02T04:04:08.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.934+0000 7ff470597700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff468100fe0 0x7ff468196f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:08.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.934+0000 7ff470597700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4681021e0 0x7ff468197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:08.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.934+0000 7ff470597700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff468102b80 0x7ff46819e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:08.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.934+0000 7ff470597700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46819ea40 con 0x7ff4681021e0 2024-06-02T04:04:08.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.934+0000 7ff470597700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46819eb80 con 0x7ff468100fe0 2024-06-02T04:04:08.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.934+0000 7ff470597700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46819ed10 con 0x7ff468102b80 2024-06-02T04:04:08.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.934+0000 7ff46db32700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4681021e0 0x7ff468197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:08.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.934+0000 7ff46db32700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4681021e0 0x7ff468197440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33330/0 (socket says 172.21.15.123:33330) 2024-06-02T04:04:08.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.934+0000 7ff46db32700 1 -- 172.21.15.123:0/1527926341 learned_addr learned my addr 172.21.15.123:0/1527926341 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:08.937 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.934+0000 7ff46e333700 1 --2- 172.21.15.123:0/1527926341 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff468100fe0 0x7ff468196f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:08.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.934+0000 7ff46eb34700 1 --2- 172.21.15.123:0/1527926341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff468102b80 0x7ff46819e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:08.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.934+0000 7ff46db32700 1 -- 172.21.15.123:0/1527926341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff468102b80 msgr2=0x7ff46819e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:08.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.934+0000 7ff46db32700 1 --2- 172.21.15.123:0/1527926341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff468102b80 0x7ff46819e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:08.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.934+0000 7ff46db32700 1 -- 172.21.15.123:0/1527926341 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff468100fe0 msgr2=0x7ff468196f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:08.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.934+0000 7ff46db32700 1 --2- 172.21.15.123:0/1527926341 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff468100fe0 0x7ff468196f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:08.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.934+0000 7ff46db32700 1 -- 172.21.15.123:0/1527926341 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4640095f0 con 0x7ff4681021e0 2024-06-02T04:04:08.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.934+0000 7ff46e333700 1 --2- 172.21.15.123:0/1527926341 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff468100fe0 0x7ff468196f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:04:08.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.934+0000 7ff46db32700 1 --2- 172.21.15.123:0/1527926341 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4681021e0 0x7ff468197440 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff45800d980 tx=0x7ff45800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:08.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.934+0000 7ff45f7fe700 1 -- 172.21.15.123:0/1527926341 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff458009b40 con 0x7ff4681021e0 2024-06-02T04:04:08.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.935+0000 7ff45f7fe700 1 -- 172.21.15.123:0/1527926341 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff45800b6e0 con 0x7ff4681021e0 2024-06-02T04:04:08.938 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.935+0000 7ff470597700 1 -- 172.21.15.123:0/1527926341 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff46819eff0 con 0x7ff4681021e0 2024-06-02T04:04:08.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.935+0000 7ff45f7fe700 1 -- 172.21.15.123:0/1527926341 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45800f620 con 0x7ff4681021e0 2024-06-02T04:04:08.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.935+0000 7ff470597700 1 -- 172.21.15.123:0/1527926341 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff46819f4b0 con 0x7ff4681021e0 2024-06-02T04:04:08.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.935+0000 7ff470597700 1 -- 172.21.15.123:0/1527926341 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff468108560 con 0x7ff4681021e0 2024-06-02T04:04:08.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.937+0000 7ff45f7fe700 1 -- 172.21.15.123:0/1527926341 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7ff458010460 con 0x7ff4681021e0 2024-06-02T04:04:08.939 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.937+0000 7ff45f7fe700 1 --2- 172.21.15.123:0/1527926341 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff4540a1230 0x7ff4540a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:08.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.937+0000 7ff46e333700 1 --2- 172.21.15.123:0/1527926341 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff4540a1230 0x7ff4540a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:08.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.937+0000 7ff45f7fe700 1 -- 172.21.15.123:0/1527926341 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7ff4580cc770 con 0x7ff4681021e0 2024-06-02T04:04:08.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.937+0000 7ff46e333700 1 --2- 172.21.15.123:0/1527926341 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff4540a1230 0x7ff4540a36f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff464006010 tx=0x7ff464009530 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:08.940 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:08.940+0000 7ff45f7fe700 1 -- 172.21.15.123:0/1527926341 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff458095ec0 con 0x7ff4681021e0 2024-06-02T04:04:09.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:09.181+0000 7ff470597700 1 -- 172.21.15.123:0/1527926341 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff46810c7e0 con 0x7ff4681021e0 2024-06-02T04:04:09.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:09.181+0000 7ff45f7fe700 1 -- 172.21.15.123:0/1527926341 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) v1 ==== 76+0+2935 (secure 0 0 0) 0x7ff458020070 con 0x7ff4681021e0 2024-06-02T04:04:09.181 INFO:teuthology.orchestra.run.smithi123.stdout:e27 2024-06-02T04:04:09.181 INFO:teuthology.orchestra.run.smithi123.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-06-02T04:04:09.181 INFO:teuthology.orchestra.run.smithi123.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T04:04:09.182 INFO:teuthology.orchestra.run.smithi123.stdout:legacy client fscid: 1 2024-06-02T04:04:09.182 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:09.182 INFO:teuthology.orchestra.run.smithi123.stdout:Filesystem 'cephfs' (1) 2024-06-02T04:04:09.182 INFO:teuthology.orchestra.run.smithi123.stdout:fs_name cephfs 2024-06-02T04:04:09.182 INFO:teuthology.orchestra.run.smithi123.stdout:epoch 27 2024-06-02T04:04:09.182 INFO:teuthology.orchestra.run.smithi123.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-06-02T04:04:09.182 INFO:teuthology.orchestra.run.smithi123.stdout:created 2024-06-02T04:03:06.667888+0000 2024-06-02T04:04:09.182 INFO:teuthology.orchestra.run.smithi123.stdout:modified 2024-06-02T04:03:13.099282+0000 2024-06-02T04:04:09.182 INFO:teuthology.orchestra.run.smithi123.stdout:tableserver 0 2024-06-02T04:04:09.182 INFO:teuthology.orchestra.run.smithi123.stdout:root 0 2024-06-02T04:04:09.182 INFO:teuthology.orchestra.run.smithi123.stdout:session_timeout 300 2024-06-02T04:04:09.182 INFO:teuthology.orchestra.run.smithi123.stdout:session_autoclose 300 2024-06-02T04:04:09.183 INFO:teuthology.orchestra.run.smithi123.stdout:max_file_size 1099511627776 2024-06-02T04:04:09.183 INFO:teuthology.orchestra.run.smithi123.stdout:max_xattr_size 65536 2024-06-02T04:04:09.183 INFO:teuthology.orchestra.run.smithi123.stdout:required_client_features {} 2024-06-02T04:04:09.183 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure 0 2024-06-02T04:04:09.183 INFO:teuthology.orchestra.run.smithi123.stdout:last_failure_osd_epoch 0 2024-06-02T04:04:09.183 INFO:teuthology.orchestra.run.smithi123.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-06-02T04:04:09.183 INFO:teuthology.orchestra.run.smithi123.stdout:max_mds 5 2024-06-02T04:04:09.183 INFO:teuthology.orchestra.run.smithi123.stdout:in 0,1,2,3,4 2024-06-02T04:04:09.183 INFO:teuthology.orchestra.run.smithi123.stdout:up {0=24509,1=24490,2=24473,3=24439,4=24437} 2024-06-02T04:04:09.183 INFO:teuthology.orchestra.run.smithi123.stdout:failed 2024-06-02T04:04:09.183 INFO:teuthology.orchestra.run.smithi123.stdout:damaged 2024-06-02T04:04:09.183 INFO:teuthology.orchestra.run.smithi123.stdout:stopped 2024-06-02T04:04:09.184 INFO:teuthology.orchestra.run.smithi123.stdout:data_pools [3] 2024-06-02T04:04:09.184 INFO:teuthology.orchestra.run.smithi123.stdout:metadata_pool 2 2024-06-02T04:04:09.184 INFO:teuthology.orchestra.run.smithi123.stdout:inline_data disabled 2024-06-02T04:04:09.184 INFO:teuthology.orchestra.run.smithi123.stdout:balancer 2024-06-02T04:04:09.184 INFO:teuthology.orchestra.run.smithi123.stdout:bal_rank_mask -1 2024-06-02T04:04:09.184 INFO:teuthology.orchestra.run.smithi123.stdout:standby_count_wanted 0 2024-06-02T04:04:09.184 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.b{0:24509} state up:active seq 3 addr [v2:172.21.15.136:6838/952830191,v1:172.21.15.136:6839/952830191] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T04:04:09.184 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.c{0:24469} state up:standby-replay seq 1 addr [v2:172.21.15.162:6836/3402138468,v1:172.21.15.162:6837/3402138468] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T04:04:09.184 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.i{1:24490} state up:active seq 5 addr [v2:172.21.15.162:6838/2588884232,v1:172.21.15.162:6839/2588884232] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T04:04:09.184 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.f{1:24463} state up:standby-replay seq 1 addr [v2:172.21.15.162:6834/2478943987,v1:172.21.15.162:6835/2478943987] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T04:04:09.184 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.h{2:24473} state up:active seq 5 addr [v2:172.21.15.136:6836/2572418263,v1:172.21.15.136:6837/2572418263] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T04:04:09.184 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.e{2:24455} state up:standby-replay seq 1 addr [v2:172.21.15.136:6834/2894031422,v1:172.21.15.136:6835/2894031422] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T04:04:09.184 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.l{3:24439} state up:active seq 9 addr [v2:172.21.15.162:6832/3583622784,v1:172.21.15.162:6833/3583622784] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T04:04:09.185 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.a{3:14619} state up:standby-replay seq 1 addr [v2:172.21.15.123:6840/4032992994,v1:172.21.15.123:6841/4032992994] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T04:04:09.185 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.k{4:24437} state up:active seq 9 addr [v2:172.21.15.136:6832/2006585076,v1:172.21.15.136:6833/2006585076] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T04:04:09.185 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.g{4:14613} state up:standby-replay seq 1 addr [v2:172.21.15.123:6838/3806973328,v1:172.21.15.123:6839/3806973328] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T04:04:09.185 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:09.185 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:09.185 INFO:teuthology.orchestra.run.smithi123.stdout:Standby daemons: 2024-06-02T04:04:09.185 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:09.185 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.j{-1:14553} state up:standby seq 1 addr [v2:172.21.15.123:6834/1940848601,v1:172.21.15.123:6835/1940848601] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T04:04:09.185 INFO:teuthology.orchestra.run.smithi123.stdout:[mds.d{-1:14565} state up:standby seq 1 addr [v2:172.21.15.123:6836/54447879,v1:172.21.15.123:6837/54447879] compat {c=[1],r=[1],i=[7ff]}] 2024-06-02T04:04:09.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:09.183+0000 7ff470597700 1 -- 172.21.15.123:0/1527926341 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff4540a1230 msgr2=0x7ff4540a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:09.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:09.183+0000 7ff470597700 1 --2- 172.21.15.123:0/1527926341 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff4540a1230 0x7ff4540a36f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff464006010 tx=0x7ff464009530 comp rx=0 tx=0).stop 2024-06-02T04:04:09.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:09.183+0000 7ff470597700 1 -- 172.21.15.123:0/1527926341 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4681021e0 msgr2=0x7ff468197440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:09.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:09.183+0000 7ff470597700 1 --2- 172.21.15.123:0/1527926341 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4681021e0 0x7ff468197440 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff45800d980 tx=0x7ff45800dd40 comp rx=0 tx=0).stop 2024-06-02T04:04:09.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:09.183+0000 7ff470597700 1 -- 172.21.15.123:0/1527926341 shutdown_connections 2024-06-02T04:04:09.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:09.183+0000 7ff470597700 1 --2- 172.21.15.123:0/1527926341 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff468102b80 0x7ff46819e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:09.186 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:09.183+0000 7ff470597700 1 --2- 172.21.15.123:0/1527926341 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff4540a1230 0x7ff4540a36f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:09.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:09.183+0000 7ff470597700 1 --2- 172.21.15.123:0/1527926341 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff468100fe0 0x7ff468196f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:09.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:09.183+0000 7ff470597700 1 --2- 172.21.15.123:0/1527926341 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff4681021e0 0x7ff468197440 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:09.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:09.183+0000 7ff470597700 1 -- 172.21.15.123:0/1527926341 >> 172.21.15.123:0/1527926341 conn(0x7ff4680fc580 msgr2=0x7ff4681056a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:09.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:09.184+0000 7ff470597700 1 -- 172.21.15.123:0/1527926341 shutdown_connections 2024-06-02T04:04:09.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:09.184+0000 7ff470597700 1 -- 172.21.15.123:0/1527926341 wait complete. 2024-06-02T04:04:09.187 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 27 2024-06-02T04:04:09.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:08 smithi162 ceph-mon[47009]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:04:09.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:08 smithi162 ceph-mon[47009]: osdmap e84: 12 total, 12 up, 12 in 2024-06-02T04:04:09.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:08 smithi123 ceph-mon[42885]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:04:09.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:08 smithi123 ceph-mon[42885]: osdmap e84: 12 total, 12 up, 12 in 2024-06-02T04:04:09.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:08 smithi136 ceph-mon[47443]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:04:09.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:08 smithi136 ceph-mon[47443]: osdmap e84: 12 total, 12 up, 12 in 2024-06-02T04:04:09.559 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- bash -c 'ceph osd dump' 2024-06-02T04:04:09.783 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:04:10.246 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:09 smithi123 ceph-mon[42885]: pgmap v255: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-06-02T04:04:10.246 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:09 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1527926341' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T04:04:10.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:09 smithi162 ceph-mon[47009]: pgmap v255: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-06-02T04:04:10.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:09 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/1527926341' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T04:04:10.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:09 smithi136 ceph-mon[47443]: pgmap v255: 97 pgs: 97 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-06-02T04:04:10.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:09 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/1527926341' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-06-02T04:04:10.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.831+0000 7f6ac9d1e700 1 -- 172.21.15.123:0/3963788008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ac4101060 msgr2=0x7f6ac41014e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:10.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.831+0000 7f6ac9d1e700 1 --2- 172.21.15.123:0/3963788008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ac4101060 0x7f6ac41014e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4009990 tx=0x7f6ab4009ca0 comp rx=0 tx=0).stop 2024-06-02T04:04:10.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.831+0000 7f6ac9d1e700 1 -- 172.21.15.123:0/3963788008 shutdown_connections 2024-06-02T04:04:10.833 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.831+0000 7f6ac9d1e700 1 --2- 172.21.15.123:0/3963788008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ac4101a20 0x7f6ac4108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:10.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.831+0000 7f6ac9d1e700 1 --2- 172.21.15.123:0/3963788008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ac40fff00 0x7f6ac4100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:10.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.831+0000 7f6ac9d1e700 1 --2- 172.21.15.123:0/3963788008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ac4101060 0x7f6ac41014e0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:10.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.831+0000 7f6ac9d1e700 1 -- 172.21.15.123:0/3963788008 >> 172.21.15.123:0/3963788008 conn(0x7f6ac40fb4a0 msgr2=0x7f6ac40fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:10.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.831+0000 7f6ac9d1e700 1 -- 172.21.15.123:0/3963788008 shutdown_connections 2024-06-02T04:04:10.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.831+0000 7f6ac9d1e700 1 -- 172.21.15.123:0/3963788008 wait complete. 2024-06-02T04:04:10.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.832+0000 7f6ac9d1e700 1 Processor -- start 2024-06-02T04:04:10.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.832+0000 7f6ac9d1e700 1 -- start start 2024-06-02T04:04:10.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.832+0000 7f6ac9d1e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ac40fff00 0x7f6ac4197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:10.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.832+0000 7f6ac9d1e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ac4101060 0x7f6ac4197560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:10.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.832+0000 7f6ac9d1e700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ac4101a20 0x7f6ac419e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:10.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.832+0000 7f6ac9d1e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac419eb60 con 0x7f6ac40fff00 2024-06-02T04:04:10.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.832+0000 7f6ac9d1e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac419eca0 con 0x7f6ac4101060 2024-06-02T04:04:10.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.832+0000 7f6ac9d1e700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac419ee30 con 0x7f6ac4101a20 2024-06-02T04:04:10.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.832+0000 7f6ac37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ac40fff00 0x7f6ac4197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:10.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.832+0000 7f6ac37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ac40fff00 0x7f6ac4197020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33352/0 (socket says 172.21.15.123:33352) 2024-06-02T04:04:10.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.832+0000 7f6ac37fe700 1 -- 172.21.15.123:0/1831387733 learned_addr learned my addr 172.21.15.123:0/1831387733 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:10.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.833+0000 7f6ac3fff700 1 --2- 172.21.15.123:0/1831387733 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ac4101a20 0x7f6ac419e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:10.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.833+0000 7f6ac2ffd700 1 --2- 172.21.15.123:0/1831387733 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ac4101060 0x7f6ac4197560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:10.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.833+0000 7f6ac37fe700 1 -- 172.21.15.123:0/1831387733 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ac4101a20 msgr2=0x7f6ac419e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:10.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.833+0000 7f6ac37fe700 1 --2- 172.21.15.123:0/1831387733 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ac4101a20 0x7f6ac419e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:10.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.833+0000 7f6ac37fe700 1 -- 172.21.15.123:0/1831387733 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ac4101060 msgr2=0x7f6ac4197560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:10.835 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.833+0000 7f6ac37fe700 1 --2- 172.21.15.123:0/1831387733 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ac4101060 0x7f6ac4197560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:10.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.833+0000 7f6ac37fe700 1 -- 172.21.15.123:0/1831387733 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab40095f0 con 0x7f6ac40fff00 2024-06-02T04:04:10.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.833+0000 7f6ac2ffd700 1 --2- 172.21.15.123:0/1831387733 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ac4101060 0x7f6ac4197560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:04:10.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.833+0000 7f6ac3fff700 1 --2- 172.21.15.123:0/1831387733 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ac4101a20 0x7f6ac419e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:04:10.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.833+0000 7f6ac37fe700 1 --2- 172.21.15.123:0/1831387733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ac40fff00 0x7f6ac4197020 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6ab800b560 tx=0x7f6ab800b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:10.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.833+0000 7f6ac0ff9700 1 -- 172.21.15.123:0/1831387733 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab8011830 con 0x7f6ac40fff00 2024-06-02T04:04:10.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.833+0000 7f6ac0ff9700 1 -- 172.21.15.123:0/1831387733 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ab8011e50 con 0x7f6ac40fff00 2024-06-02T04:04:10.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.833+0000 7f6ac9d1e700 1 -- 172.21.15.123:0/1831387733 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ac419f110 con 0x7f6ac40fff00 2024-06-02T04:04:10.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.833+0000 7f6ac0ff9700 1 -- 172.21.15.123:0/1831387733 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab800f2e0 con 0x7f6ac40fff00 2024-06-02T04:04:10.836 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.833+0000 7f6ac9d1e700 1 -- 172.21.15.123:0/1831387733 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac419f690 con 0x7f6ac40fff00 2024-06-02T04:04:10.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.834+0000 7f6ac9d1e700 1 -- 172.21.15.123:0/1831387733 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ac404ec60 con 0x7f6ac40fff00 2024-06-02T04:04:10.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.835+0000 7f6ac0ff9700 1 -- 172.21.15.123:0/1831387733 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f6ab8011990 con 0x7f6ac40fff00 2024-06-02T04:04:10.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.836+0000 7f6ac0ff9700 1 --2- 172.21.15.123:0/1831387733 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f6aac0a11b0 0x7f6aac0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:10.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.836+0000 7f6ac2ffd700 1 --2- 172.21.15.123:0/1831387733 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f6aac0a11b0 0x7f6aac0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:10.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.836+0000 7f6ac0ff9700 1 -- 172.21.15.123:0/1831387733 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f6ab80cc8d0 con 0x7f6ac40fff00 2024-06-02T04:04:10.837 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.836+0000 7f6ac2ffd700 1 --2- 172.21.15.123:0/1831387733 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f6aac0a11b0 0x7f6aac0a3670 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4000c00 tx=0x7f6ab4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:10.839 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:10.839+0000 7f6ac0ff9700 1 -- 172.21.15.123:0/1831387733 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6ab8096130 con 0x7f6ac40fff00 2024-06-02T04:04:11.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.034+0000 7f6ac9d1e700 1 -- 172.21.15.123:0/1831387733 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f6ac410b810 con 0x7f6ac40fff00 2024-06-02T04:04:11.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.035+0000 7f6ac0ff9700 1 -- 172.21.15.123:0/1831387733 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v84) v1 ==== 56+0+5229 (secure 0 0 0) 0x7f6ab8010ed0 con 0x7f6ac40fff00 2024-06-02T04:04:11.035 INFO:teuthology.orchestra.run.smithi123.stdout:epoch 84 2024-06-02T04:04:11.035 INFO:teuthology.orchestra.run.smithi123.stdout:fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 2024-06-02T04:04:11.035 INFO:teuthology.orchestra.run.smithi123.stdout:created 2024-06-02T03:57:17.383774+0000 2024-06-02T04:04:11.035 INFO:teuthology.orchestra.run.smithi123.stdout:modified 2024-06-02T04:04:08.620765+0000 2024-06-02T04:04:11.035 INFO:teuthology.orchestra.run.smithi123.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-06-02T04:04:11.035 INFO:teuthology.orchestra.run.smithi123.stdout:crush_version 26 2024-06-02T04:04:11.035 INFO:teuthology.orchestra.run.smithi123.stdout:full_ratio 0.95 2024-06-02T04:04:11.035 INFO:teuthology.orchestra.run.smithi123.stdout:backfillfull_ratio 0.9 2024-06-02T04:04:11.035 INFO:teuthology.orchestra.run.smithi123.stdout:nearfull_ratio 0.85 2024-06-02T04:04:11.036 INFO:teuthology.orchestra.run.smithi123.stdout:require_min_compat_client luminous 2024-06-02T04:04:11.036 INFO:teuthology.orchestra.run.smithi123.stdout:min_compat_client luminous 2024-06-02T04:04:11.036 INFO:teuthology.orchestra.run.smithi123.stdout:require_osd_release reef 2024-06-02T04:04:11.036 INFO:teuthology.orchestra.run.smithi123.stdout:stretch_mode_enabled false 2024-06-02T04:04:11.036 INFO:teuthology.orchestra.run.smithi123.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-06-02T04:04:11.036 INFO:teuthology.orchestra.run.smithi123.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-06-02T04:04:11.036 INFO:teuthology.orchestra.run.smithi123.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-06-02T04:04:11.036 INFO:teuthology.orchestra.run.smithi123.stdout:max_osd 12 2024-06-02T04:04:11.036 INFO:teuthology.orchestra.run.smithi123.stdout:osd.0 up in weight 1 up_from 8 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.123:6802/2763421276,v1:172.21.15.123:6803/2763421276] [v2:172.21.15.123:6804/2763421276,v1:172.21.15.123:6805/2763421276] exists,up d9d8fb5a-dac5-4b14-98e5-665bdbc696ff 2024-06-02T04:04:11.036 INFO:teuthology.orchestra.run.smithi123.stdout:osd.1 up in weight 1 up_from 13 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.136:6800/956325510,v1:172.21.15.136:6801/956325510] [v2:172.21.15.136:6802/956325510,v1:172.21.15.136:6803/956325510] exists,up 121bbe3c-bb76-4ec4-9596-37db68fbf1ea 2024-06-02T04:04:11.036 INFO:teuthology.orchestra.run.smithi123.stdout:osd.2 up in weight 1 up_from 18 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6800/2915749676,v1:172.21.15.162:6801/2915749676] [v2:172.21.15.162:6802/2915749676,v1:172.21.15.162:6803/2915749676] exists,up df9edf0d-f9f0-4699-a6ed-bbcf2dfb1b76 2024-06-02T04:04:11.036 INFO:teuthology.orchestra.run.smithi123.stdout:osd.3 up in weight 1 up_from 25 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.123:6810/1403773143,v1:172.21.15.123:6811/1403773143] [v2:172.21.15.123:6812/1403773143,v1:172.21.15.123:6813/1403773143] exists,up 3e070364-12c6-4780-b2be-f6e933e65773 2024-06-02T04:04:11.037 INFO:teuthology.orchestra.run.smithi123.stdout:osd.4 up in weight 1 up_from 32 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.136:6808/1403526782,v1:172.21.15.136:6809/1403526782] [v2:172.21.15.136:6810/1403526782,v1:172.21.15.136:6811/1403526782] exists,up 87dd92dd-73c8-4785-bf8a-3756d79dee90 2024-06-02T04:04:11.037 INFO:teuthology.orchestra.run.smithi123.stdout:osd.5 up in weight 1 up_from 37 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6808/3094256489,v1:172.21.15.162:6809/3094256489] [v2:172.21.15.162:6810/3094256489,v1:172.21.15.162:6811/3094256489] exists,up 1a730863-6b56-43b7-a115-c80d3c8f3ee3 2024-06-02T04:04:11.037 INFO:teuthology.orchestra.run.smithi123.stdout:osd.6 up in weight 1 up_from 44 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.123:6818/3025820432,v1:172.21.15.123:6819/3025820432] [v2:172.21.15.123:6820/3025820432,v1:172.21.15.123:6821/3025820432] exists,up 6f170b85-6c47-49ff-ba5b-7fe0596a4ce6 2024-06-02T04:04:11.037 INFO:teuthology.orchestra.run.smithi123.stdout:osd.7 up in weight 1 up_from 49 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.136:6816/1948829505,v1:172.21.15.136:6817/1948829505] [v2:172.21.15.136:6818/1948829505,v1:172.21.15.136:6819/1948829505] exists,up ee66bb7a-6c0d-4e5a-b717-258a39f93a87 2024-06-02T04:04:11.037 INFO:teuthology.orchestra.run.smithi123.stdout:osd.8 up in weight 1 up_from 57 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6816/1590839230,v1:172.21.15.162:6817/1590839230] [v2:172.21.15.162:6818/1590839230,v1:172.21.15.162:6819/1590839230] exists,up 0ff77e33-53a5-43ef-85da-2036a1fcdb09 2024-06-02T04:04:11.037 INFO:teuthology.orchestra.run.smithi123.stdout:osd.9 up in weight 1 up_from 64 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.123:6826/608720685,v1:172.21.15.123:6827/608720685] [v2:172.21.15.123:6828/608720685,v1:172.21.15.123:6829/608720685] exists,up 1670731c-5e8f-4cbc-8f35-6aeb14ea3075 2024-06-02T04:04:11.037 INFO:teuthology.orchestra.run.smithi123.stdout:osd.10 up in weight 1 up_from 70 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.136:6824/3777263126,v1:172.21.15.136:6825/3777263126] [v2:172.21.15.136:6826/3777263126,v1:172.21.15.136:6827/3777263126] exists,up ae138b96-13e7-46ac-9d4d-48308132465d 2024-06-02T04:04:11.037 INFO:teuthology.orchestra.run.smithi123.stdout:osd.11 up in weight 1 up_from 77 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.162:6824/704809754,v1:172.21.15.162:6825/704809754] [v2:172.21.15.162:6826/704809754,v1:172.21.15.162:6827/704809754] exists,up 69f4ede0-7e9b-4edb-be54-01f74f002a06 2024-06-02T04:04:11.037 INFO:teuthology.orchestra.run.smithi123.stdout:pg_upmap_items 2.8 [2,11] 2024-06-02T04:04:11.037 INFO:teuthology.orchestra.run.smithi123.stdout:pg_upmap_items 2.1d [8,11] 2024-06-02T04:04:11.037 INFO:teuthology.orchestra.run.smithi123.stdout:pg_upmap_items 3.1 [4,9] 2024-06-02T04:04:11.037 INFO:teuthology.orchestra.run.smithi123.stdout:pg_upmap_items 3.10 [5,9] 2024-06-02T04:04:11.037 INFO:teuthology.orchestra.run.smithi123.stdout:pg_upmap_items 3.24 [4,9] 2024-06-02T04:04:11.038 INFO:teuthology.orchestra.run.smithi123.stdout:blocklist 172.21.15.123:0/69783025 expires 2024-06-03T03:58:06.766197+0000 2024-06-02T04:04:11.038 INFO:teuthology.orchestra.run.smithi123.stdout:blocklist 172.21.15.123:6801/3555101542 expires 2024-06-03T03:58:06.766197+0000 2024-06-02T04:04:11.038 INFO:teuthology.orchestra.run.smithi123.stdout:blocklist 172.21.15.123:6801/3442784869 expires 2024-06-03T03:57:45.611046+0000 2024-06-02T04:04:11.038 INFO:teuthology.orchestra.run.smithi123.stdout:blocklist 172.21.15.123:6800/3442784869 expires 2024-06-03T03:57:45.611046+0000 2024-06-02T04:04:11.038 INFO:teuthology.orchestra.run.smithi123.stdout:blocklist 172.21.15.123:0/10165744 expires 2024-06-03T03:58:06.766197+0000 2024-06-02T04:04:11.038 INFO:teuthology.orchestra.run.smithi123.stdout:blocklist 172.21.15.123:0/2081407856 expires 2024-06-03T03:58:06.766197+0000 2024-06-02T04:04:11.038 INFO:teuthology.orchestra.run.smithi123.stdout:blocklist 172.21.15.123:0/4026642298 expires 2024-06-03T03:57:45.611046+0000 2024-06-02T04:04:11.038 INFO:teuthology.orchestra.run.smithi123.stdout:blocklist 172.21.15.123:6800/3555101542 expires 2024-06-03T03:58:06.766197+0000 2024-06-02T04:04:11.038 INFO:teuthology.orchestra.run.smithi123.stdout:blocklist 172.21.15.123:0/1442330765 expires 2024-06-03T03:57:45.611046+0000 2024-06-02T04:04:11.038 INFO:teuthology.orchestra.run.smithi123.stdout:blocklist 172.21.15.123:0/1595718606 expires 2024-06-03T03:57:45.611046+0000 2024-06-02T04:04:11.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.037+0000 7f6ac9d1e700 1 -- 172.21.15.123:0/1831387733 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f6aac0a11b0 msgr2=0x7f6aac0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:11.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.037+0000 7f6ac9d1e700 1 --2- 172.21.15.123:0/1831387733 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f6aac0a11b0 0x7f6aac0a3670 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4000c00 tx=0x7f6ab4005fb0 comp rx=0 tx=0).stop 2024-06-02T04:04:11.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.037+0000 7f6ac9d1e700 1 -- 172.21.15.123:0/1831387733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ac40fff00 msgr2=0x7f6ac4197020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:11.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.037+0000 7f6ac9d1e700 1 --2- 172.21.15.123:0/1831387733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ac40fff00 0x7f6ac4197020 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6ab800b560 tx=0x7f6ab800b920 comp rx=0 tx=0).stop 2024-06-02T04:04:11.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.037+0000 7f6ac9d1e700 1 -- 172.21.15.123:0/1831387733 shutdown_connections 2024-06-02T04:04:11.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.037+0000 7f6ac9d1e700 1 --2- 172.21.15.123:0/1831387733 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ac4101a20 0x7f6ac419e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:11.039 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.037+0000 7f6ac9d1e700 1 --2- 172.21.15.123:0/1831387733 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ac40fff00 0x7f6ac4197020 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:11.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.037+0000 7f6ac9d1e700 1 --2- 172.21.15.123:0/1831387733 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f6aac0a11b0 0x7f6aac0a3670 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:11.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.037+0000 7f6ac9d1e700 1 --2- 172.21.15.123:0/1831387733 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ac4101060 0x7f6ac4197560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:11.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.037+0000 7f6ac9d1e700 1 -- 172.21.15.123:0/1831387733 >> 172.21.15.123:0/1831387733 conn(0x7f6ac40fb4a0 msgr2=0x7f6ac40fcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:11.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.037+0000 7f6ac9d1e700 1 -- 172.21.15.123:0/1831387733 shutdown_connections 2024-06-02T04:04:11.040 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.037+0000 7f6ac9d1e700 1 -- 172.21.15.123:0/1831387733 wait complete. 2024-06-02T04:04:11.459 INFO:teuthology.run_tasks:Running task fs.ready... 2024-06-02T04:04:11.469 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:04:11.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.596+0000 7f63d7165700 1 -- 172.21.15.123:0/1467394563 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63d00ffd90 msgr2=0x7f63d01001b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:11.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.596+0000 7f63d7165700 1 --2- 172.21.15.123:0/1467394563 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63d00ffd90 0x7f63d01001b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f63c800b0d0 tx=0x7f63c800b3e0 comp rx=0 tx=0).stop 2024-06-02T04:04:11.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.596+0000 7f63d7165700 1 -- 172.21.15.123:0/1467394563 shutdown_connections 2024-06-02T04:04:11.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.596+0000 7f63d7165700 1 --2- 172.21.15.123:0/1467394563 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63d0101920 0x7f63d01081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:11.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.596+0000 7f63d7165700 1 --2- 172.21.15.123:0/1467394563 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63d00ffd90 0x7f63d01001b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:11.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.596+0000 7f63d7165700 1 --2- 172.21.15.123:0/1467394563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63d0100f80 0x7f63d01013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:11.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.596+0000 7f63d7165700 1 -- 172.21.15.123:0/1467394563 >> 172.21.15.123:0/1467394563 conn(0x7f63d00fb320 msgr2=0x7f63d00fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:11.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.596+0000 7f63d7165700 1 -- 172.21.15.123:0/1467394563 shutdown_connections 2024-06-02T04:04:11.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.596+0000 7f63d7165700 1 -- 172.21.15.123:0/1467394563 wait complete. 2024-06-02T04:04:11.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.597+0000 7f63d7165700 1 Processor -- start 2024-06-02T04:04:11.599 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.597+0000 7f63d7165700 1 -- start start 2024-06-02T04:04:11.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.597+0000 7f63d7165700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63d00ffd90 0x7f63d0196fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:11.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.597+0000 7f63d7165700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63d0100f80 0x7f63d0197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:11.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.597+0000 7f63d7165700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63d0101920 0x7f63d019e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:11.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.597+0000 7f63d7165700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d019eb10 con 0x7f63d00ffd90 2024-06-02T04:04:11.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.597+0000 7f63d7165700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d019ec50 con 0x7f63d0101920 2024-06-02T04:04:11.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.597+0000 7f63d7165700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d019ede0 con 0x7f63d0100f80 2024-06-02T04:04:11.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.597+0000 7f63d4f01700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63d00ffd90 0x7f63d0196fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:11.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.597+0000 7f63d4f01700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63d00ffd90 0x7f63d0196fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33364/0 (socket says 172.21.15.123:33364) 2024-06-02T04:04:11.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.597+0000 7f63d4f01700 1 -- 172.21.15.123:0/2735073258 learned_addr learned my addr 172.21.15.123:0/2735073258 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:11.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.597+0000 7f63d5702700 1 --2- 172.21.15.123:0/2735073258 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63d0101920 0x7f63d019e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:11.600 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.598+0000 7f63d4f01700 1 -- 172.21.15.123:0/2735073258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63d0100f80 msgr2=0x7f63d0197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:11.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.598+0000 7f63cffff700 1 --2- 172.21.15.123:0/2735073258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63d0100f80 0x7f63d0197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:11.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.598+0000 7f63d4f01700 1 --2- 172.21.15.123:0/2735073258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63d0100f80 0x7f63d0197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:11.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.598+0000 7f63d4f01700 1 -- 172.21.15.123:0/2735073258 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63d0101920 msgr2=0x7f63d019e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:11.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.598+0000 7f63d4f01700 1 --2- 172.21.15.123:0/2735073258 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63d0101920 0x7f63d019e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:11.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.598+0000 7f63d4f01700 1 -- 172.21.15.123:0/2735073258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c8009d00 con 0x7f63d00ffd90 2024-06-02T04:04:11.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.598+0000 7f63cffff700 1 --2- 172.21.15.123:0/2735073258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63d0100f80 0x7f63d0197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:04:11.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.598+0000 7f63d4f01700 1 --2- 172.21.15.123:0/2735073258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63d00ffd90 0x7f63d0196fe0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f63c8007a00 tx=0x7f63c8009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:11.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.598+0000 7f63cdffb700 1 -- 172.21.15.123:0/2735073258 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c800e040 con 0x7f63d00ffd90 2024-06-02T04:04:11.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.598+0000 7f63cdffb700 1 -- 172.21.15.123:0/2735073258 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f63c801d480 con 0x7f63d00ffd90 2024-06-02T04:04:11.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.598+0000 7f63d7165700 1 -- 172.21.15.123:0/2735073258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d019f060 con 0x7f63d00ffd90 2024-06-02T04:04:11.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.598+0000 7f63cdffb700 1 -- 172.21.15.123:0/2735073258 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c801b6b0 con 0x7f63d00ffd90 2024-06-02T04:04:11.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.598+0000 7f63d7165700 1 -- 172.21.15.123:0/2735073258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d019f5b0 con 0x7f63d00ffd90 2024-06-02T04:04:11.601 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.599+0000 7f63d7165700 1 -- 172.21.15.123:0/2735073258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63d0068060 con 0x7f63d00ffd90 2024-06-02T04:04:11.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.601+0000 7f63cdffb700 1 -- 172.21.15.123:0/2735073258 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f63c801d5f0 con 0x7f63d00ffd90 2024-06-02T04:04:11.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.601+0000 7f63cdffb700 1 --2- 172.21.15.123:0/2735073258 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f63bc0a1230 0x7f63bc0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:11.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.601+0000 7f63cdffb700 1 -- 172.21.15.123:0/2735073258 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f63c80cee60 con 0x7f63d00ffd90 2024-06-02T04:04:11.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.601+0000 7f63cffff700 1 --2- 172.21.15.123:0/2735073258 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f63bc0a1230 0x7f63bc0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:11.602 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.602+0000 7f63cffff700 1 --2- 172.21.15.123:0/2735073258 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f63bc0a1230 0x7f63bc0a36f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f63b8007900 tx=0x7f63b8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:11.604 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.605+0000 7f63cdffb700 1 -- 172.21.15.123:0/2735073258 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f63c8098640 con 0x7f63d00ffd90 2024-06-02T04:04:11.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.803+0000 7f63d7165700 1 -- 172.21.15.123:0/2735073258 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63d010b7f0 con 0x7f63d00ffd90 2024-06-02T04:04:11.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.805+0000 7f63cdffb700 1 -- 172.21.15.123:0/2735073258 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22468 (secure 0 0 0) 0x7f63c809bc60 con 0x7f63d00ffd90 2024-06-02T04:04:11.805 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:11.805 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":84,"fsid":"1b432ae0-2094-11ef-bc9b-c7b262605968","created":"2024-06-02T03:57:17.383774+0000","modified":"2024-06-02T04:04:08.620765+0000","last_up_change":"2024-06-02T04:02:34.535591+0000","last_in_change":"2024-06-02T04:02:18.346560+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T03:59:57.079448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:03:05.199881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:03:05.853741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d9d8fb5a-dac5-4b14-98e5-665bdbc696ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6803","nonce":2763421276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6805","nonce":2763421276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6809","nonce":2763421276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6807","nonce":2763421276}]},"public_addr":"172.21.15.123:6803/2763421276","cluster_addr":"172.21.15.123:6805/2763421276","heartbeat_back_addr":"172.21.15.123:6809/2763421276","heartbeat_front_addr":"172.21.15.123:6807/2763421276","state":["exists","up"]},{"osd":1,"uuid":"121bbe3c-bb76-4ec4-9596-37db68fbf1ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6801","nonce":956325510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6803","nonce":956325510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6807","nonce":956325510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6805","nonce":956325510}]},"public_addr":"172.21.15.136:6801/956325510","cluster_addr":"172.21.15.136:6803/956325510","heartbeat_back_addr":"172.21.15.136:6807/956325510","heartbeat_front_addr":"172.21.15.136:6805/956325510","state":["exists","up"]},{"osd":2,"uuid":"df9edf0d-f9f0-4699-a6ed-bbcf2dfb1b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6801","nonce":2915749676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6803","nonce":2915749676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6807","nonce":2915749676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6805","nonce":2915749676}]},"public_addr":"172.21.15.162:6801/2915749676","cluster_addr":"172.21.15.162:6803/2915749676","heartbeat_back_addr":"172.21.15.162:6807/2915749676","heartbeat_front_addr":"172.21.15.162:6805/2915749676","state":["exists","up"]},{"osd":3,"uuid":"3e070364-12c6-4780-b2be-f6e933e65773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6811","nonce":1403773143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6813","nonce":1403773143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6817","nonce":1403773143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6815","nonce":1403773143}]},"public_addr":"172.21.15.123:6811/1403773143","cluster_addr":"172.21.15.123:6813/1403773143","heartbeat_back_addr":"172.21.15.123:6817/1403773143","heartbeat_front_addr":"172.21.15.123:6815/1403773143","state":["exists","up"]},{"osd":4,"uuid":"87dd92dd-73c8-4785-bf8a-3756d79dee90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6809","nonce":1403526782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6811","nonce":1403526782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6815","nonce":1403526782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6813","nonce":1403526782}]},"public_addr":"172.21.15.136:6809/1403526782","cluster_addr":"172.21.15.136:6811/1403526782","heartbeat_back_addr":"172.21.15.136:6815/1403526782","heartbeat_front_addr":"172.21.15.136:6813/1403526782","state":["exists","up"]},{"osd":5,"uuid":"1a730863-6b56-43b7-a115-c80d3c8f3ee3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6809","nonce":3094256489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6811","nonce":3094256489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6815","nonce":3094256489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6813","nonce":3094256489}]},"public_addr":"172.21.15.162:6809/3094256489","cluster_addr":"172.21.15.162:6811/3094256489","heartbeat_back_addr":"172.21.15.162:6815/3094256489","heartbeat_front_addr":"172.21.15.162:6813/3094256489","state":["exists","up"]},{"osd":6,"uuid":"6f170b85-6c47-49ff-ba5b-7fe0596a4ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6819","nonce":3025820432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6821","nonce":3025820432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6825","nonce":3025820432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6823","nonce":3025820432}]},"public_addr":"172.21.15.123:6819/3025820432","cluster_addr":"172.21.15.123:6821/3025820432","heartbeat_back_addr":"172.21.15.123:6825/3025820432","heartbeat_front_addr":"172.21.15.123:6823/3025820432","state":["exists","up"]},{"osd":7,"uuid":"ee66bb7a-6c0d-4e5a-b717-258a39f93a87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6817","nonce":1948829505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6819","nonce":1948829505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6823","nonce":1948829505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6821","nonce":1948829505}]},"public_addr":"172.21.15.136:6817/1948829505","cluster_addr":"172.21.15.136:6819/1948829505","heartbeat_back_addr":"172.21.15.136:6823/1948829505","heartbeat_front_addr":"172.21.15.136:6821/1948829505","state":["exists","up"]},{"osd":8,"uuid":"0ff77e33-53a5-43ef-85da-2036a1fcdb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6817","nonce":1590839230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6819","nonce":1590839230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6823","nonce":1590839230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6821","nonce":1590839230}]},"public_addr":"172.21.15.162:6817/1590839230","cluster_addr":"172.21.15.162:6819/1590839230","heartbeat_back_addr":"172.21.15.162:6823/1590839230","heartbeat_front_addr":"172.21.15.162:6821/1590839230","state":["exists","up"]},{"osd":9,"uuid":"1670731c-5e8f-4cbc-8f35-6aeb14ea3075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6827","nonce":608720685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6829","nonce":608720685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6833","nonce":608720685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6831","nonce":608720685}]},"public_addr":"172.21.15.123:6827/608720685","cluster_addr":"172.21.15.123:6829/608720685","heartbeat_back_addr":"172.21.15.123:6833/608720685","heartbeat_front_addr":"172.21.15.123:6831/608720685","state":["exists","up"]},{"osd":10,"uuid":"ae138b96-13e7-46ac-9d4d-48308132465d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6825","nonce":3777263126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6827","nonce":3777263126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6831","nonce":3777263126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6829","nonce":3777263126}]},"public_addr":"172.21.15.136:6825/3777263126","cluster_addr":"172.21.15.136:6827/3777263126","heartbeat_back_addr":"172.21.15.136:6831/3777263126","heartbeat_front_addr":"172.21.15.136:6829/3777263126","state":["exists","up"]},{"osd":11,"uuid":"69f4ede0-7e9b-4edb-be54-01f74f002a06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6825","nonce":704809754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6827","nonce":704809754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6831","nonce":704809754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6829","nonce":704809754}]},"public_addr":"172.21.15.162:6825/704809754","cluster_addr":"172.21.15.162:6827/704809754","heartbeat_back_addr":"172.21.15.162:6831/704809754","heartbeat_front_addr":"172.21.15.162:6829/704809754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:19.188506+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:36.535261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:54.242294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:11.815314+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:29.512086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:46.874319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:04.437358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:22.312520+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:39.917998+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:57.340043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:15.252797+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:32.898924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:0/69783025":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/10165744":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/2081407856":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/4026642298":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/1442330765":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/1595718606":"2024-06-03T03:57:45.611046+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:04:11.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.807+0000 7f63d7165700 1 -- 172.21.15.123:0/2735073258 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f63bc0a1230 msgr2=0x7f63bc0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:11.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.807+0000 7f63d7165700 1 --2- 172.21.15.123:0/2735073258 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f63bc0a1230 0x7f63bc0a36f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f63b8007900 tx=0x7f63b8008040 comp rx=0 tx=0).stop 2024-06-02T04:04:11.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.807+0000 7f63d7165700 1 -- 172.21.15.123:0/2735073258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63d00ffd90 msgr2=0x7f63d0196fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:11.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.807+0000 7f63d7165700 1 --2- 172.21.15.123:0/2735073258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63d00ffd90 0x7f63d0196fe0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f63c8007a00 tx=0x7f63c8009570 comp rx=0 tx=0).stop 2024-06-02T04:04:11.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.807+0000 7f63d7165700 1 -- 172.21.15.123:0/2735073258 shutdown_connections 2024-06-02T04:04:11.807 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.807+0000 7f63d7165700 1 --2- 172.21.15.123:0/2735073258 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f63bc0a1230 0x7f63bc0a36f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:11.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.807+0000 7f63d7165700 1 --2- 172.21.15.123:0/2735073258 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63d0101920 0x7f63d019e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:11.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.807+0000 7f63d7165700 1 --2- 172.21.15.123:0/2735073258 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f63d00ffd90 0x7f63d0196fe0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:11.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.807+0000 7f63d7165700 1 --2- 172.21.15.123:0/2735073258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63d0100f80 0x7f63d0197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:11.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.807+0000 7f63d7165700 1 -- 172.21.15.123:0/2735073258 >> 172.21.15.123:0/2735073258 conn(0x7f63d00fb320 msgr2=0x7f63d0069470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:11.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.807+0000 7f63d7165700 1 -- 172.21.15.123:0/2735073258 shutdown_connections 2024-06-02T04:04:11.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.807+0000 7f63d7165700 1 -- 172.21.15.123:0/2735073258 wait complete. 2024-06-02T04:04:11.820 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T03:59:57.079448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-02T04:03:05.199881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-02T04:03:05.853741+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-02T04:04:11.820 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-02T04:04:11.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.945+0000 7f60eccbf700 1 -- 172.21.15.123:0/3414109162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60e8100fd0 msgr2=0x7f60e8101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:11.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.945+0000 7f60eccbf700 1 --2- 172.21.15.123:0/3414109162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60e8100fd0 0x7f60e8101450 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f60dc009990 tx=0x7f60dc009ca0 comp rx=0 tx=0).stop 2024-06-02T04:04:11.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.946+0000 7f60eccbf700 1 -- 172.21.15.123:0/3414109162 shutdown_connections 2024-06-02T04:04:11.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.946+0000 7f60eccbf700 1 --2- 172.21.15.123:0/3414109162 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60e8101990 0x7f60e81082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:11.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.946+0000 7f60eccbf700 1 --2- 172.21.15.123:0/3414109162 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60e80ffe80 0x7f60e81002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:11.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.946+0000 7f60eccbf700 1 --2- 172.21.15.123:0/3414109162 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60e8100fd0 0x7f60e8101450 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:11.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.946+0000 7f60eccbf700 1 -- 172.21.15.123:0/3414109162 >> 172.21.15.123:0/3414109162 conn(0x7f60e80fb3f0 msgr2=0x7f60e80fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:11.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.946+0000 7f60eccbf700 1 -- 172.21.15.123:0/3414109162 shutdown_connections 2024-06-02T04:04:11.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.946+0000 7f60eccbf700 1 -- 172.21.15.123:0/3414109162 wait complete. 2024-06-02T04:04:11.948 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.946+0000 7f60eccbf700 1 Processor -- start 2024-06-02T04:04:11.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.946+0000 7f60eccbf700 1 -- start start 2024-06-02T04:04:11.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.947+0000 7f60eccbf700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60e80ffe80 0x7f60e8103d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:11.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.947+0000 7f60eccbf700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60e8100fd0 0x7f60e8102440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:11.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.947+0000 7f60eccbf700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60e8101990 0x7f60e8102980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:11.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.947+0000 7f60eccbf700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e8103080 con 0x7f60e8101990 2024-06-02T04:04:11.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.947+0000 7f60eccbf700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e81031f0 con 0x7f60e80ffe80 2024-06-02T04:04:11.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.947+0000 7f60eccbf700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e81a0fa0 con 0x7f60e8100fd0 2024-06-02T04:04:11.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.947+0000 7f60e6d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60e8101990 0x7f60e8102980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:11.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.947+0000 7f60e6d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60e8101990 0x7f60e8102980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33372/0 (socket says 172.21.15.123:33372) 2024-06-02T04:04:11.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.947+0000 7f60e6d9d700 1 -- 172.21.15.123:0/3830145289 learned_addr learned my addr 172.21.15.123:0/3830145289 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:11.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.947+0000 7f60e5d9b700 1 --2- 172.21.15.123:0/3830145289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60e8100fd0 0x7f60e8102440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:11.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.947+0000 7f60e659c700 1 --2- 172.21.15.123:0/3830145289 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60e80ffe80 0x7f60e8103d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:11.949 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.947+0000 7f60e6d9d700 1 -- 172.21.15.123:0/3830145289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60e8100fd0 msgr2=0x7f60e8102440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:11.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.947+0000 7f60e6d9d700 1 --2- 172.21.15.123:0/3830145289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60e8100fd0 0x7f60e8102440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:11.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.947+0000 7f60e6d9d700 1 -- 172.21.15.123:0/3830145289 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60e80ffe80 msgr2=0x7f60e8103d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:11.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.947+0000 7f60e6d9d700 1 --2- 172.21.15.123:0/3830145289 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60e80ffe80 0x7f60e8103d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:11.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.947+0000 7f60e6d9d700 1 -- 172.21.15.123:0/3830145289 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60dc0095f0 con 0x7f60e8101990 2024-06-02T04:04:11.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.947+0000 7f60e5d9b700 1 --2- 172.21.15.123:0/3830145289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60e8100fd0 0x7f60e8102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:04:11.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.947+0000 7f60e659c700 1 --2- 172.21.15.123:0/3830145289 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60e80ffe80 0x7f60e8103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:04:11.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.947+0000 7f60e6d9d700 1 --2- 172.21.15.123:0/3830145289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60e8101990 0x7f60e8102980 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f60e000ada0 tx=0x7f60e000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:11.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.947+0000 7f60d77fe700 1 -- 172.21.15.123:0/3830145289 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e000f070 con 0x7f60e8101990 2024-06-02T04:04:11.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.947+0000 7f60d77fe700 1 -- 172.21.15.123:0/3830145289 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f60e0007b30 con 0x7f60e8101990 2024-06-02T04:04:11.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.947+0000 7f60eccbf700 1 -- 172.21.15.123:0/3830145289 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e81a1200 con 0x7f60e8101990 2024-06-02T04:04:11.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.947+0000 7f60d77fe700 1 -- 172.21.15.123:0/3830145289 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e0005440 con 0x7f60e8101990 2024-06-02T04:04:11.950 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.947+0000 7f60eccbf700 1 -- 172.21.15.123:0/3830145289 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e81a16c0 con 0x7f60e8101990 2024-06-02T04:04:11.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.948+0000 7f60eccbf700 1 -- 172.21.15.123:0/3830145289 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e8067460 con 0x7f60e8101990 2024-06-02T04:04:11.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.949+0000 7f60d77fe700 1 -- 172.21.15.123:0/3830145289 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f60e0004ad0 con 0x7f60e8101990 2024-06-02T04:04:11.951 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.950+0000 7f60d77fe700 1 --2- 172.21.15.123:0/3830145289 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f60d00a11b0 0x7f60d00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:11.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.950+0000 7f60e659c700 1 --2- 172.21.15.123:0/3830145289 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f60d00a11b0 0x7f60d00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:11.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.950+0000 7f60d77fe700 1 -- 172.21.15.123:0/3830145289 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f60e00cc060 con 0x7f60e8101990 2024-06-02T04:04:11.952 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.950+0000 7f60e659c700 1 --2- 172.21.15.123:0/3830145289 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f60d00a11b0 0x7f60d00a3670 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f60d8005fd0 tx=0x7f60d8005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:11.954 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:11.954+0000 7f60d77fe700 1 -- 172.21.15.123:0/3830145289 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f60e0095840 con 0x7f60e8101990 2024-06-02T04:04:12.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:11 smithi123 ceph-mon[42885]: pgmap v256: 97 pgs: 1 activating, 96 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-06-02T04:04:12.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:11 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1831387733' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-06-02T04:04:12.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:11 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2735073258' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:04:12.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.151+0000 7f60eccbf700 1 -- 172.21.15.123:0/3830145289 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f60e81a1910 con 0x7f60e8101990 2024-06-02T04:04:12.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.152+0000 7f60d77fe700 1 -- 172.21.15.123:0/3830145289 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f60e0098e60 con 0x7f60e8101990 2024-06-02T04:04:12.152 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-06-02T04:04:12.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.154+0000 7f60eccbf700 1 -- 172.21.15.123:0/3830145289 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f60d00a11b0 msgr2=0x7f60d00a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:12.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.154+0000 7f60eccbf700 1 --2- 172.21.15.123:0/3830145289 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f60d00a11b0 0x7f60d00a3670 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f60d8005fd0 tx=0x7f60d8005ee0 comp rx=0 tx=0).stop 2024-06-02T04:04:12.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.154+0000 7f60eccbf700 1 -- 172.21.15.123:0/3830145289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60e8101990 msgr2=0x7f60e8102980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:12.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.154+0000 7f60eccbf700 1 --2- 172.21.15.123:0/3830145289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60e8101990 0x7f60e8102980 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f60e000ada0 tx=0x7f60e000c330 comp rx=0 tx=0).stop 2024-06-02T04:04:12.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.154+0000 7f60eccbf700 1 -- 172.21.15.123:0/3830145289 shutdown_connections 2024-06-02T04:04:12.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.154+0000 7f60eccbf700 1 --2- 172.21.15.123:0/3830145289 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f60e8101990 0x7f60e8102980 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:12.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.154+0000 7f60eccbf700 1 --2- 172.21.15.123:0/3830145289 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f60d00a11b0 0x7f60d00a3670 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:12.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.154+0000 7f60eccbf700 1 --2- 172.21.15.123:0/3830145289 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f60e80ffe80 0x7f60e8103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:12.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.154+0000 7f60eccbf700 1 --2- 172.21.15.123:0/3830145289 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f60e8100fd0 0x7f60e8102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:12.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.154+0000 7f60eccbf700 1 -- 172.21.15.123:0/3830145289 >> 172.21.15.123:0/3830145289 conn(0x7f60e80fb3f0 msgr2=0x7f60e80691b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:12.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.154+0000 7f60eccbf700 1 -- 172.21.15.123:0/3830145289 shutdown_connections 2024-06-02T04:04:12.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.154+0000 7f60eccbf700 1 -- 172.21.15.123:0/3830145289 wait complete. 2024-06-02T04:04:12.167 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-02T04:04:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.292+0000 7f1851a89700 1 -- 172.21.15.123:0/3979738008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f184c0ffe60 msgr2=0x7f184c100280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.292+0000 7f1851a89700 1 --2- 172.21.15.123:0/3979738008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f184c0ffe60 0x7f184c100280 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1840009990 tx=0x7f1840009ca0 comp rx=0 tx=0).stop 2024-06-02T04:04:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.292+0000 7f1851a89700 1 -- 172.21.15.123:0/3979738008 shutdown_connections 2024-06-02T04:04:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.292+0000 7f1851a89700 1 --2- 172.21.15.123:0/3979738008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f184c101970 0x7f184c108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.292+0000 7f1851a89700 1 --2- 172.21.15.123:0/3979738008 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f184c0ffe60 0x7f184c100280 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.292+0000 7f1851a89700 1 --2- 172.21.15.123:0/3979738008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f184c100fb0 0x7f184c101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.292+0000 7f1851a89700 1 -- 172.21.15.123:0/3979738008 >> 172.21.15.123:0/3979738008 conn(0x7f184c0fb3f0 msgr2=0x7f184c0fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:12.295 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.292+0000 7f1851a89700 1 -- 172.21.15.123:0/3979738008 shutdown_connections 2024-06-02T04:04:12.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.292+0000 7f1851a89700 1 -- 172.21.15.123:0/3979738008 wait complete. 2024-06-02T04:04:12.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.293+0000 7f1851a89700 1 Processor -- start 2024-06-02T04:04:12.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.293+0000 7f1851a89700 1 -- start start 2024-06-02T04:04:12.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.293+0000 7f1851a89700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f184c0ffe60 0x7f184c103d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:12.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.293+0000 7f1851a89700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f184c100fb0 0x7f184c102420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:12.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.293+0000 7f1851a89700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f184c101970 0x7f184c102960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:12.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.293+0000 7f1851a89700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184c103100 con 0x7f184c101970 2024-06-02T04:04:12.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.293+0000 7f1851a89700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184c103270 con 0x7f184c100fb0 2024-06-02T04:04:12.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.293+0000 7f1851a89700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184c1a0fd0 con 0x7f184c0ffe60 2024-06-02T04:04:12.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.293+0000 7f184bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f184c101970 0x7f184c102960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:12.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.294+0000 7f184bfff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f184c101970 0x7f184c102960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33386/0 (socket says 172.21.15.123:33386) 2024-06-02T04:04:12.296 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.294+0000 7f184bfff700 1 -- 172.21.15.123:0/2321075349 learned_addr learned my addr 172.21.15.123:0/2321075349 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:12.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.294+0000 7f184b7fe700 1 --2- 172.21.15.123:0/2321075349 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f184c0ffe60 0x7f184c103d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:12.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.294+0000 7f184affd700 1 --2- 172.21.15.123:0/2321075349 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f184c100fb0 0x7f184c102420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:12.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.294+0000 7f184bfff700 1 -- 172.21.15.123:0/2321075349 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f184c0ffe60 msgr2=0x7f184c103d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:12.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.294+0000 7f184bfff700 1 --2- 172.21.15.123:0/2321075349 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f184c0ffe60 0x7f184c103d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:12.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.294+0000 7f184bfff700 1 -- 172.21.15.123:0/2321075349 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f184c100fb0 msgr2=0x7f184c102420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:12.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.294+0000 7f184bfff700 1 --2- 172.21.15.123:0/2321075349 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f184c100fb0 0x7f184c102420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:12.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.294+0000 7f184bfff700 1 -- 172.21.15.123:0/2321075349 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18400095f0 con 0x7f184c101970 2024-06-02T04:04:12.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.294+0000 7f184affd700 1 --2- 172.21.15.123:0/2321075349 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f184c100fb0 0x7f184c102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:04:12.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.294+0000 7f184b7fe700 1 --2- 172.21.15.123:0/2321075349 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f184c0ffe60 0x7f184c103d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:04:12.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.294+0000 7f184bfff700 1 --2- 172.21.15.123:0/2321075349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f184c101970 0x7f184c102960 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f184400b970 tx=0x7f184400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:12.297 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.294+0000 7f1848ff9700 1 -- 172.21.15.123:0/2321075349 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184400c950 con 0x7f184c101970 2024-06-02T04:04:12.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.294+0000 7f1851a89700 1 -- 172.21.15.123:0/2321075349 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f184c1a1260 con 0x7f184c101970 2024-06-02T04:04:12.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.294+0000 7f1848ff9700 1 -- 172.21.15.123:0/2321075349 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1844014440 con 0x7f184c101970 2024-06-02T04:04:12.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.294+0000 7f1848ff9700 1 -- 172.21.15.123:0/2321075349 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18440075d0 con 0x7f184c101970 2024-06-02T04:04:12.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.294+0000 7f1851a89700 1 -- 172.21.15.123:0/2321075349 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f184c1a1720 con 0x7f184c101970 2024-06-02T04:04:12.298 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.295+0000 7f1851a89700 1 -- 172.21.15.123:0/2321075349 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f184c067cf0 con 0x7f184c101970 2024-06-02T04:04:12.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:11 smithi162 ceph-mon[47009]: pgmap v256: 97 pgs: 1 activating, 96 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-06-02T04:04:12.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:11 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/1831387733' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-06-02T04:04:12.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:11 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/2735073258' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:04:12.299 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.296+0000 7f1848ff9700 1 -- 172.21.15.123:0/2321075349 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f18440145b0 con 0x7f184c101970 2024-06-02T04:04:12.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.297+0000 7f1848ff9700 1 --2- 172.21.15.123:0/2321075349 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f18340a11b0 0x7f18340a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:12.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.297+0000 7f184b7fe700 1 --2- 172.21.15.123:0/2321075349 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f18340a11b0 0x7f18340a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:12.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.297+0000 7f1848ff9700 1 -- 172.21.15.123:0/2321075349 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f1844006e40 con 0x7f184c101970 2024-06-02T04:04:12.300 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.297+0000 7f184b7fe700 1 --2- 172.21.15.123:0/2321075349 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f18340a11b0 0x7f18340a3670 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f184000b5c0 tx=0x7f1840005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:12.301 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.301+0000 7f1848ff9700 1 -- 172.21.15.123:0/2321075349 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f18440957f0 con 0x7f184c101970 2024-06-02T04:04:12.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:11 smithi136 ceph-mon[47443]: pgmap v256: 97 pgs: 1 activating, 96 active+clean; 641 KiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-06-02T04:04:12.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:11 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/1831387733' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-06-02T04:04:12.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:11 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/2735073258' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:04:12.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.502+0000 7f1851a89700 1 -- 172.21.15.123:0/2321075349 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f184c10b930 con 0x7f184c101970 2024-06-02T04:04:12.503 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.503+0000 7f1848ff9700 1 -- 172.21.15.123:0/2321075349 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1844098e10 con 0x7f184c101970 2024-06-02T04:04:12.503 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-06-02T04:04:12.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.507+0000 7f1851a89700 1 -- 172.21.15.123:0/2321075349 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f18340a11b0 msgr2=0x7f18340a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:12.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.507+0000 7f1851a89700 1 --2- 172.21.15.123:0/2321075349 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f18340a11b0 0x7f18340a3670 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f184000b5c0 tx=0x7f1840005fb0 comp rx=0 tx=0).stop 2024-06-02T04:04:12.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.507+0000 7f1851a89700 1 -- 172.21.15.123:0/2321075349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f184c101970 msgr2=0x7f184c102960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:12.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.507+0000 7f1851a89700 1 --2- 172.21.15.123:0/2321075349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f184c101970 0x7f184c102960 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f184400b970 tx=0x7f184400bd30 comp rx=0 tx=0).stop 2024-06-02T04:04:12.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.507+0000 7f1851a89700 1 -- 172.21.15.123:0/2321075349 shutdown_connections 2024-06-02T04:04:12.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.507+0000 7f1851a89700 1 --2- 172.21.15.123:0/2321075349 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f184c101970 0x7f184c102960 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:12.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.507+0000 7f1851a89700 1 --2- 172.21.15.123:0/2321075349 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f184c0ffe60 0x7f184c103d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:12.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.507+0000 7f1851a89700 1 --2- 172.21.15.123:0/2321075349 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f18340a11b0 0x7f18340a3670 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:12.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.507+0000 7f1851a89700 1 --2- 172.21.15.123:0/2321075349 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f184c100fb0 0x7f184c102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:12.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.507+0000 7f1851a89700 1 -- 172.21.15.123:0/2321075349 >> 172.21.15.123:0/2321075349 conn(0x7f184c0fb3f0 msgr2=0x7f184c068040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:12.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.507+0000 7f1851a89700 1 -- 172.21.15.123:0/2321075349 shutdown_connections 2024-06-02T04:04:12.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.507+0000 7f1851a89700 1 -- 172.21.15.123:0/2321075349 wait complete. 2024-06-02T04:04:12.520 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-02T04:04:12.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.645+0000 7f71efb5a700 1 -- 172.21.15.123:0/4239405560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71e8101970 msgr2=0x7f71e8108290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:12.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.645+0000 7f71efb5a700 1 --2- 172.21.15.123:0/4239405560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71e8101970 0x7f71e8108290 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f71e000b0a0 tx=0x7f71e000b3b0 comp rx=0 tx=0).stop 2024-06-02T04:04:12.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.645+0000 7f71efb5a700 1 -- 172.21.15.123:0/4239405560 shutdown_connections 2024-06-02T04:04:12.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.645+0000 7f71efb5a700 1 --2- 172.21.15.123:0/4239405560 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71e8101970 0x7f71e8108290 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:12.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.645+0000 7f71efb5a700 1 --2- 172.21.15.123:0/4239405560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71e80ffe60 0x7f71e8100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:12.648 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.645+0000 7f71efb5a700 1 --2- 172.21.15.123:0/4239405560 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f71e8100fb0 0x7f71e8101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:12.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.645+0000 7f71efb5a700 1 -- 172.21.15.123:0/4239405560 >> 172.21.15.123:0/4239405560 conn(0x7f71e80fb3f0 msgr2=0x7f71e80fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:12.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.645+0000 7f71efb5a700 1 -- 172.21.15.123:0/4239405560 shutdown_connections 2024-06-02T04:04:12.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.645+0000 7f71efb5a700 1 -- 172.21.15.123:0/4239405560 wait complete. 2024-06-02T04:04:12.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.646+0000 7f71efb5a700 1 Processor -- start 2024-06-02T04:04:12.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.646+0000 7f71efb5a700 1 -- start start 2024-06-02T04:04:12.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.646+0000 7f71efb5a700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f71e80ffe60 0x7f71e8068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:12.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.646+0000 7f71efb5a700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71e8100fb0 0x7f71e819bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:12.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.646+0000 7f71efb5a700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71e8101970 0x7f71e819e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:12.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.646+0000 7f71efb5a700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e819ead0 con 0x7f71e8100fb0 2024-06-02T04:04:12.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.646+0000 7f71efb5a700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e819ec40 con 0x7f71e80ffe60 2024-06-02T04:04:12.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.646+0000 7f71efb5a700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e819ee00 con 0x7f71e8101970 2024-06-02T04:04:12.649 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.646+0000 7f71ed0f5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71e8100fb0 0x7f71e819bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:12.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.646+0000 7f71ed0f5700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71e8100fb0 0x7f71e819bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33398/0 (socket says 172.21.15.123:33398) 2024-06-02T04:04:12.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.646+0000 7f71ed0f5700 1 -- 172.21.15.123:0/1600166171 learned_addr learned my addr 172.21.15.123:0/1600166171 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:12.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.646+0000 7f71ed8f6700 1 --2- 172.21.15.123:0/1600166171 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f71e80ffe60 0x7f71e8068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:12.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.646+0000 7f71ee0f7700 1 --2- 172.21.15.123:0/1600166171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71e8101970 0x7f71e819e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:12.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.646+0000 7f71ed0f5700 1 -- 172.21.15.123:0/1600166171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71e8101970 msgr2=0x7f71e819e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:12.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.646+0000 7f71ed0f5700 1 --2- 172.21.15.123:0/1600166171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71e8101970 0x7f71e819e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:12.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.646+0000 7f71ed0f5700 1 -- 172.21.15.123:0/1600166171 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f71e80ffe60 msgr2=0x7f71e8068b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:12.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.646+0000 7f71ed0f5700 1 --2- 172.21.15.123:0/1600166171 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f71e80ffe60 0x7f71e8068b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:12.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.647+0000 7f71ed0f5700 1 -- 172.21.15.123:0/1600166171 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e0009d00 con 0x7f71e8100fb0 2024-06-02T04:04:12.650 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.647+0000 7f71ee0f7700 1 --2- 172.21.15.123:0/1600166171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71e8101970 0x7f71e819e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:04:12.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.647+0000 7f71ed0f5700 1 --2- 172.21.15.123:0/1600166171 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71e8100fb0 0x7f71e819bd40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f71e400d950 tx=0x7f71e400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:12.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.647+0000 7f71daffd700 1 -- 172.21.15.123:0/1600166171 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4009940 con 0x7f71e8100fb0 2024-06-02T04:04:12.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.647+0000 7f71daffd700 1 -- 172.21.15.123:0/1600166171 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71e4010460 con 0x7f71e8100fb0 2024-06-02T04:04:12.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.647+0000 7f71efb5a700 1 -- 172.21.15.123:0/1600166171 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e819f0e0 con 0x7f71e8100fb0 2024-06-02T04:04:12.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.647+0000 7f71daffd700 1 -- 172.21.15.123:0/1600166171 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e400f620 con 0x7f71e8100fb0 2024-06-02T04:04:12.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.647+0000 7f71efb5a700 1 -- 172.21.15.123:0/1600166171 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e819f640 con 0x7f71e8100fb0 2024-06-02T04:04:12.651 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.648+0000 7f71efb5a700 1 -- 172.21.15.123:0/1600166171 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e8107200 con 0x7f71e8100fb0 2024-06-02T04:04:12.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.649+0000 7f71daffd700 1 -- 172.21.15.123:0/1600166171 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f71e40108d0 con 0x7f71e8100fb0 2024-06-02T04:04:12.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.649+0000 7f71daffd700 1 --2- 172.21.15.123:0/1600166171 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f71d40a1230 0x7f71d40a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:12.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.649+0000 7f71ed8f6700 1 --2- 172.21.15.123:0/1600166171 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f71d40a1230 0x7f71d40a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:12.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.650+0000 7f71daffd700 1 -- 172.21.15.123:0/1600166171 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f71e40cc880 con 0x7f71e8100fb0 2024-06-02T04:04:12.652 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.650+0000 7f71ed8f6700 1 --2- 172.21.15.123:0/1600166171 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f71d40a1230 0x7f71d40a36f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009c60 tx=0x7f71dc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:12.653 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.653+0000 7f71daffd700 1 -- 172.21.15.123:0/1600166171 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f71e4095ed0 con 0x7f71e8100fb0 2024-06-02T04:04:12.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.850+0000 7f71efb5a700 1 -- 172.21.15.123:0/1600166171 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f71e810b6b0 con 0x7f71e8100fb0 2024-06-02T04:04:12.850 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.850+0000 7f71daffd700 1 -- 172.21.15.123:0/1600166171 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f71e40200a0 con 0x7f71e8100fb0 2024-06-02T04:04:12.850 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-06-02T04:04:12.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.852+0000 7f71efb5a700 1 -- 172.21.15.123:0/1600166171 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f71d40a1230 msgr2=0x7f71d40a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:12.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.852+0000 7f71efb5a700 1 --2- 172.21.15.123:0/1600166171 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f71d40a1230 0x7f71d40a36f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009c60 tx=0x7f71dc009260 comp rx=0 tx=0).stop 2024-06-02T04:04:12.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.852+0000 7f71efb5a700 1 -- 172.21.15.123:0/1600166171 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71e8100fb0 msgr2=0x7f71e819bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:12.852 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.852+0000 7f71efb5a700 1 --2- 172.21.15.123:0/1600166171 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71e8100fb0 0x7f71e819bd40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f71e400d950 tx=0x7f71e400dc60 comp rx=0 tx=0).stop 2024-06-02T04:04:12.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.852+0000 7f71efb5a700 1 -- 172.21.15.123:0/1600166171 shutdown_connections 2024-06-02T04:04:12.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.852+0000 7f71efb5a700 1 --2- 172.21.15.123:0/1600166171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71e8101970 0x7f71e819e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:12.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.852+0000 7f71efb5a700 1 --2- 172.21.15.123:0/1600166171 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f71d40a1230 0x7f71d40a36f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:12.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.852+0000 7f71efb5a700 1 --2- 172.21.15.123:0/1600166171 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f71e80ffe60 0x7f71e8068b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:12.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.852+0000 7f71efb5a700 1 --2- 172.21.15.123:0/1600166171 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f71e8100fb0 0x7f71e819bd40 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:12.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.852+0000 7f71efb5a700 1 -- 172.21.15.123:0/1600166171 >> 172.21.15.123:0/1600166171 conn(0x7f71e80fb3f0 msgr2=0x7f71e8104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:12.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.852+0000 7f71efb5a700 1 -- 172.21.15.123:0/1600166171 shutdown_connections 2024-06-02T04:04:12.853 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.852+0000 7f71efb5a700 1 -- 172.21.15.123:0/1600166171 wait complete. 2024-06-02T04:04:12.864 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:04:12.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.987+0000 7f2e98553700 1 -- 172.21.15.123:0/777434322 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e900ffd60 msgr2=0x7f2e90100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:12.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.987+0000 7f2e98553700 1 --2- 172.21.15.123:0/777434322 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e900ffd60 0x7f2e90100180 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2e800099c0 tx=0x7f2e80009cd0 comp rx=0 tx=0).stop 2024-06-02T04:04:12.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.987+0000 7f2e98553700 1 -- 172.21.15.123:0/777434322 shutdown_connections 2024-06-02T04:04:12.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.987+0000 7f2e98553700 1 --2- 172.21.15.123:0/777434322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e901018f0 0x7f2e901081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:12.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.987+0000 7f2e98553700 1 --2- 172.21.15.123:0/777434322 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e900ffd60 0x7f2e90100180 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:12.989 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.987+0000 7f2e98553700 1 --2- 172.21.15.123:0/777434322 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e90100f50 0x7f2e901013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:12.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.987+0000 7f2e98553700 1 -- 172.21.15.123:0/777434322 >> 172.21.15.123:0/777434322 conn(0x7f2e900fb2f0 msgr2=0x7f2e900fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:12.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.987+0000 7f2e98553700 1 -- 172.21.15.123:0/777434322 shutdown_connections 2024-06-02T04:04:12.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.987+0000 7f2e98553700 1 -- 172.21.15.123:0/777434322 wait complete. 2024-06-02T04:04:12.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.987+0000 7f2e98553700 1 Processor -- start 2024-06-02T04:04:12.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.987+0000 7f2e98553700 1 -- start start 2024-06-02T04:04:12.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.988+0000 7f2e98553700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e900ffd60 0x7f2e90199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:12.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.988+0000 7f2e98553700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e90100f50 0x7f2e90199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:12.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.988+0000 7f2e98553700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e901018f0 0x7f2e901a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:12.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.988+0000 7f2e98553700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e901a0c50 con 0x7f2e900ffd60 2024-06-02T04:04:12.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.988+0000 7f2e98553700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e901a0d90 con 0x7f2e901018f0 2024-06-02T04:04:12.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.988+0000 7f2e98553700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e901a0f20 con 0x7f2e90100f50 2024-06-02T04:04:12.990 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.988+0000 7f2e962ef700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e900ffd60 0x7f2e90199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:12.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.988+0000 7f2e962ef700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e900ffd60 0x7f2e90199120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33418/0 (socket says 172.21.15.123:33418) 2024-06-02T04:04:12.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.988+0000 7f2e962ef700 1 -- 172.21.15.123:0/1775228688 learned_addr learned my addr 172.21.15.123:0/1775228688 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:12.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.988+0000 7f2e962ef700 1 -- 172.21.15.123:0/1775228688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e90100f50 msgr2=0x7f2e90199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:12.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.988+0000 7f2e95aee700 1 --2- 172.21.15.123:0/1775228688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e90100f50 0x7f2e90199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:12.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.988+0000 7f2e962ef700 1 --2- 172.21.15.123:0/1775228688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e90100f50 0x7f2e90199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:12.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.988+0000 7f2e962ef700 1 -- 172.21.15.123:0/1775228688 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e901018f0 msgr2=0x7f2e901a0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:12.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.988+0000 7f2e962ef700 1 --2- 172.21.15.123:0/1775228688 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e901018f0 0x7f2e901a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:12.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.988+0000 7f2e962ef700 1 -- 172.21.15.123:0/1775228688 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e800095f0 con 0x7f2e900ffd60 2024-06-02T04:04:12.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.988+0000 7f2e95aee700 1 --2- 172.21.15.123:0/1775228688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e90100f50 0x7f2e90199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:04:12.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.988+0000 7f2e962ef700 1 --2- 172.21.15.123:0/1775228688 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e900ffd60 0x7f2e90199120 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2e80003720 tx=0x7f2e800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:12.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.988+0000 7f2e877fe700 1 -- 172.21.15.123:0/1775228688 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8001d070 con 0x7f2e900ffd60 2024-06-02T04:04:12.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.988+0000 7f2e877fe700 1 -- 172.21.15.123:0/1775228688 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e800041d0 con 0x7f2e900ffd60 2024-06-02T04:04:12.991 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.988+0000 7f2e98553700 1 -- 172.21.15.123:0/1775228688 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e901a11a0 con 0x7f2e900ffd60 2024-06-02T04:04:12.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.988+0000 7f2e877fe700 1 -- 172.21.15.123:0/1775228688 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8000f460 con 0x7f2e900ffd60 2024-06-02T04:04:12.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.988+0000 7f2e98553700 1 -- 172.21.15.123:0/1775228688 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e901a1620 con 0x7f2e900ffd60 2024-06-02T04:04:12.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.989+0000 7f2e98553700 1 -- 172.21.15.123:0/1775228688 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e90067c10 con 0x7f2e900ffd60 2024-06-02T04:04:12.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.990+0000 7f2e877fe700 1 -- 172.21.15.123:0/1775228688 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f2e80003d10 con 0x7f2e900ffd60 2024-06-02T04:04:12.992 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.991+0000 7f2e877fe700 1 --2- 172.21.15.123:0/1775228688 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2e7c0a1230 0x7f2e7c0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:12.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.991+0000 7f2e95aee700 1 --2- 172.21.15.123:0/1775228688 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2e7c0a1230 0x7f2e7c0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:12.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.991+0000 7f2e877fe700 1 -- 172.21.15.123:0/1775228688 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f2e800ce460 con 0x7f2e900ffd60 2024-06-02T04:04:12.993 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.991+0000 7f2e95aee700 1 --2- 172.21.15.123:0/1775228688 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2e7c0a1230 0x7f2e7c0a36f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c006fd0 tx=0x7f2e8c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:12.994 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:12.994+0000 7f2e877fe700 1 -- 172.21.15.123:0/1775228688 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2e80097cd0 con 0x7f2e900ffd60 2024-06-02T04:04:13.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.241+0000 7f2e98553700 1 -- 172.21.15.123:0/1775228688 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e9010b660 con 0x7f2e900ffd60 2024-06-02T04:04:13.241 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.241+0000 7f2e877fe700 1 -- 172.21.15.123:0/1775228688 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10930 (secure 0 0 0) 0x7f2e8009b2f0 con 0x7f2e900ffd60 2024-06-02T04:04:13.241 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:13.242 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1940848601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1940848601},{"type":"v1","addr":"172.21.15.123:6835","nonce":1940848601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/54447879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":54447879},{"type":"v1","addr":"172.21.15.123:6837","nonce":54447879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T04:03:06.667888+0000","modified":"2024-06-02T04:03:13.099282+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24490,"mds_2":24473,"mds_3":24439,"mds_4":24437},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6839/3806973328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":3806973328},{"type":"v1","addr":"172.21.15.123:6839","nonce":3806973328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14619":{"gid":14619,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6841/4032992994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":4032992994},{"type":"v1","addr":"172.21.15.123:6841","nonce":4032992994}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24437":{"gid":24437,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6833/2006585076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2006585076},{"type":"v1","addr":"172.21.15.136:6833","nonce":2006585076}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.162:6833/3583622784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3583622784},{"type":"v1","addr":"172.21.15.162:6833","nonce":3583622784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/2894031422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2894031422},{"type":"v1","addr":"172.21.15.136:6835","nonce":2894031422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24463":{"gid":24463,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2478943987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2478943987},{"type":"v1","addr":"172.21.15.162:6835","nonce":2478943987}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3402138468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3402138468},{"type":"v1","addr":"172.21.15.162:6837","nonce":3402138468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.136:6837/2572418263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2572418263},{"type":"v1","addr":"172.21.15.136:6837","nonce":2572418263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/2588884232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2588884232},{"type":"v1","addr":"172.21.15.162:6839","nonce":2588884232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6839/952830191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":952830191},{"type":"v1","addr":"172.21.15.136:6839","nonce":952830191}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-06-02T04:04:13.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.243+0000 7f2e98553700 1 -- 172.21.15.123:0/1775228688 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2e7c0a1230 msgr2=0x7f2e7c0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:13.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.243+0000 7f2e98553700 1 --2- 172.21.15.123:0/1775228688 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2e7c0a1230 0x7f2e7c0a36f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c006fd0 tx=0x7f2e8c008040 comp rx=0 tx=0).stop 2024-06-02T04:04:13.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.243+0000 7f2e98553700 1 -- 172.21.15.123:0/1775228688 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e900ffd60 msgr2=0x7f2e90199120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:13.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.243+0000 7f2e98553700 1 --2- 172.21.15.123:0/1775228688 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e900ffd60 0x7f2e90199120 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2e80003720 tx=0x7f2e800057f0 comp rx=0 tx=0).stop 2024-06-02T04:04:13.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.244+0000 7f2e98553700 1 -- 172.21.15.123:0/1775228688 shutdown_connections 2024-06-02T04:04:13.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.244+0000 7f2e98553700 1 --2- 172.21.15.123:0/1775228688 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2e7c0a1230 0x7f2e7c0a36f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:13.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.244+0000 7f2e98553700 1 --2- 172.21.15.123:0/1775228688 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e901018f0 0x7f2e901a0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:13.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.244+0000 7f2e98553700 1 --2- 172.21.15.123:0/1775228688 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2e900ffd60 0x7f2e90199120 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:13.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.244+0000 7f2e98553700 1 --2- 172.21.15.123:0/1775228688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e90100f50 0x7f2e90199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:13.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.244+0000 7f2e98553700 1 -- 172.21.15.123:0/1775228688 >> 172.21.15.123:0/1775228688 conn(0x7f2e900fb2f0 msgr2=0x7f2e90068060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:13.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.244+0000 7f2e98553700 1 -- 172.21.15.123:0/1775228688 shutdown_connections 2024-06-02T04:04:13.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.244+0000 7f2e98553700 1 -- 172.21.15.123:0/1775228688 wait complete. 2024-06-02T04:04:13.245 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 27 2024-06-02T04:04:13.255 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:13 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/3830145289' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:04:13.255 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:13 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2321075349' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:04:13.255 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:13 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1600166171' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:04:13.256 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:04:13.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:13 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/3830145289' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:04:13.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:13 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/2321075349' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:04:13.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:13 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/1600166171' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:04:13.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:13 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/3830145289' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:04:13.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:13 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/2321075349' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:04:13.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:13 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/1600166171' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:04:13.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.378+0000 7ffaa6b17700 1 -- 172.21.15.123:0/3807950475 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffaa00ffd80 msgr2=0x7ffaa01001a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:13.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.378+0000 7ffaa6b17700 1 --2- 172.21.15.123:0/3807950475 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffaa00ffd80 0x7ffaa01001a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ffa940099c0 tx=0x7ffa94009cd0 comp rx=0 tx=0).stop 2024-06-02T04:04:13.381 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.378+0000 7ffaa6b17700 1 -- 172.21.15.123:0/3807950475 shutdown_connections 2024-06-02T04:04:13.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.378+0000 7ffaa6b17700 1 --2- 172.21.15.123:0/3807950475 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffaa0101910 0x7ffaa01081c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:13.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.378+0000 7ffaa6b17700 1 --2- 172.21.15.123:0/3807950475 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffaa00ffd80 0x7ffaa01001a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:13.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.379+0000 7ffaa6b17700 1 --2- 172.21.15.123:0/3807950475 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffaa0100f70 0x7ffaa01013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:13.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.379+0000 7ffaa6b17700 1 -- 172.21.15.123:0/3807950475 >> 172.21.15.123:0/3807950475 conn(0x7ffaa00fb330 msgr2=0x7ffaa00fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:13.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.379+0000 7ffaa6b17700 1 -- 172.21.15.123:0/3807950475 shutdown_connections 2024-06-02T04:04:13.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.379+0000 7ffaa6b17700 1 -- 172.21.15.123:0/3807950475 wait complete. 2024-06-02T04:04:13.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.379+0000 7ffaa6b17700 1 Processor -- start 2024-06-02T04:04:13.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.379+0000 7ffaa6b17700 1 -- start start 2024-06-02T04:04:13.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.379+0000 7ffaa6b17700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffaa00ffd80 0x7ffaa0196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:13.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.379+0000 7ffaa6b17700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffaa0100f70 0x7ffaa01972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:13.382 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.379+0000 7ffaa6b17700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffaa0101910 0x7ffaa019e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:13.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.379+0000 7ffaa6b17700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa019e860 con 0x7ffaa0100f70 2024-06-02T04:04:13.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.379+0000 7ffaa6b17700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa019e9d0 con 0x7ffaa0101910 2024-06-02T04:04:13.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.379+0000 7ffaa6b17700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa019eb90 con 0x7ffaa00ffd80 2024-06-02T04:04:13.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.379+0000 7ffa9ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffaa0100f70 0x7ffaa01972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:13.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.379+0000 7ffa9ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffaa0100f70 0x7ffaa01972b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33436/0 (socket says 172.21.15.123:33436) 2024-06-02T04:04:13.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.379+0000 7ffa9ffff700 1 -- 172.21.15.123:0/2691755383 learned_addr learned my addr 172.21.15.123:0/2691755383 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:13.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.379+0000 7ffaa48b3700 1 --2- 172.21.15.123:0/2691755383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffaa00ffd80 0x7ffaa0196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:13.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.380+0000 7ffaa50b4700 1 --2- 172.21.15.123:0/2691755383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffaa0101910 0x7ffaa019e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:13.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.380+0000 7ffa9ffff700 1 -- 172.21.15.123:0/2691755383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffaa00ffd80 msgr2=0x7ffaa0196d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:13.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.380+0000 7ffa9ffff700 1 --2- 172.21.15.123:0/2691755383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffaa00ffd80 0x7ffaa0196d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:13.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.380+0000 7ffa9ffff700 1 -- 172.21.15.123:0/2691755383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffaa0101910 msgr2=0x7ffaa019e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:13.383 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.380+0000 7ffa9ffff700 1 --2- 172.21.15.123:0/2691755383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffaa0101910 0x7ffaa019e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:13.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.380+0000 7ffa9ffff700 1 -- 172.21.15.123:0/2691755383 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa940095f0 con 0x7ffaa0100f70 2024-06-02T04:04:13.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.380+0000 7ffaa50b4700 1 --2- 172.21.15.123:0/2691755383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffaa0101910 0x7ffaa019e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:04:13.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.380+0000 7ffa9ffff700 1 --2- 172.21.15.123:0/2691755383 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffaa0100f70 0x7ffaa01972b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c00c9b0 tx=0x7ffa8c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:13.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.380+0000 7ffa9dffb700 1 -- 172.21.15.123:0/2691755383 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c007b00 con 0x7ffaa0100f70 2024-06-02T04:04:13.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.380+0000 7ffa9dffb700 1 -- 172.21.15.123:0/2691755383 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffa8c007c60 con 0x7ffaa0100f70 2024-06-02T04:04:13.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.380+0000 7ffa9dffb700 1 -- 172.21.15.123:0/2691755383 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c018660 con 0x7ffaa0100f70 2024-06-02T04:04:13.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.380+0000 7ffaa6b17700 1 -- 172.21.15.123:0/2691755383 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa019ee70 con 0x7ffaa0100f70 2024-06-02T04:04:13.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.380+0000 7ffaa6b17700 1 -- 172.21.15.123:0/2691755383 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa019f290 con 0x7ffaa0100f70 2024-06-02T04:04:13.384 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.381+0000 7ffaa6b17700 1 -- 172.21.15.123:0/2691755383 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa0068060 con 0x7ffaa0100f70 2024-06-02T04:04:13.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.382+0000 7ffa9dffb700 1 -- 172.21.15.123:0/2691755383 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7ffa8c00f450 con 0x7ffaa0100f70 2024-06-02T04:04:13.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.383+0000 7ffa9dffb700 1 --2- 172.21.15.123:0/2691755383 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ffa900a1230 0x7ffa900a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:13.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.383+0000 7ffaa48b3700 1 --2- 172.21.15.123:0/2691755383 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ffa900a1230 0x7ffa900a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:13.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.383+0000 7ffa9dffb700 1 -- 172.21.15.123:0/2691755383 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7ffa8c0cc980 con 0x7ffaa0100f70 2024-06-02T04:04:13.385 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.383+0000 7ffaa48b3700 1 --2- 172.21.15.123:0/2691755383 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ffa900a1230 0x7ffa900a36f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ffa94006010 tx=0x7ffa9400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:13.387 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.387+0000 7ffa9dffb700 1 -- 172.21.15.123:0/2691755383 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ffa8c095fd0 con 0x7ffaa0100f70 2024-06-02T04:04:13.588 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.588+0000 7ffaa6b17700 1 -- 172.21.15.123:0/2691755383 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffaa010b5e0 con 0x7ffaa0100f70 2024-06-02T04:04:13.590 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.590+0000 7ffa9dffb700 1 -- 172.21.15.123:0/2691755383 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22468 (secure 0 0 0) 0x7ffa8c0995f0 con 0x7ffaa0100f70 2024-06-02T04:04:13.590 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:13.590 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":84,"fsid":"1b432ae0-2094-11ef-bc9b-c7b262605968","created":"2024-06-02T03:57:17.383774+0000","modified":"2024-06-02T04:04:08.620765+0000","last_up_change":"2024-06-02T04:02:34.535591+0000","last_in_change":"2024-06-02T04:02:18.346560+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T03:59:57.079448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:03:05.199881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:03:05.853741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d9d8fb5a-dac5-4b14-98e5-665bdbc696ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6803","nonce":2763421276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6805","nonce":2763421276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6809","nonce":2763421276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6807","nonce":2763421276}]},"public_addr":"172.21.15.123:6803/2763421276","cluster_addr":"172.21.15.123:6805/2763421276","heartbeat_back_addr":"172.21.15.123:6809/2763421276","heartbeat_front_addr":"172.21.15.123:6807/2763421276","state":["exists","up"]},{"osd":1,"uuid":"121bbe3c-bb76-4ec4-9596-37db68fbf1ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6801","nonce":956325510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6803","nonce":956325510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6807","nonce":956325510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6805","nonce":956325510}]},"public_addr":"172.21.15.136:6801/956325510","cluster_addr":"172.21.15.136:6803/956325510","heartbeat_back_addr":"172.21.15.136:6807/956325510","heartbeat_front_addr":"172.21.15.136:6805/956325510","state":["exists","up"]},{"osd":2,"uuid":"df9edf0d-f9f0-4699-a6ed-bbcf2dfb1b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6801","nonce":2915749676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6803","nonce":2915749676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6807","nonce":2915749676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6805","nonce":2915749676}]},"public_addr":"172.21.15.162:6801/2915749676","cluster_addr":"172.21.15.162:6803/2915749676","heartbeat_back_addr":"172.21.15.162:6807/2915749676","heartbeat_front_addr":"172.21.15.162:6805/2915749676","state":["exists","up"]},{"osd":3,"uuid":"3e070364-12c6-4780-b2be-f6e933e65773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6811","nonce":1403773143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6813","nonce":1403773143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6817","nonce":1403773143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6815","nonce":1403773143}]},"public_addr":"172.21.15.123:6811/1403773143","cluster_addr":"172.21.15.123:6813/1403773143","heartbeat_back_addr":"172.21.15.123:6817/1403773143","heartbeat_front_addr":"172.21.15.123:6815/1403773143","state":["exists","up"]},{"osd":4,"uuid":"87dd92dd-73c8-4785-bf8a-3756d79dee90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6809","nonce":1403526782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6811","nonce":1403526782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6815","nonce":1403526782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6813","nonce":1403526782}]},"public_addr":"172.21.15.136:6809/1403526782","cluster_addr":"172.21.15.136:6811/1403526782","heartbeat_back_addr":"172.21.15.136:6815/1403526782","heartbeat_front_addr":"172.21.15.136:6813/1403526782","state":["exists","up"]},{"osd":5,"uuid":"1a730863-6b56-43b7-a115-c80d3c8f3ee3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6809","nonce":3094256489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6811","nonce":3094256489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6815","nonce":3094256489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6813","nonce":3094256489}]},"public_addr":"172.21.15.162:6809/3094256489","cluster_addr":"172.21.15.162:6811/3094256489","heartbeat_back_addr":"172.21.15.162:6815/3094256489","heartbeat_front_addr":"172.21.15.162:6813/3094256489","state":["exists","up"]},{"osd":6,"uuid":"6f170b85-6c47-49ff-ba5b-7fe0596a4ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6819","nonce":3025820432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6821","nonce":3025820432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6825","nonce":3025820432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6823","nonce":3025820432}]},"public_addr":"172.21.15.123:6819/3025820432","cluster_addr":"172.21.15.123:6821/3025820432","heartbeat_back_addr":"172.21.15.123:6825/3025820432","heartbeat_front_addr":"172.21.15.123:6823/3025820432","state":["exists","up"]},{"osd":7,"uuid":"ee66bb7a-6c0d-4e5a-b717-258a39f93a87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6817","nonce":1948829505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6819","nonce":1948829505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6823","nonce":1948829505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6821","nonce":1948829505}]},"public_addr":"172.21.15.136:6817/1948829505","cluster_addr":"172.21.15.136:6819/1948829505","heartbeat_back_addr":"172.21.15.136:6823/1948829505","heartbeat_front_addr":"172.21.15.136:6821/1948829505","state":["exists","up"]},{"osd":8,"uuid":"0ff77e33-53a5-43ef-85da-2036a1fcdb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6817","nonce":1590839230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6819","nonce":1590839230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6823","nonce":1590839230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6821","nonce":1590839230}]},"public_addr":"172.21.15.162:6817/1590839230","cluster_addr":"172.21.15.162:6819/1590839230","heartbeat_back_addr":"172.21.15.162:6823/1590839230","heartbeat_front_addr":"172.21.15.162:6821/1590839230","state":["exists","up"]},{"osd":9,"uuid":"1670731c-5e8f-4cbc-8f35-6aeb14ea3075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6827","nonce":608720685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6829","nonce":608720685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6833","nonce":608720685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6831","nonce":608720685}]},"public_addr":"172.21.15.123:6827/608720685","cluster_addr":"172.21.15.123:6829/608720685","heartbeat_back_addr":"172.21.15.123:6833/608720685","heartbeat_front_addr":"172.21.15.123:6831/608720685","state":["exists","up"]},{"osd":10,"uuid":"ae138b96-13e7-46ac-9d4d-48308132465d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6825","nonce":3777263126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6827","nonce":3777263126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6831","nonce":3777263126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6829","nonce":3777263126}]},"public_addr":"172.21.15.136:6825/3777263126","cluster_addr":"172.21.15.136:6827/3777263126","heartbeat_back_addr":"172.21.15.136:6831/3777263126","heartbeat_front_addr":"172.21.15.136:6829/3777263126","state":["exists","up"]},{"osd":11,"uuid":"69f4ede0-7e9b-4edb-be54-01f74f002a06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6825","nonce":704809754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6827","nonce":704809754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6831","nonce":704809754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6829","nonce":704809754}]},"public_addr":"172.21.15.162:6825/704809754","cluster_addr":"172.21.15.162:6827/704809754","heartbeat_back_addr":"172.21.15.162:6831/704809754","heartbeat_front_addr":"172.21.15.162:6829/704809754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:19.188506+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:36.535261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:54.242294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:11.815314+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:29.512086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:46.874319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:04.437358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:22.312520+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:39.917998+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:57.340043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:15.252797+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:32.898924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:0/69783025":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/10165744":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/2081407856":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/4026642298":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/1442330765":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/1595718606":"2024-06-03T03:57:45.611046+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:04:13.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.592+0000 7ffaa6b17700 1 -- 172.21.15.123:0/2691755383 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ffa900a1230 msgr2=0x7ffa900a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:13.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.592+0000 7ffaa6b17700 1 --2- 172.21.15.123:0/2691755383 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ffa900a1230 0x7ffa900a36f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ffa94006010 tx=0x7ffa9400b540 comp rx=0 tx=0).stop 2024-06-02T04:04:13.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.592+0000 7ffaa6b17700 1 -- 172.21.15.123:0/2691755383 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffaa0100f70 msgr2=0x7ffaa01972b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:13.592 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.592+0000 7ffaa6b17700 1 --2- 172.21.15.123:0/2691755383 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffaa0100f70 0x7ffaa01972b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c00c9b0 tx=0x7ffa8c00ccc0 comp rx=0 tx=0).stop 2024-06-02T04:04:13.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.592+0000 7ffaa6b17700 1 -- 172.21.15.123:0/2691755383 shutdown_connections 2024-06-02T04:04:13.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.592+0000 7ffaa6b17700 1 --2- 172.21.15.123:0/2691755383 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ffa900a1230 0x7ffa900a36f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:13.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.592+0000 7ffaa6b17700 1 --2- 172.21.15.123:0/2691755383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffaa0101910 0x7ffaa019e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:13.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.592+0000 7ffaa6b17700 1 --2- 172.21.15.123:0/2691755383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffaa00ffd80 0x7ffaa0196d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:13.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.592+0000 7ffaa6b17700 1 --2- 172.21.15.123:0/2691755383 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ffaa0100f70 0x7ffaa01972b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:13.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.592+0000 7ffaa6b17700 1 -- 172.21.15.123:0/2691755383 >> 172.21.15.123:0/2691755383 conn(0x7ffaa00fb330 msgr2=0x7ffaa00fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:13.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.592+0000 7ffaa6b17700 1 -- 172.21.15.123:0/2691755383 shutdown_connections 2024-06-02T04:04:13.593 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.592+0000 7ffaa6b17700 1 -- 172.21.15.123:0/2691755383 wait complete. 2024-06-02T04:04:13.605 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T03:59:57.079448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-02T04:03:05.199881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-02T04:03:05.853741+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-02T04:04:13.605 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-02T04:04:13.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.730+0000 7f1eb69b0700 1 -- 172.21.15.123:0/4038525959 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1eb0101990 msgr2=0x7f1eb01082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:13.732 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.730+0000 7f1eb69b0700 1 --2- 172.21.15.123:0/4038525959 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1eb0101990 0x7f1eb01082b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1ea800b0a0 tx=0x7f1ea800b3b0 comp rx=0 tx=0).stop 2024-06-02T04:04:13.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.730+0000 7f1eb69b0700 1 -- 172.21.15.123:0/4038525959 shutdown_connections 2024-06-02T04:04:13.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.730+0000 7f1eb69b0700 1 --2- 172.21.15.123:0/4038525959 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1eb0101990 0x7f1eb01082b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:13.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.730+0000 7f1eb69b0700 1 --2- 172.21.15.123:0/4038525959 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1eb00ffe80 0x7f1eb01002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:13.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.730+0000 7f1eb69b0700 1 --2- 172.21.15.123:0/4038525959 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1eb0100fd0 0x7f1eb0101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:13.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.730+0000 7f1eb69b0700 1 -- 172.21.15.123:0/4038525959 >> 172.21.15.123:0/4038525959 conn(0x7f1eb00fb3f0 msgr2=0x7f1eb00fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:13.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.731+0000 7f1eb69b0700 1 -- 172.21.15.123:0/4038525959 shutdown_connections 2024-06-02T04:04:13.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.731+0000 7f1eb69b0700 1 -- 172.21.15.123:0/4038525959 wait complete. 2024-06-02T04:04:13.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.731+0000 7f1eb69b0700 1 Processor -- start 2024-06-02T04:04:13.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.731+0000 7f1eb69b0700 1 -- start start 2024-06-02T04:04:13.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.731+0000 7f1eb69b0700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1eb00ffe80 0x7f1eb0196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:13.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.731+0000 7f1eb69b0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1eb0100fd0 0x7f1eb0197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:13.733 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.731+0000 7f1eb69b0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1eb0101990 0x7f1eb019e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:13.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.731+0000 7f1eb69b0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb019eaf0 con 0x7f1eb0100fd0 2024-06-02T04:04:13.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.731+0000 7f1eb69b0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb019ec30 con 0x7f1eb0101990 2024-06-02T04:04:13.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.731+0000 7f1eb69b0700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb019edc0 con 0x7f1eb00ffe80 2024-06-02T04:04:13.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.731+0000 7f1eaf7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1eb0100fd0 0x7f1eb0197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:13.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.732+0000 7f1eaf7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1eb0100fd0 0x7f1eb0197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33458/0 (socket says 172.21.15.123:33458) 2024-06-02T04:04:13.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.732+0000 7f1eaf7fe700 1 -- 172.21.15.123:0/330633656 learned_addr learned my addr 172.21.15.123:0/330633656 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:13.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.732+0000 7f1eaffff700 1 --2- 172.21.15.123:0/330633656 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1eb00ffe80 0x7f1eb0196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:13.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.732+0000 7f1eb4f4d700 1 --2- 172.21.15.123:0/330633656 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1eb0101990 0x7f1eb019e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:13.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.732+0000 7f1eaf7fe700 1 -- 172.21.15.123:0/330633656 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1eb00ffe80 msgr2=0x7f1eb0196fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:13.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.732+0000 7f1eaf7fe700 1 --2- 172.21.15.123:0/330633656 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1eb00ffe80 0x7f1eb0196fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:13.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.732+0000 7f1eaf7fe700 1 -- 172.21.15.123:0/330633656 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1eb0101990 msgr2=0x7f1eb019e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:13.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.732+0000 7f1eaf7fe700 1 --2- 172.21.15.123:0/330633656 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1eb0101990 0x7f1eb019e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:13.734 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.732+0000 7f1eaf7fe700 1 -- 172.21.15.123:0/330633656 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea8009d00 con 0x7f1eb0100fd0 2024-06-02T04:04:13.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.732+0000 7f1eaf7fe700 1 --2- 172.21.15.123:0/330633656 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1eb0100fd0 0x7f1eb0197500 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000d950 tx=0x7f1ea000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:13.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.732+0000 7f1ead7fa700 1 -- 172.21.15.123:0/330633656 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea000f890 con 0x7f1eb0100fd0 2024-06-02T04:04:13.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.732+0000 7f1ead7fa700 1 -- 172.21.15.123:0/330633656 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1ea0010460 con 0x7f1eb0100fd0 2024-06-02T04:04:13.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.732+0000 7f1eb69b0700 1 -- 172.21.15.123:0/330633656 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb019f0a0 con 0x7f1eb0100fd0 2024-06-02T04:04:13.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.732+0000 7f1ead7fa700 1 -- 172.21.15.123:0/330633656 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea000e610 con 0x7f1eb0100fd0 2024-06-02T04:04:13.735 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.732+0000 7f1eb69b0700 1 -- 172.21.15.123:0/330633656 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb019f5b0 con 0x7f1eb0100fd0 2024-06-02T04:04:13.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.733+0000 7f1eb69b0700 1 -- 172.21.15.123:0/330633656 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb0068140 con 0x7f1eb0100fd0 2024-06-02T04:04:13.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.734+0000 7f1ead7fa700 1 -- 172.21.15.123:0/330633656 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f1ea00108d0 con 0x7f1eb0100fd0 2024-06-02T04:04:13.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.735+0000 7f1ead7fa700 1 --2- 172.21.15.123:0/330633656 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f1e980a11b0 0x7f1e980a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:13.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.735+0000 7f1eaffff700 1 --2- 172.21.15.123:0/330633656 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f1e980a11b0 0x7f1e980a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:13.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.735+0000 7f1ead7fa700 1 -- 172.21.15.123:0/330633656 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f1ea00cc710 con 0x7f1eb0100fd0 2024-06-02T04:04:13.736 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.735+0000 7f1eaffff700 1 --2- 172.21.15.123:0/330633656 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f1e980a11b0 0x7f1e980a3670 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4005950 tx=0x7f1ea400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:13.738 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.738+0000 7f1ead7fa700 1 -- 172.21.15.123:0/330633656 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1ea0095e60 con 0x7f1eb0100fd0 2024-06-02T04:04:13.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.932+0000 7f1eb69b0700 1 -- 172.21.15.123:0/330633656 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1eb019f8d0 con 0x7f1eb0100fd0 2024-06-02T04:04:13.932 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.933+0000 7f1ead7fa700 1 -- 172.21.15.123:0/330633656 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1ea00160a0 con 0x7f1eb0100fd0 2024-06-02T04:04:13.933 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-06-02T04:04:13.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.935+0000 7f1eb69b0700 1 -- 172.21.15.123:0/330633656 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f1e980a11b0 msgr2=0x7f1e980a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:13.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.935+0000 7f1eb69b0700 1 --2- 172.21.15.123:0/330633656 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f1e980a11b0 0x7f1e980a3670 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4005950 tx=0x7f1ea400b410 comp rx=0 tx=0).stop 2024-06-02T04:04:13.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.935+0000 7f1eb69b0700 1 -- 172.21.15.123:0/330633656 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1eb0100fd0 msgr2=0x7f1eb0197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:13.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.935+0000 7f1eb69b0700 1 --2- 172.21.15.123:0/330633656 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1eb0100fd0 0x7f1eb0197500 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f1ea000d950 tx=0x7f1ea000dc60 comp rx=0 tx=0).stop 2024-06-02T04:04:13.935 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.935+0000 7f1eb69b0700 1 -- 172.21.15.123:0/330633656 shutdown_connections 2024-06-02T04:04:13.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.935+0000 7f1eb69b0700 1 --2- 172.21.15.123:0/330633656 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f1e980a11b0 0x7f1e980a3670 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:13.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.935+0000 7f1eb69b0700 1 --2- 172.21.15.123:0/330633656 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1eb0101990 0x7f1eb019e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:13.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.935+0000 7f1eb69b0700 1 --2- 172.21.15.123:0/330633656 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1eb00ffe80 0x7f1eb0196fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:13.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.935+0000 7f1eb69b0700 1 --2- 172.21.15.123:0/330633656 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1eb0100fd0 0x7f1eb0197500 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:13.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.935+0000 7f1eb69b0700 1 -- 172.21.15.123:0/330633656 >> 172.21.15.123:0/330633656 conn(0x7f1eb00fb3f0 msgr2=0x7f1eb00fceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:13.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.935+0000 7f1eb69b0700 1 -- 172.21.15.123:0/330633656 shutdown_connections 2024-06-02T04:04:13.936 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:13.935+0000 7f1eb69b0700 1 -- 172.21.15.123:0/330633656 wait complete. 2024-06-02T04:04:13.948 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-02T04:04:14.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.074+0000 7f2a86b4e700 1 -- 172.21.15.123:0/2350569610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a80100fd0 msgr2=0x7f2a80101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:14.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.074+0000 7f2a86b4e700 1 --2- 172.21.15.123:0/2350569610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a80100fd0 0x7f2a80101450 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c009990 tx=0x7f2a6c009ca0 comp rx=0 tx=0).stop 2024-06-02T04:04:14.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.074+0000 7f2a86b4e700 1 -- 172.21.15.123:0/2350569610 shutdown_connections 2024-06-02T04:04:14.076 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.074+0000 7f2a86b4e700 1 --2- 172.21.15.123:0/2350569610 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a80101990 0x7f2a801082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:14.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.074+0000 7f2a86b4e700 1 --2- 172.21.15.123:0/2350569610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a800ffe80 0x7f2a801002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:14.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.074+0000 7f2a86b4e700 1 --2- 172.21.15.123:0/2350569610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a80100fd0 0x7f2a80101450 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:14.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.074+0000 7f2a86b4e700 1 -- 172.21.15.123:0/2350569610 >> 172.21.15.123:0/2350569610 conn(0x7f2a800fb3f0 msgr2=0x7f2a800fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:14.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.074+0000 7f2a86b4e700 1 -- 172.21.15.123:0/2350569610 shutdown_connections 2024-06-02T04:04:14.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.074+0000 7f2a86b4e700 1 -- 172.21.15.123:0/2350569610 wait complete. 2024-06-02T04:04:14.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.074+0000 7f2a86b4e700 1 Processor -- start 2024-06-02T04:04:14.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.075+0000 7f2a86b4e700 1 -- start start 2024-06-02T04:04:14.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.075+0000 7f2a86b4e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a800ffe80 0x7f2a80069cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:14.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.075+0000 7f2a86b4e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a80100fd0 0x7f2a8019bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:14.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.075+0000 7f2a86b4e700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a80101990 0x7f2a8019e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:14.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.075+0000 7f2a86b4e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8019e9f0 con 0x7f2a80100fd0 2024-06-02T04:04:14.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.075+0000 7f2a86b4e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8019eb60 con 0x7f2a800ffe80 2024-06-02T04:04:14.077 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.075+0000 7f2a86b4e700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8019ed20 con 0x7f2a80101990 2024-06-02T04:04:14.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.075+0000 7f2a7ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a80100fd0 0x7f2a8019bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:14.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.075+0000 7f2a7ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a80100fd0 0x7f2a8019bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:33472/0 (socket says 172.21.15.123:33472) 2024-06-02T04:04:14.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.075+0000 7f2a7ffff700 1 -- 172.21.15.123:0/2160279844 learned_addr learned my addr 172.21.15.123:0/2160279844 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:14.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.075+0000 7f2a848ea700 1 --2- 172.21.15.123:0/2160279844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a800ffe80 0x7f2a80069cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:14.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.075+0000 7f2a7ffff700 1 -- 172.21.15.123:0/2160279844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a80101990 msgr2=0x7f2a8019e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:14.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.075+0000 7f2a7ffff700 1 --2- 172.21.15.123:0/2160279844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a80101990 0x7f2a8019e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:14.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.075+0000 7f2a7ffff700 1 -- 172.21.15.123:0/2160279844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a800ffe80 msgr2=0x7f2a80069cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:14.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.075+0000 7f2a7ffff700 1 --2- 172.21.15.123:0/2160279844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a800ffe80 0x7f2a80069cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:14.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.075+0000 7f2a7ffff700 1 -- 172.21.15.123:0/2160279844 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6c0095f0 con 0x7f2a80100fd0 2024-06-02T04:04:14.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.075+0000 7f2a848ea700 1 --2- 172.21.15.123:0/2160279844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a800ffe80 0x7f2a80069cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:04:14.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.075+0000 7f2a7ffff700 1 --2- 172.21.15.123:0/2160279844 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a80100fd0 0x7f2a8019bc60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c005910 tx=0x7f2a6c009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:14.078 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.075+0000 7f2a7dffb700 1 -- 172.21.15.123:0/2160279844 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c01d070 con 0x7f2a80100fd0 2024-06-02T04:04:14.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.075+0000 7f2a86b4e700 1 -- 172.21.15.123:0/2160279844 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a8019efa0 con 0x7f2a80100fd0 2024-06-02T04:04:14.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.075+0000 7f2a7dffb700 1 -- 172.21.15.123:0/2160279844 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2a6c003fe0 con 0x7f2a80100fd0 2024-06-02T04:04:14.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.075+0000 7f2a7dffb700 1 -- 172.21.15.123:0/2160279844 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c022dd0 con 0x7f2a80100fd0 2024-06-02T04:04:14.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.076+0000 7f2a86b4e700 1 -- 172.21.15.123:0/2160279844 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a8019f370 con 0x7f2a80100fd0 2024-06-02T04:04:14.079 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.076+0000 7f2a86b4e700 1 -- 172.21.15.123:0/2160279844 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a80107290 con 0x7f2a80100fd0 2024-06-02T04:04:14.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.078+0000 7f2a7dffb700 1 -- 172.21.15.123:0/2160279844 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f2a6c022470 con 0x7f2a80100fd0 2024-06-02T04:04:14.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.078+0000 7f2a7dffb700 1 --2- 172.21.15.123:0/2160279844 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2a700a11b0 0x7f2a700a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:14.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.078+0000 7f2a7dffb700 1 -- 172.21.15.123:0/2160279844 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f2a6c0cde10 con 0x7f2a80100fd0 2024-06-02T04:04:14.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.078+0000 7f2a848ea700 1 --2- 172.21.15.123:0/2160279844 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2a700a11b0 0x7f2a700a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:14.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.079+0000 7f2a848ea700 1 --2- 172.21.15.123:0/2160279844 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2a700a11b0 0x7f2a700a3670 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2a74005950 tx=0x7f2a74005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:14.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.082+0000 7f2a7dffb700 1 -- 172.21.15.123:0/2160279844 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2a6c0975f0 con 0x7f2a80100fd0 2024-06-02T04:04:14.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.282+0000 7f2a86b4e700 1 -- 172.21.15.123:0/2160279844 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2a8010b930 con 0x7f2a80100fd0 2024-06-02T04:04:14.282 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.282+0000 7f2a7dffb700 1 -- 172.21.15.123:0/2160279844 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2a6c09ac10 con 0x7f2a80100fd0 2024-06-02T04:04:14.282 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-06-02T04:04:14.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.284+0000 7f2a86b4e700 1 -- 172.21.15.123:0/2160279844 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2a700a11b0 msgr2=0x7f2a700a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:14.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.284+0000 7f2a86b4e700 1 --2- 172.21.15.123:0/2160279844 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2a700a11b0 0x7f2a700a3670 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2a74005950 tx=0x7f2a74005f50 comp rx=0 tx=0).stop 2024-06-02T04:04:14.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.284+0000 7f2a86b4e700 1 -- 172.21.15.123:0/2160279844 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a80100fd0 msgr2=0x7f2a8019bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:14.284 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.284+0000 7f2a86b4e700 1 --2- 172.21.15.123:0/2160279844 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a80100fd0 0x7f2a8019bc60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c005910 tx=0x7f2a6c009510 comp rx=0 tx=0).stop 2024-06-02T04:04:14.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.284+0000 7f2a86b4e700 1 -- 172.21.15.123:0/2160279844 shutdown_connections 2024-06-02T04:04:14.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.284+0000 7f2a86b4e700 1 --2- 172.21.15.123:0/2160279844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a80101990 0x7f2a8019e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:14.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.284+0000 7f2a86b4e700 1 --2- 172.21.15.123:0/2160279844 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2a700a11b0 0x7f2a700a3670 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:14.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.284+0000 7f2a86b4e700 1 --2- 172.21.15.123:0/2160279844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a800ffe80 0x7f2a80069cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:14.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.284+0000 7f2a86b4e700 1 --2- 172.21.15.123:0/2160279844 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2a80100fd0 0x7f2a8019bc60 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:14.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.284+0000 7f2a86b4e700 1 -- 172.21.15.123:0/2160279844 >> 172.21.15.123:0/2160279844 conn(0x7f2a800fb3f0 msgr2=0x7f2a801043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:14.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.284+0000 7f2a86b4e700 1 -- 172.21.15.123:0/2160279844 shutdown_connections 2024-06-02T04:04:14.285 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.284+0000 7f2a86b4e700 1 -- 172.21.15.123:0/2160279844 wait complete. 2024-06-02T04:04:14.295 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:14 smithi123 ceph-mon[42885]: pgmap v257: 97 pgs: 1 activating, 96 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-06-02T04:04:14.296 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:14 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1775228688' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:04:14.296 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:14 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2691755383' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:04:14.296 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:14 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/330633656' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:04:14.297 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-02T04:04:14.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:14 smithi162 ceph-mon[47009]: pgmap v257: 97 pgs: 1 activating, 96 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-06-02T04:04:14.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:14 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/1775228688' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:04:14.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:14 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/2691755383' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:04:14.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:14 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/330633656' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:04:14.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:14 smithi136 ceph-mon[47443]: pgmap v257: 97 pgs: 1 activating, 96 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-06-02T04:04:14.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:14 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/1775228688' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:04:14.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:14 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/2691755383' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:04:14.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:14 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/330633656' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:04:14.423 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.421+0000 7f3e73fbc700 1 -- 172.21.15.123:0/3246899473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e6c1020f0 msgr2=0x7f3e6c102570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:14.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.421+0000 7f3e73fbc700 1 --2- 172.21.15.123:0/3246899473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e6c1020f0 0x7f3e6c102570 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3e68009990 tx=0x7f3e68009ca0 comp rx=0 tx=0).stop 2024-06-02T04:04:14.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.421+0000 7f3e73fbc700 1 -- 172.21.15.123:0/3246899473 shutdown_connections 2024-06-02T04:04:14.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.421+0000 7f3e73fbc700 1 --2- 172.21.15.123:0/3246899473 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e6c102ab0 0x7f3e6c1093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:14.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.421+0000 7f3e73fbc700 1 --2- 172.21.15.123:0/3246899473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e6c100f20 0x7f3e6c101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:14.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.421+0000 7f3e73fbc700 1 --2- 172.21.15.123:0/3246899473 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e6c1020f0 0x7f3e6c102570 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:14.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.421+0000 7f3e73fbc700 1 -- 172.21.15.123:0/3246899473 >> 172.21.15.123:0/3246899473 conn(0x7f3e6c0fc4e0 msgr2=0x7f3e6c0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:14.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.421+0000 7f3e73fbc700 1 -- 172.21.15.123:0/3246899473 shutdown_connections 2024-06-02T04:04:14.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.421+0000 7f3e73fbc700 1 -- 172.21.15.123:0/3246899473 wait complete. 2024-06-02T04:04:14.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.422+0000 7f3e73fbc700 1 Processor -- start 2024-06-02T04:04:14.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.422+0000 7f3e73fbc700 1 -- start start 2024-06-02T04:04:14.424 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.422+0000 7f3e73fbc700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e6c100f20 0x7f3e6c196f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:14.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.422+0000 7f3e73fbc700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e6c1020f0 0x7f3e6c197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:14.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.422+0000 7f3e73fbc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e6c102ab0 0x7f3e6c19e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:14.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.422+0000 7f3e73fbc700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c19ea70 con 0x7f3e6c102ab0 2024-06-02T04:04:14.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.422+0000 7f3e73fbc700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c19ebb0 con 0x7f3e6c100f20 2024-06-02T04:04:14.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.422+0000 7f3e73fbc700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c19ed40 con 0x7f3e6c1020f0 2024-06-02T04:04:14.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.422+0000 7f3e72559700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e6c102ab0 0x7f3e6c19e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:14.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.422+0000 7f3e72559700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e6c102ab0 0x7f3e6c19e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37636/0 (socket says 172.21.15.123:37636) 2024-06-02T04:04:14.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.422+0000 7f3e72559700 1 -- 172.21.15.123:0/2355722471 learned_addr learned my addr 172.21.15.123:0/2355722471 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:14.425 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.422+0000 7f3e71d58700 1 --2- 172.21.15.123:0/2355722471 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e6c100f20 0x7f3e6c196f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:14.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.422+0000 7f3e71557700 1 --2- 172.21.15.123:0/2355722471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e6c1020f0 0x7f3e6c197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:14.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.422+0000 7f3e72559700 1 -- 172.21.15.123:0/2355722471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e6c1020f0 msgr2=0x7f3e6c197480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:14.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.422+0000 7f3e72559700 1 --2- 172.21.15.123:0/2355722471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e6c1020f0 0x7f3e6c197480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:14.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.422+0000 7f3e72559700 1 -- 172.21.15.123:0/2355722471 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e6c100f20 msgr2=0x7f3e6c196f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:14.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.422+0000 7f3e72559700 1 --2- 172.21.15.123:0/2355722471 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e6c100f20 0x7f3e6c196f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:14.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.422+0000 7f3e72559700 1 -- 172.21.15.123:0/2355722471 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e680095f0 con 0x7f3e6c102ab0 2024-06-02T04:04:14.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.422+0000 7f3e72559700 1 --2- 172.21.15.123:0/2355722471 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e6c102ab0 0x7f3e6c19e4a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3e64007ee0 tx=0x7f3e6400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:14.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.423+0000 7f3e62ffd700 1 -- 172.21.15.123:0/2355722471 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e64017070 con 0x7f3e6c102ab0 2024-06-02T04:04:14.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.423+0000 7f3e62ffd700 1 -- 172.21.15.123:0/2355722471 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e6400f040 con 0x7f3e6c102ab0 2024-06-02T04:04:14.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.423+0000 7f3e62ffd700 1 -- 172.21.15.123:0/2355722471 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e64005740 con 0x7f3e6c102ab0 2024-06-02T04:04:14.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.423+0000 7f3e73fbc700 1 -- 172.21.15.123:0/2355722471 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e6c19efc0 con 0x7f3e6c102ab0 2024-06-02T04:04:14.426 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.423+0000 7f3e73fbc700 1 -- 172.21.15.123:0/2355722471 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e6c19f4a0 con 0x7f3e6c102ab0 2024-06-02T04:04:14.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.424+0000 7f3e73fbc700 1 -- 172.21.15.123:0/2355722471 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e6c108460 con 0x7f3e6c102ab0 2024-06-02T04:04:14.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.425+0000 7f3e62ffd700 1 -- 172.21.15.123:0/2355722471 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f3e6400dc60 con 0x7f3e6c102ab0 2024-06-02T04:04:14.427 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.425+0000 7f3e62ffd700 1 --2- 172.21.15.123:0/2355722471 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3e580a1230 0x7f3e580a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:14.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.425+0000 7f3e71d58700 1 --2- 172.21.15.123:0/2355722471 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3e580a1230 0x7f3e580a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:14.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.425+0000 7f3e62ffd700 1 -- 172.21.15.123:0/2355722471 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f3e640cc0c0 con 0x7f3e6c102ab0 2024-06-02T04:04:14.428 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.426+0000 7f3e71d58700 1 --2- 172.21.15.123:0/2355722471 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3e580a1230 0x7f3e580a36f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c100c40 tx=0x7f3e5c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:14.429 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.430+0000 7f3e62ffd700 1 -- 172.21.15.123:0/2355722471 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3e64095810 con 0x7f3e6c102ab0 2024-06-02T04:04:14.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.630+0000 7f3e73fbc700 1 -- 172.21.15.123:0/2355722471 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3e6c10c970 con 0x7f3e6c102ab0 2024-06-02T04:04:14.630 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.630+0000 7f3e62ffd700 1 -- 172.21.15.123:0/2355722471 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3e64098e30 con 0x7f3e6c102ab0 2024-06-02T04:04:14.630 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-06-02T04:04:14.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.632+0000 7f3e73fbc700 1 -- 172.21.15.123:0/2355722471 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3e580a1230 msgr2=0x7f3e580a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:14.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.632+0000 7f3e73fbc700 1 --2- 172.21.15.123:0/2355722471 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3e580a1230 0x7f3e580a36f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c100c40 tx=0x7f3e5c00b410 comp rx=0 tx=0).stop 2024-06-02T04:04:14.632 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.632+0000 7f3e73fbc700 1 -- 172.21.15.123:0/2355722471 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e6c102ab0 msgr2=0x7f3e6c19e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:14.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.632+0000 7f3e73fbc700 1 --2- 172.21.15.123:0/2355722471 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e6c102ab0 0x7f3e6c19e4a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3e64007ee0 tx=0x7f3e6400d3b0 comp rx=0 tx=0).stop 2024-06-02T04:04:14.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.632+0000 7f3e73fbc700 1 -- 172.21.15.123:0/2355722471 shutdown_connections 2024-06-02T04:04:14.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.632+0000 7f3e73fbc700 1 --2- 172.21.15.123:0/2355722471 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3e6c102ab0 0x7f3e6c19e4a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:14.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.632+0000 7f3e73fbc700 1 --2- 172.21.15.123:0/2355722471 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f3e580a1230 0x7f3e580a36f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:14.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.632+0000 7f3e73fbc700 1 --2- 172.21.15.123:0/2355722471 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e6c100f20 0x7f3e6c196f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:14.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.632+0000 7f3e73fbc700 1 --2- 172.21.15.123:0/2355722471 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e6c1020f0 0x7f3e6c197480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:14.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.632+0000 7f3e73fbc700 1 -- 172.21.15.123:0/2355722471 >> 172.21.15.123:0/2355722471 conn(0x7f3e6c0fc4e0 msgr2=0x7f3e6c1055a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:14.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.632+0000 7f3e73fbc700 1 -- 172.21.15.123:0/2355722471 shutdown_connections 2024-06-02T04:04:14.633 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.632+0000 7f3e73fbc700 1 -- 172.21.15.123:0/2355722471 wait complete. 2024-06-02T04:04:14.645 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:04:14.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.766+0000 7f7b102af700 1 -- 172.21.15.123:0/1692620058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b080ffd90 msgr2=0x7f7b081001b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:14.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.766+0000 7f7b102af700 1 --2- 172.21.15.123:0/1692620058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b080ffd90 0x7f7b081001b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7af80099c0 tx=0x7f7af8009cd0 comp rx=0 tx=0).stop 2024-06-02T04:04:14.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.766+0000 7f7b102af700 1 -- 172.21.15.123:0/1692620058 shutdown_connections 2024-06-02T04:04:14.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.766+0000 7f7b102af700 1 --2- 172.21.15.123:0/1692620058 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b08101920 0x7f7b081081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:14.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.766+0000 7f7b102af700 1 --2- 172.21.15.123:0/1692620058 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b080ffd90 0x7f7b081001b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:14.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.766+0000 7f7b102af700 1 --2- 172.21.15.123:0/1692620058 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b08100f80 0x7f7b081013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:14.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.766+0000 7f7b102af700 1 -- 172.21.15.123:0/1692620058 >> 172.21.15.123:0/1692620058 conn(0x7f7b080fb300 msgr2=0x7f7b080fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:14.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.766+0000 7f7b102af700 1 -- 172.21.15.123:0/1692620058 shutdown_connections 2024-06-02T04:04:14.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.766+0000 7f7b102af700 1 -- 172.21.15.123:0/1692620058 wait complete. 2024-06-02T04:04:14.768 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.767+0000 7f7b102af700 1 Processor -- start 2024-06-02T04:04:14.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.767+0000 7f7b102af700 1 -- start start 2024-06-02T04:04:14.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.767+0000 7f7b102af700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b080ffd90 0x7f7b08196e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:14.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.767+0000 7f7b102af700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b08100f80 0x7f7b08197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:14.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.767+0000 7f7b102af700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b08101920 0x7f7b0819e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:14.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.767+0000 7f7b102af700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0819e940 con 0x7f7b080ffd90 2024-06-02T04:04:14.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.767+0000 7f7b102af700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0819ea80 con 0x7f7b08100f80 2024-06-02T04:04:14.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.767+0000 7f7b102af700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b0819ec10 con 0x7f7b08101920 2024-06-02T04:04:14.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.767+0000 7f7b0e04b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b080ffd90 0x7f7b08196e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:14.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.767+0000 7f7b0e04b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b080ffd90 0x7f7b08196e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37652/0 (socket says 172.21.15.123:37652) 2024-06-02T04:04:14.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.767+0000 7f7b0e04b700 1 -- 172.21.15.123:0/4176396137 learned_addr learned my addr 172.21.15.123:0/4176396137 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:14.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.767+0000 7f7b0d84a700 1 --2- 172.21.15.123:0/4176396137 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b08100f80 0x7f7b08197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:14.769 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.767+0000 7f7b0e04b700 1 -- 172.21.15.123:0/4176396137 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b08101920 msgr2=0x7f7b0819e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:14.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.767+0000 7f7b0e04b700 1 --2- 172.21.15.123:0/4176396137 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b08101920 0x7f7b0819e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:14.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.767+0000 7f7b0e04b700 1 -- 172.21.15.123:0/4176396137 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b08100f80 msgr2=0x7f7b08197350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:14.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.767+0000 7f7b0e04b700 1 --2- 172.21.15.123:0/4176396137 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b08100f80 0x7f7b08197350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:14.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.767+0000 7f7b0e04b700 1 -- 172.21.15.123:0/4176396137 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af80095f0 con 0x7f7b080ffd90 2024-06-02T04:04:14.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.767+0000 7f7b0e04b700 1 --2- 172.21.15.123:0/4176396137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b080ffd90 0x7f7b08196e10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7af8006010 tx=0x7f7af8009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:14.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.767+0000 7f7aff7fe700 1 -- 172.21.15.123:0/4176396137 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af801d070 con 0x7f7b080ffd90 2024-06-02T04:04:14.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.767+0000 7f7aff7fe700 1 -- 172.21.15.123:0/4176396137 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7af80041d0 con 0x7f7b080ffd90 2024-06-02T04:04:14.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.768+0000 7f7aff7fe700 1 -- 172.21.15.123:0/4176396137 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af8005290 con 0x7f7b080ffd90 2024-06-02T04:04:14.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.768+0000 7f7b102af700 1 -- 172.21.15.123:0/4176396137 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b0819ee90 con 0x7f7b080ffd90 2024-06-02T04:04:14.770 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.768+0000 7f7b102af700 1 -- 172.21.15.123:0/4176396137 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b0819f260 con 0x7f7b080ffd90 2024-06-02T04:04:14.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.769+0000 7f7b102af700 1 -- 172.21.15.123:0/4176396137 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b08068060 con 0x7f7b080ffd90 2024-06-02T04:04:14.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.770+0000 7f7aff7fe700 1 -- 172.21.15.123:0/4176396137 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f7af8004870 con 0x7f7b080ffd90 2024-06-02T04:04:14.771 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.770+0000 7f7aff7fe700 1 --2- 172.21.15.123:0/4176396137 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7af40a11b0 0x7f7af40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:14.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.770+0000 7f7b0d84a700 1 --2- 172.21.15.123:0/4176396137 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7af40a11b0 0x7f7af40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:14.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.770+0000 7f7aff7fe700 1 -- 172.21.15.123:0/4176396137 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f7af80cdc40 con 0x7f7b080ffd90 2024-06-02T04:04:14.772 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.771+0000 7f7b0d84a700 1 --2- 172.21.15.123:0/4176396137 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7af40a11b0 0x7f7af40a3670 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7b04005950 tx=0x7f7b040058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:14.773 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:14.774+0000 7f7aff7fe700 1 -- 172.21.15.123:0/4176396137 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7af8097420 con 0x7f7b080ffd90 2024-06-02T04:04:15.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.018+0000 7f7b102af700 1 -- 172.21.15.123:0/4176396137 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b0810b830 con 0x7f7b080ffd90 2024-06-02T04:04:15.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.019+0000 7f7aff7fe700 1 -- 172.21.15.123:0/4176396137 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10930 (secure 0 0 0) 0x7f7af809aa40 con 0x7f7b080ffd90 2024-06-02T04:04:15.019 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:15.019 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1940848601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1940848601},{"type":"v1","addr":"172.21.15.123:6835","nonce":1940848601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/54447879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":54447879},{"type":"v1","addr":"172.21.15.123:6837","nonce":54447879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T04:03:06.667888+0000","modified":"2024-06-02T04:03:13.099282+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24490,"mds_2":24473,"mds_3":24439,"mds_4":24437},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6839/3806973328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":3806973328},{"type":"v1","addr":"172.21.15.123:6839","nonce":3806973328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14619":{"gid":14619,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6841/4032992994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":4032992994},{"type":"v1","addr":"172.21.15.123:6841","nonce":4032992994}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24437":{"gid":24437,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6833/2006585076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2006585076},{"type":"v1","addr":"172.21.15.136:6833","nonce":2006585076}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.162:6833/3583622784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3583622784},{"type":"v1","addr":"172.21.15.162:6833","nonce":3583622784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/2894031422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2894031422},{"type":"v1","addr":"172.21.15.136:6835","nonce":2894031422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24463":{"gid":24463,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2478943987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2478943987},{"type":"v1","addr":"172.21.15.162:6835","nonce":2478943987}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3402138468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3402138468},{"type":"v1","addr":"172.21.15.162:6837","nonce":3402138468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.136:6837/2572418263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2572418263},{"type":"v1","addr":"172.21.15.136:6837","nonce":2572418263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/2588884232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2588884232},{"type":"v1","addr":"172.21.15.162:6839","nonce":2588884232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6839/952830191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":952830191},{"type":"v1","addr":"172.21.15.136:6839","nonce":952830191}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-06-02T04:04:15.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.021+0000 7f7b102af700 1 -- 172.21.15.123:0/4176396137 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7af40a11b0 msgr2=0x7f7af40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.021+0000 7f7b102af700 1 --2- 172.21.15.123:0/4176396137 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7af40a11b0 0x7f7af40a3670 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7b04005950 tx=0x7f7b040058e0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.021+0000 7f7b102af700 1 -- 172.21.15.123:0/4176396137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b080ffd90 msgr2=0x7f7b08196e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.021 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.021+0000 7f7b102af700 1 --2- 172.21.15.123:0/4176396137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b080ffd90 0x7f7b08196e10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7af8006010 tx=0x7f7af8009510 comp rx=0 tx=0).stop 2024-06-02T04:04:15.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.021+0000 7f7b102af700 1 -- 172.21.15.123:0/4176396137 shutdown_connections 2024-06-02T04:04:15.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.021+0000 7f7b102af700 1 --2- 172.21.15.123:0/4176396137 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b08101920 0x7f7b0819e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.021+0000 7f7b102af700 1 --2- 172.21.15.123:0/4176396137 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b080ffd90 0x7f7b08196e10 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.021+0000 7f7b102af700 1 --2- 172.21.15.123:0/4176396137 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7af40a11b0 0x7f7af40a3670 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.021+0000 7f7b102af700 1 --2- 172.21.15.123:0/4176396137 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b08100f80 0x7f7b08197350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.021+0000 7f7b102af700 1 -- 172.21.15.123:0/4176396137 >> 172.21.15.123:0/4176396137 conn(0x7f7b080fb300 msgr2=0x7f7b08069460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:15.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.021+0000 7f7b102af700 1 -- 172.21.15.123:0/4176396137 shutdown_connections 2024-06-02T04:04:15.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.021+0000 7f7b102af700 1 -- 172.21.15.123:0/4176396137 wait complete. 2024-06-02T04:04:15.022 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 27 2024-06-02T04:04:15.033 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:04:15.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.156+0000 7fd670e5d700 1 -- 172.21.15.123:0/1514532853 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd66c101910 msgr2=0x7fd66c1081c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.156+0000 7fd670e5d700 1 --2- 172.21.15.123:0/1514532853 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd66c101910 0x7fd66c1081c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd66400b0d0 tx=0x7fd66400b3e0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.156+0000 7fd670e5d700 1 -- 172.21.15.123:0/1514532853 shutdown_connections 2024-06-02T04:04:15.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.156+0000 7fd670e5d700 1 --2- 172.21.15.123:0/1514532853 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd66c101910 0x7fd66c1081c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.156+0000 7fd670e5d700 1 --2- 172.21.15.123:0/1514532853 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd66c0ffd80 0x7fd66c1001a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.156+0000 7fd670e5d700 1 --2- 172.21.15.123:0/1514532853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd66c100f70 0x7fd66c1013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.156+0000 7fd670e5d700 1 -- 172.21.15.123:0/1514532853 >> 172.21.15.123:0/1514532853 conn(0x7fd66c0fb2f0 msgr2=0x7fd66c0fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:15.156 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.156+0000 7fd670e5d700 1 -- 172.21.15.123:0/1514532853 shutdown_connections 2024-06-02T04:04:15.157 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.156+0000 7fd670e5d700 1 -- 172.21.15.123:0/1514532853 wait complete. 2024-06-02T04:04:15.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.157+0000 7fd670e5d700 1 Processor -- start 2024-06-02T04:04:15.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.157+0000 7fd670e5d700 1 -- start start 2024-06-02T04:04:15.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.157+0000 7fd670e5d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd66c0ffd80 0x7fd66c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.157+0000 7fd670e5d700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd66c100f70 0x7fd66c19bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.157+0000 7fd670e5d700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd66c101910 0x7fd66c19e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.157+0000 7fd670e5d700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c19ea00 con 0x7fd66c0ffd80 2024-06-02T04:04:15.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.157+0000 7fd670e5d700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c19eb70 con 0x7fd66c100f70 2024-06-02T04:04:15.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.157+0000 7fd670e5d700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c19ed30 con 0x7fd66c101910 2024-06-02T04:04:15.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.157+0000 7fd66a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd66c0ffd80 0x7fd66c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.159 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.157+0000 7fd66a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd66c0ffd80 0x7fd66c069db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37676/0 (socket says 172.21.15.123:37676) 2024-06-02T04:04:15.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.157+0000 7fd66a59c700 1 -- 172.21.15.123:0/3935040377 learned_addr learned my addr 172.21.15.123:0/3935040377 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:15.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.157+0000 7fd66ad9d700 1 --2- 172.21.15.123:0/3935040377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd66c101910 0x7fd66c19e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.157+0000 7fd669d9b700 1 --2- 172.21.15.123:0/3935040377 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd66c100f70 0x7fd66c19bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.157+0000 7fd66a59c700 1 -- 172.21.15.123:0/3935040377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd66c101910 msgr2=0x7fd66c19e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.157+0000 7fd66a59c700 1 --2- 172.21.15.123:0/3935040377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd66c101910 0x7fd66c19e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.157+0000 7fd66a59c700 1 -- 172.21.15.123:0/3935040377 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd66c100f70 msgr2=0x7fd66c19bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.157+0000 7fd66a59c700 1 --2- 172.21.15.123:0/3935040377 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd66c100f70 0x7fd66c19bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.157+0000 7fd66a59c700 1 -- 172.21.15.123:0/3935040377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd664009d00 con 0x7fd66c0ffd80 2024-06-02T04:04:15.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.158+0000 7fd66a59c700 1 --2- 172.21.15.123:0/3935040377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd66c0ffd80 0x7fd66c069db0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd65c00d980 tx=0x7fd65c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:15.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.158+0000 7fd65b7fe700 1 -- 172.21.15.123:0/3935040377 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65c004020 con 0x7fd66c0ffd80 2024-06-02T04:04:15.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.158+0000 7fd65b7fe700 1 -- 172.21.15.123:0/3935040377 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd65c00f690 con 0x7fd66c0ffd80 2024-06-02T04:04:15.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.158+0000 7fd670e5d700 1 -- 172.21.15.123:0/3935040377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd66c19efb0 con 0x7fd66c0ffd80 2024-06-02T04:04:15.160 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.158+0000 7fd65b7fe700 1 -- 172.21.15.123:0/3935040377 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65c003a60 con 0x7fd66c0ffd80 2024-06-02T04:04:15.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.158+0000 7fd670e5d700 1 -- 172.21.15.123:0/3935040377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd66c19f4b0 con 0x7fd66c0ffd80 2024-06-02T04:04:15.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.159+0000 7fd670e5d700 1 -- 172.21.15.123:0/3935040377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd66c1071b0 con 0x7fd66c0ffd80 2024-06-02T04:04:15.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.160+0000 7fd65b7fe700 1 -- 172.21.15.123:0/3935040377 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fd65c00fb00 con 0x7fd66c0ffd80 2024-06-02T04:04:15.161 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.160+0000 7fd65b7fe700 1 --2- 172.21.15.123:0/3935040377 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd6540a1230 0x7fd6540a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.161+0000 7fd669d9b700 1 --2- 172.21.15.123:0/3935040377 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd6540a1230 0x7fd6540a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.161+0000 7fd65b7fe700 1 -- 172.21.15.123:0/3935040377 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fd65c0cc880 con 0x7fd66c0ffd80 2024-06-02T04:04:15.162 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.161+0000 7fd669d9b700 1 --2- 172.21.15.123:0/3935040377 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd6540a1230 0x7fd6540a36f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd66c06a310 tx=0x7fd660009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:15.164 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.164+0000 7fd65b7fe700 1 -- 172.21.15.123:0/3935040377 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd65c095fd0 con 0x7fd66c0ffd80 2024-06-02T04:04:15.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:15 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/2160279844' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:04:15.317 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:15 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/2355722471' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:04:15.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:15 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2160279844' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:04:15.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:15 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2355722471' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:04:15.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:15 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/2160279844' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:04:15.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:15 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/2355722471' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:04:15.362 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.363+0000 7fd670e5d700 1 -- 172.21.15.123:0/3935040377 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd66c067380 con 0x7fd66c0ffd80 2024-06-02T04:04:15.364 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.364+0000 7fd65b7fe700 1 -- 172.21.15.123:0/3935040377 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22468 (secure 0 0 0) 0x7fd65c0995f0 con 0x7fd66c0ffd80 2024-06-02T04:04:15.364 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:15.364 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":84,"fsid":"1b432ae0-2094-11ef-bc9b-c7b262605968","created":"2024-06-02T03:57:17.383774+0000","modified":"2024-06-02T04:04:08.620765+0000","last_up_change":"2024-06-02T04:02:34.535591+0000","last_in_change":"2024-06-02T04:02:18.346560+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T03:59:57.079448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:03:05.199881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:03:05.853741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d9d8fb5a-dac5-4b14-98e5-665bdbc696ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6803","nonce":2763421276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6805","nonce":2763421276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6809","nonce":2763421276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6807","nonce":2763421276}]},"public_addr":"172.21.15.123:6803/2763421276","cluster_addr":"172.21.15.123:6805/2763421276","heartbeat_back_addr":"172.21.15.123:6809/2763421276","heartbeat_front_addr":"172.21.15.123:6807/2763421276","state":["exists","up"]},{"osd":1,"uuid":"121bbe3c-bb76-4ec4-9596-37db68fbf1ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6801","nonce":956325510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6803","nonce":956325510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6807","nonce":956325510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6805","nonce":956325510}]},"public_addr":"172.21.15.136:6801/956325510","cluster_addr":"172.21.15.136:6803/956325510","heartbeat_back_addr":"172.21.15.136:6807/956325510","heartbeat_front_addr":"172.21.15.136:6805/956325510","state":["exists","up"]},{"osd":2,"uuid":"df9edf0d-f9f0-4699-a6ed-bbcf2dfb1b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6801","nonce":2915749676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6803","nonce":2915749676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6807","nonce":2915749676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6805","nonce":2915749676}]},"public_addr":"172.21.15.162:6801/2915749676","cluster_addr":"172.21.15.162:6803/2915749676","heartbeat_back_addr":"172.21.15.162:6807/2915749676","heartbeat_front_addr":"172.21.15.162:6805/2915749676","state":["exists","up"]},{"osd":3,"uuid":"3e070364-12c6-4780-b2be-f6e933e65773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6811","nonce":1403773143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6813","nonce":1403773143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6817","nonce":1403773143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6815","nonce":1403773143}]},"public_addr":"172.21.15.123:6811/1403773143","cluster_addr":"172.21.15.123:6813/1403773143","heartbeat_back_addr":"172.21.15.123:6817/1403773143","heartbeat_front_addr":"172.21.15.123:6815/1403773143","state":["exists","up"]},{"osd":4,"uuid":"87dd92dd-73c8-4785-bf8a-3756d79dee90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6809","nonce":1403526782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6811","nonce":1403526782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6815","nonce":1403526782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6813","nonce":1403526782}]},"public_addr":"172.21.15.136:6809/1403526782","cluster_addr":"172.21.15.136:6811/1403526782","heartbeat_back_addr":"172.21.15.136:6815/1403526782","heartbeat_front_addr":"172.21.15.136:6813/1403526782","state":["exists","up"]},{"osd":5,"uuid":"1a730863-6b56-43b7-a115-c80d3c8f3ee3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6809","nonce":3094256489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6811","nonce":3094256489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6815","nonce":3094256489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6813","nonce":3094256489}]},"public_addr":"172.21.15.162:6809/3094256489","cluster_addr":"172.21.15.162:6811/3094256489","heartbeat_back_addr":"172.21.15.162:6815/3094256489","heartbeat_front_addr":"172.21.15.162:6813/3094256489","state":["exists","up"]},{"osd":6,"uuid":"6f170b85-6c47-49ff-ba5b-7fe0596a4ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6819","nonce":3025820432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6821","nonce":3025820432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6825","nonce":3025820432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6823","nonce":3025820432}]},"public_addr":"172.21.15.123:6819/3025820432","cluster_addr":"172.21.15.123:6821/3025820432","heartbeat_back_addr":"172.21.15.123:6825/3025820432","heartbeat_front_addr":"172.21.15.123:6823/3025820432","state":["exists","up"]},{"osd":7,"uuid":"ee66bb7a-6c0d-4e5a-b717-258a39f93a87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6817","nonce":1948829505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6819","nonce":1948829505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6823","nonce":1948829505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6821","nonce":1948829505}]},"public_addr":"172.21.15.136:6817/1948829505","cluster_addr":"172.21.15.136:6819/1948829505","heartbeat_back_addr":"172.21.15.136:6823/1948829505","heartbeat_front_addr":"172.21.15.136:6821/1948829505","state":["exists","up"]},{"osd":8,"uuid":"0ff77e33-53a5-43ef-85da-2036a1fcdb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6817","nonce":1590839230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6819","nonce":1590839230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6823","nonce":1590839230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6821","nonce":1590839230}]},"public_addr":"172.21.15.162:6817/1590839230","cluster_addr":"172.21.15.162:6819/1590839230","heartbeat_back_addr":"172.21.15.162:6823/1590839230","heartbeat_front_addr":"172.21.15.162:6821/1590839230","state":["exists","up"]},{"osd":9,"uuid":"1670731c-5e8f-4cbc-8f35-6aeb14ea3075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6827","nonce":608720685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6829","nonce":608720685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6833","nonce":608720685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6831","nonce":608720685}]},"public_addr":"172.21.15.123:6827/608720685","cluster_addr":"172.21.15.123:6829/608720685","heartbeat_back_addr":"172.21.15.123:6833/608720685","heartbeat_front_addr":"172.21.15.123:6831/608720685","state":["exists","up"]},{"osd":10,"uuid":"ae138b96-13e7-46ac-9d4d-48308132465d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6825","nonce":3777263126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6827","nonce":3777263126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6831","nonce":3777263126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6829","nonce":3777263126}]},"public_addr":"172.21.15.136:6825/3777263126","cluster_addr":"172.21.15.136:6827/3777263126","heartbeat_back_addr":"172.21.15.136:6831/3777263126","heartbeat_front_addr":"172.21.15.136:6829/3777263126","state":["exists","up"]},{"osd":11,"uuid":"69f4ede0-7e9b-4edb-be54-01f74f002a06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6825","nonce":704809754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6827","nonce":704809754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6831","nonce":704809754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6829","nonce":704809754}]},"public_addr":"172.21.15.162:6825/704809754","cluster_addr":"172.21.15.162:6827/704809754","heartbeat_back_addr":"172.21.15.162:6831/704809754","heartbeat_front_addr":"172.21.15.162:6829/704809754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:19.188506+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:36.535261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:54.242294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:11.815314+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:29.512086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:46.874319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:04.437358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:22.312520+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:39.917998+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:57.340043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:15.252797+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:32.898924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:0/69783025":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/10165744":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/2081407856":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/4026642298":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/1442330765":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/1595718606":"2024-06-03T03:57:45.611046+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:04:15.366 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.366+0000 7fd670e5d700 1 -- 172.21.15.123:0/3935040377 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd6540a1230 msgr2=0x7fd6540a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.366+0000 7fd670e5d700 1 --2- 172.21.15.123:0/3935040377 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd6540a1230 0x7fd6540a36f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd66c06a310 tx=0x7fd660009260 comp rx=0 tx=0).stop 2024-06-02T04:04:15.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.366+0000 7fd670e5d700 1 -- 172.21.15.123:0/3935040377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd66c0ffd80 msgr2=0x7fd66c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.366+0000 7fd670e5d700 1 --2- 172.21.15.123:0/3935040377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd66c0ffd80 0x7fd66c069db0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fd65c00d980 tx=0x7fd65c00dc90 comp rx=0 tx=0).stop 2024-06-02T04:04:15.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.366+0000 7fd670e5d700 1 -- 172.21.15.123:0/3935040377 shutdown_connections 2024-06-02T04:04:15.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.366+0000 7fd670e5d700 1 --2- 172.21.15.123:0/3935040377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd66c101910 0x7fd66c19e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.366+0000 7fd670e5d700 1 --2- 172.21.15.123:0/3935040377 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd66c0ffd80 0x7fd66c069db0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.366+0000 7fd670e5d700 1 --2- 172.21.15.123:0/3935040377 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd6540a1230 0x7fd6540a36f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.366+0000 7fd670e5d700 1 --2- 172.21.15.123:0/3935040377 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd66c100f70 0x7fd66c19bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.366+0000 7fd670e5d700 1 -- 172.21.15.123:0/3935040377 >> 172.21.15.123:0/3935040377 conn(0x7fd66c0fb2f0 msgr2=0x7fd66c1042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:15.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.366+0000 7fd670e5d700 1 -- 172.21.15.123:0/3935040377 shutdown_connections 2024-06-02T04:04:15.367 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.366+0000 7fd670e5d700 1 -- 172.21.15.123:0/3935040377 wait complete. 2024-06-02T04:04:15.379 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-06-02T04:03:06.667888+0000', 'modified': '2024-06-02T04:03:13.099282+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24509, 'mds_1': 24490, 'mds_2': 24473, 'mds_3': 24439, 'mds_4': 24437}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14613': {'gid': 14613, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.123:6839/3806973328', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6838', 'nonce': 3806973328}, {'type': 'v1', 'addr': '172.21.15.123:6839', 'nonce': 3806973328}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_14619': {'gid': 14619, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.123:6841/4032992994', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.123:6840', 'nonce': 4032992994}, {'type': 'v1', 'addr': '172.21.15.123:6841', 'nonce': 4032992994}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24437': {'gid': 24437, 'name': 'k', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.136:6833/2006585076', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6832', 'nonce': 2006585076}, {'type': 'v1', 'addr': '172.21.15.136:6833', 'nonce': 2006585076}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24439': {'gid': 24439, 'name': 'l', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.162:6833/3583622784', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6832', 'nonce': 3583622784}, {'type': 'v1', 'addr': '172.21.15.162:6833', 'nonce': 3583622784}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24455': {'gid': 24455, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.136:6835/2894031422', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6834', 'nonce': 2894031422}, {'type': 'v1', 'addr': '172.21.15.136:6835', 'nonce': 2894031422}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24463': {'gid': 24463, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.162:6835/2478943987', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6834', 'nonce': 2478943987}, {'type': 'v1', 'addr': '172.21.15.162:6835', 'nonce': 2478943987}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24469': {'gid': 24469, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.162:6837/3402138468', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6836', 'nonce': 3402138468}, {'type': 'v1', 'addr': '172.21.15.162:6837', 'nonce': 3402138468}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24473': {'gid': 24473, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.136:6837/2572418263', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6836', 'nonce': 2572418263}, {'type': 'v1', 'addr': '172.21.15.136:6837', 'nonce': 2572418263}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24490': {'gid': 24490, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.162:6839/2588884232', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6838', 'nonce': 2588884232}, {'type': 'v1', 'addr': '172.21.15.162:6839', 'nonce': 2588884232}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24509': {'gid': 24509, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.136:6839/952830191', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6838', 'nonce': 952830191}, {'type': 'v1', 'addr': '172.21.15.136:6839', 'nonce': 952830191}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-06-02T04:04:15.379 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-06-02T04:04:15.379 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.k status 2024-06-02T04:04:15.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.503+0000 7f7b4f320700 1 -- 172.21.15.123:0/559145241 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b48102ab0 msgr2=0x7f7b481093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.503+0000 7f7b4f320700 1 --2- 172.21.15.123:0/559145241 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b48102ab0 0x7f7b481093d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7b4000b0a0 tx=0x7f7b4000b3b0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.503+0000 7f7b4f320700 1 -- 172.21.15.123:0/559145241 shutdown_connections 2024-06-02T04:04:15.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.503+0000 7f7b4f320700 1 --2- 172.21.15.123:0/559145241 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b48102ab0 0x7f7b481093d0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.503+0000 7f7b4f320700 1 --2- 172.21.15.123:0/559145241 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b48100f20 0x7f7b48101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.505 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.503+0000 7f7b4f320700 1 --2- 172.21.15.123:0/559145241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b481020f0 0x7f7b48102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.503+0000 7f7b4f320700 1 -- 172.21.15.123:0/559145241 >> 172.21.15.123:0/559145241 conn(0x7f7b480fc4e0 msgr2=0x7f7b480fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:15.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.503+0000 7f7b4f320700 1 -- 172.21.15.123:0/559145241 shutdown_connections 2024-06-02T04:04:15.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.503+0000 7f7b4f320700 1 -- 172.21.15.123:0/559145241 wait complete. 2024-06-02T04:04:15.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.504+0000 7f7b4f320700 1 Processor -- start 2024-06-02T04:04:15.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.504+0000 7f7b4f320700 1 -- start start 2024-06-02T04:04:15.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.504+0000 7f7b4f320700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b48100f20 0x7f7b48196f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.504+0000 7f7b4f320700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b481020f0 0x7f7b48197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.504+0000 7f7b4f320700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b48102ab0 0x7f7b4819e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.504+0000 7f7b4f320700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4819ea30 con 0x7f7b48102ab0 2024-06-02T04:04:15.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.504+0000 7f7b4f320700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4819eb70 con 0x7f7b481020f0 2024-06-02T04:04:15.506 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.504+0000 7f7b4f320700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4819ed00 con 0x7f7b48100f20 2024-06-02T04:04:15.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.504+0000 7f7b4d8bd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b48102ab0 0x7f7b4819e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.504+0000 7f7b4d8bd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b48102ab0 0x7f7b4819e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37692/0 (socket says 172.21.15.123:37692) 2024-06-02T04:04:15.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.504+0000 7f7b4d8bd700 1 -- 172.21.15.123:0/3008946705 learned_addr learned my addr 172.21.15.123:0/3008946705 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:15.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.504+0000 7f7b4c8bb700 1 --2- 172.21.15.123:0/3008946705 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b481020f0 0x7f7b48197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.504+0000 7f7b4d0bc700 1 --2- 172.21.15.123:0/3008946705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b48100f20 0x7f7b48196f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.504+0000 7f7b4d8bd700 1 -- 172.21.15.123:0/3008946705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b48100f20 msgr2=0x7f7b48196f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.504+0000 7f7b4d8bd700 1 --2- 172.21.15.123:0/3008946705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b48100f20 0x7f7b48196f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.504+0000 7f7b4d8bd700 1 -- 172.21.15.123:0/3008946705 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b481020f0 msgr2=0x7f7b48197440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.504+0000 7f7b4d8bd700 1 --2- 172.21.15.123:0/3008946705 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b481020f0 0x7f7b48197440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.504+0000 7f7b4d8bd700 1 -- 172.21.15.123:0/3008946705 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b40009d00 con 0x7f7b48102ab0 2024-06-02T04:04:15.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.504+0000 7f7b4d0bc700 1 --2- 172.21.15.123:0/3008946705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b48100f20 0x7f7b48196f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:04:15.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.505+0000 7f7b4d8bd700 1 --2- 172.21.15.123:0/3008946705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b48102ab0 0x7f7b4819e460 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7b4000d010 tx=0x7f7b40004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:15.507 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.505+0000 7f7b3a7fc700 1 -- 172.21.15.123:0/3008946705 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4000e040 con 0x7f7b48102ab0 2024-06-02T04:04:15.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.505+0000 7f7b3a7fc700 1 -- 172.21.15.123:0/3008946705 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b400094c0 con 0x7f7b48102ab0 2024-06-02T04:04:15.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.505+0000 7f7b4f320700 1 -- 172.21.15.123:0/3008946705 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b4819ef80 con 0x7f7b48102ab0 2024-06-02T04:04:15.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.505+0000 7f7b3a7fc700 1 -- 172.21.15.123:0/3008946705 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4001bc70 con 0x7f7b48102ab0 2024-06-02T04:04:15.508 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.505+0000 7f7b4f320700 1 -- 172.21.15.123:0/3008946705 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4819f3b0 con 0x7f7b48102ab0 2024-06-02T04:04:15.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.507+0000 7f7b3a7fc700 1 -- 172.21.15.123:0/3008946705 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f7b4001d890 con 0x7f7b48102ab0 2024-06-02T04:04:15.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.507+0000 7f7b3a7fc700 1 --2- 172.21.15.123:0/3008946705 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7b340a1230 0x7f7b340a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.507+0000 7f7b4d0bc700 1 --2- 172.21.15.123:0/3008946705 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7b340a1230 0x7f7b340a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.514 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.507+0000 7f7b3a7fc700 1 -- 172.21.15.123:0/3008946705 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f7b400ce870 con 0x7f7b48102ab0 2024-06-02T04:04:15.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.508+0000 7f7b4d0bc700 1 --2- 172.21.15.123:0/3008946705 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7b340a1230 0x7f7b340a36f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c005fd0 tx=0x7f7b3c005e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:15.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.508+0000 7f7b5b4dbb80 1 Processor -- start 2024-06-02T04:04:15.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.508+0000 7f7b5b4dbb80 1 -- start start 2024-06-02T04:04:15.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.509+0000 7f7b5b4dbb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5640504074f0 0x564050407910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.509+0000 7f7b5b4dbb80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564050407e50 0x5640504082d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.509+0000 7f7b5b4dbb80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564050408810 0x564050408c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.509+0000 7f7b5b4dbb80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x56405035e100 con 0x564050407e50 2024-06-02T04:04:15.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.509+0000 7f7b5b4dbb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x56405035bac0 con 0x5640504074f0 2024-06-02T04:04:15.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.509+0000 7f7b5b4dbb80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640503573b0 con 0x564050408810 2024-06-02T04:04:15.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.509+0000 7f7b4c8bb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564050407e50 0x5640504082d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.509+0000 7f7b4c8bb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564050407e50 0x5640504082d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37706/0 (socket says 172.21.15.123:37706) 2024-06-02T04:04:15.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.509+0000 7f7b4c8bb700 1 -- 172.21.15.123:0/310336350 learned_addr learned my addr 172.21.15.123:0/310336350 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:15.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.509+0000 7f7b4d0bc700 1 --2- 172.21.15.123:0/310336350 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5640504074f0 0x564050407910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.515 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.509+0000 7f7b4d8bd700 1 --2- 172.21.15.123:0/310336350 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564050408810 0x564050408c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.509+0000 7f7b4c8bb700 1 -- 172.21.15.123:0/310336350 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564050408810 msgr2=0x564050408c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:15.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.509+0000 7f7b4c8bb700 1 --2- 172.21.15.123:0/310336350 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564050408810 0x564050408c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.509+0000 7f7b4c8bb700 1 -- 172.21.15.123:0/310336350 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5640504074f0 msgr2=0x564050407910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:15.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.509+0000 7f7b4c8bb700 1 --2- 172.21.15.123:0/310336350 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5640504074f0 0x564050407910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.509+0000 7f7b4c8bb700 1 -- 172.21.15.123:0/310336350 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640501d8360 con 0x564050407e50 2024-06-02T04:04:15.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.509+0000 7f7b4d8bd700 1 --2- 172.21.15.123:0/310336350 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564050408810 0x564050408c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:04:15.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.509+0000 7f7b4c8bb700 1 --2- 172.21.15.123:0/310336350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564050407e50 0x5640504082d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7b44005e20 tx=0x7f7b4400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549f89b599970c5d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:15.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.509+0000 7f7b337fe700 1 -- 172.21.15.123:0/310336350 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4400ee20 con 0x564050407e50 2024-06-02T04:04:15.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.509+0000 7f7b337fe700 1 -- 172.21.15.123:0/310336350 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b440108f0 con 0x564050407e50 2024-06-02T04:04:15.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.509+0000 7f7b337fe700 1 -- 172.21.15.123:0/310336350 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4401a930 con 0x564050407e50 2024-06-02T04:04:15.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.510+0000 7f7b5b4dbb80 1 -- 172.21.15.123:0/310336350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564050407e50 msgr2=0x5640504082d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.510+0000 7f7b5b4dbb80 1 --2- 172.21.15.123:0/310336350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564050407e50 0x5640504082d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7b44005e20 tx=0x7f7b4400cf90 comp rx=0 tx=0).stop 2024-06-02T04:04:15.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.510+0000 7f7b5b4dbb80 1 -- 172.21.15.123:0/310336350 shutdown_connections 2024-06-02T04:04:15.516 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.510+0000 7f7b5b4dbb80 1 --2- 172.21.15.123:0/310336350 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564050408810 0x564050408c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.510+0000 7f7b5b4dbb80 1 --2- 172.21.15.123:0/310336350 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5640504074f0 0x564050407910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.510+0000 7f7b5b4dbb80 1 --2- 172.21.15.123:0/310336350 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564050407e50 0x5640504082d0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.510+0000 7f7b5b4dbb80 1 -- 172.21.15.123:0/310336350 >> 172.21.15.123:0/310336350 conn(0x5640503651c0 msgr2=0x564050401d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:15.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.510+0000 7f7b5b4dbb80 1 -- 172.21.15.123:0/310336350 shutdown_connections 2024-06-02T04:04:15.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.510+0000 7f7b5b4dbb80 1 -- 172.21.15.123:0/310336350 wait complete. 2024-06-02T04:04:15.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.510+0000 7f7b5b4dbb80 1 -- start start 2024-06-02T04:04:15.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.511+0000 7f7b5b4dbb80 1 Processor -- start 2024-06-02T04:04:15.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.511+0000 7f7b5b4dbb80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640504074f0 0x564050410db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.511+0000 7f7b5b4dbb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564050407e50 0x5640504112f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.511+0000 7f7b5b4dbb80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564050408810 0x564050418330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.511+0000 7f7b5b4dbb80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640502f3510 con 0x564050408810 2024-06-02T04:04:15.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.511+0000 7f7b5b4dbb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640502f31b0 con 0x564050407e50 2024-06-02T04:04:15.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.511+0000 7f7b5b4dbb80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640501da650 con 0x5640504074f0 2024-06-02T04:04:15.517 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.511+0000 7f7b5b4dbb80 10 client.0 _ll_register_callbacks cb 0x5640502fcae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:04:15.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.511+0000 7f7b4d8bd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564050408810 0x564050418330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.511+0000 7f7b4d8bd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564050408810 0x564050418330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37720/0 (socket says 172.21.15.123:37720) 2024-06-02T04:04:15.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.511+0000 7f7b4d8bd700 1 -- 172.21.15.123:0/2618577043 learned_addr learned my addr 172.21.15.123:0/2618577043 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:15.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.511+0000 7f7b4d8bd700 1 -- 172.21.15.123:0/2618577043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640504074f0 msgr2=0x564050410db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:15.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.511+0000 7f7b4d8bd700 1 --2- 172.21.15.123:0/2618577043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640504074f0 0x564050410db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.511+0000 7f7b4d8bd700 1 -- 172.21.15.123:0/2618577043 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564050407e50 msgr2=0x5640504112f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:15.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.511+0000 7f7b4d8bd700 1 --2- 172.21.15.123:0/2618577043 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564050407e50 0x5640504112f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.511+0000 7f7b4d8bd700 1 -- 172.21.15.123:0/2618577043 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4400c910 con 0x564050408810 2024-06-02T04:04:15.518 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.511+0000 7f7b4d8bd700 1 --2- 172.21.15.123:0/2618577043 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564050408810 0x564050418330 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7b40098780 tx=0x7f7b4009b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a86f37f599d5047 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:15.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.511+0000 7f7b30ff9700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-06-02T04:04:15.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.511+0000 7f7b30ff9700 1 -- 172.21.15.123:0/2618577043 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4009fb40 con 0x564050408810 2024-06-02T04:04:15.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.512+0000 7f7b30ff9700 1 -- 172.21.15.123:0/2618577043 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f7b400a4100 con 0x564050408810 2024-06-02T04:04:15.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.512+0000 7f7b5b4dbb80 1 -- 172.21.15.123:0/2618577043 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5640502b0220 con 0x564050408810 2024-06-02T04:04:15.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.512+0000 7f7b30ff9700 1 -- 172.21.15.123:0/2618577043 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b4009bf70 con 0x564050408810 2024-06-02T04:04:15.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.512+0000 7f7b5b4dbb80 10 client.15234 fetch_fsmap learned FSMap version 27 2024-06-02T04:04:15.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.512+0000 7f7b5b4dbb80 1 -- 172.21.15.123:0/2618577043 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x564050184b10 con 0x564050408810 2024-06-02T04:04:15.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.512+0000 7f7b30ff9700 1 -- 172.21.15.123:0/2618577043 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5640502b0220 con 0x564050408810 2024-06-02T04:04:15.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.512+0000 7f7b30ff9700 1 -- 172.21.15.123:0/2618577043 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f7b4009cd20 con 0x564050408810 2024-06-02T04:04:15.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.512+0000 7f7b5b4dbb80 10 client.15234 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:04:15.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.512+0000 7f7b5b4dbb80 10 client.15234 resolve_mds: resolved name 'k' to daemon mds.k 2024-06-02T04:04:15.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.512+0000 7f7b5b4dbb80 20 client.15234 populate_metadata read hostname 'smithi123' 2024-06-02T04:04:15.519 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.512+0000 7f7b5b4dbb80 1 --2- 172.21.15.123:0/2618577043 >> [v2:172.21.15.136:6832/2006585076,v1:172.21.15.136:6833/2006585076] conn(0x56405041bce0 0x564050421040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.512+0000 7f7b5b4dbb80 4 client.15234 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:04:15.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.512+0000 7f7b5b4dbb80 1 -- 172.21.15.123:0/2618577043 --> [v2:172.21.15.136:6832/2006585076,v1:172.21.15.136:6833/2006585076] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5640503d67c0 con 0x56405041bce0 2024-06-02T04:04:15.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.512+0000 7f7b4d0bc700 1 --2- 172.21.15.123:0/2618577043 >> [v2:172.21.15.136:6832/2006585076,v1:172.21.15.136:6833/2006585076] conn(0x56405041bce0 0x564050421040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.513+0000 7f7b4d0bc700 1 --2- 172.21.15.123:0/2618577043 >> [v2:172.21.15.136:6832/2006585076,v1:172.21.15.136:6833/2006585076] conn(0x56405041bce0 0x564050421040 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8c687ba20d79fe65 server_cookie=6df6c4410fc3b6d4 in_seq=0 out_seq=0 2024-06-02T04:04:15.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.513+0000 7f7b30ff9700 10 client.15234 ms_handle_connect on v2:172.21.15.136:6832/2006585076 2024-06-02T04:04:15.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.513+0000 7f7b30ff9700 1 -- 172.21.15.123:0/2618577043 <== mds.4 v2:172.21.15.136:6832/2006585076 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5640503d67c0 con 0x56405041bce0 2024-06-02T04:04:15.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.513+0000 7f7b30ff9700 10 client.15234 handle_command_reply: tid=0 2024-06-02T04:04:15.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.513+0000 7f7b5b4dbb80 1 client.15234 shutdown 2024-06-02T04:04:15.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.513+0000 7f7b5b4dbb80 1 -- 172.21.15.123:0/2618577043 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564050408810 msgr2=0x564050418330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.513+0000 7f7b5b4dbb80 1 --2- 172.21.15.123:0/2618577043 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564050408810 0x564050418330 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7b40098780 tx=0x7f7b4009b670 comp rx=0 tx=0).stop 2024-06-02T04:04:15.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.514+0000 7f7b5b4dbb80 1 -- 172.21.15.123:0/2618577043 shutdown_connections 2024-06-02T04:04:15.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.514+0000 7f7b5b4dbb80 1 --2- 172.21.15.123:0/2618577043 >> [v2:172.21.15.136:6832/2006585076,v1:172.21.15.136:6833/2006585076] conn(0x56405041bce0 0x564050421040 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.514+0000 7f7b5b4dbb80 1 --2- 172.21.15.123:0/2618577043 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564050408810 0x564050418330 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.520 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.514+0000 7f7b5b4dbb80 1 --2- 172.21.15.123:0/2618577043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640504074f0 0x564050410db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.514+0000 7f7b30ff9700 0 client.15234 ms_handle_reset on v2:172.21.15.136:6832/2006585076 2024-06-02T04:04:15.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.514+0000 7f7b5b4dbb80 1 --2- 172.21.15.123:0/2618577043 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564050407e50 0x5640504112f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.514+0000 7f7b5b4dbb80 1 -- 172.21.15.123:0/2618577043 >> 172.21.15.123:0/2618577043 conn(0x5640503651c0 msgr2=0x564050401550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:15.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.514+0000 7f7b5b4dbb80 1 -- 172.21.15.123:0/2618577043 shutdown_connections 2024-06-02T04:04:15.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.514+0000 7f7b5b4dbb80 1 -- 172.21.15.123:0/2618577043 wait complete. 2024-06-02T04:04:15.521 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.514+0000 7f7b5b4dbb80 20 client.15234 trim_cache size 0 max 16384 2024-06-02T04:04:15.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.531+0000 7f7b5b4dbb80 1 Processor -- start 2024-06-02T04:04:15.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.532+0000 7f7b5b4dbb80 1 -- start start 2024-06-02T04:04:15.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.532+0000 7f7b5b4dbb80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640504074f0 0x5640504113f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.532+0000 7f7b5b4dbb80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564050407e50 0x5640504078d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.532+0000 7f7b5b4dbb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564050408810 0x5640504182f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.532+0000 7f7b5b4dbb80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640502b0220 con 0x564050407e50 2024-06-02T04:04:15.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.532+0000 7f7b5b4dbb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640503152b0 con 0x564050408810 2024-06-02T04:04:15.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.532+0000 7f7b5b4dbb80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x564050354010 con 0x5640504074f0 2024-06-02T04:04:15.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.532+0000 7f7b4c8bb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564050407e50 0x5640504078d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.532+0000 7f7b4c8bb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564050407e50 0x5640504078d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37732/0 (socket says 172.21.15.123:37732) 2024-06-02T04:04:15.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.532+0000 7f7b4c8bb700 1 -- 172.21.15.123:0/2676003192 learned_addr learned my addr 172.21.15.123:0/2676003192 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:15.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.532+0000 7f7b4d8bd700 1 --2- 172.21.15.123:0/2676003192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564050408810 0x5640504182f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.532+0000 7f7b4c8bb700 1 -- 172.21.15.123:0/2676003192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640504074f0 msgr2=0x5640504113f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:15.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.532+0000 7f7b4c8bb700 1 --2- 172.21.15.123:0/2676003192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640504074f0 0x5640504113f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.532+0000 7f7b4c8bb700 1 -- 172.21.15.123:0/2676003192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564050408810 msgr2=0x5640504182f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:15.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.532+0000 7f7b4c8bb700 1 --2- 172.21.15.123:0/2676003192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564050408810 0x5640504182f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.532+0000 7f7b4c8bb700 1 -- 172.21.15.123:0/2676003192 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56405031d510 con 0x564050407e50 2024-06-02T04:04:15.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.532+0000 7f7b4d8bd700 1 --2- 172.21.15.123:0/2676003192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564050408810 0x5640504182f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:04:15.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.532+0000 7f7b4c8bb700 1 --2- 172.21.15.123:0/2676003192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564050407e50 0x5640504078d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400c310 tx=0x7f7b4400c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16be4899f228237f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:15.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.532+0000 7f7b33fff700 1 -- 172.21.15.123:0/2676003192 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4400ee20 con 0x564050407e50 2024-06-02T04:04:15.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.532+0000 7f7b33fff700 1 -- 172.21.15.123:0/2676003192 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b44010a60 con 0x564050407e50 2024-06-02T04:04:15.540 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.532+0000 7f7b33fff700 1 -- 172.21.15.123:0/2676003192 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b440056c0 con 0x564050407e50 2024-06-02T04:04:15.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.533+0000 7f7b5b4dbb80 1 -- 172.21.15.123:0/2676003192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564050407e50 msgr2=0x5640504078d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.533+0000 7f7b5b4dbb80 1 --2- 172.21.15.123:0/2676003192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564050407e50 0x5640504078d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400c310 tx=0x7f7b4400c340 comp rx=0 tx=0).stop 2024-06-02T04:04:15.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.533+0000 7f7b5b4dbb80 1 -- 172.21.15.123:0/2676003192 shutdown_connections 2024-06-02T04:04:15.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.533+0000 7f7b5b4dbb80 1 --2- 172.21.15.123:0/2676003192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564050408810 0x5640504182f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.533+0000 7f7b5b4dbb80 1 --2- 172.21.15.123:0/2676003192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640504074f0 0x5640504113f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.533+0000 7f7b5b4dbb80 1 --2- 172.21.15.123:0/2676003192 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564050407e50 0x5640504078d0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.533+0000 7f7b5b4dbb80 1 -- 172.21.15.123:0/2676003192 >> 172.21.15.123:0/2676003192 conn(0x5640503651c0 msgr2=0x564050408bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:15.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.533+0000 7f7b5b4dbb80 1 -- 172.21.15.123:0/2676003192 shutdown_connections 2024-06-02T04:04:15.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.533+0000 7f7b5b4dbb80 1 -- 172.21.15.123:0/2676003192 wait complete. 2024-06-02T04:04:15.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.533+0000 7f7b5b4dbb80 1 -- start start 2024-06-02T04:04:15.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.533+0000 7f7b5b4dbb80 1 Processor -- start 2024-06-02T04:04:15.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.534+0000 7f7b5b4dbb80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640504074f0 0x564050412940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.541 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.534+0000 7f7b5b4dbb80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564050407e50 0x564050412f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.534+0000 7f7b5b4dbb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564050408810 0x564050417be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.534+0000 7f7b5b4dbb80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x564050418120 con 0x564050407e50 2024-06-02T04:04:15.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.534+0000 7f7b5b4dbb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x564050418290 con 0x564050408810 2024-06-02T04:04:15.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.534+0000 7f7b5b4dbb80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x564050418450 con 0x5640504074f0 2024-06-02T04:04:15.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.534+0000 7f7b5b4dbb80 10 client.0 _ll_register_callbacks cb 0x5640502fcae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:04:15.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.534+0000 7f7b4c8bb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564050407e50 0x564050412f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.534+0000 7f7b4c8bb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564050407e50 0x564050412f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37746/0 (socket says 172.21.15.123:37746) 2024-06-02T04:04:15.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.534+0000 7f7b4c8bb700 1 -- 172.21.15.123:0/2531058571 learned_addr learned my addr 172.21.15.123:0/2531058571 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:15.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.534+0000 7f7b4d0bc700 1 --2- 172.21.15.123:0/2531058571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640504074f0 0x564050412940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.534+0000 7f7b4d8bd700 1 --2- 172.21.15.123:0/2531058571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564050408810 0x564050417be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.534+0000 7f7b4c8bb700 1 -- 172.21.15.123:0/2531058571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640504074f0 msgr2=0x564050412940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:15.542 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.534+0000 7f7b4c8bb700 1 --2- 172.21.15.123:0/2531058571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640504074f0 0x564050412940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.534+0000 7f7b4c8bb700 1 -- 172.21.15.123:0/2531058571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564050408810 msgr2=0x564050417be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:15.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.534+0000 7f7b4c8bb700 1 --2- 172.21.15.123:0/2531058571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564050408810 0x564050417be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.534+0000 7f7b4c8bb700 1 -- 172.21.15.123:0/2531058571 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5640501d8360 con 0x564050407e50 2024-06-02T04:04:15.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.534+0000 7f7b4d0bc700 1 --2- 172.21.15.123:0/2531058571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640504074f0 0x564050412940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:04:15.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.534+0000 7f7b4d8bd700 1 --2- 172.21.15.123:0/2531058571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564050408810 0x564050417be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:04:15.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.534+0000 7f7b4c8bb700 1 --2- 172.21.15.123:0/2531058571 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564050407e50 0x564050412f00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400cc20 tx=0x7f7b4400ef80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d16215d5b7a35ab server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:15.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.534+0000 7f7b30ff9700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-06-02T04:04:15.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.534+0000 7f7b30ff9700 1 -- 172.21.15.123:0/2531058571 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b44010430 con 0x564050407e50 2024-06-02T04:04:15.543 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.534+0000 7f7b30ff9700 1 -- 172.21.15.123:0/2531058571 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f7b44010590 con 0x564050407e50 2024-06-02T04:04:15.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.534+0000 7f7b5b4dbb80 1 -- 172.21.15.123:0/2531058571 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7b440108f0 con 0x564050407e50 2024-06-02T04:04:15.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.535+0000 7f7b30ff9700 1 -- 172.21.15.123:0/2531058571 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b44010750 con 0x564050407e50 2024-06-02T04:04:15.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.535+0000 7f7b5b4dbb80 10 client.15240 fetch_fsmap learned FSMap version 27 2024-06-02T04:04:15.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.535+0000 7f7b5b4dbb80 1 -- 172.21.15.123:0/2531058571 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5640501dcc80 con 0x564050407e50 2024-06-02T04:04:15.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.535+0000 7f7b30ff9700 1 -- 172.21.15.123:0/2531058571 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b4403a020 con 0x564050407e50 2024-06-02T04:04:15.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.535+0000 7f7b30ff9700 1 -- 172.21.15.123:0/2531058571 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f7b440049c0 con 0x564050407e50 2024-06-02T04:04:15.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.535+0000 7f7b5b4dbb80 10 client.15240 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:04:15.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.535+0000 7f7b5b4dbb80 10 client.15240 resolve_mds: resolved name 'k' to daemon mds.k 2024-06-02T04:04:15.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.535+0000 7f7b5b4dbb80 20 client.15240 populate_metadata read hostname 'smithi123' 2024-06-02T04:04:15.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.535+0000 7f7b5b4dbb80 1 --2- 172.21.15.123:0/2531058571 >> [v2:172.21.15.136:6832/2006585076,v1:172.21.15.136:6833/2006585076] conn(0x5640504773a0 0x564050473cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.544 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.535+0000 7f7b5b4dbb80 4 client.15240 mds_command: new command op to 24437 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T04:04:15.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.535+0000 7f7b5b4dbb80 1 -- 172.21.15.123:0/2531058571 --> [v2:172.21.15.136:6832/2006585076,v1:172.21.15.136:6833/2006585076] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56405034fe70 con 0x5640504773a0 2024-06-02T04:04:15.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.535+0000 7f7b4d0bc700 1 --2- 172.21.15.123:0/2531058571 >> [v2:172.21.15.136:6832/2006585076,v1:172.21.15.136:6833/2006585076] conn(0x5640504773a0 0x564050473cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.535+0000 7f7b30ff9700 10 client.15240 ms_handle_connect on v2:172.21.15.136:6832/2006585076 2024-06-02T04:04:15.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.535+0000 7f7b4d0bc700 1 --2- 172.21.15.123:0/2531058571 >> [v2:172.21.15.136:6832/2006585076,v1:172.21.15.136:6833/2006585076] conn(0x5640504773a0 0x564050473cf0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=950a58fce089948e server_cookie=316115b3f42c17fb in_seq=0 out_seq=0 2024-06-02T04:04:15.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.536+0000 7f7b30ff9700 1 -- 172.21.15.123:0/2531058571 <== mds.4 v2:172.21.15.136:6832/2006585076 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x56405034fe70 con 0x5640504773a0 2024-06-02T04:04:15.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.536+0000 7f7b30ff9700 10 client.15240 handle_command_reply: tid=0 2024-06-02T04:04:15.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.536+0000 7f7b5b4dbb80 1 client.15240 shutdown 2024-06-02T04:04:15.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.536+0000 7f7b5b4dbb80 1 -- 172.21.15.123:0/2531058571 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564050407e50 msgr2=0x564050412f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.536+0000 7f7b5b4dbb80 1 --2- 172.21.15.123:0/2531058571 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564050407e50 0x564050412f00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400cc20 tx=0x7f7b4400ef80 comp rx=0 tx=0).stop 2024-06-02T04:04:15.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.536+0000 7f7b5b4dbb80 1 -- 172.21.15.123:0/2531058571 shutdown_connections 2024-06-02T04:04:15.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.536+0000 7f7b5b4dbb80 1 --2- 172.21.15.123:0/2531058571 >> [v2:172.21.15.136:6832/2006585076,v1:172.21.15.136:6833/2006585076] conn(0x5640504773a0 0x564050473cf0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.545 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.536+0000 7f7b5b4dbb80 1 --2- 172.21.15.123:0/2531058571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x564050408810 0x564050417be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.536+0000 7f7b30ff9700 0 client.15240 ms_handle_reset on v2:172.21.15.136:6832/2006585076 2024-06-02T04:04:15.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.536+0000 7f7b5b4dbb80 1 --2- 172.21.15.123:0/2531058571 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5640504074f0 0x564050412940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.536+0000 7f7b5b4dbb80 1 --2- 172.21.15.123:0/2531058571 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x564050407e50 0x564050412f00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.536+0000 7f7b5b4dbb80 1 -- 172.21.15.123:0/2531058571 >> 172.21.15.123:0/2531058571 conn(0x5640503651c0 msgr2=0x564050410b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:15.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.536+0000 7f7b5b4dbb80 1 -- 172.21.15.123:0/2531058571 shutdown_connections 2024-06-02T04:04:15.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.536+0000 7f7b5b4dbb80 1 -- 172.21.15.123:0/2531058571 wait complete. 2024-06-02T04:04:15.546 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.536+0000 7f7b5b4dbb80 20 client.15240 trim_cache size 0 max 16384 2024-06-02T04:04:15.546 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-06-02T04:04:15.546 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "1b432ae0-2094-11ef-bc9b-c7b262605968", 2024-06-02T04:04:15.547 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 4, 2024-06-02T04:04:15.547 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 24437, 2024-06-02T04:04:15.547 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-06-02T04:04:15.547 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-06-02T04:04:15.547 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-06-02T04:04:15.547 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 63.450140724999997, 2024-06-02T04:04:15.547 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 27, 2024-06-02T04:04:15.547 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 84, 2024-06-02T04:04:15.547 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 82, 2024-06-02T04:04:15.547 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 91.609138947999995 2024-06-02T04:04:15.547 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-06-02T04:04:15.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.536+0000 7f7b4f320700 1 -- 172.21.15.123:0/3008946705 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7b340a1230 msgr2=0x7f7b340a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.536+0000 7f7b4f320700 1 --2- 172.21.15.123:0/3008946705 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7b340a1230 0x7f7b340a36f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c005fd0 tx=0x7f7b3c005e40 comp rx=0 tx=0).stop 2024-06-02T04:04:15.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.536+0000 7f7b4f320700 1 -- 172.21.15.123:0/3008946705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b48102ab0 msgr2=0x7f7b4819e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.536+0000 7f7b4f320700 1 --2- 172.21.15.123:0/3008946705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b48102ab0 0x7f7b4819e460 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7b4000d010 tx=0x7f7b40004db0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.537+0000 7f7b4f320700 1 -- 172.21.15.123:0/3008946705 shutdown_connections 2024-06-02T04:04:15.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.537+0000 7f7b4f320700 1 --2- 172.21.15.123:0/3008946705 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7b48102ab0 0x7f7b4819e460 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.537+0000 7f7b4f320700 1 --2- 172.21.15.123:0/3008946705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b48100f20 0x7f7b48196f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.537+0000 7f7b4f320700 1 --2- 172.21.15.123:0/3008946705 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f7b340a1230 0x7f7b340a36f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.537+0000 7f7b4f320700 1 --2- 172.21.15.123:0/3008946705 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7b481020f0 0x7f7b48197440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.537+0000 7f7b4f320700 1 -- 172.21.15.123:0/3008946705 >> 172.21.15.123:0/3008946705 conn(0x7f7b480fc4e0 msgr2=0x7f7b48105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:15.549 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.537+0000 7f7b4f320700 1 -- 172.21.15.123:0/3008946705 shutdown_connections 2024-06-02T04:04:15.550 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.537+0000 7f7b4f320700 1 -- 172.21.15.123:0/3008946705 wait complete. 2024-06-02T04:04:15.550 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.l status 2024-06-02T04:04:15.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.673+0000 7fa3acd08700 1 -- 172.21.15.123:0/805993544 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3a8101970 msgr2=0x7fa3a8108290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.673+0000 7fa3acd08700 1 --2- 172.21.15.123:0/805993544 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3a8101970 0x7fa3a8108290 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000b0a0 tx=0x7fa3a000b3b0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.673+0000 7fa3acd08700 1 -- 172.21.15.123:0/805993544 shutdown_connections 2024-06-02T04:04:15.676 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.673+0000 7fa3acd08700 1 --2- 172.21.15.123:0/805993544 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3a8101970 0x7fa3a8108290 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.673+0000 7fa3acd08700 1 --2- 172.21.15.123:0/805993544 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3a80ffe60 0x7fa3a8100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.673+0000 7fa3acd08700 1 --2- 172.21.15.123:0/805993544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3a8100fb0 0x7fa3a8101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.673+0000 7fa3acd08700 1 -- 172.21.15.123:0/805993544 >> 172.21.15.123:0/805993544 conn(0x7fa3a80fb3f0 msgr2=0x7fa3a80fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:15.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.673+0000 7fa3acd08700 1 -- 172.21.15.123:0/805993544 shutdown_connections 2024-06-02T04:04:15.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.673+0000 7fa3acd08700 1 -- 172.21.15.123:0/805993544 wait complete. 2024-06-02T04:04:15.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.674+0000 7fa3acd08700 1 Processor -- start 2024-06-02T04:04:15.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.674+0000 7fa3acd08700 1 -- start start 2024-06-02T04:04:15.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.674+0000 7fa3acd08700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3a80ffe60 0x7fa3a8103d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.677 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.674+0000 7fa3acd08700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3a8100fb0 0x7fa3a8102420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.674+0000 7fa3acd08700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3a8101970 0x7fa3a8102960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.674+0000 7fa3acd08700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a8103100 con 0x7fa3a8100fb0 2024-06-02T04:04:15.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.674+0000 7fa3acd08700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a8103270 con 0x7fa3a8101970 2024-06-02T04:04:15.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.674+0000 7fa3acd08700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a81a1090 con 0x7fa3a80ffe60 2024-06-02T04:04:15.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.674+0000 7fa3a5d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3a8100fb0 0x7fa3a8102420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.674+0000 7fa3a5d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3a8100fb0 0x7fa3a8102420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37766/0 (socket says 172.21.15.123:37766) 2024-06-02T04:04:15.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.674+0000 7fa3a5d9b700 1 -- 172.21.15.123:0/2126064746 learned_addr learned my addr 172.21.15.123:0/2126064746 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:15.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.674+0000 7fa3a6d9d700 1 --2- 172.21.15.123:0/2126064746 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3a8101970 0x7fa3a8102960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.674+0000 7fa3a5d9b700 1 -- 172.21.15.123:0/2126064746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3a80ffe60 msgr2=0x7fa3a8103d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.674+0000 7fa3a5d9b700 1 --2- 172.21.15.123:0/2126064746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3a80ffe60 0x7fa3a8103d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.678 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.674+0000 7fa3a5d9b700 1 -- 172.21.15.123:0/2126064746 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3a8101970 msgr2=0x7fa3a8102960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.674+0000 7fa3a5d9b700 1 --2- 172.21.15.123:0/2126064746 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3a8101970 0x7fa3a8102960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.674+0000 7fa3a5d9b700 1 -- 172.21.15.123:0/2126064746 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a0009d00 con 0x7fa3a8100fb0 2024-06-02T04:04:15.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.674+0000 7fa3a5d9b700 1 --2- 172.21.15.123:0/2126064746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3a8100fb0 0x7fa3a8102420 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa39800e9a0 tx=0x7fa39800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:15.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.675+0000 7fa39f7fe700 1 -- 172.21.15.123:0/2126064746 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa398009790 con 0x7fa3a8100fb0 2024-06-02T04:04:15.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.675+0000 7fa39f7fe700 1 -- 172.21.15.123:0/2126064746 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa39800cb70 con 0x7fa3a8100fb0 2024-06-02T04:04:15.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.675+0000 7fa3acd08700 1 -- 172.21.15.123:0/2126064746 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a81a1320 con 0x7fa3a8100fb0 2024-06-02T04:04:15.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.675+0000 7fa39f7fe700 1 -- 172.21.15.123:0/2126064746 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa398010ea0 con 0x7fa3a8100fb0 2024-06-02T04:04:15.679 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.675+0000 7fa3acd08700 1 -- 172.21.15.123:0/2126064746 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a81a1830 con 0x7fa3a8100fb0 2024-06-02T04:04:15.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.677+0000 7fa39f7fe700 1 -- 172.21.15.123:0/2126064746 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fa39800cce0 con 0x7fa3a8100fb0 2024-06-02T04:04:15.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.677+0000 7fa39f7fe700 1 --2- 172.21.15.123:0/2126064746 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa3940a11b0 0x7fa3940a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.678+0000 7fa3a659c700 1 --2- 172.21.15.123:0/2126064746 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa3940a11b0 0x7fa3940a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.678+0000 7fa39f7fe700 1 -- 172.21.15.123:0/2126064746 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fa398014070 con 0x7fa3a8100fb0 2024-06-02T04:04:15.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.678+0000 7fa3a659c700 1 --2- 172.21.15.123:0/2126064746 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa3940a11b0 0x7fa3940a3670 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa390005950 tx=0x7fa3900058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:15.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.678+0000 7fa3b8ec3b80 1 Processor -- start 2024-06-02T04:04:15.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.679+0000 7fa3b8ec3b80 1 -- start start 2024-06-02T04:04:15.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.679+0000 7fa3b8ec3b80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56448cfa94f0 0x56448cfa9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.679+0000 7fa3b8ec3b80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56448cfa9e50 0x56448cfaa2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.679+0000 7fa3b8ec3b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56448cfaa810 0x56448cfaac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.679+0000 7fa3b8ec3b80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x56448cf00100 con 0x56448cfa9e50 2024-06-02T04:04:15.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.679+0000 7fa3b8ec3b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x56448cefdac0 con 0x56448cfaa810 2024-06-02T04:04:15.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.679+0000 7fa3b8ec3b80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56448cef93b0 con 0x56448cfa94f0 2024-06-02T04:04:15.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.679+0000 7fa3a5d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56448cfa9e50 0x56448cfaa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.679+0000 7fa3a5d9b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56448cfa9e50 0x56448cfaa2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37768/0 (socket says 172.21.15.123:37768) 2024-06-02T04:04:15.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.679+0000 7fa3a5d9b700 1 -- 172.21.15.123:0/2705406869 learned_addr learned my addr 172.21.15.123:0/2705406869 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:15.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.679+0000 7fa3a659c700 1 --2- 172.21.15.123:0/2705406869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56448cfa94f0 0x56448cfa9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.679+0000 7fa3a5d9b700 1 -- 172.21.15.123:0/2705406869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56448cfa94f0 msgr2=0x56448cfa9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:15.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.679+0000 7fa3a5d9b700 1 --2- 172.21.15.123:0/2705406869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56448cfa94f0 0x56448cfa9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.679+0000 7fa3a5d9b700 1 -- 172.21.15.123:0/2705406869 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56448cfaa810 msgr2=0x56448cfaac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:15.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.679+0000 7fa3a6d9d700 1 --2- 172.21.15.123:0/2705406869 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56448cfaa810 0x56448cfaac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.679+0000 7fa3a5d9b700 1 --2- 172.21.15.123:0/2705406869 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56448cfaa810 0x56448cfaac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.679+0000 7fa3a5d9b700 1 -- 172.21.15.123:0/2705406869 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56448cd7a360 con 0x56448cfa9e50 2024-06-02T04:04:15.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.679+0000 7fa3a5d9b700 1 --2- 172.21.15.123:0/2705406869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56448cfa9e50 0x56448cfaa2d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa398096a30 tx=0x7fa3980999a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1e181c330d606f server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:15.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.679+0000 7fa39cff9700 1 -- 172.21.15.123:0/2705406869 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39809ddf0 con 0x56448cfa9e50 2024-06-02T04:04:15.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.679+0000 7fa39cff9700 1 -- 172.21.15.123:0/2705406869 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa3980ade90 con 0x56448cfa9e50 2024-06-02T04:04:15.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.679+0000 7fa39cff9700 1 -- 172.21.15.123:0/2705406869 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3980a2240 con 0x56448cfa9e50 2024-06-02T04:04:15.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.680+0000 7fa3b8ec3b80 1 -- 172.21.15.123:0/2705406869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56448cfa9e50 msgr2=0x56448cfaa2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.680+0000 7fa3b8ec3b80 1 --2- 172.21.15.123:0/2705406869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56448cfa9e50 0x56448cfaa2d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa398096a30 tx=0x7fa3980999a0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.680+0000 7fa3b8ec3b80 1 -- 172.21.15.123:0/2705406869 shutdown_connections 2024-06-02T04:04:15.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.680+0000 7fa3b8ec3b80 1 --2- 172.21.15.123:0/2705406869 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56448cfaa810 0x56448cfaac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.680+0000 7fa3b8ec3b80 1 --2- 172.21.15.123:0/2705406869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56448cfa94f0 0x56448cfa9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.680+0000 7fa3b8ec3b80 1 --2- 172.21.15.123:0/2705406869 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56448cfa9e50 0x56448cfaa2d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.680+0000 7fa3b8ec3b80 1 -- 172.21.15.123:0/2705406869 >> 172.21.15.123:0/2705406869 conn(0x56448cf071c0 msgr2=0x56448cfa3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:15.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.680+0000 7fa3b8ec3b80 1 -- 172.21.15.123:0/2705406869 shutdown_connections 2024-06-02T04:04:15.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.680+0000 7fa3b8ec3b80 1 -- 172.21.15.123:0/2705406869 wait complete. 2024-06-02T04:04:15.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.680+0000 7fa3b8ec3b80 1 -- start start 2024-06-02T04:04:15.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.681+0000 7fa3b8ec3b80 1 Processor -- start 2024-06-02T04:04:15.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.681+0000 7fa3b8ec3b80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56448cfa94f0 0x56448cfb2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.681+0000 7fa3b8ec3b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56448cfa9e50 0x56448cfb32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.688 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.681+0000 7fa3b8ec3b80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56448cfaa810 0x56448cfba300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.681+0000 7fa3b8ec3b80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x56448ce95510 con 0x56448cfaa810 2024-06-02T04:04:15.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.681+0000 7fa3b8ec3b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x56448ce951b0 con 0x56448cfa9e50 2024-06-02T04:04:15.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.681+0000 7fa3b8ec3b80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56448cd7c650 con 0x56448cfa94f0 2024-06-02T04:04:15.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.681+0000 7fa3b8ec3b80 10 client.0 _ll_register_callbacks cb 0x56448ce9eae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:04:15.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.681+0000 7fa3a6d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56448cfaa810 0x56448cfba300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.681+0000 7fa3a6d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56448cfaa810 0x56448cfba300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37774/0 (socket says 172.21.15.123:37774) 2024-06-02T04:04:15.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.681+0000 7fa3a6d9d700 1 -- 172.21.15.123:0/1829950682 learned_addr learned my addr 172.21.15.123:0/1829950682 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:15.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.681+0000 7fa3a659c700 1 --2- 172.21.15.123:0/1829950682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56448cfa94f0 0x56448cfb2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.681+0000 7fa3a6d9d700 1 -- 172.21.15.123:0/1829950682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56448cfa94f0 msgr2=0x56448cfb2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:15.689 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.681+0000 7fa3a6d9d700 1 --2- 172.21.15.123:0/1829950682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56448cfa94f0 0x56448cfb2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.681+0000 7fa3a6d9d700 1 -- 172.21.15.123:0/1829950682 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56448cfa9e50 msgr2=0x56448cfb32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:15.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.681+0000 7fa3a6d9d700 1 --2- 172.21.15.123:0/1829950682 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56448cfa9e50 0x56448cfb32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.681+0000 7fa3a6d9d700 1 -- 172.21.15.123:0/1829950682 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a81a1830 con 0x56448cfaa810 2024-06-02T04:04:15.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.681+0000 7fa3a659c700 1 --2- 172.21.15.123:0/1829950682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56448cfa94f0 0x56448cfb2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:04:15.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.681+0000 7fa3a6d9d700 1 --2- 172.21.15.123:0/1829950682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56448cfaa810 0x56448cfba300 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000b0a0 tx=0x7fa3a00074e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14318d1d31c8d3 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:15.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.681+0000 7fa38dffb700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-06-02T04:04:15.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.681+0000 7fa38dffb700 1 -- 172.21.15.123:0/1829950682 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a000e070 con 0x56448cfaa810 2024-06-02T04:04:15.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.681+0000 7fa38dffb700 1 -- 172.21.15.123:0/1829950682 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fa3a0003a00 con 0x56448cfaa810 2024-06-02T04:04:15.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.681+0000 7fa3b8ec3b80 1 -- 172.21.15.123:0/1829950682 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56448ce52220 con 0x56448cfaa810 2024-06-02T04:04:15.690 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.682+0000 7fa38dffb700 1 -- 172.21.15.123:0/1829950682 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3a0003bc0 con 0x56448cfaa810 2024-06-02T04:04:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.682+0000 7fa3b8ec3b80 10 client.15252 fetch_fsmap learned FSMap version 27 2024-06-02T04:04:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.682+0000 7fa3b8ec3b80 1 -- 172.21.15.123:0/1829950682 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56448cd26b10 con 0x56448cfaa810 2024-06-02T04:04:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.682+0000 7fa38dffb700 1 -- 172.21.15.123:0/1829950682 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56448ce52220 con 0x56448cfaa810 2024-06-02T04:04:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.682+0000 7fa38dffb700 1 -- 172.21.15.123:0/1829950682 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa3a0022020 con 0x56448cfaa810 2024-06-02T04:04:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.682+0000 7fa3b8ec3b80 10 client.15252 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:04:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.682+0000 7fa3b8ec3b80 10 client.15252 resolve_mds: resolved name 'l' to daemon mds.l 2024-06-02T04:04:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.682+0000 7fa3b8ec3b80 20 client.15252 populate_metadata read hostname 'smithi123' 2024-06-02T04:04:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.682+0000 7fa3b8ec3b80 1 --2- 172.21.15.123:0/1829950682 >> [v2:172.21.15.162:6832/3583622784,v1:172.21.15.162:6833/3583622784] conn(0x56448cfbd9c0 0x56448cfc32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.682+0000 7fa3b8ec3b80 4 client.15252 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:04:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.682+0000 7fa3b8ec3b80 1 -- 172.21.15.123:0/1829950682 --> [v2:172.21.15.162:6832/3583622784,v1:172.21.15.162:6833/3583622784] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56448cf787c0 con 0x56448cfbd9c0 2024-06-02T04:04:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.682+0000 7fa3a659c700 1 --2- 172.21.15.123:0/1829950682 >> [v2:172.21.15.162:6832/3583622784,v1:172.21.15.162:6833/3583622784] conn(0x56448cfbd9c0 0x56448cfc32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.683+0000 7fa38dffb700 10 client.15252 ms_handle_connect on v2:172.21.15.162:6832/3583622784 2024-06-02T04:04:15.691 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.683+0000 7fa3a659c700 1 --2- 172.21.15.123:0/1829950682 >> [v2:172.21.15.162:6832/3583622784,v1:172.21.15.162:6833/3583622784] conn(0x56448cfbd9c0 0x56448cfc32b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=13cba7aeefad9d4 server_cookie=8bac3ab801d77c00 in_seq=0 out_seq=0 2024-06-02T04:04:15.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.683+0000 7fa38dffb700 1 -- 172.21.15.123:0/1829950682 <== mds.3 v2:172.21.15.162:6832/3583622784 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56448cf787c0 con 0x56448cfbd9c0 2024-06-02T04:04:15.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.683+0000 7fa38dffb700 10 client.15252 handle_command_reply: tid=0 2024-06-02T04:04:15.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.683+0000 7fa3b8ec3b80 1 client.15252 shutdown 2024-06-02T04:04:15.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.683+0000 7fa3b8ec3b80 1 -- 172.21.15.123:0/1829950682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56448cfaa810 msgr2=0x56448cfba300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.683+0000 7fa3b8ec3b80 1 --2- 172.21.15.123:0/1829950682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56448cfaa810 0x56448cfba300 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000b0a0 tx=0x7fa3a00074e0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.683+0000 7fa3b8ec3b80 1 -- 172.21.15.123:0/1829950682 shutdown_connections 2024-06-02T04:04:15.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.683+0000 7fa3b8ec3b80 1 --2- 172.21.15.123:0/1829950682 >> [v2:172.21.15.162:6832/3583622784,v1:172.21.15.162:6833/3583622784] conn(0x56448cfbd9c0 0x56448cfc32b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.683+0000 7fa3b8ec3b80 1 --2- 172.21.15.123:0/1829950682 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56448cfaa810 0x56448cfba300 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.683+0000 7fa38dffb700 0 client.15252 ms_handle_reset on v2:172.21.15.162:6832/3583622784 2024-06-02T04:04:15.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.683+0000 7fa3b8ec3b80 1 --2- 172.21.15.123:0/1829950682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56448cfa94f0 0x56448cfb2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.683+0000 7fa3b8ec3b80 1 --2- 172.21.15.123:0/1829950682 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56448cfa9e50 0x56448cfb32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.683+0000 7fa3b8ec3b80 1 -- 172.21.15.123:0/1829950682 >> 172.21.15.123:0/1829950682 conn(0x56448cf071c0 msgr2=0x56448cfa3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:15.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.684+0000 7fa3b8ec3b80 1 -- 172.21.15.123:0/1829950682 shutdown_connections 2024-06-02T04:04:15.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.684+0000 7fa3b8ec3b80 1 -- 172.21.15.123:0/1829950682 wait complete. 2024-06-02T04:04:15.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.684+0000 7fa3b8ec3b80 20 client.15252 trim_cache size 0 max 16384 2024-06-02T04:04:15.709 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.701+0000 7fa3b8ec3b80 1 Processor -- start 2024-06-02T04:04:15.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.701+0000 7fa3b8ec3b80 1 -- start start 2024-06-02T04:04:15.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.702+0000 7fa3b8ec3b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56448cfa94f0 0x56448cfa46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.702+0000 7fa3b8ec3b80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56448cfa9e50 0x56448cfba9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.702+0000 7fa3b8ec3b80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56448cfaa810 0x56448cfba220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.702+0000 7fa3b8ec3b80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x56448cf787c0 con 0x56448cfaa810 2024-06-02T04:04:15.710 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.702+0000 7fa3b8ec3b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x56448ce52220 con 0x56448cfa94f0 2024-06-02T04:04:15.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.702+0000 7fa3b8ec3b80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56448cef2150 con 0x56448cfa9e50 2024-06-02T04:04:15.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.702+0000 7fa3a6d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56448cfaa810 0x56448cfba220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.702+0000 7fa3a6d9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56448cfaa810 0x56448cfba220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37782/0 (socket says 172.21.15.123:37782) 2024-06-02T04:04:15.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.702+0000 7fa3a6d9d700 1 -- 172.21.15.123:0/2127970883 learned_addr learned my addr 172.21.15.123:0/2127970883 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:15.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.702+0000 7fa3a6d9d700 1 -- 172.21.15.123:0/2127970883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56448cfa9e50 msgr2=0x56448cfba9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:15.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.702+0000 7fa3a6d9d700 1 --2- 172.21.15.123:0/2127970883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56448cfa9e50 0x56448cfba9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.711 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.702+0000 7fa3a659c700 1 --2- 172.21.15.123:0/2127970883 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56448cfa94f0 0x56448cfa46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.702+0000 7fa3a6d9d700 1 -- 172.21.15.123:0/2127970883 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56448cfa94f0 msgr2=0x56448cfa46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:15.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.702+0000 7fa3a6d9d700 1 --2- 172.21.15.123:0/2127970883 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56448cfa94f0 0x56448cfa46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.702+0000 7fa3a6d9d700 1 -- 172.21.15.123:0/2127970883 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56448cebf510 con 0x56448cfaa810 2024-06-02T04:04:15.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.702+0000 7fa3a659c700 1 --2- 172.21.15.123:0/2127970883 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56448cfa94f0 0x56448cfa46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:04:15.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.702+0000 7fa3a6d9d700 1 --2- 172.21.15.123:0/2127970883 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56448cfaa810 0x56448cfba220 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000b070 tx=0x7fa3a001c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d02753a94b315180 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:15.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.702+0000 7fa39d7fa700 1 -- 172.21.15.123:0/2127970883 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a000e070 con 0x56448cfaa810 2024-06-02T04:04:15.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.702+0000 7fa39d7fa700 1 -- 172.21.15.123:0/2127970883 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa3a0007600 con 0x56448cfaa810 2024-06-02T04:04:15.712 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.702+0000 7fa39d7fa700 1 -- 172.21.15.123:0/2127970883 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0005370 con 0x56448cfaa810 2024-06-02T04:04:15.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.703+0000 7fa3b8ec3b80 1 -- 172.21.15.123:0/2127970883 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56448cfaa810 msgr2=0x56448cfba220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.703+0000 7fa3b8ec3b80 1 --2- 172.21.15.123:0/2127970883 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56448cfaa810 0x56448cfba220 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000b070 tx=0x7fa3a001c750 comp rx=0 tx=0).stop 2024-06-02T04:04:15.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.703+0000 7fa3b8ec3b80 1 -- 172.21.15.123:0/2127970883 shutdown_connections 2024-06-02T04:04:15.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.703+0000 7fa3b8ec3b80 1 --2- 172.21.15.123:0/2127970883 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56448cfaa810 0x56448cfba220 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.703+0000 7fa3b8ec3b80 1 --2- 172.21.15.123:0/2127970883 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56448cfa94f0 0x56448cfa46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.703+0000 7fa3b8ec3b80 1 --2- 172.21.15.123:0/2127970883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56448cfa9e50 0x56448cfba9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.713 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.703+0000 7fa3b8ec3b80 1 -- 172.21.15.123:0/2127970883 >> 172.21.15.123:0/2127970883 conn(0x56448cf071c0 msgr2=0x56448cfa01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:15.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.703+0000 7fa3b8ec3b80 1 -- 172.21.15.123:0/2127970883 shutdown_connections 2024-06-02T04:04:15.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.703+0000 7fa3b8ec3b80 1 -- 172.21.15.123:0/2127970883 wait complete. 2024-06-02T04:04:15.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.703+0000 7fa3b8ec3b80 1 -- start start 2024-06-02T04:04:15.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.703+0000 7fa3b8ec3b80 1 Processor -- start 2024-06-02T04:04:15.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.703+0000 7fa3b8ec3b80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56448cfa94f0 0x56448cfa2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.703+0000 7fa3b8ec3b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56448cfa9e50 0x56448cfa3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.714 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.703+0000 7fa3b8ec3b80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56448cfaa810 0x56448cfb95d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.703+0000 7fa3b8ec3b80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x56448cfb9b10 con 0x56448cfa94f0 2024-06-02T04:04:15.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.703+0000 7fa3b8ec3b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x56448cfb9c50 con 0x56448cfa9e50 2024-06-02T04:04:15.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.703+0000 7fa3b8ec3b80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x56448cfb9e10 con 0x56448cfaa810 2024-06-02T04:04:15.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.703+0000 7fa3b8ec3b80 10 client.0 _ll_register_callbacks cb 0x56448ce9eae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:04:15.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.703+0000 7fa3a659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56448cfa94f0 0x56448cfa2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.703+0000 7fa3a659c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56448cfa94f0 0x56448cfa2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37788/0 (socket says 172.21.15.123:37788) 2024-06-02T04:04:15.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.703+0000 7fa3a659c700 1 -- 172.21.15.123:0/2394038684 learned_addr learned my addr 172.21.15.123:0/2394038684 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:15.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.704+0000 7fa3a6d9d700 1 --2- 172.21.15.123:0/2394038684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56448cfaa810 0x56448cfb95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.704+0000 7fa3a5d9b700 1 --2- 172.21.15.123:0/2394038684 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56448cfa9e50 0x56448cfa3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.704+0000 7fa3a659c700 1 -- 172.21.15.123:0/2394038684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56448cfaa810 msgr2=0x56448cfb95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:15.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.704+0000 7fa3a659c700 1 --2- 172.21.15.123:0/2394038684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56448cfaa810 0x56448cfb95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.704+0000 7fa3a659c700 1 -- 172.21.15.123:0/2394038684 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56448cfa9e50 msgr2=0x56448cfa3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:15.715 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.704+0000 7fa3a659c700 1 --2- 172.21.15.123:0/2394038684 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56448cfa9e50 0x56448cfa3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.704+0000 7fa3a659c700 1 -- 172.21.15.123:0/2394038684 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56448cd26b10 con 0x56448cfa94f0 2024-06-02T04:04:15.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.704+0000 7fa3a659c700 1 --2- 172.21.15.123:0/2394038684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56448cfa94f0 0x56448cfa2f10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x56448cfb2d50 tx=0x7fa390005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fad5d111ebda02d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:15.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.704+0000 7fa38dffb700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-06-02T04:04:15.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.704+0000 7fa38dffb700 1 -- 172.21.15.123:0/2394038684 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa390025070 con 0x56448cfa94f0 2024-06-02T04:04:15.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.704+0000 7fa38dffb700 1 -- 172.21.15.123:0/2394038684 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fa3900109c0 con 0x56448cfa94f0 2024-06-02T04:04:15.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.704+0000 7fa3b8ec3b80 1 -- 172.21.15.123:0/2394038684 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa3980ade90 con 0x56448cfa94f0 2024-06-02T04:04:15.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.704+0000 7fa38dffb700 1 -- 172.21.15.123:0/2394038684 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa390025e90 con 0x56448cfa94f0 2024-06-02T04:04:15.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.704+0000 7fa3b8ec3b80 10 client.15258 fetch_fsmap learned FSMap version 27 2024-06-02T04:04:15.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.704+0000 7fa3b8ec3b80 1 -- 172.21.15.123:0/2394038684 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56448cd7ec80 con 0x56448cfa94f0 2024-06-02T04:04:15.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.704+0000 7fa38dffb700 1 -- 172.21.15.123:0/2394038684 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa3980ade90 con 0x56448cfa94f0 2024-06-02T04:04:15.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.704+0000 7fa38dffb700 1 -- 172.21.15.123:0/2394038684 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa39001f490 con 0x56448cfa94f0 2024-06-02T04:04:15.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.705+0000 7fa3b8ec3b80 10 client.15258 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:04:15.716 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.705+0000 7fa3b8ec3b80 10 client.15258 resolve_mds: resolved name 'l' to daemon mds.l 2024-06-02T04:04:15.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.705+0000 7fa3b8ec3b80 20 client.15258 populate_metadata read hostname 'smithi123' 2024-06-02T04:04:15.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.705+0000 7fa3b8ec3b80 1 --2- 172.21.15.123:0/2394038684 >> [v2:172.21.15.162:6832/3583622784,v1:172.21.15.162:6833/3583622784] conn(0x56448d019320 0x56448d015c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.705+0000 7fa3b8ec3b80 4 client.15258 mds_command: new command op to 24439 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T04:04:15.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.705+0000 7fa3b8ec3b80 1 -- 172.21.15.123:0/2394038684 --> [v2:172.21.15.162:6832/3583622784,v1:172.21.15.162:6833/3583622784] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56448cef1e70 con 0x56448d019320 2024-06-02T04:04:15.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.705+0000 7fa3a5d9b700 1 --2- 172.21.15.123:0/2394038684 >> [v2:172.21.15.162:6832/3583622784,v1:172.21.15.162:6833/3583622784] conn(0x56448d019320 0x56448d015c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.705+0000 7fa38dffb700 10 client.15258 ms_handle_connect on v2:172.21.15.162:6832/3583622784 2024-06-02T04:04:15.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.705+0000 7fa3a5d9b700 1 --2- 172.21.15.123:0/2394038684 >> [v2:172.21.15.162:6832/3583622784,v1:172.21.15.162:6833/3583622784] conn(0x56448d019320 0x56448d015c50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f24bb229c610c8d0 server_cookie=9205dbd0b52f9d18 in_seq=0 out_seq=0 2024-06-02T04:04:15.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.705+0000 7fa38dffb700 1 -- 172.21.15.123:0/2394038684 <== mds.3 v2:172.21.15.162:6832/3583622784 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x56448cef1e70 con 0x56448d019320 2024-06-02T04:04:15.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.705+0000 7fa38dffb700 10 client.15258 handle_command_reply: tid=0 2024-06-02T04:04:15.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.705+0000 7fa3b8ec3b80 1 client.15258 shutdown 2024-06-02T04:04:15.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.705+0000 7fa3b8ec3b80 1 -- 172.21.15.123:0/2394038684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56448cfa94f0 msgr2=0x56448cfa2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.705+0000 7fa3b8ec3b80 1 --2- 172.21.15.123:0/2394038684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56448cfa94f0 0x56448cfa2f10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x56448cfb2d50 tx=0x7fa390005d20 comp rx=0 tx=0).stop 2024-06-02T04:04:15.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.706+0000 7fa3b8ec3b80 1 -- 172.21.15.123:0/2394038684 shutdown_connections 2024-06-02T04:04:15.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.706+0000 7fa3b8ec3b80 1 --2- 172.21.15.123:0/2394038684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56448cfaa810 0x56448cfb95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.706+0000 7fa3b8ec3b80 1 --2- 172.21.15.123:0/2394038684 >> [v2:172.21.15.162:6832/3583622784,v1:172.21.15.162:6833/3583622784] conn(0x56448d019320 0x56448d015c50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.706+0000 7fa3b8ec3b80 1 --2- 172.21.15.123:0/2394038684 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x56448cfa94f0 0x56448cfa2f10 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.706+0000 7fa38dffb700 0 client.15258 ms_handle_reset on v2:172.21.15.162:6832/3583622784 2024-06-02T04:04:15.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.706+0000 7fa3b8ec3b80 1 --2- 172.21.15.123:0/2394038684 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x56448cfa9e50 0x56448cfa3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.706+0000 7fa3b8ec3b80 1 -- 172.21.15.123:0/2394038684 >> 172.21.15.123:0/2394038684 conn(0x56448cf071c0 msgr2=0x56448cfb2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:15.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.706+0000 7fa3b8ec3b80 1 -- 172.21.15.123:0/2394038684 shutdown_connections 2024-06-02T04:04:15.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.706+0000 7fa3b8ec3b80 1 -- 172.21.15.123:0/2394038684 wait complete. 2024-06-02T04:04:15.718 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.706+0000 7fa3b8ec3b80 20 client.15258 trim_cache size 0 max 16384 2024-06-02T04:04:15.719 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-06-02T04:04:15.719 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "1b432ae0-2094-11ef-bc9b-c7b262605968", 2024-06-02T04:04:15.719 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 3, 2024-06-02T04:04:15.719 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 24439, 2024-06-02T04:04:15.719 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-06-02T04:04:15.719 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-06-02T04:04:15.719 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-06-02T04:04:15.719 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 64.628654990000001, 2024-06-02T04:04:15.719 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 27, 2024-06-02T04:04:15.719 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 84, 2024-06-02T04:04:15.719 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 82, 2024-06-02T04:04:15.720 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 93.606222571000004 2024-06-02T04:04:15.720 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-06-02T04:04:15.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.706+0000 7fa3acd08700 1 -- 172.21.15.123:0/2126064746 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa3940a11b0 msgr2=0x7fa3940a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.706+0000 7fa3acd08700 1 --2- 172.21.15.123:0/2126064746 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa3940a11b0 0x7fa3940a3670 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa390005950 tx=0x7fa3900058e0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.706+0000 7fa3acd08700 1 -- 172.21.15.123:0/2126064746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3a8100fb0 msgr2=0x7fa3a8102420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.706+0000 7fa3acd08700 1 --2- 172.21.15.123:0/2126064746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3a8100fb0 0x7fa3a8102420 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa39800e9a0 tx=0x7fa39800ecb0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.706+0000 7fa3acd08700 1 -- 172.21.15.123:0/2126064746 shutdown_connections 2024-06-02T04:04:15.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.706+0000 7fa3acd08700 1 --2- 172.21.15.123:0/2126064746 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa3940a11b0 0x7fa3940a3670 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.721 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.706+0000 7fa3acd08700 1 --2- 172.21.15.123:0/2126064746 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3a8101970 0x7fa3a8102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.706+0000 7fa3acd08700 1 --2- 172.21.15.123:0/2126064746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3a80ffe60 0x7fa3a8103d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.706+0000 7fa3acd08700 1 --2- 172.21.15.123:0/2126064746 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa3a8100fb0 0x7fa3a8102420 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.706+0000 7fa3acd08700 1 -- 172.21.15.123:0/2126064746 >> 172.21.15.123:0/2126064746 conn(0x7fa3a80fb3f0 msgr2=0x7fa3a80fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:15.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.706+0000 7fa3acd08700 1 -- 172.21.15.123:0/2126064746 shutdown_connections 2024-06-02T04:04:15.722 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.706+0000 7fa3acd08700 1 -- 172.21.15.123:0/2126064746 wait complete. 2024-06-02T04:04:15.722 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-06-02T04:04:15.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.844+0000 7f1cf9b0b700 1 -- 172.21.15.123:0/2635297029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cf40ff220 msgr2=0x7f1cf40ff640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.844+0000 7f1cf9b0b700 1 --2- 172.21.15.123:0/2635297029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cf40ff220 0x7f1cf40ff640 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4009990 tx=0x7f1ce4009ca0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.844+0000 7f1cf9b0b700 1 -- 172.21.15.123:0/2635297029 shutdown_connections 2024-06-02T04:04:15.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.844+0000 7f1cf9b0b700 1 --2- 172.21.15.123:0/2635297029 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cf4102b90 0x7f1cf4109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.858 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.844+0000 7f1cf9b0b700 1 --2- 172.21.15.123:0/2635297029 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cf40ff220 0x7f1cf40ff640 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.844+0000 7f1cf9b0b700 1 --2- 172.21.15.123:0/2635297029 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1cf41021f0 0x7f1cf4102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.844+0000 7f1cf9b0b700 1 -- 172.21.15.123:0/2635297029 >> 172.21.15.123:0/2635297029 conn(0x7f1cf40fab50 msgr2=0x7f1cf40fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:15.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.844+0000 7f1cf9b0b700 1 -- 172.21.15.123:0/2635297029 shutdown_connections 2024-06-02T04:04:15.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.844+0000 7f1cf9b0b700 1 -- 172.21.15.123:0/2635297029 wait complete. 2024-06-02T04:04:15.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.845+0000 7f1cf9b0b700 1 Processor -- start 2024-06-02T04:04:15.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.845+0000 7f1cf9b0b700 1 -- start start 2024-06-02T04:04:15.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.845+0000 7f1cf9b0b700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cf40ff220 0x7f1cf4196f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.845+0000 7f1cf9b0b700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cf41021f0 0x7f1cf4197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.845+0000 7f1cf9b0b700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1cf4102b90 0x7f1cf419e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.859 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.845+0000 7f1cf9b0b700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf419ea30 con 0x7f1cf40ff220 2024-06-02T04:04:15.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.845+0000 7f1cf9b0b700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf419eb70 con 0x7f1cf4102b90 2024-06-02T04:04:15.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.845+0000 7f1cf9b0b700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf419ed00 con 0x7f1cf41021f0 2024-06-02T04:04:15.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.845+0000 7f1cf37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cf40ff220 0x7f1cf4196f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.845+0000 7f1cf37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cf40ff220 0x7f1cf4196f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37820/0 (socket says 172.21.15.123:37820) 2024-06-02T04:04:15.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.845+0000 7f1cf37fe700 1 -- 172.21.15.123:0/881204578 learned_addr learned my addr 172.21.15.123:0/881204578 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:15.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.845+0000 7f1cf3fff700 1 --2- 172.21.15.123:0/881204578 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1cf4102b90 0x7f1cf419e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.845+0000 7f1cf37fe700 1 -- 172.21.15.123:0/881204578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cf41021f0 msgr2=0x7f1cf4197440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.845+0000 7f1cf37fe700 1 --2- 172.21.15.123:0/881204578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cf41021f0 0x7f1cf4197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.845+0000 7f1cf37fe700 1 -- 172.21.15.123:0/881204578 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1cf4102b90 msgr2=0x7f1cf419e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.845+0000 7f1cf37fe700 1 --2- 172.21.15.123:0/881204578 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1cf4102b90 0x7f1cf419e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.860 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.845+0000 7f1cf37fe700 1 -- 172.21.15.123:0/881204578 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce40095f0 con 0x7f1cf40ff220 2024-06-02T04:04:15.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.846+0000 7f1cf37fe700 1 --2- 172.21.15.123:0/881204578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cf40ff220 0x7f1cf4196f00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1ce40095c0 tx=0x7f1ce400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:15.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.846+0000 7f1cf0ff9700 1 -- 172.21.15.123:0/881204578 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce401d070 con 0x7f1cf40ff220 2024-06-02T04:04:15.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.846+0000 7f1cf0ff9700 1 -- 172.21.15.123:0/881204578 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1ce4022470 con 0x7f1cf40ff220 2024-06-02T04:04:15.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.846+0000 7f1cf0ff9700 1 -- 172.21.15.123:0/881204578 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4017650 con 0x7f1cf40ff220 2024-06-02T04:04:15.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.846+0000 7f1cf9b0b700 1 -- 172.21.15.123:0/881204578 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf419ef80 con 0x7f1cf40ff220 2024-06-02T04:04:15.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.846+0000 7f1cf9b0b700 1 -- 172.21.15.123:0/881204578 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf419f340 con 0x7f1cf40ff220 2024-06-02T04:04:15.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.848+0000 7f1cf0ff9700 1 -- 172.21.15.123:0/881204578 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f1ce4022890 con 0x7f1cf40ff220 2024-06-02T04:04:15.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.849+0000 7f1cf0ff9700 1 --2- 172.21.15.123:0/881204578 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f1ce00a1230 0x7f1ce00a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.849+0000 7f1cf2ffd700 1 --2- 172.21.15.123:0/881204578 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f1ce00a1230 0x7f1ce00a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.849+0000 7f1cf0ff9700 1 -- 172.21.15.123:0/881204578 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f1ce40cdf70 con 0x7f1cf40ff220 2024-06-02T04:04:15.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.849+0000 7f1cf2ffd700 1 --2- 172.21.15.123:0/881204578 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f1ce00a1230 0x7f1ce00a36f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc005950 tx=0x7f1cdc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:15.861 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.850+0000 7f1d05cc6b80 1 Processor -- start 2024-06-02T04:04:15.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.850+0000 7f1d05cc6b80 1 -- start start 2024-06-02T04:04:15.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.850+0000 7f1d05cc6b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5595269404f0 0x559526940910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.850+0000 7f1d05cc6b80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559526940e50 0x5595269412d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.850+0000 7f1d05cc6b80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559526941810 0x559526941c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.850+0000 7f1d05cc6b80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x559526897100 con 0x559526940e50 2024-06-02T04:04:15.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.850+0000 7f1d05cc6b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x559526894ac0 con 0x5595269404f0 2024-06-02T04:04:15.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.850+0000 7f1d05cc6b80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595268903b0 con 0x559526941810 2024-06-02T04:04:15.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.850+0000 7f1cf2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559526940e50 0x5595269412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.850+0000 7f1cf2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559526940e50 0x5595269412d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37824/0 (socket says 172.21.15.123:37824) 2024-06-02T04:04:15.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.850+0000 7f1cf2ffd700 1 -- 172.21.15.123:0/3440302508 learned_addr learned my addr 172.21.15.123:0/3440302508 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:15.862 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.850+0000 7f1cf3fff700 1 --2- 172.21.15.123:0/3440302508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559526941810 0x559526941c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.850+0000 7f1cf2ffd700 1 -- 172.21.15.123:0/3440302508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559526941810 msgr2=0x559526941c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:15.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.850+0000 7f1cf2ffd700 1 --2- 172.21.15.123:0/3440302508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559526941810 0x559526941c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.850+0000 7f1cf2ffd700 1 -- 172.21.15.123:0/3440302508 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5595269404f0 msgr2=0x559526940910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:15.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.850+0000 7f1cf2ffd700 1 --2- 172.21.15.123:0/3440302508 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5595269404f0 0x559526940910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.850+0000 7f1cf2ffd700 1 -- 172.21.15.123:0/3440302508 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559526711360 con 0x559526940e50 2024-06-02T04:04:15.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.850+0000 7f1cf3fff700 1 --2- 172.21.15.123:0/3440302508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559526941810 0x559526941c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:04:15.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.850+0000 7f1cf2ffd700 1 --2- 172.21.15.123:0/3440302508 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559526940e50 0x5595269412d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009270 tx=0x7f1cdc010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd1b797cb91ee44d server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:15.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.850+0000 7f1ce9ffb700 1 -- 172.21.15.123:0/3440302508 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc010ac0 con 0x559526940e50 2024-06-02T04:04:15.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.850+0000 7f1ce9ffb700 1 -- 172.21.15.123:0/3440302508 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1cdc010c20 con 0x559526940e50 2024-06-02T04:04:15.863 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.850+0000 7f1ce9ffb700 1 -- 172.21.15.123:0/3440302508 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc00f620 con 0x559526940e50 2024-06-02T04:04:15.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.851+0000 7f1d05cc6b80 1 -- 172.21.15.123:0/3440302508 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559526940e50 msgr2=0x5595269412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.851+0000 7f1d05cc6b80 1 --2- 172.21.15.123:0/3440302508 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559526940e50 0x5595269412d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc009270 tx=0x7f1cdc010000 comp rx=0 tx=0).stop 2024-06-02T04:04:15.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.851+0000 7f1d05cc6b80 1 -- 172.21.15.123:0/3440302508 shutdown_connections 2024-06-02T04:04:15.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.851+0000 7f1d05cc6b80 1 --2- 172.21.15.123:0/3440302508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559526941810 0x559526941c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.851+0000 7f1d05cc6b80 1 --2- 172.21.15.123:0/3440302508 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5595269404f0 0x559526940910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.851+0000 7f1d05cc6b80 1 --2- 172.21.15.123:0/3440302508 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559526940e50 0x5595269412d0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.851+0000 7f1d05cc6b80 1 -- 172.21.15.123:0/3440302508 >> 172.21.15.123:0/3440302508 conn(0x55952689e1c0 msgr2=0x55952693ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:15.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.851+0000 7f1d05cc6b80 1 -- 172.21.15.123:0/3440302508 shutdown_connections 2024-06-02T04:04:15.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.851+0000 7f1d05cc6b80 1 -- 172.21.15.123:0/3440302508 wait complete. 2024-06-02T04:04:15.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.851+0000 7f1d05cc6b80 1 -- start start 2024-06-02T04:04:15.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.852+0000 7f1d05cc6b80 1 Processor -- start 2024-06-02T04:04:15.864 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.852+0000 7f1d05cc6b80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595269404f0 0x559526949df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.852+0000 7f1d05cc6b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559526940e50 0x55952694a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.852+0000 7f1d05cc6b80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559526941810 0x559526951370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.852+0000 7f1d05cc6b80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952682c510 con 0x5595269404f0 2024-06-02T04:04:15.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.852+0000 7f1d05cc6b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952682c1b0 con 0x559526940e50 2024-06-02T04:04:15.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.852+0000 7f1d05cc6b80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x559526713650 con 0x559526941810 2024-06-02T04:04:15.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.852+0000 7f1d05cc6b80 10 client.0 _ll_register_callbacks cb 0x559526835ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:04:15.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.852+0000 7f1cf37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595269404f0 0x559526949df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.852+0000 7f1cf37fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595269404f0 0x559526949df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37830/0 (socket says 172.21.15.123:37830) 2024-06-02T04:04:15.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.852+0000 7f1cf37fe700 1 -- 172.21.15.123:0/1268252036 learned_addr learned my addr 172.21.15.123:0/1268252036 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:15.865 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.852+0000 7f1cf2ffd700 1 --2- 172.21.15.123:0/1268252036 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559526940e50 0x55952694a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.852+0000 7f1cf3fff700 1 --2- 172.21.15.123:0/1268252036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559526941810 0x559526951370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.852+0000 7f1cf37fe700 1 -- 172.21.15.123:0/1268252036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559526941810 msgr2=0x559526951370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:15.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.852+0000 7f1cf37fe700 1 --2- 172.21.15.123:0/1268252036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559526941810 0x559526951370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.852+0000 7f1cf37fe700 1 -- 172.21.15.123:0/1268252036 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559526940e50 msgr2=0x55952694a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:15.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.852+0000 7f1cf37fe700 1 --2- 172.21.15.123:0/1268252036 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559526940e50 0x55952694a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.852+0000 7f1cf37fe700 1 -- 172.21.15.123:0/1268252036 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cdc00d960 con 0x5595269404f0 2024-06-02T04:04:15.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.852+0000 7f1cf3fff700 1 --2- 172.21.15.123:0/1268252036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559526941810 0x559526951370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:04:15.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.852+0000 7f1cf2ffd700 1 --2- 172.21.15.123:0/1268252036 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559526940e50 0x55952694a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:04:15.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.852+0000 7f1cf37fe700 1 --2- 172.21.15.123:0/1268252036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595269404f0 0x559526949df0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4097ea0 tx=0x7f1ce409b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d881251aab5a1a6 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:15.866 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.852+0000 7f1cd2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-06-02T04:04:15.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.853+0000 7f1cd2ffd700 1 -- 172.21.15.123:0/1268252036 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce409b430 con 0x5595269404f0 2024-06-02T04:04:15.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.853+0000 7f1cd2ffd700 1 -- 172.21.15.123:0/1268252036 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f1ce409f260 con 0x5595269404f0 2024-06-02T04:04:15.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.853+0000 7f1d05cc6b80 1 -- 172.21.15.123:0/1268252036 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5595267e9220 con 0x5595269404f0 2024-06-02T04:04:15.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.853+0000 7f1cd2ffd700 1 -- 172.21.15.123:0/1268252036 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ce40a3820 con 0x5595269404f0 2024-06-02T04:04:15.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.853+0000 7f1d05cc6b80 10 client.15270 fetch_fsmap learned FSMap version 27 2024-06-02T04:04:15.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.853+0000 7f1d05cc6b80 1 -- 172.21.15.123:0/1268252036 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5595266bdb10 con 0x5595269404f0 2024-06-02T04:04:15.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.853+0000 7f1cd2ffd700 1 -- 172.21.15.123:0/1268252036 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1ce407e020 con 0x5595269404f0 2024-06-02T04:04:15.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.853+0000 7f1cd2ffd700 1 -- 172.21.15.123:0/1268252036 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1ce40973b0 con 0x5595269404f0 2024-06-02T04:04:15.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.853+0000 7f1d05cc6b80 10 client.15270 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:04:15.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.853+0000 7f1d05cc6b80 10 client.15270 resolve_mds: resolved name 'h' to daemon mds.h 2024-06-02T04:04:15.867 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.853+0000 7f1d05cc6b80 20 client.15270 populate_metadata read hostname 'smithi123' 2024-06-02T04:04:15.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.853+0000 7f1d05cc6b80 1 --2- 172.21.15.123:0/1268252036 >> [v2:172.21.15.136:6836/2572418263,v1:172.21.15.136:6837/2572418263] conn(0x559526954b80 0x559526959e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.853+0000 7f1d05cc6b80 4 client.15270 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:04:15.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.853+0000 7f1d05cc6b80 1 -- 172.21.15.123:0/1268252036 --> [v2:172.21.15.136:6836/2572418263,v1:172.21.15.136:6837/2572418263] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55952690f7c0 con 0x559526954b80 2024-06-02T04:04:15.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.853+0000 7f1cf2ffd700 1 --2- 172.21.15.123:0/1268252036 >> [v2:172.21.15.136:6836/2572418263,v1:172.21.15.136:6837/2572418263] conn(0x559526954b80 0x559526959e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.854+0000 7f1cd2ffd700 10 client.15270 ms_handle_connect on v2:172.21.15.136:6836/2572418263 2024-06-02T04:04:15.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.854+0000 7f1cf2ffd700 1 --2- 172.21.15.123:0/1268252036 >> [v2:172.21.15.136:6836/2572418263,v1:172.21.15.136:6837/2572418263] conn(0x559526954b80 0x559526959e00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=163ff6b029b9f8ff server_cookie=56b0ffe0221af645 in_seq=0 out_seq=0 2024-06-02T04:04:15.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.854+0000 7f1cd2ffd700 1 -- 172.21.15.123:0/1268252036 <== mds.2 v2:172.21.15.136:6836/2572418263 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55952690f7c0 con 0x559526954b80 2024-06-02T04:04:15.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.854+0000 7f1cd2ffd700 10 client.15270 handle_command_reply: tid=0 2024-06-02T04:04:15.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.854+0000 7f1d05cc6b80 1 client.15270 shutdown 2024-06-02T04:04:15.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.855+0000 7f1d05cc6b80 1 -- 172.21.15.123:0/1268252036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595269404f0 msgr2=0x559526949df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.868 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.855+0000 7f1d05cc6b80 1 --2- 172.21.15.123:0/1268252036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595269404f0 0x559526949df0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4097ea0 tx=0x7f1ce409b970 comp rx=0 tx=0).stop 2024-06-02T04:04:15.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.855+0000 7f1d05cc6b80 1 -- 172.21.15.123:0/1268252036 shutdown_connections 2024-06-02T04:04:15.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.855+0000 7f1d05cc6b80 1 --2- 172.21.15.123:0/1268252036 >> [v2:172.21.15.136:6836/2572418263,v1:172.21.15.136:6837/2572418263] conn(0x559526954b80 0x559526959e00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.855+0000 7f1d05cc6b80 1 --2- 172.21.15.123:0/1268252036 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559526941810 0x559526951370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.855+0000 7f1d05cc6b80 1 --2- 172.21.15.123:0/1268252036 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x5595269404f0 0x559526949df0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.855+0000 7f1d05cc6b80 1 --2- 172.21.15.123:0/1268252036 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559526940e50 0x55952694a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.855+0000 7f1cd2ffd700 0 client.15270 ms_handle_reset on v2:172.21.15.136:6836/2572418263 2024-06-02T04:04:15.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.855+0000 7f1d05cc6b80 1 -- 172.21.15.123:0/1268252036 >> 172.21.15.123:0/1268252036 conn(0x55952689e1c0 msgr2=0x55952693a550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:15.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.855+0000 7f1d05cc6b80 1 -- 172.21.15.123:0/1268252036 shutdown_connections 2024-06-02T04:04:15.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.855+0000 7f1d05cc6b80 1 -- 172.21.15.123:0/1268252036 wait complete. 2024-06-02T04:04:15.869 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.855+0000 7f1d05cc6b80 20 client.15270 trim_cache size 0 max 16384 2024-06-02T04:04:15.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.873+0000 7f1d05cc6b80 1 Processor -- start 2024-06-02T04:04:15.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.873+0000 7f1d05cc6b80 1 -- start start 2024-06-02T04:04:15.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.873+0000 7f1d05cc6b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5595269404f0 0x5595269408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.873+0000 7f1d05cc6b80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559526940e50 0x55952694a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.879 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.873+0000 7f1d05cc6b80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559526941810 0x559526951330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.873+0000 7f1d05cc6b80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595269357b0 con 0x559526940e50 2024-06-02T04:04:15.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.873+0000 7f1d05cc6b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952690f7c0 con 0x5595269404f0 2024-06-02T04:04:15.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.873+0000 7f1d05cc6b80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952693bb80 con 0x559526941810 2024-06-02T04:04:15.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.873+0000 7f1cf2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559526940e50 0x55952694a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.873+0000 7f1cf2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559526940e50 0x55952694a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37836/0 (socket says 172.21.15.123:37836) 2024-06-02T04:04:15.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.873+0000 7f1cf2ffd700 1 -- 172.21.15.123:0/3287113617 learned_addr learned my addr 172.21.15.123:0/3287113617 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:15.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.873+0000 7f1cf37fe700 1 --2- 172.21.15.123:0/3287113617 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5595269404f0 0x5595269408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.873+0000 7f1cf3fff700 1 --2- 172.21.15.123:0/3287113617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559526941810 0x559526951330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.873+0000 7f1cf2ffd700 1 -- 172.21.15.123:0/3287113617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559526941810 msgr2=0x559526951330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:15.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.873+0000 7f1cf2ffd700 1 --2- 172.21.15.123:0/3287113617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559526941810 0x559526951330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.873+0000 7f1cf2ffd700 1 -- 172.21.15.123:0/3287113617 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5595269404f0 msgr2=0x5595269408f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:15.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.873+0000 7f1cf2ffd700 1 --2- 172.21.15.123:0/3287113617 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5595269404f0 0x5595269408f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.873+0000 7f1cf2ffd700 1 -- 172.21.15.123:0/3287113617 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559526856510 con 0x559526940e50 2024-06-02T04:04:15.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.874+0000 7f1cf2ffd700 1 --2- 172.21.15.123:0/3287113617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559526940e50 0x55952694a430 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00dc50 tx=0x7f1cdc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1647f148414430f7 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:15.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.874+0000 7f1cea7fc700 1 -- 172.21.15.123:0/3287113617 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc02c040 con 0x559526940e50 2024-06-02T04:04:15.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.874+0000 7f1cea7fc700 1 -- 172.21.15.123:0/3287113617 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1cdc01d900 con 0x559526940e50 2024-06-02T04:04:15.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.874+0000 7f1cea7fc700 1 -- 172.21.15.123:0/3287113617 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc02fe40 con 0x559526940e50 2024-06-02T04:04:15.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.874+0000 7f1d05cc6b80 1 -- 172.21.15.123:0/3287113617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559526940e50 msgr2=0x55952694a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.874+0000 7f1d05cc6b80 1 --2- 172.21.15.123:0/3287113617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559526940e50 0x55952694a430 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00dc50 tx=0x7f1cdc004750 comp rx=0 tx=0).stop 2024-06-02T04:04:15.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.874+0000 7f1d05cc6b80 1 -- 172.21.15.123:0/3287113617 shutdown_connections 2024-06-02T04:04:15.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.874+0000 7f1d05cc6b80 1 --2- 172.21.15.123:0/3287113617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559526941810 0x559526951330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.874+0000 7f1d05cc6b80 1 --2- 172.21.15.123:0/3287113617 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5595269404f0 0x5595269408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.874+0000 7f1d05cc6b80 1 --2- 172.21.15.123:0/3287113617 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559526940e50 0x55952694a430 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.874+0000 7f1d05cc6b80 1 -- 172.21.15.123:0/3287113617 >> 172.21.15.123:0/3287113617 conn(0x55952689e1c0 msgr2=0x559526941bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:15.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.874+0000 7f1d05cc6b80 1 -- 172.21.15.123:0/3287113617 shutdown_connections 2024-06-02T04:04:15.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.874+0000 7f1d05cc6b80 1 -- 172.21.15.123:0/3287113617 wait complete. 2024-06-02T04:04:15.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.875+0000 7f1d05cc6b80 1 -- start start 2024-06-02T04:04:15.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.875+0000 7f1d05cc6b80 1 Processor -- start 2024-06-02T04:04:15.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.875+0000 7f1d05cc6b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5595269404f0 0x559526950b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.875+0000 7f1d05cc6b80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559526940e50 0x5595269510b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.875+0000 7f1d05cc6b80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559526941810 0x55952694d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.875+0000 7f1d05cc6b80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952694dba0 con 0x559526940e50 2024-06-02T04:04:15.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.875+0000 7f1d05cc6b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952694dce0 con 0x5595269404f0 2024-06-02T04:04:15.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.875+0000 7f1d05cc6b80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952694dea0 con 0x559526941810 2024-06-02T04:04:15.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.875+0000 7f1d05cc6b80 10 client.0 _ll_register_callbacks cb 0x559526835ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:04:15.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.875+0000 7f1cf2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559526940e50 0x5595269510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.875+0000 7f1cf2ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559526940e50 0x5595269510b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37848/0 (socket says 172.21.15.123:37848) 2024-06-02T04:04:15.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.875+0000 7f1cf2ffd700 1 -- 172.21.15.123:0/1379854383 learned_addr learned my addr 172.21.15.123:0/1379854383 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:15.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.875+0000 7f1cf37fe700 1 --2- 172.21.15.123:0/1379854383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5595269404f0 0x559526950b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.875+0000 7f1cf3fff700 1 --2- 172.21.15.123:0/1379854383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559526941810 0x55952694d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.876+0000 7f1cf2ffd700 1 -- 172.21.15.123:0/1379854383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559526941810 msgr2=0x55952694d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:15.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.876+0000 7f1cf2ffd700 1 --2- 172.21.15.123:0/1379854383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559526941810 0x55952694d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.876+0000 7f1cf2ffd700 1 -- 172.21.15.123:0/1379854383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5595269404f0 msgr2=0x559526950b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:15.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.876+0000 7f1cf2ffd700 1 --2- 172.21.15.123:0/1379854383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5595269404f0 0x559526950b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.876+0000 7f1cf2ffd700 1 -- 172.21.15.123:0/1379854383 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559526711360 con 0x559526940e50 2024-06-02T04:04:15.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.876+0000 7f1cf2ffd700 1 --2- 172.21.15.123:0/1379854383 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559526940e50 0x5595269510b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00d640 tx=0x7f1cdc0107d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9443993ff2f87020 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:15.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.876+0000 7f1cd2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-06-02T04:04:15.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.876+0000 7f1cd2ffd700 1 -- 172.21.15.123:0/1379854383 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc010d90 con 0x559526940e50 2024-06-02T04:04:15.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.876+0000 7f1cd2ffd700 1 -- 172.21.15.123:0/1379854383 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f1cdc01dc50 con 0x559526940e50 2024-06-02T04:04:15.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.876+0000 7f1d05cc6b80 1 -- 172.21.15.123:0/1379854383 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1cdc010c20 con 0x559526940e50 2024-06-02T04:04:15.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.876+0000 7f1cd2ffd700 1 -- 172.21.15.123:0/1379854383 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1cdc02fbe0 con 0x559526940e50 2024-06-02T04:04:15.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.876+0000 7f1d05cc6b80 10 client.15276 fetch_fsmap learned FSMap version 27 2024-06-02T04:04:15.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.876+0000 7f1d05cc6b80 1 -- 172.21.15.123:0/1379854383 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x559526715c80 con 0x559526940e50 2024-06-02T04:04:15.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.876+0000 7f1cd2ffd700 1 -- 172.21.15.123:0/1379854383 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1cdc010c20 con 0x559526940e50 2024-06-02T04:04:15.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.876+0000 7f1cd2ffd700 1 -- 172.21.15.123:0/1379854383 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1cdc02f050 con 0x559526940e50 2024-06-02T04:04:15.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.876+0000 7f1d05cc6b80 10 client.15276 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:04:15.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.876+0000 7f1d05cc6b80 10 client.15276 resolve_mds: resolved name 'h' to daemon mds.h 2024-06-02T04:04:15.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.876+0000 7f1d05cc6b80 20 client.15276 populate_metadata read hostname 'smithi123' 2024-06-02T04:04:15.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.876+0000 7f1d05cc6b80 1 --2- 172.21.15.123:0/1379854383 >> [v2:172.21.15.136:6836/2572418263,v1:172.21.15.136:6837/2572418263] conn(0x5595269afec0 0x5595269ac880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:15.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.876+0000 7f1d05cc6b80 4 client.15276 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T04:04:15.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.876+0000 7f1d05cc6b80 1 -- 172.21.15.123:0/1379854383 --> [v2:172.21.15.136:6836/2572418263,v1:172.21.15.136:6837/2572418263] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559526888e70 con 0x5595269afec0 2024-06-02T04:04:15.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.877+0000 7f1cf37fe700 1 --2- 172.21.15.123:0/1379854383 >> [v2:172.21.15.136:6836/2572418263,v1:172.21.15.136:6837/2572418263] conn(0x5595269afec0 0x5595269ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:15.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.877+0000 7f1cd2ffd700 10 client.15276 ms_handle_connect on v2:172.21.15.136:6836/2572418263 2024-06-02T04:04:15.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.877+0000 7f1cf37fe700 1 --2- 172.21.15.123:0/1379854383 >> [v2:172.21.15.136:6836/2572418263,v1:172.21.15.136:6837/2572418263] conn(0x5595269afec0 0x5595269ac880 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e1367a687a665335 server_cookie=1403e499c71b38b3 in_seq=0 out_seq=0 2024-06-02T04:04:15.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.877+0000 7f1cd2ffd700 1 -- 172.21.15.123:0/1379854383 <== mds.2 v2:172.21.15.136:6836/2572418263 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x559526888e70 con 0x5595269afec0 2024-06-02T04:04:15.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.877+0000 7f1cd2ffd700 10 client.15276 handle_command_reply: tid=0 2024-06-02T04:04:15.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.877+0000 7f1d05cc6b80 1 client.15276 shutdown 2024-06-02T04:04:15.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.877+0000 7f1d05cc6b80 1 -- 172.21.15.123:0/1379854383 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559526940e50 msgr2=0x5595269510b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.877+0000 7f1d05cc6b80 1 --2- 172.21.15.123:0/1379854383 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559526940e50 0x5595269510b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00d640 tx=0x7f1cdc0107d0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.877+0000 7f1d05cc6b80 1 -- 172.21.15.123:0/1379854383 shutdown_connections 2024-06-02T04:04:15.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.877+0000 7f1d05cc6b80 1 --2- 172.21.15.123:0/1379854383 >> [v2:172.21.15.136:6836/2572418263,v1:172.21.15.136:6837/2572418263] conn(0x5595269afec0 0x5595269ac880 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.877+0000 7f1d05cc6b80 1 --2- 172.21.15.123:0/1379854383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x559526941810 0x55952694d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.877+0000 7f1d05cc6b80 1 --2- 172.21.15.123:0/1379854383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5595269404f0 0x559526950b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.877+0000 7f1cd2ffd700 0 client.15276 ms_handle_reset on v2:172.21.15.136:6836/2572418263 2024-06-02T04:04:15.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.877+0000 7f1d05cc6b80 1 --2- 172.21.15.123:0/1379854383 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x559526940e50 0x5595269510b0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.877+0000 7f1d05cc6b80 1 -- 172.21.15.123:0/1379854383 >> 172.21.15.123:0/1379854383 conn(0x55952689e1c0 msgr2=0x559526951a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:15.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.878+0000 7f1d05cc6b80 1 -- 172.21.15.123:0/1379854383 shutdown_connections 2024-06-02T04:04:15.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.878+0000 7f1d05cc6b80 1 -- 172.21.15.123:0/1379854383 wait complete. 2024-06-02T04:04:15.887 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.878+0000 7f1d05cc6b80 20 client.15276 trim_cache size 0 max 16384 2024-06-02T04:04:15.887 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-06-02T04:04:15.887 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "1b432ae0-2094-11ef-bc9b-c7b262605968", 2024-06-02T04:04:15.887 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 2, 2024-06-02T04:04:15.887 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 24473, 2024-06-02T04:04:15.888 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-06-02T04:04:15.888 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-06-02T04:04:15.888 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-06-02T04:04:15.888 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 65.171243343, 2024-06-02T04:04:15.888 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 27, 2024-06-02T04:04:15.888 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 84, 2024-06-02T04:04:15.888 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 82, 2024-06-02T04:04:15.888 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 80.952622562000002 2024-06-02T04:04:15.888 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-06-02T04:04:15.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.878+0000 7f1cf9b0b700 1 -- 172.21.15.123:0/881204578 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f1ce00a1230 msgr2=0x7f1ce00a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.878+0000 7f1cf9b0b700 1 --2- 172.21.15.123:0/881204578 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f1ce00a1230 0x7f1ce00a36f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc005950 tx=0x7f1cdc0058e0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.878+0000 7f1cf9b0b700 1 -- 172.21.15.123:0/881204578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cf40ff220 msgr2=0x7f1cf4196f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:15.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.878+0000 7f1cf9b0b700 1 --2- 172.21.15.123:0/881204578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cf40ff220 0x7f1cf4196f00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1ce40095c0 tx=0x7f1ce400f690 comp rx=0 tx=0).stop 2024-06-02T04:04:15.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.878+0000 7f1cf9b0b700 1 -- 172.21.15.123:0/881204578 shutdown_connections 2024-06-02T04:04:15.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.878+0000 7f1cf9b0b700 1 --2- 172.21.15.123:0/881204578 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f1ce00a1230 0x7f1ce00a36f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.878+0000 7f1cf9b0b700 1 --2- 172.21.15.123:0/881204578 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1cf4102b90 0x7f1cf419e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.889 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.878+0000 7f1cf9b0b700 1 --2- 172.21.15.123:0/881204578 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f1cf40ff220 0x7f1cf4196f00 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.878+0000 7f1cf9b0b700 1 --2- 172.21.15.123:0/881204578 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cf41021f0 0x7f1cf4197440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:15.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.878+0000 7f1cf9b0b700 1 -- 172.21.15.123:0/881204578 >> 172.21.15.123:0/881204578 conn(0x7f1cf40fab50 msgr2=0x7f1cf41055c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:15.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.878+0000 7f1cf9b0b700 1 -- 172.21.15.123:0/881204578 shutdown_connections 2024-06-02T04:04:15.890 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:15.878+0000 7f1cf9b0b700 1 -- 172.21.15.123:0/881204578 wait complete. 2024-06-02T04:04:15.891 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-06-02T04:04:16.014 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.014+0000 7f92fdd29700 1 -- 172.21.15.123:0/2596920327 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92f8106c60 msgr2=0x7f92f81090d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:16.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.014+0000 7f92fdd29700 1 --2- 172.21.15.123:0/2596920327 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92f8106c60 0x7f92f81090d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f92f000b0a0 tx=0x7f92f000b3b0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.014+0000 7f92fdd29700 1 -- 172.21.15.123:0/2596920327 shutdown_connections 2024-06-02T04:04:16.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.014+0000 7f92fdd29700 1 --2- 172.21.15.123:0/2596920327 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92f8106c60 0x7f92f81090d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.014+0000 7f92fdd29700 1 --2- 172.21.15.123:0/2596920327 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92f8101a00 0x7f92f8103df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.014+0000 7f92fdd29700 1 --2- 172.21.15.123:0/2596920327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92f8104330 0x7f92f8106720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.014+0000 7f92fdd29700 1 -- 172.21.15.123:0/2596920327 >> 172.21.15.123:0/2596920327 conn(0x7f92f80fb3f0 msgr2=0x7f92f80fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:16.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.014+0000 7f92fdd29700 1 -- 172.21.15.123:0/2596920327 shutdown_connections 2024-06-02T04:04:16.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.014+0000 7f92fdd29700 1 -- 172.21.15.123:0/2596920327 wait complete. 2024-06-02T04:04:16.015 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.015+0000 7f92fdd29700 1 Processor -- start 2024-06-02T04:04:16.017 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.015+0000 7f92fdd29700 1 -- start start 2024-06-02T04:04:16.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.015+0000 7f92fdd29700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92f8101a00 0x7f92f8196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.015+0000 7f92fdd29700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92f8104330 0x7f92f81974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.015+0000 7f92fdd29700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92f8106c60 0x7f92f819e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.015+0000 7f92fdd29700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f819eac0 con 0x7f92f8101a00 2024-06-02T04:04:16.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.015+0000 7f92fdd29700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f819ec00 con 0x7f92f8106c60 2024-06-02T04:04:16.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.015+0000 7f92fdd29700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f819ed90 con 0x7f92f8104330 2024-06-02T04:04:16.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.015+0000 7f92f77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92f8101a00 0x7f92f8196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.015+0000 7f92f77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92f8101a00 0x7f92f8196f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37868/0 (socket says 172.21.15.123:37868) 2024-06-02T04:04:16.018 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.015+0000 7f92f77fe700 1 -- 172.21.15.123:0/2428482056 learned_addr learned my addr 172.21.15.123:0/2428482056 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:16.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.016+0000 7f92f6ffd700 1 --2- 172.21.15.123:0/2428482056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92f8104330 0x7f92f81974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.016+0000 7f92f7fff700 1 --2- 172.21.15.123:0/2428482056 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92f8106c60 0x7f92f819e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.016+0000 7f92f77fe700 1 -- 172.21.15.123:0/2428482056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92f8104330 msgr2=0x7f92f81974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:16.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.016+0000 7f92f77fe700 1 --2- 172.21.15.123:0/2428482056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92f8104330 0x7f92f81974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.016+0000 7f92f77fe700 1 -- 172.21.15.123:0/2428482056 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92f8106c60 msgr2=0x7f92f819e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:16.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.016+0000 7f92f77fe700 1 --2- 172.21.15.123:0/2428482056 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92f8106c60 0x7f92f819e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.016+0000 7f92f77fe700 1 -- 172.21.15.123:0/2428482056 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f0009d00 con 0x7f92f8101a00 2024-06-02T04:04:16.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.016+0000 7f92f7fff700 1 --2- 172.21.15.123:0/2428482056 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92f8106c60 0x7f92f819e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:04:16.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.016+0000 7f92f77fe700 1 --2- 172.21.15.123:0/2428482056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92f8101a00 0x7f92f8196f90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f92e800d950 tx=0x7f92e800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:16.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.016+0000 7f92f4ff9700 1 -- 172.21.15.123:0/2428482056 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e8009940 con 0x7f92f8101a00 2024-06-02T04:04:16.019 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.016+0000 7f92f4ff9700 1 -- 172.21.15.123:0/2428482056 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f92e8010460 con 0x7f92f8101a00 2024-06-02T04:04:16.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.016+0000 7f92fdd29700 1 -- 172.21.15.123:0/2428482056 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92f819f070 con 0x7f92f8101a00 2024-06-02T04:04:16.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.016+0000 7f92f4ff9700 1 -- 172.21.15.123:0/2428482056 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e800f620 con 0x7f92f8101a00 2024-06-02T04:04:16.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.016+0000 7f92fdd29700 1 -- 172.21.15.123:0/2428482056 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92f819f5d0 con 0x7f92f8101a00 2024-06-02T04:04:16.020 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.018+0000 7f92f4ff9700 1 -- 172.21.15.123:0/2428482056 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f92e80108d0 con 0x7f92f8101a00 2024-06-02T04:04:16.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.018+0000 7f92f4ff9700 1 --2- 172.21.15.123:0/2428482056 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f92e00a1230 0x7f92e00a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.019+0000 7f92f6ffd700 1 --2- 172.21.15.123:0/2428482056 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f92e00a1230 0x7f92e00a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.019+0000 7f92f4ff9700 1 -- 172.21.15.123:0/2428482056 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f92e80cc740 con 0x7f92f8101a00 2024-06-02T04:04:16.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.019+0000 7f92f6ffd700 1 --2- 172.21.15.123:0/2428482056 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f92e00a1230 0x7f92e00a36f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f92ec007be0 tx=0x7f92ec0073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:16.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.019+0000 7f9309ee4b80 1 Processor -- start 2024-06-02T04:04:16.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.020+0000 7f9309ee4b80 1 -- start start 2024-06-02T04:04:16.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.020+0000 7f9309ee4b80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a01f8ab4f0 0x55a01f8ab910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.020+0000 7f9309ee4b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a01f8abe50 0x55a01f8ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.020+0000 7f9309ee4b80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a01f8ac810 0x55a01f8acc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.020+0000 7f9309ee4b80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a01f802100 con 0x55a01f8ab4f0 2024-06-02T04:04:16.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.020+0000 7f9309ee4b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a01f7ffac0 con 0x55a01f8abe50 2024-06-02T04:04:16.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.020+0000 7f9309ee4b80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a01f7fb3b0 con 0x55a01f8ac810 2024-06-02T04:04:16.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.020+0000 7f92f77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a01f8ab4f0 0x55a01f8ab910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.020+0000 7f92f77fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a01f8ab4f0 0x55a01f8ab910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37872/0 (socket says 172.21.15.123:37872) 2024-06-02T04:04:16.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.020+0000 7f92f77fe700 1 -- 172.21.15.123:0/957038250 learned_addr learned my addr 172.21.15.123:0/957038250 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:16.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.020+0000 7f92f6ffd700 1 --2- 172.21.15.123:0/957038250 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a01f8abe50 0x55a01f8ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.020+0000 7f92f77fe700 1 -- 172.21.15.123:0/957038250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a01f8ac810 msgr2=0x55a01f8acc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:16.027 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.020+0000 7f92f77fe700 1 --2- 172.21.15.123:0/957038250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a01f8ac810 0x55a01f8acc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.020+0000 7f92f77fe700 1 -- 172.21.15.123:0/957038250 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a01f8abe50 msgr2=0x55a01f8ac2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:16.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.020+0000 7f92f77fe700 1 --2- 172.21.15.123:0/957038250 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a01f8abe50 0x55a01f8ac2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.020+0000 7f92f77fe700 1 -- 172.21.15.123:0/957038250 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a01f67c360 con 0x55a01f8ab4f0 2024-06-02T04:04:16.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.020+0000 7f92f77fe700 1 --2- 172.21.15.123:0/957038250 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a01f8ab4f0 0x55a01f8ab910 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f92e80965c0 tx=0x7f92e809a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f6910029790ee36 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:16.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.020+0000 7f92ddffb700 1 -- 172.21.15.123:0/957038250 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e80a1fd0 con 0x55a01f8ab4f0 2024-06-02T04:04:16.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.020+0000 7f92ddffb700 1 -- 172.21.15.123:0/957038250 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f92e80b9050 con 0x55a01f8ab4f0 2024-06-02T04:04:16.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.020+0000 7f92ddffb700 1 -- 172.21.15.123:0/957038250 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e80a1b40 con 0x55a01f8ab4f0 2024-06-02T04:04:16.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.021+0000 7f9309ee4b80 1 -- 172.21.15.123:0/957038250 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a01f8ab4f0 msgr2=0x55a01f8ab910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:16.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.021+0000 7f9309ee4b80 1 --2- 172.21.15.123:0/957038250 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a01f8ab4f0 0x55a01f8ab910 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f92e80965c0 tx=0x7f92e809a250 comp rx=0 tx=0).stop 2024-06-02T04:04:16.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.021+0000 7f9309ee4b80 1 -- 172.21.15.123:0/957038250 shutdown_connections 2024-06-02T04:04:16.028 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.021+0000 7f9309ee4b80 1 --2- 172.21.15.123:0/957038250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a01f8ac810 0x55a01f8acc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.021+0000 7f9309ee4b80 1 --2- 172.21.15.123:0/957038250 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a01f8ab4f0 0x55a01f8ab910 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.021+0000 7f9309ee4b80 1 --2- 172.21.15.123:0/957038250 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a01f8abe50 0x55a01f8ac2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.021+0000 7f9309ee4b80 1 -- 172.21.15.123:0/957038250 >> 172.21.15.123:0/957038250 conn(0x55a01f8091c0 msgr2=0x55a01f8a5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:16.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.021+0000 7f9309ee4b80 1 -- 172.21.15.123:0/957038250 shutdown_connections 2024-06-02T04:04:16.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.021+0000 7f9309ee4b80 1 -- 172.21.15.123:0/957038250 wait complete. 2024-06-02T04:04:16.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.021+0000 7f9309ee4b80 1 -- start start 2024-06-02T04:04:16.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.022+0000 7f9309ee4b80 1 Processor -- start 2024-06-02T04:04:16.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.022+0000 7f9309ee4b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a01f8ab4f0 0x55a01f8b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.022+0000 7f9309ee4b80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a01f8abe50 0x55a01f8b5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.022+0000 7f9309ee4b80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a01f8ac810 0x55a01f8bc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.022+0000 7f9309ee4b80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a01f797510 con 0x55a01f8abe50 2024-06-02T04:04:16.029 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.022+0000 7f9309ee4b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a01f7971b0 con 0x55a01f8ab4f0 2024-06-02T04:04:16.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.022+0000 7f9309ee4b80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a01f67e650 con 0x55a01f8ac810 2024-06-02T04:04:16.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.022+0000 7f9309ee4b80 10 client.0 _ll_register_callbacks cb 0x55a01f7a0ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:04:16.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.022+0000 7f92f6ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a01f8abe50 0x55a01f8b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.022+0000 7f92f6ffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a01f8abe50 0x55a01f8b5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37880/0 (socket says 172.21.15.123:37880) 2024-06-02T04:04:16.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.022+0000 7f92f6ffd700 1 -- 172.21.15.123:0/3721610891 learned_addr learned my addr 172.21.15.123:0/3721610891 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:16.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.022+0000 7f92f77fe700 1 --2- 172.21.15.123:0/3721610891 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a01f8ab4f0 0x55a01f8b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.022+0000 7f92f6ffd700 1 -- 172.21.15.123:0/3721610891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a01f8ac810 msgr2=0x55a01f8bc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:16.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.022+0000 7f92f6ffd700 1 --2- 172.21.15.123:0/3721610891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a01f8ac810 0x55a01f8bc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.022+0000 7f92f6ffd700 1 -- 172.21.15.123:0/3721610891 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a01f8ab4f0 msgr2=0x55a01f8b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:16.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.022+0000 7f92f6ffd700 1 --2- 172.21.15.123:0/3721610891 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a01f8ab4f0 0x55a01f8b4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.030 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.022+0000 7f92f6ffd700 1 -- 172.21.15.123:0/3721610891 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92f819f5d0 con 0x55a01f8abe50 2024-06-02T04:04:16.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.022+0000 7f92f6ffd700 1 --2- 172.21.15.123:0/3721610891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a01f8abe50 0x55a01f8b5350 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f92ec0042e0 tx=0x7f92ec0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18f63e38b90582bc server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:16.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.022+0000 7f92d6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-06-02T04:04:16.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.022+0000 7f92d6ffd700 1 -- 172.21.15.123:0/3721610891 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec003b10 con 0x55a01f8abe50 2024-06-02T04:04:16.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.023+0000 7f92d6ffd700 1 -- 172.21.15.123:0/3721610891 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f92ec017070 con 0x55a01f8abe50 2024-06-02T04:04:16.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.023+0000 7f9309ee4b80 1 -- 172.21.15.123:0/3721610891 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a01f754220 con 0x55a01f8abe50 2024-06-02T04:04:16.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.023+0000 7f92d6ffd700 1 -- 172.21.15.123:0/3721610891 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92ec003c70 con 0x55a01f8abe50 2024-06-02T04:04:16.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.023+0000 7f9309ee4b80 10 client.15288 fetch_fsmap learned FSMap version 27 2024-06-02T04:04:16.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.023+0000 7f9309ee4b80 1 -- 172.21.15.123:0/3721610891 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a01f628b10 con 0x55a01f8abe50 2024-06-02T04:04:16.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.023+0000 7f92d6ffd700 1 -- 172.21.15.123:0/3721610891 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a01f754220 con 0x55a01f8abe50 2024-06-02T04:04:16.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.023+0000 7f92d6ffd700 1 -- 172.21.15.123:0/3721610891 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f92ec020410 con 0x55a01f8abe50 2024-06-02T04:04:16.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.023+0000 7f9309ee4b80 10 client.15288 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:04:16.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.023+0000 7f9309ee4b80 10 client.15288 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-02T04:04:16.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.023+0000 7f9309ee4b80 20 client.15288 populate_metadata read hostname 'smithi123' 2024-06-02T04:04:16.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.023+0000 7f9309ee4b80 1 --2- 172.21.15.123:0/3721610891 >> [v2:172.21.15.162:6838/2588884232,v1:172.21.15.162:6839/2588884232] conn(0x55a01f8bf590 0x55a01f8c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.023+0000 7f9309ee4b80 4 client.15288 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:04:16.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.023+0000 7f9309ee4b80 1 -- 172.21.15.123:0/3721610891 --> [v2:172.21.15.162:6838/2588884232,v1:172.21.15.162:6839/2588884232] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a01f87a7c0 con 0x55a01f8bf590 2024-06-02T04:04:16.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.023+0000 7f92f77fe700 1 --2- 172.21.15.123:0/3721610891 >> [v2:172.21.15.162:6838/2588884232,v1:172.21.15.162:6839/2588884232] conn(0x55a01f8bf590 0x55a01f8c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.024+0000 7f92f77fe700 1 --2- 172.21.15.123:0/3721610891 >> [v2:172.21.15.162:6838/2588884232,v1:172.21.15.162:6839/2588884232] conn(0x55a01f8bf590 0x55a01f8c53d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5fb24bece665a244 server_cookie=2071f82932ef5b6e in_seq=0 out_seq=0 2024-06-02T04:04:16.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.024+0000 7f92d6ffd700 10 client.15288 ms_handle_connect on v2:172.21.15.162:6838/2588884232 2024-06-02T04:04:16.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.024+0000 7f92d6ffd700 1 -- 172.21.15.123:0/3721610891 <== mds.1 v2:172.21.15.162:6838/2588884232 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a01f87a7c0 con 0x55a01f8bf590 2024-06-02T04:04:16.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.024+0000 7f92d6ffd700 10 client.15288 handle_command_reply: tid=0 2024-06-02T04:04:16.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.025+0000 7f9309ee4b80 1 client.15288 shutdown 2024-06-02T04:04:16.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.025+0000 7f9309ee4b80 1 -- 172.21.15.123:0/3721610891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a01f8abe50 msgr2=0x55a01f8b5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:16.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.025+0000 7f9309ee4b80 1 --2- 172.21.15.123:0/3721610891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a01f8abe50 0x55a01f8b5350 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f92ec0042e0 tx=0x7f92ec0047c0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.025+0000 7f9309ee4b80 1 -- 172.21.15.123:0/3721610891 shutdown_connections 2024-06-02T04:04:16.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.025+0000 7f9309ee4b80 1 --2- 172.21.15.123:0/3721610891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a01f8ac810 0x55a01f8bc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.025+0000 7f9309ee4b80 1 --2- 172.21.15.123:0/3721610891 >> [v2:172.21.15.162:6838/2588884232,v1:172.21.15.162:6839/2588884232] conn(0x55a01f8bf590 0x55a01f8c53d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.025+0000 7f9309ee4b80 1 --2- 172.21.15.123:0/3721610891 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a01f8ab4f0 0x55a01f8b4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.025+0000 7f9309ee4b80 1 --2- 172.21.15.123:0/3721610891 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a01f8abe50 0x55a01f8b5350 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.025+0000 7f92d6ffd700 0 client.15288 ms_handle_reset on v2:172.21.15.162:6838/2588884232 2024-06-02T04:04:16.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.025+0000 7f9309ee4b80 1 -- 172.21.15.123:0/3721610891 >> 172.21.15.123:0/3721610891 conn(0x55a01f8091c0 msgr2=0x55a01f8a5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:16.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.025+0000 7f9309ee4b80 1 -- 172.21.15.123:0/3721610891 shutdown_connections 2024-06-02T04:04:16.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.025+0000 7f9309ee4b80 1 -- 172.21.15.123:0/3721610891 wait complete. 2024-06-02T04:04:16.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.025+0000 7f9309ee4b80 20 client.15288 trim_cache size 0 max 16384 2024-06-02T04:04:16.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.043+0000 7f9309ee4b80 1 Processor -- start 2024-06-02T04:04:16.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.043+0000 7f9309ee4b80 1 -- start start 2024-06-02T04:04:16.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.043+0000 7f9309ee4b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a01f8ab4f0 0x55a01f8b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.043+0000 7f9309ee4b80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a01f8abe50 0x55a01f8ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.043+0000 7f9309ee4b80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a01f8ac810 0x55a01f8bc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.043+0000 7f9309ee4b80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a01f87a7c0 con 0x55a01f8ac810 2024-06-02T04:04:16.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.043+0000 7f9309ee4b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a01f754220 con 0x55a01f8ab4f0 2024-06-02T04:04:16.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.043+0000 7f9309ee4b80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a01f7f4150 con 0x55a01f8abe50 2024-06-02T04:04:16.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.043+0000 7f92f7fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a01f8ac810 0x55a01f8bc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.049 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.043+0000 7f92f7fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a01f8ac810 0x55a01f8bc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37890/0 (socket says 172.21.15.123:37890) 2024-06-02T04:04:16.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.043+0000 7f92f7fff700 1 -- 172.21.15.123:0/2291238658 learned_addr learned my addr 172.21.15.123:0/2291238658 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:16.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.043+0000 7f92f77fe700 1 --2- 172.21.15.123:0/2291238658 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a01f8ab4f0 0x55a01f8b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.043+0000 7f92f6ffd700 1 --2- 172.21.15.123:0/2291238658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a01f8abe50 0x55a01f8ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.044+0000 7f92f7fff700 1 -- 172.21.15.123:0/2291238658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a01f8abe50 msgr2=0x55a01f8ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:16.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.044+0000 7f92f7fff700 1 --2- 172.21.15.123:0/2291238658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a01f8abe50 0x55a01f8ab8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.044+0000 7f92f7fff700 1 -- 172.21.15.123:0/2291238658 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a01f8ab4f0 msgr2=0x55a01f8b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:16.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.044+0000 7f92f7fff700 1 --2- 172.21.15.123:0/2291238658 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a01f8ab4f0 0x55a01f8b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.044+0000 7f92f7fff700 1 -- 172.21.15.123:0/2291238658 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a01f7c1510 con 0x55a01f8ac810 2024-06-02T04:04:16.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.044+0000 7f92f7fff700 1 --2- 172.21.15.123:0/2291238658 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a01f8ac810 0x55a01f8bc350 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f92f0007be0 tx=0x7f92f0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c85aefa876948a server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:16.050 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.044+0000 7f92de7fc700 1 -- 172.21.15.123:0/2291238658 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f000e070 con 0x55a01f8ac810 2024-06-02T04:04:16.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.044+0000 7f92de7fc700 1 -- 172.21.15.123:0/2291238658 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f92f00090d0 con 0x55a01f8ac810 2024-06-02T04:04:16.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.044+0000 7f92de7fc700 1 -- 172.21.15.123:0/2291238658 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f00052a0 con 0x55a01f8ac810 2024-06-02T04:04:16.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.044+0000 7f9309ee4b80 1 -- 172.21.15.123:0/2291238658 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a01f8ac810 msgr2=0x55a01f8bc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:16.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.044+0000 7f9309ee4b80 1 --2- 172.21.15.123:0/2291238658 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a01f8ac810 0x55a01f8bc350 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f92f0007be0 tx=0x7f92f0009c00 comp rx=0 tx=0).stop 2024-06-02T04:04:16.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.044+0000 7f9309ee4b80 1 -- 172.21.15.123:0/2291238658 shutdown_connections 2024-06-02T04:04:16.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.044+0000 7f9309ee4b80 1 --2- 172.21.15.123:0/2291238658 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a01f8ac810 0x55a01f8bc350 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.044+0000 7f9309ee4b80 1 --2- 172.21.15.123:0/2291238658 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a01f8ab4f0 0x55a01f8b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.044+0000 7f9309ee4b80 1 --2- 172.21.15.123:0/2291238658 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a01f8abe50 0x55a01f8ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.044+0000 7f9309ee4b80 1 -- 172.21.15.123:0/2291238658 >> 172.21.15.123:0/2291238658 conn(0x55a01f8091c0 msgr2=0x55a01f8acbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:16.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.044+0000 7f9309ee4b80 1 -- 172.21.15.123:0/2291238658 shutdown_connections 2024-06-02T04:04:16.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.044+0000 7f9309ee4b80 1 -- 172.21.15.123:0/2291238658 wait complete. 2024-06-02T04:04:16.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.045+0000 7f9309ee4b80 1 -- start start 2024-06-02T04:04:16.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.045+0000 7f9309ee4b80 1 Processor -- start 2024-06-02T04:04:16.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.045+0000 7f9309ee4b80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a01f8ab4f0 0x55a01f8b8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.045+0000 7f9309ee4b80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a01f8abe50 0x55a01f8b8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.045+0000 7f9309ee4b80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a01f8ac810 0x55a01f8bb950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.045+0000 7f9309ee4b80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a01f8bbe90 con 0x55a01f8ac810 2024-06-02T04:04:16.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.045+0000 7f9309ee4b80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a01f8bbfd0 con 0x55a01f8abe50 2024-06-02T04:04:16.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.045+0000 7f9309ee4b80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a01f8bc190 con 0x55a01f8ab4f0 2024-06-02T04:04:16.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.045+0000 7f9309ee4b80 10 client.0 _ll_register_callbacks cb 0x55a01f7a0ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:04:16.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.045+0000 7f92f7fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a01f8ac810 0x55a01f8bb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.045+0000 7f92f7fff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a01f8ac810 0x55a01f8bb950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37902/0 (socket says 172.21.15.123:37902) 2024-06-02T04:04:16.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.045+0000 7f92f7fff700 1 -- 172.21.15.123:0/246033544 learned_addr learned my addr 172.21.15.123:0/246033544 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:16.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.045+0000 7f92f6ffd700 1 --2- 172.21.15.123:0/246033544 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a01f8abe50 0x55a01f8b8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.053 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.045+0000 7f92f77fe700 1 --2- 172.21.15.123:0/246033544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a01f8ab4f0 0x55a01f8b8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.045+0000 7f92f7fff700 1 -- 172.21.15.123:0/246033544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a01f8ab4f0 msgr2=0x55a01f8b8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:16.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.045+0000 7f92f7fff700 1 --2- 172.21.15.123:0/246033544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a01f8ab4f0 0x55a01f8b8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.045+0000 7f92f7fff700 1 -- 172.21.15.123:0/246033544 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a01f8abe50 msgr2=0x55a01f8b8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:16.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.045+0000 7f92f7fff700 1 --2- 172.21.15.123:0/246033544 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a01f8abe50 0x55a01f8b8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.045+0000 7f92f7fff700 1 -- 172.21.15.123:0/246033544 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92f8109cc0 con 0x55a01f8ac810 2024-06-02T04:04:16.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.045+0000 7f92f77fe700 1 --2- 172.21.15.123:0/246033544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a01f8ab4f0 0x55a01f8b8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:04:16.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.046+0000 7f92f7fff700 1 --2- 172.21.15.123:0/246033544 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a01f8ac810 0x55a01f8bb950 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f92f0009fd0 tx=0x7f92f0007810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7a9c9f779aac63 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:16.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.046+0000 7f92d6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-06-02T04:04:16.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.046+0000 7f92d6ffd700 1 -- 172.21.15.123:0/246033544 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f000e040 con 0x55a01f8ac810 2024-06-02T04:04:16.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.046+0000 7f92d6ffd700 1 -- 172.21.15.123:0/246033544 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f92f00052d0 con 0x55a01f8ac810 2024-06-02T04:04:16.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.046+0000 7f9309ee4b80 1 -- 172.21.15.123:0/246033544 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f92e80b9050 con 0x55a01f8ac810 2024-06-02T04:04:16.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.046+0000 7f92d6ffd700 1 -- 172.21.15.123:0/246033544 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92f0006130 con 0x55a01f8ac810 2024-06-02T04:04:16.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.046+0000 7f9309ee4b80 10 client.15294 fetch_fsmap learned FSMap version 27 2024-06-02T04:04:16.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.046+0000 7f9309ee4b80 1 -- 172.21.15.123:0/246033544 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a01f680c80 con 0x55a01f8ac810 2024-06-02T04:04:16.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.046+0000 7f92d6ffd700 1 -- 172.21.15.123:0/246033544 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f92e80b9050 con 0x55a01f8ac810 2024-06-02T04:04:16.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.046+0000 7f92d6ffd700 1 -- 172.21.15.123:0/246033544 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f92f000b0d0 con 0x55a01f8ac810 2024-06-02T04:04:16.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.046+0000 7f9309ee4b80 10 client.15294 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:04:16.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.046+0000 7f9309ee4b80 10 client.15294 resolve_mds: resolved name 'i' to daemon mds.i 2024-06-02T04:04:16.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.046+0000 7f9309ee4b80 20 client.15294 populate_metadata read hostname 'smithi123' 2024-06-02T04:04:16.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.046+0000 7f9309ee4b80 1 --2- 172.21.15.123:0/246033544 >> [v2:172.21.15.162:6838/2588884232,v1:172.21.15.162:6839/2588884232] conn(0x55a01f91b490 0x55a01f917e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.046+0000 7f9309ee4b80 4 client.15294 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T04:04:16.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.046+0000 7f9309ee4b80 1 -- 172.21.15.123:0/246033544 --> [v2:172.21.15.162:6838/2588884232,v1:172.21.15.162:6839/2588884232] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a01f7f3e70 con 0x55a01f91b490 2024-06-02T04:04:16.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.047+0000 7f92f77fe700 1 --2- 172.21.15.123:0/246033544 >> [v2:172.21.15.162:6838/2588884232,v1:172.21.15.162:6839/2588884232] conn(0x55a01f91b490 0x55a01f917e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.047+0000 7f92d6ffd700 10 client.15294 ms_handle_connect on v2:172.21.15.162:6838/2588884232 2024-06-02T04:04:16.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.047+0000 7f92f77fe700 1 --2- 172.21.15.123:0/246033544 >> [v2:172.21.15.162:6838/2588884232,v1:172.21.15.162:6839/2588884232] conn(0x55a01f91b490 0x55a01f917e20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1882f9409b6868f0 server_cookie=eb993147fe83da9d in_seq=0 out_seq=0 2024-06-02T04:04:16.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.047+0000 7f92d6ffd700 1 -- 172.21.15.123:0/246033544 <== mds.1 v2:172.21.15.162:6838/2588884232 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55a01f7f3e70 con 0x55a01f91b490 2024-06-02T04:04:16.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.047+0000 7f92d6ffd700 10 client.15294 handle_command_reply: tid=0 2024-06-02T04:04:16.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.047+0000 7f9309ee4b80 1 client.15294 shutdown 2024-06-02T04:04:16.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.047+0000 7f9309ee4b80 1 -- 172.21.15.123:0/246033544 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a01f8ac810 msgr2=0x55a01f8bb950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:16.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.047+0000 7f9309ee4b80 1 --2- 172.21.15.123:0/246033544 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a01f8ac810 0x55a01f8bb950 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f92f0009fd0 tx=0x7f92f0007810 comp rx=0 tx=0).stop 2024-06-02T04:04:16.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.047+0000 7f9309ee4b80 1 -- 172.21.15.123:0/246033544 shutdown_connections 2024-06-02T04:04:16.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.047+0000 7f9309ee4b80 1 --2- 172.21.15.123:0/246033544 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55a01f8ac810 0x55a01f8bb950 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.047+0000 7f9309ee4b80 1 --2- 172.21.15.123:0/246033544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a01f8ab4f0 0x55a01f8b8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.047+0000 7f9309ee4b80 1 --2- 172.21.15.123:0/246033544 >> [v2:172.21.15.162:6838/2588884232,v1:172.21.15.162:6839/2588884232] conn(0x55a01f91b490 0x55a01f917e20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.047+0000 7f9309ee4b80 1 --2- 172.21.15.123:0/246033544 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a01f8abe50 0x55a01f8b8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.047+0000 7f92d6ffd700 0 client.15294 ms_handle_reset on v2:172.21.15.162:6838/2588884232 2024-06-02T04:04:16.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.047+0000 7f9309ee4b80 1 -- 172.21.15.123:0/246033544 >> 172.21.15.123:0/246033544 conn(0x55a01f8091c0 msgr2=0x55a01f8acbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:16.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.047+0000 7f9309ee4b80 1 -- 172.21.15.123:0/246033544 shutdown_connections 2024-06-02T04:04:16.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.047+0000 7f9309ee4b80 1 -- 172.21.15.123:0/246033544 wait complete. 2024-06-02T04:04:16.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.048+0000 7f9309ee4b80 20 client.15294 trim_cache size 0 max 16384 2024-06-02T04:04:16.057 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-06-02T04:04:16.058 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "1b432ae0-2094-11ef-bc9b-c7b262605968", 2024-06-02T04:04:16.058 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 1, 2024-06-02T04:04:16.058 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 24490, 2024-06-02T04:04:16.058 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-06-02T04:04:16.058 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-06-02T04:04:16.058 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-06-02T04:04:16.058 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 66.349020686000003, 2024-06-02T04:04:16.058 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 27, 2024-06-02T04:04:16.058 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 84, 2024-06-02T04:04:16.058 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 82, 2024-06-02T04:04:16.058 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 79.292195207000006 2024-06-02T04:04:16.059 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-06-02T04:04:16.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.048+0000 7f92fdd29700 1 -- 172.21.15.123:0/2428482056 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f92e00a1230 msgr2=0x7f92e00a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:16.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.048+0000 7f92fdd29700 1 --2- 172.21.15.123:0/2428482056 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f92e00a1230 0x7f92e00a36f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f92ec007be0 tx=0x7f92ec0073d0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.048+0000 7f92fdd29700 1 -- 172.21.15.123:0/2428482056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92f8101a00 msgr2=0x7f92f8196f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:16.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.048+0000 7f92fdd29700 1 --2- 172.21.15.123:0/2428482056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92f8101a00 0x7f92f8196f90 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f92e800d950 tx=0x7f92e800dc60 comp rx=0 tx=0).stop 2024-06-02T04:04:16.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.048+0000 7f92fdd29700 1 -- 172.21.15.123:0/2428482056 shutdown_connections 2024-06-02T04:04:16.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.048+0000 7f92fdd29700 1 --2- 172.21.15.123:0/2428482056 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f92e00a1230 0x7f92e00a36f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.060 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.048+0000 7f92fdd29700 1 --2- 172.21.15.123:0/2428482056 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92f8106c60 0x7f92f819e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.048+0000 7f92fdd29700 1 --2- 172.21.15.123:0/2428482056 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f92f8101a00 0x7f92f8196f90 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.048+0000 7f92fdd29700 1 --2- 172.21.15.123:0/2428482056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92f8104330 0x7f92f81974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.048+0000 7f92fdd29700 1 -- 172.21.15.123:0/2428482056 >> 172.21.15.123:0/2428482056 conn(0x7f92f80fb3f0 msgr2=0x7f92f81022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:16.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.048+0000 7f92fdd29700 1 -- 172.21.15.123:0/2428482056 shutdown_connections 2024-06-02T04:04:16.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.048+0000 7f92fdd29700 1 -- 172.21.15.123:0/2428482056 wait complete. 2024-06-02T04:04:16.061 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-06-02T04:04:16.188 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.186+0000 7fe3a37b3700 1 -- 172.21.15.123:0/2008064628 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe39c100fb0 msgr2=0x7fe39c101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:16.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.186+0000 7fe3a37b3700 1 --2- 172.21.15.123:0/2008064628 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe39c100fb0 0x7fe39c101430 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fe38c009990 tx=0x7fe38c009ca0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.186+0000 7fe3a37b3700 1 -- 172.21.15.123:0/2008064628 shutdown_connections 2024-06-02T04:04:16.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.186+0000 7fe3a37b3700 1 --2- 172.21.15.123:0/2008064628 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe39c101970 0x7fe39c108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.186+0000 7fe3a37b3700 1 --2- 172.21.15.123:0/2008064628 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe39c0ffe60 0x7fe39c100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.186+0000 7fe3a37b3700 1 --2- 172.21.15.123:0/2008064628 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe39c100fb0 0x7fe39c101430 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.186+0000 7fe3a37b3700 1 -- 172.21.15.123:0/2008064628 >> 172.21.15.123:0/2008064628 conn(0x7fe39c0fb3f0 msgr2=0x7fe39c0fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:16.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.186+0000 7fe3a37b3700 1 -- 172.21.15.123:0/2008064628 shutdown_connections 2024-06-02T04:04:16.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.186+0000 7fe3a37b3700 1 -- 172.21.15.123:0/2008064628 wait complete. 2024-06-02T04:04:16.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.186+0000 7fe3a37b3700 1 Processor -- start 2024-06-02T04:04:16.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.186+0000 7fe3a37b3700 1 -- start start 2024-06-02T04:04:16.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.186+0000 7fe3a37b3700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe39c0ffe60 0x7fe39c06a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.189 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.186+0000 7fe3a37b3700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe39c100fb0 0x7fe39c19bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.186+0000 7fe3a37b3700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe39c101970 0x7fe39c19e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.186+0000 7fe3a37b3700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c19e990 con 0x7fe39c100fb0 2024-06-02T04:04:16.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.186+0000 7fe3a37b3700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c19eb00 con 0x7fe39c101970 2024-06-02T04:04:16.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.186+0000 7fe3a37b3700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c19ecc0 con 0x7fe39c0ffe60 2024-06-02T04:04:16.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.187+0000 7fe3a0d4e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe39c100fb0 0x7fe39c19bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.187+0000 7fe3a0d4e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe39c100fb0 0x7fe39c19bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37930/0 (socket says 172.21.15.123:37930) 2024-06-02T04:04:16.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.187+0000 7fe3a0d4e700 1 -- 172.21.15.123:0/4212447181 learned_addr learned my addr 172.21.15.123:0/4212447181 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:16.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.187+0000 7fe3a1d50700 1 --2- 172.21.15.123:0/4212447181 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe39c101970 0x7fe39c19e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.187+0000 7fe3a154f700 1 --2- 172.21.15.123:0/4212447181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe39c0ffe60 0x7fe39c06a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.187+0000 7fe3a0d4e700 1 -- 172.21.15.123:0/4212447181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe39c0ffe60 msgr2=0x7fe39c06a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:16.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.187+0000 7fe3a0d4e700 1 --2- 172.21.15.123:0/4212447181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe39c0ffe60 0x7fe39c06a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.190 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.187+0000 7fe3a0d4e700 1 -- 172.21.15.123:0/4212447181 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe39c101970 msgr2=0x7fe39c19e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:16.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.187+0000 7fe3a0d4e700 1 --2- 172.21.15.123:0/4212447181 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe39c101970 0x7fe39c19e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.187+0000 7fe3a0d4e700 1 -- 172.21.15.123:0/4212447181 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe38c0095f0 con 0x7fe39c100fb0 2024-06-02T04:04:16.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.187+0000 7fe3a0d4e700 1 --2- 172.21.15.123:0/4212447181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe39c100fb0 0x7fe39c19bc00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00b5c0 tx=0x7fe38c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:16.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.187+0000 7fe3927fc700 1 -- 172.21.15.123:0/4212447181 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c01d070 con 0x7fe39c100fb0 2024-06-02T04:04:16.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.187+0000 7fe3927fc700 1 -- 172.21.15.123:0/4212447181 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe38c003f60 con 0x7fe39c100fb0 2024-06-02T04:04:16.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.187+0000 7fe3a37b3700 1 -- 172.21.15.123:0/4212447181 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe39c19ef40 con 0x7fe39c100fb0 2024-06-02T04:04:16.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.187+0000 7fe3927fc700 1 -- 172.21.15.123:0/4212447181 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c022d10 con 0x7fe39c100fb0 2024-06-02T04:04:16.191 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.187+0000 7fe3a37b3700 1 -- 172.21.15.123:0/4212447181 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe39c19f300 con 0x7fe39c100fb0 2024-06-02T04:04:16.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.189+0000 7fe3927fc700 1 -- 172.21.15.123:0/4212447181 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fe38c022470 con 0x7fe39c100fb0 2024-06-02T04:04:16.199 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.190+0000 7fe3927fc700 1 --2- 172.21.15.123:0/4212447181 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe3880a11b0 0x7fe3880a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.190+0000 7fe3a154f700 1 --2- 172.21.15.123:0/4212447181 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe3880a11b0 0x7fe3880a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.190+0000 7fe3927fc700 1 -- 172.21.15.123:0/4212447181 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fe38c0cd850 con 0x7fe39c100fb0 2024-06-02T04:04:16.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.190+0000 7fe3a154f700 1 --2- 172.21.15.123:0/4212447181 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe3880a11b0 0x7fe3880a3670 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe398005950 tx=0x7fe39800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:16.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.191+0000 7fe3af96eb80 1 Processor -- start 2024-06-02T04:04:16.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.191+0000 7fe3af96eb80 1 -- start start 2024-06-02T04:04:16.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.191+0000 7fe3af96eb80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa77c8a900 0x55aa77c8ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.191+0000 7fe3af96eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa77c8b260 0x55aa77c8b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.191+0000 7fe3af96eb80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa77c8bc20 0x55aa77c8c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.200 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.191+0000 7fe3af96eb80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa77bdd100 con 0x55aa77c8a900 2024-06-02T04:04:16.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.191+0000 7fe3af96eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa77bdaac0 con 0x55aa77c8b260 2024-06-02T04:04:16.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.191+0000 7fe3af96eb80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa77bd63b0 con 0x55aa77c8bc20 2024-06-02T04:04:16.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.191+0000 7fe3a154f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa77c8a900 0x55aa77c8ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.191+0000 7fe3a154f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa77c8a900 0x55aa77c8ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37946/0 (socket says 172.21.15.123:37946) 2024-06-02T04:04:16.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.191+0000 7fe3a154f700 1 -- 172.21.15.123:0/1032499642 learned_addr learned my addr 172.21.15.123:0/1032499642 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:16.201 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.191+0000 7fe3a1d50700 1 --2- 172.21.15.123:0/1032499642 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa77c8bc20 0x55aa77c8c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.191+0000 7fe3a154f700 1 -- 172.21.15.123:0/1032499642 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa77c8bc20 msgr2=0x55aa77c8c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:16.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.191+0000 7fe3a154f700 1 --2- 172.21.15.123:0/1032499642 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa77c8bc20 0x55aa77c8c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.191+0000 7fe3a154f700 1 -- 172.21.15.123:0/1032499642 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa77c8b260 msgr2=0x55aa77c8b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:16.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.191+0000 7fe3a154f700 1 --2- 172.21.15.123:0/1032499642 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa77c8b260 0x55aa77c8b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.191+0000 7fe3a154f700 1 -- 172.21.15.123:0/1032499642 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa77a57360 con 0x55aa77c8a900 2024-06-02T04:04:16.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.191+0000 7fe3a154f700 1 --2- 172.21.15.123:0/1032499642 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa77c8a900 0x55aa77c8ad20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe398010fa0 tx=0x7fe398013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=984805a15fb5acee server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:16.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.192+0000 7fe3877fe700 1 -- 172.21.15.123:0/1032499642 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39801e620 con 0x55aa77c8a900 2024-06-02T04:04:16.202 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.192+0000 7fe3877fe700 1 -- 172.21.15.123:0/1032499642 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe398015070 con 0x55aa77c8a900 2024-06-02T04:04:16.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.192+0000 7fe3877fe700 1 -- 172.21.15.123:0/1032499642 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39801c9c0 con 0x55aa77c8a900 2024-06-02T04:04:16.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.192+0000 7fe3af96eb80 1 -- 172.21.15.123:0/1032499642 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa77c8a900 msgr2=0x55aa77c8ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:16.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.192+0000 7fe3af96eb80 1 --2- 172.21.15.123:0/1032499642 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa77c8a900 0x55aa77c8ad20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe398010fa0 tx=0x7fe398013000 comp rx=0 tx=0).stop 2024-06-02T04:04:16.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.192+0000 7fe3af96eb80 1 -- 172.21.15.123:0/1032499642 shutdown_connections 2024-06-02T04:04:16.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.192+0000 7fe3af96eb80 1 --2- 172.21.15.123:0/1032499642 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa77c8bc20 0x55aa77c8c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.192+0000 7fe3af96eb80 1 --2- 172.21.15.123:0/1032499642 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa77c8a900 0x55aa77c8ad20 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.192+0000 7fe3af96eb80 1 --2- 172.21.15.123:0/1032499642 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa77c8b260 0x55aa77c8b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.192+0000 7fe3af96eb80 1 -- 172.21.15.123:0/1032499642 >> 172.21.15.123:0/1032499642 conn(0x55aa77be41c0 msgr2=0x55aa77c80d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:16.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.192+0000 7fe3af96eb80 1 -- 172.21.15.123:0/1032499642 shutdown_connections 2024-06-02T04:04:16.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.192+0000 7fe3af96eb80 1 -- 172.21.15.123:0/1032499642 wait complete. 2024-06-02T04:04:16.203 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.193+0000 7fe3af96eb80 1 -- start start 2024-06-02T04:04:16.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.193+0000 7fe3af96eb80 1 Processor -- start 2024-06-02T04:04:16.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.193+0000 7fe3af96eb80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa77c8a900 0x55aa77c94190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.193+0000 7fe3af96eb80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa77c8b260 0x55aa77c946d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.193+0000 7fe3af96eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa77c8bc20 0x55aa77c9b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.193+0000 7fe3af96eb80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa77b72510 con 0x55aa77c8b260 2024-06-02T04:04:16.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.193+0000 7fe3af96eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa77b721b0 con 0x55aa77c8bc20 2024-06-02T04:04:16.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.193+0000 7fe3af96eb80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa77a59650 con 0x55aa77c8a900 2024-06-02T04:04:16.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.193+0000 7fe3a0d4e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa77c8b260 0x55aa77c946d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.193+0000 7fe3af96eb80 10 client.0 _ll_register_callbacks cb 0x55aa77b7bae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:04:16.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.193+0000 7fe3a0d4e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa77c8b260 0x55aa77c946d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37958/0 (socket says 172.21.15.123:37958) 2024-06-02T04:04:16.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.193+0000 7fe3a0d4e700 1 -- 172.21.15.123:0/4040790814 learned_addr learned my addr 172.21.15.123:0/4040790814 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:16.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.193+0000 7fe3a154f700 1 --2- 172.21.15.123:0/4040790814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa77c8a900 0x55aa77c94190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.194+0000 7fe3a1d50700 1 --2- 172.21.15.123:0/4040790814 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa77c8bc20 0x55aa77c9b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.204 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.194+0000 7fe3a0d4e700 1 -- 172.21.15.123:0/4040790814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa77c8a900 msgr2=0x55aa77c94190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:16.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.194+0000 7fe3a0d4e700 1 --2- 172.21.15.123:0/4040790814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa77c8a900 0x55aa77c94190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.194+0000 7fe3a0d4e700 1 -- 172.21.15.123:0/4040790814 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa77c8bc20 msgr2=0x55aa77c9b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:16.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.194+0000 7fe3a0d4e700 1 --2- 172.21.15.123:0/4040790814 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa77c8bc20 0x55aa77c9b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.194+0000 7fe3a0d4e700 1 -- 172.21.15.123:0/4040790814 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe398010c50 con 0x55aa77c8b260 2024-06-02T04:04:16.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.194+0000 7fe3a0d4e700 1 --2- 172.21.15.123:0/4040790814 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa77c8b260 0x55aa77c946d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe38c005d90 tx=0x7fe38c09b230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ccd2a196fdaefb8 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:16.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.194+0000 7fe384ff9700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-06-02T04:04:16.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.194+0000 7fe384ff9700 1 -- 172.21.15.123:0/4040790814 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c09eb20 con 0x55aa77c8b260 2024-06-02T04:04:16.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.194+0000 7fe384ff9700 1 -- 172.21.15.123:0/4040790814 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fe38c0a30e0 con 0x55aa77c8b260 2024-06-02T04:04:16.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.194+0000 7fe3af96eb80 1 -- 172.21.15.123:0/4040790814 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aa77b2f220 con 0x55aa77c8b260 2024-06-02T04:04:16.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.194+0000 7fe384ff9700 1 -- 172.21.15.123:0/4040790814 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe38c0a2e60 con 0x55aa77c8b260 2024-06-02T04:04:16.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.194+0000 7fe3af96eb80 10 client.15306 fetch_fsmap learned FSMap version 27 2024-06-02T04:04:16.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.194+0000 7fe3af96eb80 1 -- 172.21.15.123:0/4040790814 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55aa77a03b10 con 0x55aa77c8b260 2024-06-02T04:04:16.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.194+0000 7fe384ff9700 1 -- 172.21.15.123:0/4040790814 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe38c0b7020 con 0x55aa77c8b260 2024-06-02T04:04:16.205 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.194+0000 7fe384ff9700 1 -- 172.21.15.123:0/4040790814 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe38c096ce0 con 0x55aa77c8b260 2024-06-02T04:04:16.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.194+0000 7fe3af96eb80 10 client.15306 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:04:16.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.194+0000 7fe3af96eb80 10 client.15306 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-02T04:04:16.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.194+0000 7fe3af96eb80 20 client.15306 populate_metadata read hostname 'smithi123' 2024-06-02T04:04:16.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.195+0000 7fe3af96eb80 1 --2- 172.21.15.123:0/4040790814 >> [v2:172.21.15.136:6838/952830191,v1:172.21.15.136:6839/952830191] conn(0x55aa77c9ee70 0x55aa77ca4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.195+0000 7fe3af96eb80 4 client.15306 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-06-02T04:04:16.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.195+0000 7fe3af96eb80 1 -- 172.21.15.123:0/4040790814 --> [v2:172.21.15.136:6838/952830191,v1:172.21.15.136:6839/952830191] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aa77c557c0 con 0x55aa77c9ee70 2024-06-02T04:04:16.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.195+0000 7fe3a154f700 1 --2- 172.21.15.123:0/4040790814 >> [v2:172.21.15.136:6838/952830191,v1:172.21.15.136:6839/952830191] conn(0x55aa77c9ee70 0x55aa77ca4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.195+0000 7fe3a154f700 1 --2- 172.21.15.123:0/4040790814 >> [v2:172.21.15.136:6838/952830191,v1:172.21.15.136:6839/952830191] conn(0x55aa77c9ee70 0x55aa77ca4110 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c48d3cc716f3d47 server_cookie=170dda0ec0970ea3 in_seq=0 out_seq=0 2024-06-02T04:04:16.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.195+0000 7fe384ff9700 10 client.15306 ms_handle_connect on v2:172.21.15.136:6838/952830191 2024-06-02T04:04:16.206 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.196+0000 7fe384ff9700 1 -- 172.21.15.123:0/4040790814 <== mds.0 v2:172.21.15.136:6838/952830191 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55aa77c557c0 con 0x55aa77c9ee70 2024-06-02T04:04:16.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.196+0000 7fe384ff9700 10 client.15306 handle_command_reply: tid=0 2024-06-02T04:04:16.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.196+0000 7fe3af96eb80 1 client.15306 shutdown 2024-06-02T04:04:16.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.196+0000 7fe3af96eb80 1 -- 172.21.15.123:0/4040790814 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa77c8b260 msgr2=0x55aa77c946d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:16.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.196+0000 7fe3af96eb80 1 --2- 172.21.15.123:0/4040790814 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa77c8b260 0x55aa77c946d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe38c005d90 tx=0x7fe38c09b230 comp rx=0 tx=0).stop 2024-06-02T04:04:16.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.196+0000 7fe3af96eb80 1 -- 172.21.15.123:0/4040790814 shutdown_connections 2024-06-02T04:04:16.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.196+0000 7fe3af96eb80 1 --2- 172.21.15.123:0/4040790814 >> [v2:172.21.15.136:6838/952830191,v1:172.21.15.136:6839/952830191] conn(0x55aa77c9ee70 0x55aa77ca4110 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.196+0000 7fe3af96eb80 1 --2- 172.21.15.123:0/4040790814 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa77c8bc20 0x55aa77c9b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.196+0000 7fe3af96eb80 1 --2- 172.21.15.123:0/4040790814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa77c8a900 0x55aa77c94190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.196+0000 7fe384ff9700 0 client.15306 ms_handle_reset on v2:172.21.15.136:6838/952830191 2024-06-02T04:04:16.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.196+0000 7fe3af96eb80 1 --2- 172.21.15.123:0/4040790814 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa77c8b260 0x55aa77c946d0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.196+0000 7fe3af96eb80 1 -- 172.21.15.123:0/4040790814 >> 172.21.15.123:0/4040790814 conn(0x55aa77be41c0 msgr2=0x55aa77c80550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:16.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.196+0000 7fe3af96eb80 1 -- 172.21.15.123:0/4040790814 shutdown_connections 2024-06-02T04:04:16.207 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.196+0000 7fe3af96eb80 1 -- 172.21.15.123:0/4040790814 wait complete. 2024-06-02T04:04:16.208 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.196+0000 7fe3af96eb80 20 client.15306 trim_cache size 0 max 16384 2024-06-02T04:04:16.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.214+0000 7fe3af96eb80 1 Processor -- start 2024-06-02T04:04:16.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.214+0000 7fe3af96eb80 1 -- start start 2024-06-02T04:04:16.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.215+0000 7fe3af96eb80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa77c8a900 0x55aa77c8ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.215+0000 7fe3af96eb80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa77c8b260 0x55aa77c9bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.215+0000 7fe3af96eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa77c8bc20 0x55aa77c936a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.215+0000 7fe3af96eb80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa77b942b0 con 0x55aa77c8a900 2024-06-02T04:04:16.222 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.215+0000 7fe3af96eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa77bcf150 con 0x55aa77c8bc20 2024-06-02T04:04:16.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.215+0000 7fe3af96eb80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa77b755a0 con 0x55aa77c8b260 2024-06-02T04:04:16.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.215+0000 7fe3a154f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa77c8a900 0x55aa77c8ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.215+0000 7fe3a154f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa77c8a900 0x55aa77c8ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37974/0 (socket says 172.21.15.123:37974) 2024-06-02T04:04:16.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.215+0000 7fe3a154f700 1 -- 172.21.15.123:0/3009845761 learned_addr learned my addr 172.21.15.123:0/3009845761 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:16.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.215+0000 7fe3a1d50700 1 --2- 172.21.15.123:0/3009845761 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa77c8bc20 0x55aa77c936a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.215+0000 7fe3a0d4e700 1 --2- 172.21.15.123:0/3009845761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa77c8b260 0x55aa77c9bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.215+0000 7fe3a154f700 1 -- 172.21.15.123:0/3009845761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa77c8b260 msgr2=0x55aa77c9bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:16.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.215+0000 7fe3a154f700 1 --2- 172.21.15.123:0/3009845761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa77c8b260 0x55aa77c9bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.215+0000 7fe3a154f700 1 -- 172.21.15.123:0/3009845761 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa77c8bc20 msgr2=0x55aa77c936a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:16.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.215+0000 7fe3a154f700 1 --2- 172.21.15.123:0/3009845761 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa77c8bc20 0x55aa77c936a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.215+0000 7fe3a154f700 1 -- 172.21.15.123:0/3009845761 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa77b9c510 con 0x55aa77c8a900 2024-06-02T04:04:16.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.215+0000 7fe3a0d4e700 1 --2- 172.21.15.123:0/3009845761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa77c8b260 0x55aa77c9bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:04:16.223 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.215+0000 7fe3a154f700 1 --2- 172.21.15.123:0/3009845761 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa77c8a900 0x55aa77c8ace0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe398010a40 tx=0x7fe39800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39fadbd2a10142c4 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:16.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.215+0000 7fe387fff700 1 -- 172.21.15.123:0/3009845761 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39802d050 con 0x55aa77c8a900 2024-06-02T04:04:16.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.215+0000 7fe387fff700 1 -- 172.21.15.123:0/3009845761 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe39802e040 con 0x55aa77c8a900 2024-06-02T04:04:16.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.215+0000 7fe387fff700 1 -- 172.21.15.123:0/3009845761 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe398035370 con 0x55aa77c8a900 2024-06-02T04:04:16.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.216+0000 7fe3af96eb80 1 -- 172.21.15.123:0/3009845761 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa77c8a900 msgr2=0x55aa77c8ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:16.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.216+0000 7fe3af96eb80 1 --2- 172.21.15.123:0/3009845761 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa77c8a900 0x55aa77c8ace0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe398010a40 tx=0x7fe39800bf10 comp rx=0 tx=0).stop 2024-06-02T04:04:16.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.216+0000 7fe3af96eb80 1 -- 172.21.15.123:0/3009845761 shutdown_connections 2024-06-02T04:04:16.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.216+0000 7fe3af96eb80 1 --2- 172.21.15.123:0/3009845761 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa77c8bc20 0x55aa77c936a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.216+0000 7fe3af96eb80 1 --2- 172.21.15.123:0/3009845761 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa77c8a900 0x55aa77c8ace0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.216+0000 7fe3af96eb80 1 --2- 172.21.15.123:0/3009845761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa77c8b260 0x55aa77c9bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.216+0000 7fe3af96eb80 1 -- 172.21.15.123:0/3009845761 >> 172.21.15.123:0/3009845761 conn(0x55aa77be41c0 msgr2=0x55aa77c8c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:16.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.216+0000 7fe3af96eb80 1 -- 172.21.15.123:0/3009845761 shutdown_connections 2024-06-02T04:04:16.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.216+0000 7fe3af96eb80 1 -- 172.21.15.123:0/3009845761 wait complete. 2024-06-02T04:04:16.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.216+0000 7fe3af96eb80 1 -- start start 2024-06-02T04:04:16.224 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.216+0000 7fe3af96eb80 1 Processor -- start 2024-06-02T04:04:16.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.216+0000 7fe3af96eb80 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa77c8a900 0x55aa77c7fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.216+0000 7fe3af96eb80 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa77c8b260 0x55aa77c9b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.216+0000 7fe3af96eb80 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa77c8bc20 0x55aa77c80220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.216+0000 7fe3af96eb80 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa77c80910 con 0x55aa77c8bc20 2024-06-02T04:04:16.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.216+0000 7fe3af96eb80 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa77c80a80 con 0x55aa77c8b260 2024-06-02T04:04:16.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.217+0000 7fe3af96eb80 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa77cf5dd0 con 0x55aa77c8a900 2024-06-02T04:04:16.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.217+0000 7fe3af96eb80 10 client.0 _ll_register_callbacks cb 0x55aa77b7bae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-06-02T04:04:16.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.217+0000 7fe3a1d50700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa77c8bc20 0x55aa77c80220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.217+0000 7fe3a1d50700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa77c8bc20 0x55aa77c80220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37978/0 (socket says 172.21.15.123:37978) 2024-06-02T04:04:16.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.217+0000 7fe3a1d50700 1 -- 172.21.15.123:0/948558030 learned_addr learned my addr 172.21.15.123:0/948558030 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:16.225 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.217+0000 7fe3a154f700 1 --2- 172.21.15.123:0/948558030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa77c8a900 0x55aa77c7fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.217+0000 7fe3a0d4e700 1 --2- 172.21.15.123:0/948558030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa77c8b260 0x55aa77c9b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.217+0000 7fe3a1d50700 1 -- 172.21.15.123:0/948558030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa77c8a900 msgr2=0x55aa77c7fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:16.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.217+0000 7fe3a1d50700 1 --2- 172.21.15.123:0/948558030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa77c8a900 0x55aa77c7fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.217+0000 7fe3a1d50700 1 -- 172.21.15.123:0/948558030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa77c8b260 msgr2=0x55aa77c9b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-06-02T04:04:16.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.217+0000 7fe3a1d50700 1 --2- 172.21.15.123:0/948558030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa77c8b260 0x55aa77c9b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.217+0000 7fe3a1d50700 1 -- 172.21.15.123:0/948558030 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aa77a57360 con 0x55aa77c8bc20 2024-06-02T04:04:16.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.217+0000 7fe3a1d50700 1 --2- 172.21.15.123:0/948558030 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa77c8bc20 0x55aa77c80220 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe394004070 tx=0x7fe394004380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0b626beaa7e6733 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:16.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.217+0000 7fe384ff9700 10 client.0 ms_handle_connect on v2:172.21.15.123:3300/0 2024-06-02T04:04:16.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.217+0000 7fe384ff9700 1 -- 172.21.15.123:0/948558030 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe394003bd0 con 0x55aa77c8bc20 2024-06-02T04:04:16.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.217+0000 7fe384ff9700 1 -- 172.21.15.123:0/948558030 <== mon.0 v2:172.21.15.123:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fe394007910 con 0x55aa77c8bc20 2024-06-02T04:04:16.226 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.217+0000 7fe3af96eb80 1 -- 172.21.15.123:0/948558030 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aa77c931a0 con 0x55aa77c8bc20 2024-06-02T04:04:16.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.217+0000 7fe384ff9700 1 -- 172.21.15.123:0/948558030 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe394007ad0 con 0x55aa77c8bc20 2024-06-02T04:04:16.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.217+0000 7fe3af96eb80 10 client.15312 fetch_fsmap learned FSMap version 27 2024-06-02T04:04:16.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.217+0000 7fe3af96eb80 1 -- 172.21.15.123:0/948558030 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55aa77a5bc80 con 0x55aa77c8bc20 2024-06-02T04:04:16.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.217+0000 7fe384ff9700 1 -- 172.21.15.123:0/948558030 <== mon.0 v2:172.21.15.123:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55aa77c931a0 con 0x55aa77c8bc20 2024-06-02T04:04:16.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.218+0000 7fe384ff9700 1 -- 172.21.15.123:0/948558030 <== mon.0 v2:172.21.15.123:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe394014050 con 0x55aa77c8bc20 2024-06-02T04:04:16.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.218+0000 7fe3af96eb80 10 client.15312 fetch_fsmap finished waiting for FSMap version 27 2024-06-02T04:04:16.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.218+0000 7fe3af96eb80 10 client.15312 resolve_mds: resolved name 'b' to daemon mds.b 2024-06-02T04:04:16.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.218+0000 7fe3af96eb80 20 client.15312 populate_metadata read hostname 'smithi123' 2024-06-02T04:04:16.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.218+0000 7fe3af96eb80 1 --2- 172.21.15.123:0/948558030 >> [v2:172.21.15.136:6838/952830191,v1:172.21.15.136:6839/952830191] conn(0x55aa77cfabd0 0x55aa77cf7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:16.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.218+0000 7fe3af96eb80 4 client.15312 mds_command: new command op to 24509 tid=0 multi_id=0 [{"prefix": "status"}] 2024-06-02T04:04:16.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.218+0000 7fe3af96eb80 1 -- 172.21.15.123:0/948558030 --> [v2:172.21.15.136:6838/952830191,v1:172.21.15.136:6839/952830191] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fe398015070 con 0x55aa77cfabd0 2024-06-02T04:04:16.227 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.218+0000 7fe3a154f700 1 --2- 172.21.15.123:0/948558030 >> [v2:172.21.15.136:6838/952830191,v1:172.21.15.136:6839/952830191] conn(0x55aa77cfabd0 0x55aa77cf7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:16.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.218+0000 7fe384ff9700 10 client.15312 ms_handle_connect on v2:172.21.15.136:6838/952830191 2024-06-02T04:04:16.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.218+0000 7fe3a154f700 1 --2- 172.21.15.123:0/948558030 >> [v2:172.21.15.136:6838/952830191,v1:172.21.15.136:6839/952830191] conn(0x55aa77cfabd0 0x55aa77cf7500 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ca0db5b96c0e235 server_cookie=9bc03999e30cdfd2 in_seq=0 out_seq=0 2024-06-02T04:04:16.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.219+0000 7fe384ff9700 1 -- 172.21.15.123:0/948558030 <== mds.0 v2:172.21.15.136:6838/952830191 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x7fe398015070 con 0x55aa77cfabd0 2024-06-02T04:04:16.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.219+0000 7fe384ff9700 10 client.15312 handle_command_reply: tid=0 2024-06-02T04:04:16.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.219+0000 7fe3af96eb80 1 client.15312 shutdown 2024-06-02T04:04:16.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.219+0000 7fe3af96eb80 1 -- 172.21.15.123:0/948558030 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa77c8bc20 msgr2=0x55aa77c80220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:16.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.219+0000 7fe3af96eb80 1 --2- 172.21.15.123:0/948558030 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa77c8bc20 0x55aa77c80220 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe394004070 tx=0x7fe394004380 comp rx=0 tx=0).stop 2024-06-02T04:04:16.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.219+0000 7fe3af96eb80 1 -- 172.21.15.123:0/948558030 shutdown_connections 2024-06-02T04:04:16.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.219+0000 7fe3af96eb80 1 --2- 172.21.15.123:0/948558030 >> [v2:172.21.15.136:6838/952830191,v1:172.21.15.136:6839/952830191] conn(0x55aa77cfabd0 0x55aa77cf7500 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.219+0000 7fe3af96eb80 1 --2- 172.21.15.123:0/948558030 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x55aa77c8bc20 0x55aa77c80220 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.219+0000 7fe3af96eb80 1 --2- 172.21.15.123:0/948558030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55aa77c8a900 0x55aa77c7fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.219+0000 7fe384ff9700 0 client.15312 ms_handle_reset on v2:172.21.15.136:6838/952830191 2024-06-02T04:04:16.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.219+0000 7fe3af96eb80 1 --2- 172.21.15.123:0/948558030 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55aa77c8b260 0x55aa77c9b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.219+0000 7fe3af96eb80 1 -- 172.21.15.123:0/948558030 >> 172.21.15.123:0/948558030 conn(0x55aa77be41c0 msgr2=0x55aa77c9bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:16.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.219+0000 7fe3af96eb80 1 -- 172.21.15.123:0/948558030 shutdown_connections 2024-06-02T04:04:16.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.219+0000 7fe3af96eb80 1 -- 172.21.15.123:0/948558030 wait complete. 2024-06-02T04:04:16.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.219+0000 7fe3af96eb80 20 client.15312 trim_cache size 0 max 16384 2024-06-02T04:04:16.229 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-06-02T04:04:16.229 INFO:teuthology.orchestra.run.smithi123.stdout: "cluster_fsid": "1b432ae0-2094-11ef-bc9b-c7b262605968", 2024-06-02T04:04:16.229 INFO:teuthology.orchestra.run.smithi123.stdout: "whoami": 0, 2024-06-02T04:04:16.229 INFO:teuthology.orchestra.run.smithi123.stdout: "id": 24509, 2024-06-02T04:04:16.230 INFO:teuthology.orchestra.run.smithi123.stdout: "want_state": "up:active", 2024-06-02T04:04:16.230 INFO:teuthology.orchestra.run.smithi123.stdout: "state": "up:active", 2024-06-02T04:04:16.230 INFO:teuthology.orchestra.run.smithi123.stdout: "fs_name": "cephfs", 2024-06-02T04:04:16.230 INFO:teuthology.orchestra.run.smithi123.stdout: "rank_uptime": 69.548602424999999, 2024-06-02T04:04:16.230 INFO:teuthology.orchestra.run.smithi123.stdout: "mdsmap_epoch": 27, 2024-06-02T04:04:16.230 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch": 84, 2024-06-02T04:04:16.230 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_epoch_barrier": 82, 2024-06-02T04:04:16.230 INFO:teuthology.orchestra.run.smithi123.stdout: "uptime": 74.028178385000004 2024-06-02T04:04:16.230 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-06-02T04:04:16.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.219+0000 7fe3a37b3700 1 -- 172.21.15.123:0/4212447181 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe3880a11b0 msgr2=0x7fe3880a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:16.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.219+0000 7fe3a37b3700 1 --2- 172.21.15.123:0/4212447181 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe3880a11b0 0x7fe3880a3670 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe398005950 tx=0x7fe39800b410 comp rx=0 tx=0).stop 2024-06-02T04:04:16.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.219+0000 7fe3a37b3700 1 -- 172.21.15.123:0/4212447181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe39c100fb0 msgr2=0x7fe39c19bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:16.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.219+0000 7fe3a37b3700 1 --2- 172.21.15.123:0/4212447181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe39c100fb0 0x7fe39c19bc00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00b5c0 tx=0x7fe38c004730 comp rx=0 tx=0).stop 2024-06-02T04:04:16.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.219+0000 7fe3a37b3700 1 -- 172.21.15.123:0/4212447181 shutdown_connections 2024-06-02T04:04:16.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.220+0000 7fe3a37b3700 1 --2- 172.21.15.123:0/4212447181 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fe3880a11b0 0x7fe3880a3670 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.220+0000 7fe3a37b3700 1 --2- 172.21.15.123:0/4212447181 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe39c101970 0x7fe39c19e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.220+0000 7fe3a37b3700 1 --2- 172.21.15.123:0/4212447181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe39c0ffe60 0x7fe39c06a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.220+0000 7fe3a37b3700 1 --2- 172.21.15.123:0/4212447181 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fe39c100fb0 0x7fe39c19bc00 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:16.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.220+0000 7fe3a37b3700 1 -- 172.21.15.123:0/4212447181 >> 172.21.15.123:0/4212447181 conn(0x7fe39c0fb3f0 msgr2=0x7fe39c1043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:16.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.220+0000 7fe3a37b3700 1 -- 172.21.15.123:0/4212447181 shutdown_connections 2024-06-02T04:04:16.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:16.220+0000 7fe3a37b3700 1 -- 172.21.15.123:0/4212447181 wait complete. 2024-06-02T04:04:16.233 INFO:teuthology.run_tasks:Running task sequential... 2024-06-02T04:04:16.242 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-06-02T04:04:16.242 INFO:teuthology.task.sequential:In sequential, running task print... 2024-06-02T04:04:16.243 INFO:teuthology.task.print:Enabling mgr modules 2024-06-02T04:04:16.243 INFO:teuthology.run_tasks:Running task kclient... 2024-06-02T04:04:16.270 INFO:tasks.kclient:Mounting kernel clients... 2024-06-02T04:04:16.270 INFO:tasks.kclient:config is {'client.0': {}} 2024-06-02T04:04:16.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:04:16.270 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-06-02T04:04:16.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:04:16.289 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link delete ceph-brx 2024-06-02T04:04:16.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:16 smithi162 ceph-mon[47009]: pgmap v258: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-06-02T04:04:16.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:16 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/4176396137' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:04:16.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:16 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/3935040377' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:04:16.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:16 smithi123 ceph-mon[42885]: pgmap v258: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-06-02T04:04:16.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:16 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/4176396137' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:04:16.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:16 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/3935040377' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:04:16.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:16 smithi136 ceph-mon[47443]: pgmap v258: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 10 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-06-02T04:04:16.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:16 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/4176396137' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:04:16.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:16 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/3935040377' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:04:16.352 INFO:teuthology.orchestra.run.smithi123.stderr:Cannot find device "ceph-brx" 2024-06-02T04:04:16.353 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T04:04:16.354 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync', 'context=system_u:object_r:postgresql_db_t:s0'], 'syntax': 'v1', 'mount_subvol_num': 1, 'mountpoint': '/tmp/cephfs'} 2024-06-02T04:04:16.354 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-06-02T04:04:16.354 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2024-06-02T04:04:16.354 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2024-06-02T04:04:16.354 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph fs ls 2024-06-02T04:04:16.615 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:04:17.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.637+0000 7f2de0f7e700 1 -- 172.21.15.123:0/4263537041 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ddc100890 msgr2=0x7f2ddc10cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:17.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.637+0000 7f2de0f7e700 1 --2- 172.21.15.123:0/4263537041 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ddc100890 0x7f2ddc10cd40 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400b0a0 tx=0x7f2dd400b3b0 comp rx=0 tx=0).stop 2024-06-02T04:04:17.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.637+0000 7f2de0f7e700 1 -- 172.21.15.123:0/4263537041 shutdown_connections 2024-06-02T04:04:17.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.637+0000 7f2de0f7e700 1 --2- 172.21.15.123:0/4263537041 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ddc100890 0x7f2ddc10cd40 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:17.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.637+0000 7f2de0f7e700 1 --2- 172.21.15.123:0/4263537041 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ddc105f00 0x7f2ddc1062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:17.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.637+0000 7f2de0f7e700 1 --2- 172.21.15.123:0/4263537041 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ddc0ffed0 0x7f2ddc100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:17.637 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.637+0000 7f2de0f7e700 1 -- 172.21.15.123:0/4263537041 >> 172.21.15.123:0/4263537041 conn(0x7f2ddc075f80 msgr2=0x7f2ddc076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:17.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.637+0000 7f2de0f7e700 1 -- 172.21.15.123:0/4263537041 shutdown_connections 2024-06-02T04:04:17.638 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.637+0000 7f2de0f7e700 1 -- 172.21.15.123:0/4263537041 wait complete. 2024-06-02T04:04:17.639 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.638+0000 7f2de0f7e700 1 Processor -- start 2024-06-02T04:04:17.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.638+0000 7f2de0f7e700 1 -- start start 2024-06-02T04:04:17.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.638+0000 7f2de0f7e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ddc0ffed0 0x7f2ddc1996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:17.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.638+0000 7f2de0f7e700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ddc100890 0x7f2ddc199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:17.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.638+0000 7f2de0f7e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ddc105f00 0x7f2ddc19dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:17.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.638+0000 7f2de0f7e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc19e5d0 con 0x7f2ddc105f00 2024-06-02T04:04:17.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.638+0000 7f2de0f7e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc19e740 con 0x7f2ddc0ffed0 2024-06-02T04:04:17.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.638+0000 7f2de0f7e700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc19e900 con 0x7f2ddc100890 2024-06-02T04:04:17.640 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.638+0000 7f2ddad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ddc105f00 0x7f2ddc19dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:17.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.638+0000 7f2ddad9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ddc105f00 0x7f2ddc19dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:37990/0 (socket says 172.21.15.123:37990) 2024-06-02T04:04:17.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.638+0000 7f2ddad9d700 1 -- 172.21.15.123:0/523137868 learned_addr learned my addr 172.21.15.123:0/523137868 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:17.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.638+0000 7f2ddad9d700 1 -- 172.21.15.123:0/523137868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ddc100890 msgr2=0x7f2ddc199c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:17.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.638+0000 7f2ddad9d700 1 --2- 172.21.15.123:0/523137868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ddc100890 0x7f2ddc199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:17.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.638+0000 7f2ddad9d700 1 -- 172.21.15.123:0/523137868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ddc0ffed0 msgr2=0x7f2ddc1996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:17.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.638+0000 7f2ddad9d700 1 --2- 172.21.15.123:0/523137868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ddc0ffed0 0x7f2ddc1996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:17.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.638+0000 7f2ddad9d700 1 -- 172.21.15.123:0/523137868 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd4009d00 con 0x7f2ddc105f00 2024-06-02T04:04:17.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.638+0000 7f2ddad9d700 1 --2- 172.21.15.123:0/523137868 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ddc105f00 0x7f2ddc19dfc0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400b070 tx=0x7f2dd4007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:17.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.638+0000 7f2dcb7fe700 1 -- 172.21.15.123:0/523137868 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd400e040 con 0x7f2ddc105f00 2024-06-02T04:04:17.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.638+0000 7f2dcb7fe700 1 -- 172.21.15.123:0/523137868 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2dd4009440 con 0x7f2ddc105f00 2024-06-02T04:04:17.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.639+0000 7f2de0f7e700 1 -- 172.21.15.123:0/523137868 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ddc19eb80 con 0x7f2ddc105f00 2024-06-02T04:04:17.641 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.639+0000 7f2dcb7fe700 1 -- 172.21.15.123:0/523137868 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd401b6b0 con 0x7f2ddc105f00 2024-06-02T04:04:17.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.639+0000 7f2de0f7e700 1 -- 172.21.15.123:0/523137868 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ddc1a6440 con 0x7f2ddc105f00 2024-06-02T04:04:17.642 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.639+0000 7f2de0f7e700 1 -- 172.21.15.123:0/523137868 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ddc1015b0 con 0x7f2ddc105f00 2024-06-02T04:04:17.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.641+0000 7f2dcb7fe700 1 -- 172.21.15.123:0/523137868 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f2dd401d480 con 0x7f2ddc105f00 2024-06-02T04:04:17.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.641+0000 7f2dcb7fe700 1 --2- 172.21.15.123:0/523137868 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2dc40a11b0 0x7f2dc40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:17.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.641+0000 7f2dda59c700 1 --2- 172.21.15.123:0/523137868 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2dc40a11b0 0x7f2dc40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:17.643 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.641+0000 7f2dcb7fe700 1 -- 172.21.15.123:0/523137868 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f2dd40ce560 con 0x7f2ddc105f00 2024-06-02T04:04:17.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.642+0000 7f2dda59c700 1 --2- 172.21.15.123:0/523137868 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2dc40a11b0 0x7f2dc40a3670 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc005fd0 tx=0x7f2dcc005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:17.644 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.645+0000 7f2dcb7fe700 1 -- 172.21.15.123:0/523137868 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2dd4097d40 con 0x7f2ddc105f00 2024-06-02T04:04:17.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.882+0000 7f2de0f7e700 1 -- 172.21.15.123:0/523137868 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2ddc19aa40 con 0x7f2ddc105f00 2024-06-02T04:04:17.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.882+0000 7f2dcb7fe700 1 -- 172.21.15.123:0/523137868 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2dd401de60 con 0x7f2ddc105f00 2024-06-02T04:04:17.883 INFO:teuthology.orchestra.run.smithi123.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-06-02T04:04:17.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.884+0000 7f2de0f7e700 1 -- 172.21.15.123:0/523137868 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2dc40a11b0 msgr2=0x7f2dc40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:17.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.884+0000 7f2de0f7e700 1 --2- 172.21.15.123:0/523137868 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2dc40a11b0 0x7f2dc40a3670 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc005fd0 tx=0x7f2dcc005ee0 comp rx=0 tx=0).stop 2024-06-02T04:04:17.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.884+0000 7f2de0f7e700 1 -- 172.21.15.123:0/523137868 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ddc105f00 msgr2=0x7f2ddc19dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:17.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.884+0000 7f2de0f7e700 1 --2- 172.21.15.123:0/523137868 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ddc105f00 0x7f2ddc19dfc0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400b070 tx=0x7f2dd4007920 comp rx=0 tx=0).stop 2024-06-02T04:04:17.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.884+0000 7f2de0f7e700 1 -- 172.21.15.123:0/523137868 shutdown_connections 2024-06-02T04:04:17.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.884+0000 7f2de0f7e700 1 --2- 172.21.15.123:0/523137868 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f2ddc105f00 0x7f2ddc19dfc0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:17.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.884+0000 7f2de0f7e700 1 --2- 172.21.15.123:0/523137868 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f2dc40a11b0 0x7f2dc40a3670 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:17.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.884+0000 7f2de0f7e700 1 --2- 172.21.15.123:0/523137868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2ddc0ffed0 0x7f2ddc1996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:17.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.884+0000 7f2de0f7e700 1 --2- 172.21.15.123:0/523137868 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ddc100890 0x7f2ddc199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:17.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.884+0000 7f2de0f7e700 1 -- 172.21.15.123:0/523137868 >> 172.21.15.123:0/523137868 conn(0x7f2ddc075f80 msgr2=0x7f2ddc068950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:17.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.885+0000 7f2de0f7e700 1 -- 172.21.15.123:0/523137868 shutdown_connections 2024-06-02T04:04:17.885 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:17.885+0000 7f2de0f7e700 1 -- 172.21.15.123:0/523137868 wait complete. 2024-06-02T04:04:18.223 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:18 smithi123 ceph-mon[42885]: pgmap v259: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-06-02T04:04:18.223 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:18 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/523137868' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-02T04:04:18.258 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-06-02T04:04:18.258 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-06-02T04:04:18.258 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi123.front.sepia.ceph.com 2024-06-02T04:04:18.259 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-06-02T04:04:18.259 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2024-06-02T04:04:18.259 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-06-02T04:04:18.259 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-06-02T04:04:18.259 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-06-02T04:04:18.259 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2024-06-02T04:04:18.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:04:18.259 DEBUG:teuthology.orchestra.run.smithi123:> ip addr 2024-06-02T04:04:18.278 INFO:teuthology.orchestra.run.smithi123.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-06-02T04:04:18.279 INFO:teuthology.orchestra.run.smithi123.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-06-02T04:04:18.279 INFO:teuthology.orchestra.run.smithi123.stdout: inet 127.0.0.1/8 scope host lo 2024-06-02T04:04:18.279 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-06-02T04:04:18.279 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 ::1/128 scope host 2024-06-02T04:04:18.279 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-06-02T04:04:18.279 INFO:teuthology.orchestra.run.smithi123.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T04:04:18.279 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6c brd ff:ff:ff:ff:ff:ff 2024-06-02T04:04:18.279 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f0 2024-06-02T04:04:18.279 INFO:teuthology.orchestra.run.smithi123.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T04:04:18.279 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:d8:da:6d brd ff:ff:ff:ff:ff:ff 2024-06-02T04:04:18.279 INFO:teuthology.orchestra.run.smithi123.stdout: altname enp7s0f1 2024-06-02T04:04:18.280 INFO:teuthology.orchestra.run.smithi123.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-06-02T04:04:18.280 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f0 brd ff:ff:ff:ff:ff:ff 2024-06-02T04:04:18.280 INFO:teuthology.orchestra.run.smithi123.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-06-02T04:04:18.280 INFO:teuthology.orchestra.run.smithi123.stdout: link/ether 0c:c4:7a:8f:d3:f1 brd ff:ff:ff:ff:ff:ff 2024-06-02T04:04:18.280 INFO:teuthology.orchestra.run.smithi123.stdout: inet 172.21.15.123/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-06-02T04:04:18.280 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft 41838sec preferred_lft 41838sec 2024-06-02T04:04:18.280 INFO:teuthology.orchestra.run.smithi123.stdout: inet6 fe80::e0af:e078:ac35:4506/64 scope link noprefixroute 2024-06-02T04:04:18.280 INFO:teuthology.orchestra.run.smithi123.stdout: valid_lft forever preferred_lft forever 2024-06-02T04:04:18.280 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-06-02T04:04:18.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:04:18.281 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-06-02T04:04:18.281 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-06-02T04:04:18.281 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add name ceph-brx type bridge 2024-06-02T04:04:18.281 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip addr flush dev ceph-brx 2024-06-02T04:04:18.281 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set ceph-brx up 2024-06-02T04:04:18.281 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-06-02T04:04:18.281 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-06-02T04:04:18.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:18 smithi162 ceph-mon[47009]: pgmap v259: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-06-02T04:04:18.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:18 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/523137868' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-02T04:04:18.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:18 smithi136 ceph-mon[47443]: pgmap v259: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-06-02T04:04:18.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:18 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/523137868' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-06-02T04:04:18.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:04:18.456 DEBUG:teuthology.orchestra.run.smithi123:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-06-02T04:04:18.484 INFO:teuthology.orchestra.run.smithi123.stdout:1 2024-06-02T04:04:18.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:04:18.485 DEBUG:teuthology.orchestra.run.smithi123:> route 2024-06-02T04:04:18.559 INFO:teuthology.orchestra.run.smithi123.stdout:Kernel IP routing table 2024-06-02T04:04:18.560 INFO:teuthology.orchestra.run.smithi123.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-06-02T04:04:18.560 INFO:teuthology.orchestra.run.smithi123.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-06-02T04:04:18.560 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-06-02T04:04:18.560 INFO:teuthology.orchestra.run.smithi123.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-06-02T04:04:18.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:04:18.561 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-06-02T04:04:18.561 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-06-02T04:04:18.561 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-06-02T04:04:18.561 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-06-02T04:04:18.561 DEBUG:teuthology.orchestra.run.smithi123:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-06-02T04:04:18.561 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-06-02T04:04:18.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:04:18.818 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-06-02T04:04:18.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:04:18.836 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list-id 2024-06-02T04:04:18.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:04:18.893 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-06-02T04:04:18.893 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-06-02T04:04:18.893 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns add ceph-ns--tmp-cephfs 2024-06-02T04:04:18.893 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns set ceph-ns--tmp-cephfs 0 2024-06-02T04:04:18.893 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-06-02T04:04:18.990 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2024-06-02T04:04:18.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:04:18.991 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-06-02T04:04:18.991 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-06-02T04:04:18.991 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2024-06-02T04:04:18.991 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-06-02T04:04:18.991 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2024-06-02T04:04:18.991 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2024-06-02T04:04:18.991 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2024-06-02T04:04:18.991 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-06-02T04:04:19.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:04:19.198 DEBUG:teuthology.orchestra.run.smithi123:> (cd / && exec bash -c ' 2024-06-02T04:04:19.198 DEBUG:teuthology.orchestra.run.smithi123:> set -e 2024-06-02T04:04:19.198 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set brx.0 up 2024-06-02T04:04:19.198 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link set dev brx.0 master ceph-brx 2024-06-02T04:04:19.198 DEBUG:teuthology.orchestra.run.smithi123:> ') 2024-06-02T04:04:19.296 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T04:04:19.296 DEBUG:teuthology.orchestra.run.smithi123:> mkdir -p -v /tmp/cephfs 2024-06-02T04:04:19.313 INFO:teuthology.orchestra.run.smithi123.stdout:mkdir: created directory '/tmp/cephfs' 2024-06-02T04:04:19.313 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-06-02T04:04:19.313 DEBUG:teuthology.orchestra.run.smithi123:> chmod 0000 /tmp/cephfs 2024-06-02T04:04:19.369 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-06-02T04:04:19.369 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-06-02T04:04:19.369 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/52776420-9bb3-4c52-8627-060b8738590d 2024-06-02T04:04:19.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:04:19.370 DEBUG:teuthology.orchestra.run.smithi123:> sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/52776420-9bb3-4c52-8627-060b8738590d /tmp/cephfs -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,context=system_u:object_r:postgresql_db_t:s0 2024-06-02T04:04:19.455 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,context="system_u:object_r:postgresql_db_t:s0" 2024-06-02T04:04:19.455 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-06-02T04:04:19.455 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-06-02T04:04:19.549 INFO:teuthology.orchestra.run.smithi123.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,context="system_u:object_r:postgresql_db_t:s0" 2024-06-02T04:04:19.550 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-06-02T04:04:19.550 INFO:teuthology.orchestra.run.smithi123.stdout:invalid new device string format 2024-06-02T04:04:19.550 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: resolved to: "172.21.15.123:3300,172.21.15.136:3300,172.21.15.162:3300" 2024-06-02T04:04:19.550 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.123:3300,172.21.15.136:3300,172.21.15.162:3300:/volumes/qa/sv_1/52776420-9bb3-4c52-8627-060b8738590d 2024-06-02T04:04:19.550 INFO:teuthology.orchestra.run.smithi123.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,context="system_u:object_r:postgresql_db_t:s0",key=0,fsid=1b432ae0-2094-11ef-bc9b-c7b262605968" will pass to kernel 2024-06-02T04:04:19.552 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-06-02T04:04:19.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:04:19.553 DEBUG:teuthology.orchestra.run.smithi123:> sudo chmod 1777 /tmp/cephfs 2024-06-02T04:04:19.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:04:19.586 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/cephfs && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-02T04:04:19.678 INFO:teuthology.orchestra.run.smithi123.stdout:client15321 2024-06-02T04:04:19.679 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-06-02T04:04:19.679 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T04:04:19.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:04:19.696 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/cephfs && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-02T04:04:19.787 INFO:teuthology.orchestra.run.smithi123.stdout:client15321 2024-06-02T04:04:19.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:04:19.787 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/cephfs && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-06-02T04:04:19.836 INFO:teuthology.orchestra.run.smithi123.stdout:client15321 2024-06-02T04:04:19.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:04:19.837 DEBUG:teuthology.orchestra.run.smithi123:> (cd /tmp/cephfs && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968.client15321/status') 2024-06-02T04:04:19.894 INFO:teuthology.orchestra.run.smithi123.stdout:instance: client.15321 (3)192.168.0.1:0/1875684587 2024-06-02T04:04:19.894 INFO:teuthology.orchestra.run.smithi123.stdout:blocklisted: false 2024-06-02T04:04:19.894 INFO:teuthology.orchestra.run.smithi123.stderr:0+1 records in 2024-06-02T04:04:19.894 INFO:teuthology.orchestra.run.smithi123.stderr:0+1 records out 2024-06-02T04:04:19.894 INFO:teuthology.orchestra.run.smithi123.stderr:70 bytes copied, 2.134e-05 s, 3.3 MB/s 2024-06-02T04:04:19.896 INFO:teuthology.run_tasks:Running task exec... 2024-06-02T04:04:19.905 INFO:teuthology.task.exec:Executing custom commands... 2024-06-02T04:04:19.905 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi123.front.sepia.ceph.com 2024-06-02T04:04:19.905 DEBUG:teuthology.orchestra.run.smithi123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-06-02T04:04:20.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.028+0000 7f5d460c2700 1 -- 172.21.15.123:0/1778122568 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d40101990 msgr2=0x7f5d40108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:20.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.028+0000 7f5d460c2700 1 --2- 172.21.15.123:0/1778122568 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d40101990 0x7f5d40108240 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5d3800b0d0 tx=0x7f5d3800b3e0 comp rx=0 tx=0).stop 2024-06-02T04:04:20.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.028+0000 7f5d460c2700 1 -- 172.21.15.123:0/1778122568 shutdown_connections 2024-06-02T04:04:20.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.028+0000 7f5d460c2700 1 --2- 172.21.15.123:0/1778122568 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d40101990 0x7f5d40108240 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:20.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.028+0000 7f5d460c2700 1 --2- 172.21.15.123:0/1778122568 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d400ffe00 0x7f5d40100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:20.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.028+0000 7f5d460c2700 1 --2- 172.21.15.123:0/1778122568 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d40100ff0 0x7f5d40101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:20.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.028+0000 7f5d460c2700 1 -- 172.21.15.123:0/1778122568 >> 172.21.15.123:0/1778122568 conn(0x7f5d400fb390 msgr2=0x7f5d400fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:20.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.028+0000 7f5d460c2700 1 -- 172.21.15.123:0/1778122568 shutdown_connections 2024-06-02T04:04:20.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.028+0000 7f5d460c2700 1 -- 172.21.15.123:0/1778122568 wait complete. 2024-06-02T04:04:20.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.029+0000 7f5d460c2700 1 Processor -- start 2024-06-02T04:04:20.031 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.029+0000 7f5d460c2700 1 -- start start 2024-06-02T04:04:20.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.029+0000 7f5d460c2700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d400ffe00 0x7f5d40195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:20.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.029+0000 7f5d460c2700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d40100ff0 0x7f5d401963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:20.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.029+0000 7f5d460c2700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d40101990 0x7f5d4019d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:20.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.030+0000 7f5d460c2700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4019d9d0 con 0x7f5d40100ff0 2024-06-02T04:04:20.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.030+0000 7f5d460c2700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4019db10 con 0x7f5d40101990 2024-06-02T04:04:20.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.030+0000 7f5d460c2700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4019dca0 con 0x7f5d400ffe00 2024-06-02T04:04:20.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.030+0000 7f5d3effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d40100ff0 0x7f5d401963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:20.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.030+0000 7f5d3effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d40100ff0 0x7f5d401963e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38002/0 (socket says 172.21.15.123:38002) 2024-06-02T04:04:20.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.030+0000 7f5d3effd700 1 -- 172.21.15.123:0/2352465214 learned_addr learned my addr 172.21.15.123:0/2352465214 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:20.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.030+0000 7f5d3ffff700 1 --2- 172.21.15.123:0/2352465214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d40101990 0x7f5d4019d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:20.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.030+0000 7f5d3f7fe700 1 --2- 172.21.15.123:0/2352465214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d400ffe00 0x7f5d40195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:20.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.030+0000 7f5d3effd700 1 -- 172.21.15.123:0/2352465214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d400ffe00 msgr2=0x7f5d40195ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:20.032 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.030+0000 7f5d3effd700 1 --2- 172.21.15.123:0/2352465214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d400ffe00 0x7f5d40195ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:20.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.030+0000 7f5d3effd700 1 -- 172.21.15.123:0/2352465214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d40101990 msgr2=0x7f5d4019d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:20.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.030+0000 7f5d3effd700 1 --2- 172.21.15.123:0/2352465214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d40101990 0x7f5d4019d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:20.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.030+0000 7f5d3effd700 1 -- 172.21.15.123:0/2352465214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d38009d00 con 0x7f5d40100ff0 2024-06-02T04:04:20.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.030+0000 7f5d3effd700 1 --2- 172.21.15.123:0/2352465214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d40100ff0 0x7f5d401963e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5d3400d950 tx=0x7f5d3400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:20.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.030+0000 7f5d3cff9700 1 -- 172.21.15.123:0/2352465214 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d34009940 con 0x7f5d40100ff0 2024-06-02T04:04:20.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.030+0000 7f5d3cff9700 1 -- 172.21.15.123:0/2352465214 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d34010460 con 0x7f5d40100ff0 2024-06-02T04:04:20.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.030+0000 7f5d3cff9700 1 -- 172.21.15.123:0/2352465214 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3400f620 con 0x7f5d40100ff0 2024-06-02T04:04:20.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.030+0000 7f5d460c2700 1 -- 172.21.15.123:0/2352465214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d4019df80 con 0x7f5d40100ff0 2024-06-02T04:04:20.033 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.030+0000 7f5d460c2700 1 -- 172.21.15.123:0/2352465214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d4019e3b0 con 0x7f5d40100ff0 2024-06-02T04:04:20.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.031+0000 7f5d460c2700 1 -- 172.21.15.123:0/2352465214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d401071b0 con 0x7f5d40100ff0 2024-06-02T04:04:20.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.032+0000 7f5d3cff9700 1 -- 172.21.15.123:0/2352465214 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7f5d340108d0 con 0x7f5d40100ff0 2024-06-02T04:04:20.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.033+0000 7f5d3cff9700 1 --2- 172.21.15.123:0/2352465214 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f5d280a11b0 0x7f5d280a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:20.034 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.033+0000 7f5d3f7fe700 1 --2- 172.21.15.123:0/2352465214 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f5d280a11b0 0x7f5d280a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:20.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.033+0000 7f5d3cff9700 1 -- 172.21.15.123:0/2352465214 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f5d340cc7c0 con 0x7f5d40100ff0 2024-06-02T04:04:20.035 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.033+0000 7f5d3f7fe700 1 --2- 172.21.15.123:0/2352465214 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f5d280a11b0 0x7f5d280a3670 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5d30005950 tx=0x7f5d300058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:20.036 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.036+0000 7f5d3cff9700 1 -- 172.21.15.123:0/2352465214 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5d34095f10 con 0x7f5d40100ff0 2024-06-02T04:04:20.280 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:20.280+0000 7f5d460c2700 1 -- 172.21.15.123:0/2352465214 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) v1 -- 0x7f5d40067e30 con 0x7f5d40100ff0 2024-06-02T04:04:20.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:20 smithi162 ceph-mon[47009]: pgmap v260: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-06-02T04:04:20.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:20 smithi123 ceph-mon[42885]: pgmap v260: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-06-02T04:04:20.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:20 smithi136 ceph-mon[47443]: pgmap v260: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-06-02T04:04:21.022 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.022+0000 7f5d3cff9700 1 -- 172.21.15.123:0/2352465214 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v28) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5d340160b0 con 0x7f5d40100ff0 2024-06-02T04:04:21.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.024+0000 7f5d460c2700 1 -- 172.21.15.123:0/2352465214 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f5d280a11b0 msgr2=0x7f5d280a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:21.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.024+0000 7f5d460c2700 1 --2- 172.21.15.123:0/2352465214 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f5d280a11b0 0x7f5d280a3670 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5d30005950 tx=0x7f5d300058e0 comp rx=0 tx=0).stop 2024-06-02T04:04:21.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.025+0000 7f5d460c2700 1 -- 172.21.15.123:0/2352465214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d40100ff0 msgr2=0x7f5d401963e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:21.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.025+0000 7f5d460c2700 1 --2- 172.21.15.123:0/2352465214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d40100ff0 0x7f5d401963e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5d3400d950 tx=0x7f5d3400dc60 comp rx=0 tx=0).stop 2024-06-02T04:04:21.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.025+0000 7f5d460c2700 1 -- 172.21.15.123:0/2352465214 shutdown_connections 2024-06-02T04:04:21.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.025+0000 7f5d460c2700 1 --2- 172.21.15.123:0/2352465214 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f5d280a11b0 0x7f5d280a3670 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:21.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.025+0000 7f5d460c2700 1 --2- 172.21.15.123:0/2352465214 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5d40101990 0x7f5d4019d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:21.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.025+0000 7f5d460c2700 1 --2- 172.21.15.123:0/2352465214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d400ffe00 0x7f5d40195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:21.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.025+0000 7f5d460c2700 1 --2- 172.21.15.123:0/2352465214 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f5d40100ff0 0x7f5d401963e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:21.025 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.025+0000 7f5d460c2700 1 -- 172.21.15.123:0/2352465214 >> 172.21.15.123:0/2352465214 conn(0x7f5d400fb390 msgr2=0x7f5d401042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:21.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.025+0000 7f5d460c2700 1 -- 172.21.15.123:0/2352465214 shutdown_connections 2024-06-02T04:04:21.026 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.025+0000 7f5d460c2700 1 -- 172.21.15.123:0/2352465214 wait complete. 2024-06-02T04:04:21.038 DEBUG:teuthology.orchestra.run.smithi123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-06-02T04:04:21.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.164+0000 7fea5541e700 1 -- 172.21.15.123:0/3674175569 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea501042f0 msgr2=0x7fea501066e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:21.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.164+0000 7fea5541e700 1 --2- 172.21.15.123:0/3674175569 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea501042f0 0x7fea501066e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fea40009990 tx=0x7fea40009ca0 comp rx=0 tx=0).stop 2024-06-02T04:04:21.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.164+0000 7fea5541e700 1 -- 172.21.15.123:0/3674175569 shutdown_connections 2024-06-02T04:04:21.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.164+0000 7fea5541e700 1 --2- 172.21.15.123:0/3674175569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea50106c20 0x7fea50109090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:21.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.164+0000 7fea5541e700 1 --2- 172.21.15.123:0/3674175569 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fea501019c0 0x7fea50103db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:21.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.164+0000 7fea5541e700 1 --2- 172.21.15.123:0/3674175569 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea501042f0 0x7fea501066e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:21.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.164+0000 7fea5541e700 1 -- 172.21.15.123:0/3674175569 >> 172.21.15.123:0/3674175569 conn(0x7fea500fb3b0 msgr2=0x7fea500fd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:21.166 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.164+0000 7fea5541e700 1 -- 172.21.15.123:0/3674175569 shutdown_connections 2024-06-02T04:04:21.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.164+0000 7fea5541e700 1 -- 172.21.15.123:0/3674175569 wait complete. 2024-06-02T04:04:21.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.164+0000 7fea5541e700 1 Processor -- start 2024-06-02T04:04:21.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.165+0000 7fea5541e700 1 -- start start 2024-06-02T04:04:21.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.165+0000 7fea5541e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea501019c0 0x7fea50101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:21.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.165+0000 7fea5541e700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea501042f0 0x7fea500ff970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:21.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.165+0000 7fea5541e700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fea50106c20 0x7fea500ffeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:21.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.165+0000 7fea5541e700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea501005b0 con 0x7fea501019c0 2024-06-02T04:04:21.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.165+0000 7fea5541e700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea50100720 con 0x7fea50106c20 2024-06-02T04:04:21.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.165+0000 7fea5541e700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea501a0f30 con 0x7fea501042f0 2024-06-02T04:04:21.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.165+0000 7fea4effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea501019c0 0x7fea50101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:21.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.165+0000 7fea4effd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea501019c0 0x7fea50101290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38016/0 (socket says 172.21.15.123:38016) 2024-06-02T04:04:21.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.165+0000 7fea4effd700 1 -- 172.21.15.123:0/1177037227 learned_addr learned my addr 172.21.15.123:0/1177037227 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:04:21.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.165+0000 7fea4f7fe700 1 --2- 172.21.15.123:0/1177037227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fea50106c20 0x7fea500ffeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:21.167 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.165+0000 7fea4e7fc700 1 --2- 172.21.15.123:0/1177037227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea501042f0 0x7fea500ff970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:21.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.165+0000 7fea4effd700 1 -- 172.21.15.123:0/1177037227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea501042f0 msgr2=0x7fea500ff970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:21.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.165+0000 7fea4effd700 1 --2- 172.21.15.123:0/1177037227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea501042f0 0x7fea500ff970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:21.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.165+0000 7fea4effd700 1 -- 172.21.15.123:0/1177037227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fea50106c20 msgr2=0x7fea500ffeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:21.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.165+0000 7fea4effd700 1 --2- 172.21.15.123:0/1177037227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fea50106c20 0x7fea500ffeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:21.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.165+0000 7fea4effd700 1 -- 172.21.15.123:0/1177037227 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea400095f0 con 0x7fea501019c0 2024-06-02T04:04:21.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.165+0000 7fea4e7fc700 1 --2- 172.21.15.123:0/1177037227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea501042f0 0x7fea500ff970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:04:21.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.165+0000 7fea4effd700 1 --2- 172.21.15.123:0/1177037227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea501019c0 0x7fea50101290 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fea4400b530 tx=0x7fea4400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:21.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.165+0000 7fea37fff700 1 -- 172.21.15.123:0/1177037227 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea44011830 con 0x7fea501019c0 2024-06-02T04:04:21.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.166+0000 7fea37fff700 1 -- 172.21.15.123:0/1177037227 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fea44011e50 con 0x7fea501019c0 2024-06-02T04:04:21.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.166+0000 7fea37fff700 1 -- 172.21.15.123:0/1177037227 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4400f2e0 con 0x7fea501019c0 2024-06-02T04:04:21.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.166+0000 7fea5541e700 1 -- 172.21.15.123:0/1177037227 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea501a1190 con 0x7fea501019c0 2024-06-02T04:04:21.168 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.166+0000 7fea5541e700 1 -- 172.21.15.123:0/1177037227 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea501a1650 con 0x7fea501019c0 2024-06-02T04:04:21.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.166+0000 7fea5541e700 1 -- 172.21.15.123:0/1177037227 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea500fcf30 con 0x7fea501019c0 2024-06-02T04:04:21.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.168+0000 7fea37fff700 1 -- 172.21.15.123:0/1177037227 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 17) v1 ==== 135925+0+0 (secure 0 0 0) 0x7fea44010580 con 0x7fea501019c0 2024-06-02T04:04:21.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.169+0000 7fea37fff700 1 --2- 172.21.15.123:0/1177037227 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fea380a11b0 0x7fea380a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:04:21.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.169+0000 7fea4e7fc700 1 --2- 172.21.15.123:0/1177037227 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fea380a11b0 0x7fea380a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:04:21.169 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.169+0000 7fea37fff700 1 -- 172.21.15.123:0/1177037227 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fea440cc8e0 con 0x7fea501019c0 2024-06-02T04:04:21.170 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.169+0000 7fea4e7fc700 1 --2- 172.21.15.123:0/1177037227 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fea380a11b0 0x7fea380a3670 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fea4000b5c0 tx=0x7fea40005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:04:21.172 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.173+0000 7fea37fff700 1 -- 172.21.15.123:0/1177037227 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fea44096140 con 0x7fea501019c0 2024-06-02T04:04:21.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:21 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/2352465214' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-06-02T04:04:21.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:21 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2352465214' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-06-02T04:04:21.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:21 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/2352465214' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-06-02T04:04:21.404 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.404+0000 7fea5541e700 1 -- 172.21.15.123:0/1177037227 --> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) v1 -- 0x7fea5002ce10 con 0x7fea380a11b0 2024-06-02T04:04:21.409 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.409+0000 7fea37fff700 1 -- 172.21.15.123:0/1177037227 <== mgr.14152 v2:172.21.15.123:6800/526143134 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3 (secure 0 0 0) 0x7fea5002ce10 con 0x7fea380a11b0 2024-06-02T04:04:21.409 INFO:teuthology.orchestra.run.smithi123.stdout:{} 2024-06-02T04:04:21.411 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.411+0000 7fea5541e700 1 -- 172.21.15.123:0/1177037227 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fea380a11b0 msgr2=0x7fea380a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:21.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.411+0000 7fea5541e700 1 --2- 172.21.15.123:0/1177037227 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fea380a11b0 0x7fea380a3670 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fea4000b5c0 tx=0x7fea40005fb0 comp rx=0 tx=0).stop 2024-06-02T04:04:21.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.411+0000 7fea5541e700 1 -- 172.21.15.123:0/1177037227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea501019c0 msgr2=0x7fea50101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:04:21.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.411+0000 7fea5541e700 1 --2- 172.21.15.123:0/1177037227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea501019c0 0x7fea50101290 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fea4400b530 tx=0x7fea4400b8f0 comp rx=0 tx=0).stop 2024-06-02T04:04:21.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.411+0000 7fea5541e700 1 -- 172.21.15.123:0/1177037227 shutdown_connections 2024-06-02T04:04:21.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.411+0000 7fea5541e700 1 --2- 172.21.15.123:0/1177037227 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fea380a11b0 0x7fea380a3670 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:21.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.411+0000 7fea5541e700 1 --2- 172.21.15.123:0/1177037227 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fea50106c20 0x7fea500ffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:21.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.411+0000 7fea5541e700 1 --2- 172.21.15.123:0/1177037227 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fea501019c0 0x7fea50101290 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:21.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.411+0000 7fea5541e700 1 --2- 172.21.15.123:0/1177037227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fea501042f0 0x7fea500ff970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:04:21.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.411+0000 7fea5541e700 1 -- 172.21.15.123:0/1177037227 >> 172.21.15.123:0/1177037227 conn(0x7fea500fb3b0 msgr2=0x7fea50102260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:04:21.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.412+0000 7fea5541e700 1 -- 172.21.15.123:0/1177037227 shutdown_connections 2024-06-02T04:04:21.412 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:04:21.412+0000 7fea5541e700 1 -- 172.21.15.123:0/1177037227 wait complete. 2024-06-02T04:04:21.423 INFO:teuthology.run_tasks:Running task check-counter... 2024-06-02T04:04:21.434 INFO:teuthology.run_tasks:Running task exec... 2024-06-02T04:04:21.443 INFO:teuthology.task.exec:Executing custom commands... 2024-06-02T04:04:21.443 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi123.front.sepia.ceph.com 2024-06-02T04:04:21.443 DEBUG:teuthology.orchestra.run.smithi123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2024-06-02T04:04:21.481 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:04:21.496 INFO:teuthology.orchestra.run.smithi123.stdout:Filesystem Size Used Avail Use% Mounted on 2024-06-02T04:04:21.496 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:3300,172.21.15.136:3300,172.21.15.162:3300:/volumes/qa/sv_1/52776420-9bb3-4c52-8627-060b8738590d 340G 0 340G 0% /tmp/cephfs 2024-06-02T04:04:21.498 DEBUG:teuthology.orchestra.run.smithi123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2024-06-02T04:04:21.593 DEBUG:teuthology.orchestra.run.smithi123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2024-06-02T04:04:21.635 DEBUG:teuthology.orchestra.run.smithi123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2024-06-02T04:04:22.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:22 smithi162 ceph-mon[47009]: pgmap v261: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-06-02T04:04:22.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:22 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/2352465214' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-06-02T04:04:22.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:22 smithi162 ceph-mon[47009]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-02T04:04:22.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:22 smithi123 ceph-mon[42885]: pgmap v261: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-06-02T04:04:22.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:22 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2352465214' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-06-02T04:04:22.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:22 smithi123 ceph-mon[42885]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-02T04:04:22.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:22 smithi136 ceph-mon[47443]: pgmap v261: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-06-02T04:04:22.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:22 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/2352465214' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-06-02T04:04:22.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:22 smithi136 ceph-mon[47443]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-06-02T04:04:23.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:23 smithi162 ceph-mon[47009]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:04:23.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:23 smithi123 ceph-mon[42885]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:04:23.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:23 smithi136 ceph-mon[47443]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-06-02T04:04:24.215 DEBUG:teuthology.orchestra.run.smithi123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2024-06-02T04:04:24.256 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2024-06-02T04:04:24.258 DEBUG:teuthology.orchestra.run.smithi123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2024-06-02T04:04:24.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:24 smithi162 ceph-mon[47009]: pgmap v262: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-06-02T04:04:24.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:24 smithi123 ceph-mon[42885]: pgmap v262: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-06-02T04:04:24.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:24 smithi136 ceph-mon[47443]: pgmap v262: 97 pgs: 97 active+clean; 641 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-06-02T04:04:24.339 DEBUG:teuthology.orchestra.run.smithi123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-06-02T04:04:24.417 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/: 2024-06-02T04:04:24.417 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:04:24.417 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 04:04 . 2024-06-02T04:04:24.417 INFO:teuthology.orchestra.run.smithi123.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Jun 2 04:04 .. 2024-06-02T04:04:24.417 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 data 2024-06-02T04:04:24.418 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:24.418 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data: 2024-06-02T04:04:24.418 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:04:24.418 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 . 2024-06-02T04:04:24.418 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 04:04 .. 2024-06-02T04:04:24.419 DEBUG:teuthology.orchestra.run.smithi123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2024-06-02T04:04:24.506 INFO:teuthology.orchestra.run.smithi123.stdout:[Service] 2024-06-02T04:04:24.507 INFO:teuthology.orchestra.run.smithi123.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2024-06-02T04:04:24.507 INFO:teuthology.orchestra.run.smithi123.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2024-06-02T04:04:24.508 DEBUG:teuthology.orchestra.run.smithi123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2024-06-02T04:04:24.586 INFO:teuthology.orchestra.run.smithi123.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2024-06-02T04:04:26.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:26 smithi162 ceph-mon[47009]: pgmap v263: 97 pgs: 97 active+clean; 657 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-06-02T04:04:26.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:26 smithi123 ceph-mon[42885]: pgmap v263: 97 pgs: 97 active+clean; 657 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-06-02T04:04:26.337 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:26 smithi136 ceph-mon[47443]: pgmap v263: 97 pgs: 97 active+clean; 657 KiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-06-02T04:04:27.865 INFO:teuthology.orchestra.run.smithi123.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2024-06-02T04:04:27.868 DEBUG:teuthology.orchestra.run.smithi123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-06-02T04:04:27.912 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/: 2024-06-02T04:04:27.912 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:04:27.912 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 04:04 . 2024-06-02T04:04:27.912 INFO:teuthology.orchestra.run.smithi123.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Jun 2 04:04 .. 2024-06-02T04:04:27.912 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 04:04 data 2024-06-02T04:04:27.912 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:27.912 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data: 2024-06-02T04:04:27.912 INFO:teuthology.orchestra.run.smithi123.stdout:total 30 2024-06-02T04:04:27.912 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 04:04 . 2024-06-02T04:04:27.912 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 04:04 .. 2024-06-02T04:04:27.913 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 04:04 base 2024-06-02T04:04:27.913 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Jun 2 04:04 global 2024-06-02T04:04:27.913 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 log 2024-06-02T04:04:27.913 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 pg_commit_ts 2024-06-02T04:04:27.913 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 pg_dynshmem 2024-06-02T04:04:27.913 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4269 Jun 2 04:04 pg_hba.conf 2024-06-02T04:04:27.913 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Jun 2 04:04 pg_ident.conf 2024-06-02T04:04:27.913 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 04:04 pg_logical 2024-06-02T04:04:27.913 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Jun 2 04:04 pg_multixact 2024-06-02T04:04:27.913 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 04:04 pg_notify 2024-06-02T04:04:27.913 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 pg_replslot 2024-06-02T04:04:27.913 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 pg_serial 2024-06-02T04:04:27.913 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 pg_snapshots 2024-06-02T04:04:27.914 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 pg_stat 2024-06-02T04:04:27.914 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 pg_stat_tmp 2024-06-02T04:04:27.914 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 04:04 pg_subtrans 2024-06-02T04:04:27.914 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 pg_tblspc 2024-06-02T04:04:27.914 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 pg_twophase 2024-06-02T04:04:27.914 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 04:04 PG_VERSION 2024-06-02T04:04:27.914 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Jun 2 04:04 pg_wal 2024-06-02T04:04:27.914 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 04:04 pg_xact 2024-06-02T04:04:27.914 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Jun 2 04:04 postgresql.auto.conf 2024-06-02T04:04:27.914 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 22989 Jun 2 04:04 postgresql.conf 2024-06-02T04:04:27.915 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:27.915 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/base: 2024-06-02T04:04:27.915 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:04:27.915 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 04:04 . 2024-06-02T04:04:27.915 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 04:04 .. 2024-06-02T04:04:27.915 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Jun 2 04:04 1 2024-06-02T04:04:27.915 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Jun 2 04:04 12346 2024-06-02T04:04:27.915 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Jun 2 04:04 12347 2024-06-02T04:04:27.915 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:27.915 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/base/1: 2024-06-02T04:04:27.915 INFO:teuthology.orchestra.run.smithi123.stdout:total 7193 2024-06-02T04:04:27.915 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Jun 2 04:04 . 2024-06-02T04:04:27.915 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 04:04 .. 2024-06-02T04:04:27.915 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 112 2024-06-02T04:04:27.915 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 113 2024-06-02T04:04:27.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jun 2 04:04 12182 2024-06-02T04:04:27.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12182_fsm 2024-06-02T04:04:27.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12182_vm 2024-06-02T04:04:27.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12184 2024-06-02T04:04:27.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12186 2024-06-02T04:04:27.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12187 2024-06-02T04:04:27.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12187_fsm 2024-06-02T04:04:27.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12187_vm 2024-06-02T04:04:27.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12189 2024-06-02T04:04:27.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12191 2024-06-02T04:04:27.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12192 2024-06-02T04:04:27.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12192_fsm 2024-06-02T04:04:27.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12192_vm 2024-06-02T04:04:27.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12194 2024-06-02T04:04:27.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12196 2024-06-02T04:04:27.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12197 2024-06-02T04:04:27.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12197_fsm 2024-06-02T04:04:27.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12197_vm 2024-06-02T04:04:27.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12199 2024-06-02T04:04:27.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12201 2024-06-02T04:04:27.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12202 2024-06-02T04:04:27.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12202_fsm 2024-06-02T04:04:27.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12202_vm 2024-06-02T04:04:27.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12204 2024-06-02T04:04:27.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12206 2024-06-02T04:04:27.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12207 2024-06-02T04:04:27.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12207_fsm 2024-06-02T04:04:27.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12207_vm 2024-06-02T04:04:27.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12209 2024-06-02T04:04:27.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12211 2024-06-02T04:04:27.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12212 2024-06-02T04:04:27.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12214 2024-06-02T04:04:27.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12216 2024-06-02T04:04:27.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Jun 2 04:04 1247 2024-06-02T04:04:27.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1247_fsm 2024-06-02T04:04:27.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1247_vm 2024-06-02T04:04:27.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Jun 2 04:04 1249 2024-06-02T04:04:27.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1249_fsm 2024-06-02T04:04:27.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1249_vm 2024-06-02T04:04:27.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Jun 2 04:04 1255 2024-06-02T04:04:27.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1255_fsm 2024-06-02T04:04:27.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1255_vm 2024-06-02T04:04:27.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Jun 2 04:04 1259 2024-06-02T04:04:27.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1259_fsm 2024-06-02T04:04:27.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1259_vm 2024-06-02T04:04:27.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 1417 2024-06-02T04:04:27.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 1417_vm 2024-06-02T04:04:27.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 1418 2024-06-02T04:04:27.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 1418_vm 2024-06-02T04:04:27.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 174 2024-06-02T04:04:27.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 175 2024-06-02T04:04:27.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2187 2024-06-02T04:04:27.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2224 2024-06-02T04:04:27.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2224_vm 2024-06-02T04:04:27.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2328 2024-06-02T04:04:27.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2328_vm 2024-06-02T04:04:27.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2336 2024-06-02T04:04:27.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2336_vm 2024-06-02T04:04:27.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2337 2024-06-02T04:04:27.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2600 2024-06-02T04:04:27.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2600_fsm 2024-06-02T04:04:27.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2600_vm 2024-06-02T04:04:27.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2601 2024-06-02T04:04:27.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2601_fsm 2024-06-02T04:04:27.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2601_vm 2024-06-02T04:04:27.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:04 2602 2024-06-02T04:04:27.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2602_fsm 2024-06-02T04:04:27.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2602_vm 2024-06-02T04:04:27.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 2603 2024-06-02T04:04:27.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2603_fsm 2024-06-02T04:04:27.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2603_vm 2024-06-02T04:04:27.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2604 2024-06-02T04:04:27.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2604_vm 2024-06-02T04:04:27.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2605 2024-06-02T04:04:27.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2605_fsm 2024-06-02T04:04:27.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2605_vm 2024-06-02T04:04:27.922 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2606 2024-06-02T04:04:27.922 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2606_fsm 2024-06-02T04:04:27.922 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2606_vm 2024-06-02T04:04:27.922 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2607 2024-06-02T04:04:27.922 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2607_fsm 2024-06-02T04:04:27.922 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2607_vm 2024-06-02T04:04:27.922 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Jun 2 04:04 2608 2024-06-02T04:04:27.922 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2608_fsm 2024-06-02T04:04:27.922 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2608_vm 2024-06-02T04:04:27.922 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Jun 2 04:04 2609 2024-06-02T04:04:27.922 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2609_fsm 2024-06-02T04:04:27.922 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2609_vm 2024-06-02T04:04:27.923 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2610 2024-06-02T04:04:27.923 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2610_fsm 2024-06-02T04:04:27.923 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2610_vm 2024-06-02T04:04:27.923 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2611 2024-06-02T04:04:27.923 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2611_vm 2024-06-02T04:04:27.923 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2612 2024-06-02T04:04:27.923 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2612_fsm 2024-06-02T04:04:27.923 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2612_vm 2024-06-02T04:04:27.923 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2613 2024-06-02T04:04:27.923 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2613_vm 2024-06-02T04:04:27.923 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2615 2024-06-02T04:04:27.923 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2615_fsm 2024-06-02T04:04:27.923 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2615_vm 2024-06-02T04:04:27.924 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2616 2024-06-02T04:04:27.924 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2616_fsm 2024-06-02T04:04:27.924 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2616_vm 2024-06-02T04:04:27.924 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Jun 2 04:04 2617 2024-06-02T04:04:27.924 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2617_fsm 2024-06-02T04:04:27.924 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2617_vm 2024-06-02T04:04:27.924 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Jun 2 04:04 2618 2024-06-02T04:04:27.924 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2618_fsm 2024-06-02T04:04:27.924 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2618_vm 2024-06-02T04:04:27.924 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Jun 2 04:04 2619 2024-06-02T04:04:27.924 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2619_fsm 2024-06-02T04:04:27.924 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2619_vm 2024-06-02T04:04:27.925 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2620 2024-06-02T04:04:27.925 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2620_vm 2024-06-02T04:04:27.925 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2650 2024-06-02T04:04:27.925 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2651 2024-06-02T04:04:27.925 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2652 2024-06-02T04:04:27.925 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:04 2653 2024-06-02T04:04:27.925 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:04 2654 2024-06-02T04:04:27.925 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 2655 2024-06-02T04:04:27.925 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2656 2024-06-02T04:04:27.925 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2657 2024-06-02T04:04:27.925 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Jun 2 04:04 2658 2024-06-02T04:04:27.925 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 04:04 2659 2024-06-02T04:04:27.926 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2660 2024-06-02T04:04:27.926 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2661 2024-06-02T04:04:27.926 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 2662 2024-06-02T04:04:27.926 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:04 2663 2024-06-02T04:04:27.926 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2664 2024-06-02T04:04:27.926 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2665 2024-06-02T04:04:27.926 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2666 2024-06-02T04:04:27.926 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2667 2024-06-02T04:04:27.926 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2668 2024-06-02T04:04:27.926 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2669 2024-06-02T04:04:27.926 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2670 2024-06-02T04:04:27.926 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 319488 Jun 2 04:04 2673 2024-06-02T04:04:27.927 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Jun 2 04:04 2674 2024-06-02T04:04:27.927 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Jun 2 04:04 2675 2024-06-02T04:04:27.927 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2678 2024-06-02T04:04:27.927 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2679 2024-06-02T04:04:27.927 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2680 2024-06-02T04:04:27.927 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2681 2024-06-02T04:04:27.927 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2682 2024-06-02T04:04:27.927 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2683 2024-06-02T04:04:27.927 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2684 2024-06-02T04:04:27.927 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2685 2024-06-02T04:04:27.927 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2686 2024-06-02T04:04:27.927 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2687 2024-06-02T04:04:27.927 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:04 2688 2024-06-02T04:04:27.927 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:04 2689 2024-06-02T04:04:27.928 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 04:04 2690 2024-06-02T04:04:27.928 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Jun 2 04:04 2691 2024-06-02T04:04:27.928 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2692 2024-06-02T04:04:27.928 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2693 2024-06-02T04:04:27.928 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2696 2024-06-02T04:04:27.928 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2699 2024-06-02T04:04:27.928 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2701 2024-06-02T04:04:27.928 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2702 2024-06-02T04:04:27.928 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2703 2024-06-02T04:04:27.928 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:04 2704 2024-06-02T04:04:27.928 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2753 2024-06-02T04:04:27.929 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2753_fsm 2024-06-02T04:04:27.929 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2753_vm 2024-06-02T04:04:27.929 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2754 2024-06-02T04:04:27.929 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2755 2024-06-02T04:04:27.929 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 2756 2024-06-02T04:04:27.929 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 2757 2024-06-02T04:04:27.929 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2830 2024-06-02T04:04:27.929 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2830_vm 2024-06-02T04:04:27.929 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2831 2024-06-02T04:04:27.929 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2832 2024-06-02T04:04:27.929 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2832_vm 2024-06-02T04:04:27.929 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2833 2024-06-02T04:04:27.929 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2834 2024-06-02T04:04:27.929 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2834_vm 2024-06-02T04:04:27.930 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2835 2024-06-02T04:04:27.930 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2836 2024-06-02T04:04:27.930 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2836_vm 2024-06-02T04:04:27.930 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2837 2024-06-02T04:04:27.930 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Jun 2 04:04 2838 2024-06-02T04:04:27.930 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2838_fsm 2024-06-02T04:04:27.930 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2838_vm 2024-06-02T04:04:27.930 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2839 2024-06-02T04:04:27.930 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2840 2024-06-02T04:04:27.930 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2840_fsm 2024-06-02T04:04:27.930 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2840_vm 2024-06-02T04:04:27.930 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2841 2024-06-02T04:04:27.930 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2995 2024-06-02T04:04:27.931 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2995_vm 2024-06-02T04:04:27.931 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2996 2024-06-02T04:04:27.931 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3079 2024-06-02T04:04:27.931 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3079_fsm 2024-06-02T04:04:27.931 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3079_vm 2024-06-02T04:04:27.931 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3080 2024-06-02T04:04:27.931 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3081 2024-06-02T04:04:27.931 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3085 2024-06-02T04:04:27.931 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3118 2024-06-02T04:04:27.931 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3118_vm 2024-06-02T04:04:27.931 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3119 2024-06-02T04:04:27.931 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3164 2024-06-02T04:04:27.931 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3256 2024-06-02T04:04:27.931 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3256_vm 2024-06-02T04:04:27.932 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3257 2024-06-02T04:04:27.932 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3258 2024-06-02T04:04:27.932 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3350 2024-06-02T04:04:27.932 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3350_vm 2024-06-02T04:04:27.932 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3351 2024-06-02T04:04:27.932 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3379 2024-06-02T04:04:27.932 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3380 2024-06-02T04:04:27.932 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3381 2024-06-02T04:04:27.932 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3381_vm 2024-06-02T04:04:27.932 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3394 2024-06-02T04:04:27.932 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3394_fsm 2024-06-02T04:04:27.932 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3394_vm 2024-06-02T04:04:27.932 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3395 2024-06-02T04:04:27.933 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3439 2024-06-02T04:04:27.933 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3439_vm 2024-06-02T04:04:27.933 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3440 2024-06-02T04:04:27.933 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:04 3455 2024-06-02T04:04:27.933 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3456 2024-06-02T04:04:27.933 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3456_fsm 2024-06-02T04:04:27.933 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3456_vm 2024-06-02T04:04:27.933 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3466 2024-06-02T04:04:27.933 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3466_vm 2024-06-02T04:04:27.933 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3467 2024-06-02T04:04:27.933 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3468 2024-06-02T04:04:27.934 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3501 2024-06-02T04:04:27.934 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3501_vm 2024-06-02T04:04:27.934 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3502 2024-06-02T04:04:27.934 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3503 2024-06-02T04:04:27.934 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3534 2024-06-02T04:04:27.934 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3541 2024-06-02T04:04:27.934 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3541_fsm 2024-06-02T04:04:27.934 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3541_vm 2024-06-02T04:04:27.934 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3542 2024-06-02T04:04:27.934 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3574 2024-06-02T04:04:27.934 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3575 2024-06-02T04:04:27.934 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3576 2024-06-02T04:04:27.934 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3576_vm 2024-06-02T04:04:27.935 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3596 2024-06-02T04:04:27.935 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3596_vm 2024-06-02T04:04:27.935 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3597 2024-06-02T04:04:27.935 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3598 2024-06-02T04:04:27.935 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3598_vm 2024-06-02T04:04:27.935 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3599 2024-06-02T04:04:27.935 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3600 2024-06-02T04:04:27.935 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3600_fsm 2024-06-02T04:04:27.935 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3600_vm 2024-06-02T04:04:27.935 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3601 2024-06-02T04:04:27.935 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3601_fsm 2024-06-02T04:04:27.935 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3601_vm 2024-06-02T04:04:27.936 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3602 2024-06-02T04:04:27.936 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3602_fsm 2024-06-02T04:04:27.936 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3602_vm 2024-06-02T04:04:27.936 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3603 2024-06-02T04:04:27.936 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3603_fsm 2024-06-02T04:04:27.936 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3603_vm 2024-06-02T04:04:27.936 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3604 2024-06-02T04:04:27.936 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3605 2024-06-02T04:04:27.936 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3606 2024-06-02T04:04:27.939 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3607 2024-06-02T04:04:27.939 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3608 2024-06-02T04:04:27.939 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 3609 2024-06-02T04:04:27.939 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3712 2024-06-02T04:04:27.939 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3764 2024-06-02T04:04:27.939 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3764_fsm 2024-06-02T04:04:27.939 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3764_vm 2024-06-02T04:04:27.940 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3766 2024-06-02T04:04:27.940 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3767 2024-06-02T04:04:27.940 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3997 2024-06-02T04:04:27.940 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 5002 2024-06-02T04:04:27.940 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 548 2024-06-02T04:04:27.940 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 549 2024-06-02T04:04:27.940 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6102 2024-06-02T04:04:27.940 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6102_vm 2024-06-02T04:04:27.940 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6104 2024-06-02T04:04:27.940 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6104_vm 2024-06-02T04:04:27.940 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6106 2024-06-02T04:04:27.940 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6106_vm 2024-06-02T04:04:27.940 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6110 2024-06-02T04:04:27.940 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6111 2024-06-02T04:04:27.941 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6112 2024-06-02T04:04:27.941 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6113 2024-06-02T04:04:27.941 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6117 2024-06-02T04:04:27.941 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 826 2024-06-02T04:04:27.941 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 826_vm 2024-06-02T04:04:27.941 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 827 2024-06-02T04:04:27.941 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 828 2024-06-02T04:04:27.941 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jun 2 04:04 pg_filenode.map 2024-06-02T04:04:27.941 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 04:04 PG_VERSION 2024-06-02T04:04:27.941 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:27.941 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/base/12346: 2024-06-02T04:04:27.941 INFO:teuthology.orchestra.run.smithi123.stdout:total 7193 2024-06-02T04:04:27.941 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Jun 2 04:04 . 2024-06-02T04:04:27.941 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 04:04 .. 2024-06-02T04:04:27.942 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 112 2024-06-02T04:04:27.942 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 113 2024-06-02T04:04:27.942 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jun 2 04:04 12182 2024-06-02T04:04:27.942 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12182_fsm 2024-06-02T04:04:27.942 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12182_vm 2024-06-02T04:04:27.942 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12184 2024-06-02T04:04:27.942 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12186 2024-06-02T04:04:27.942 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12187 2024-06-02T04:04:27.942 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12187_fsm 2024-06-02T04:04:27.942 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12187_vm 2024-06-02T04:04:27.942 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12189 2024-06-02T04:04:27.942 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12191 2024-06-02T04:04:27.942 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12192 2024-06-02T04:04:27.943 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12192_fsm 2024-06-02T04:04:27.943 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12192_vm 2024-06-02T04:04:27.943 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12194 2024-06-02T04:04:27.943 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12196 2024-06-02T04:04:27.943 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12197 2024-06-02T04:04:27.943 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12197_fsm 2024-06-02T04:04:27.943 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12197_vm 2024-06-02T04:04:27.943 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12199 2024-06-02T04:04:27.943 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12201 2024-06-02T04:04:27.943 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12202 2024-06-02T04:04:27.943 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12202_fsm 2024-06-02T04:04:27.943 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12202_vm 2024-06-02T04:04:27.943 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12204 2024-06-02T04:04:27.944 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12206 2024-06-02T04:04:27.944 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12207 2024-06-02T04:04:27.944 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12207_fsm 2024-06-02T04:04:27.944 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12207_vm 2024-06-02T04:04:27.944 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12209 2024-06-02T04:04:27.944 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12211 2024-06-02T04:04:27.944 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12212 2024-06-02T04:04:27.944 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12214 2024-06-02T04:04:27.944 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12216 2024-06-02T04:04:27.944 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Jun 2 04:04 1247 2024-06-02T04:04:27.944 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1247_fsm 2024-06-02T04:04:27.944 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1247_vm 2024-06-02T04:04:27.944 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Jun 2 04:04 1249 2024-06-02T04:04:27.944 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1249_fsm 2024-06-02T04:04:27.944 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1249_vm 2024-06-02T04:04:27.945 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Jun 2 04:04 1255 2024-06-02T04:04:27.945 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1255_fsm 2024-06-02T04:04:27.945 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1255_vm 2024-06-02T04:04:27.945 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Jun 2 04:04 1259 2024-06-02T04:04:27.945 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1259_fsm 2024-06-02T04:04:27.945 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1259_vm 2024-06-02T04:04:27.945 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 1417 2024-06-02T04:04:27.945 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 1417_vm 2024-06-02T04:04:27.945 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 1418 2024-06-02T04:04:27.945 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 1418_vm 2024-06-02T04:04:27.945 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 174 2024-06-02T04:04:27.945 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 175 2024-06-02T04:04:27.945 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2187 2024-06-02T04:04:27.945 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2224 2024-06-02T04:04:27.946 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2224_vm 2024-06-02T04:04:27.946 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2328 2024-06-02T04:04:27.946 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2328_vm 2024-06-02T04:04:27.946 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2336 2024-06-02T04:04:27.946 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2336_vm 2024-06-02T04:04:27.946 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2337 2024-06-02T04:04:27.946 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2600 2024-06-02T04:04:27.946 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2600_fsm 2024-06-02T04:04:27.946 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2600_vm 2024-06-02T04:04:27.946 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2601 2024-06-02T04:04:27.946 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2601_fsm 2024-06-02T04:04:27.946 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2601_vm 2024-06-02T04:04:27.947 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:04 2602 2024-06-02T04:04:27.947 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2602_fsm 2024-06-02T04:04:27.947 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2602_vm 2024-06-02T04:04:27.947 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 2603 2024-06-02T04:04:27.947 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2603_fsm 2024-06-02T04:04:27.947 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2603_vm 2024-06-02T04:04:27.947 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2604 2024-06-02T04:04:27.947 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2604_vm 2024-06-02T04:04:27.947 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2605 2024-06-02T04:04:27.947 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2605_fsm 2024-06-02T04:04:27.947 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2605_vm 2024-06-02T04:04:27.947 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2606 2024-06-02T04:04:27.947 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2606_fsm 2024-06-02T04:04:27.947 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2606_vm 2024-06-02T04:04:27.948 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2607 2024-06-02T04:04:27.948 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2607_fsm 2024-06-02T04:04:27.948 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2607_vm 2024-06-02T04:04:27.948 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Jun 2 04:04 2608 2024-06-02T04:04:27.948 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2608_fsm 2024-06-02T04:04:27.948 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2608_vm 2024-06-02T04:04:27.948 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Jun 2 04:04 2609 2024-06-02T04:04:27.948 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2609_fsm 2024-06-02T04:04:27.948 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2609_vm 2024-06-02T04:04:27.948 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2610 2024-06-02T04:04:27.948 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2610_fsm 2024-06-02T04:04:27.948 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2610_vm 2024-06-02T04:04:27.948 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2611 2024-06-02T04:04:27.948 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2611_vm 2024-06-02T04:04:27.949 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2612 2024-06-02T04:04:27.949 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2612_fsm 2024-06-02T04:04:27.949 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2612_vm 2024-06-02T04:04:27.949 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2613 2024-06-02T04:04:27.949 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2613_vm 2024-06-02T04:04:27.949 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2615 2024-06-02T04:04:27.949 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2615_fsm 2024-06-02T04:04:27.949 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2615_vm 2024-06-02T04:04:27.949 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2616 2024-06-02T04:04:27.949 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2616_fsm 2024-06-02T04:04:27.949 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2616_vm 2024-06-02T04:04:27.949 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Jun 2 04:04 2617 2024-06-02T04:04:27.949 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2617_fsm 2024-06-02T04:04:27.949 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2617_vm 2024-06-02T04:04:27.950 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Jun 2 04:04 2618 2024-06-02T04:04:27.950 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2618_fsm 2024-06-02T04:04:27.950 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2618_vm 2024-06-02T04:04:27.950 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Jun 2 04:04 2619 2024-06-02T04:04:27.950 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2619_fsm 2024-06-02T04:04:27.950 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2619_vm 2024-06-02T04:04:27.950 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2620 2024-06-02T04:04:27.950 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2620_vm 2024-06-02T04:04:27.950 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2650 2024-06-02T04:04:27.950 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2651 2024-06-02T04:04:27.950 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2652 2024-06-02T04:04:27.950 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:04 2653 2024-06-02T04:04:27.950 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:04 2654 2024-06-02T04:04:27.951 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 2655 2024-06-02T04:04:27.951 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2656 2024-06-02T04:04:27.951 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2657 2024-06-02T04:04:27.951 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Jun 2 04:04 2658 2024-06-02T04:04:27.951 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 04:04 2659 2024-06-02T04:04:27.951 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2660 2024-06-02T04:04:27.951 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2661 2024-06-02T04:04:27.951 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 2662 2024-06-02T04:04:27.951 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:04 2663 2024-06-02T04:04:27.951 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2664 2024-06-02T04:04:27.951 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2665 2024-06-02T04:04:27.951 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2666 2024-06-02T04:04:27.951 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2667 2024-06-02T04:04:27.952 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2668 2024-06-02T04:04:27.952 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2669 2024-06-02T04:04:27.952 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2670 2024-06-02T04:04:27.952 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 319488 Jun 2 04:04 2673 2024-06-02T04:04:27.952 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Jun 2 04:04 2674 2024-06-02T04:04:27.952 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Jun 2 04:04 2675 2024-06-02T04:04:27.952 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2678 2024-06-02T04:04:27.952 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2679 2024-06-02T04:04:27.952 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2680 2024-06-02T04:04:27.952 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2681 2024-06-02T04:04:27.952 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2682 2024-06-02T04:04:27.952 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2683 2024-06-02T04:04:27.952 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2684 2024-06-02T04:04:27.953 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2685 2024-06-02T04:04:27.953 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2686 2024-06-02T04:04:27.953 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2687 2024-06-02T04:04:27.953 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:04 2688 2024-06-02T04:04:27.953 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:04 2689 2024-06-02T04:04:27.953 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 04:04 2690 2024-06-02T04:04:27.953 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Jun 2 04:04 2691 2024-06-02T04:04:27.953 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2692 2024-06-02T04:04:27.953 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2693 2024-06-02T04:04:27.953 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2696 2024-06-02T04:04:27.953 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2699 2024-06-02T04:04:27.953 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2701 2024-06-02T04:04:27.953 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2702 2024-06-02T04:04:27.954 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2703 2024-06-02T04:04:27.954 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:04 2704 2024-06-02T04:04:27.954 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2753 2024-06-02T04:04:27.954 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2753_fsm 2024-06-02T04:04:27.954 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2753_vm 2024-06-02T04:04:27.954 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2754 2024-06-02T04:04:27.954 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2755 2024-06-02T04:04:27.954 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 2756 2024-06-02T04:04:27.954 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 2757 2024-06-02T04:04:27.954 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2830 2024-06-02T04:04:27.954 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2830_vm 2024-06-02T04:04:27.955 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2831 2024-06-02T04:04:27.955 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2832 2024-06-02T04:04:27.955 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2832_vm 2024-06-02T04:04:27.955 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2833 2024-06-02T04:04:27.955 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2834 2024-06-02T04:04:27.955 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2834_vm 2024-06-02T04:04:27.955 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2835 2024-06-02T04:04:27.955 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2836 2024-06-02T04:04:27.955 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2836_vm 2024-06-02T04:04:27.955 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2837 2024-06-02T04:04:27.955 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Jun 2 04:04 2838 2024-06-02T04:04:27.955 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2838_fsm 2024-06-02T04:04:27.955 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2838_vm 2024-06-02T04:04:27.955 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2839 2024-06-02T04:04:27.955 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2840 2024-06-02T04:04:27.956 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2840_fsm 2024-06-02T04:04:27.956 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2840_vm 2024-06-02T04:04:27.956 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2841 2024-06-02T04:04:27.956 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2995 2024-06-02T04:04:27.956 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2995_vm 2024-06-02T04:04:27.956 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2996 2024-06-02T04:04:27.956 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3079 2024-06-02T04:04:27.956 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3079_fsm 2024-06-02T04:04:27.956 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3079_vm 2024-06-02T04:04:27.956 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3080 2024-06-02T04:04:27.956 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3081 2024-06-02T04:04:27.956 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3085 2024-06-02T04:04:27.956 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3118 2024-06-02T04:04:27.956 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3118_vm 2024-06-02T04:04:27.957 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3119 2024-06-02T04:04:27.957 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3164 2024-06-02T04:04:27.957 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3256 2024-06-02T04:04:27.957 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3256_vm 2024-06-02T04:04:27.957 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3257 2024-06-02T04:04:27.957 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3258 2024-06-02T04:04:27.957 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3350 2024-06-02T04:04:27.957 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3350_vm 2024-06-02T04:04:27.957 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3351 2024-06-02T04:04:27.957 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3379 2024-06-02T04:04:27.957 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3380 2024-06-02T04:04:27.957 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3381 2024-06-02T04:04:27.957 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3381_vm 2024-06-02T04:04:27.958 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3394 2024-06-02T04:04:27.958 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3394_fsm 2024-06-02T04:04:27.958 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3394_vm 2024-06-02T04:04:27.958 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3395 2024-06-02T04:04:27.958 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3439 2024-06-02T04:04:27.958 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3439_vm 2024-06-02T04:04:27.958 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3440 2024-06-02T04:04:27.958 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:04 3455 2024-06-02T04:04:27.958 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3456 2024-06-02T04:04:27.958 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3456_fsm 2024-06-02T04:04:27.958 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3456_vm 2024-06-02T04:04:27.958 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3466 2024-06-02T04:04:27.958 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3466_vm 2024-06-02T04:04:27.959 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3467 2024-06-02T04:04:27.959 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3468 2024-06-02T04:04:27.959 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3501 2024-06-02T04:04:27.959 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3501_vm 2024-06-02T04:04:27.959 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3502 2024-06-02T04:04:27.959 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3503 2024-06-02T04:04:27.959 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3534 2024-06-02T04:04:27.959 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3541 2024-06-02T04:04:27.959 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3541_fsm 2024-06-02T04:04:27.959 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3541_vm 2024-06-02T04:04:27.959 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3542 2024-06-02T04:04:27.959 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3574 2024-06-02T04:04:27.959 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3575 2024-06-02T04:04:27.959 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3576 2024-06-02T04:04:27.959 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3576_vm 2024-06-02T04:04:27.960 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3596 2024-06-02T04:04:27.960 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3596_vm 2024-06-02T04:04:27.960 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3597 2024-06-02T04:04:27.960 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3598 2024-06-02T04:04:27.960 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3598_vm 2024-06-02T04:04:27.960 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3599 2024-06-02T04:04:27.960 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3600 2024-06-02T04:04:27.960 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3600_fsm 2024-06-02T04:04:27.960 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3600_vm 2024-06-02T04:04:27.960 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3601 2024-06-02T04:04:27.960 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3601_fsm 2024-06-02T04:04:27.960 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3601_vm 2024-06-02T04:04:27.960 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3602 2024-06-02T04:04:27.960 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3602_fsm 2024-06-02T04:04:27.961 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3602_vm 2024-06-02T04:04:27.961 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3603 2024-06-02T04:04:27.961 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3603_fsm 2024-06-02T04:04:27.961 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3603_vm 2024-06-02T04:04:27.961 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3604 2024-06-02T04:04:27.961 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3605 2024-06-02T04:04:27.961 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3606 2024-06-02T04:04:27.961 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3607 2024-06-02T04:04:27.961 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3608 2024-06-02T04:04:27.961 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 3609 2024-06-02T04:04:27.961 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3712 2024-06-02T04:04:27.961 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3764 2024-06-02T04:04:27.961 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3764_fsm 2024-06-02T04:04:27.961 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3764_vm 2024-06-02T04:04:27.961 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3766 2024-06-02T04:04:27.962 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3767 2024-06-02T04:04:27.962 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3997 2024-06-02T04:04:27.962 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 5002 2024-06-02T04:04:27.962 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 548 2024-06-02T04:04:27.962 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 549 2024-06-02T04:04:27.962 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6102 2024-06-02T04:04:27.962 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6102_vm 2024-06-02T04:04:27.962 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6104 2024-06-02T04:04:27.962 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6104_vm 2024-06-02T04:04:27.962 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6106 2024-06-02T04:04:27.962 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6106_vm 2024-06-02T04:04:27.962 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6110 2024-06-02T04:04:27.962 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6111 2024-06-02T04:04:27.963 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6112 2024-06-02T04:04:27.963 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6113 2024-06-02T04:04:27.963 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6117 2024-06-02T04:04:27.963 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 826 2024-06-02T04:04:27.963 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 826_vm 2024-06-02T04:04:27.963 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 827 2024-06-02T04:04:27.963 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 828 2024-06-02T04:04:27.963 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jun 2 04:04 pg_filenode.map 2024-06-02T04:04:27.963 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 04:04 PG_VERSION 2024-06-02T04:04:27.963 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:27.963 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/base/12347: 2024-06-02T04:04:27.963 INFO:teuthology.orchestra.run.smithi123.stdout:total 7193 2024-06-02T04:04:27.963 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Jun 2 04:04 . 2024-06-02T04:04:27.963 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 04:04 .. 2024-06-02T04:04:27.964 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 112 2024-06-02T04:04:27.964 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 113 2024-06-02T04:04:27.964 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jun 2 04:04 12182 2024-06-02T04:04:27.964 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12182_fsm 2024-06-02T04:04:27.964 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12182_vm 2024-06-02T04:04:27.964 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12184 2024-06-02T04:04:27.964 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12186 2024-06-02T04:04:27.964 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12187 2024-06-02T04:04:27.964 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12187_fsm 2024-06-02T04:04:27.964 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12187_vm 2024-06-02T04:04:27.964 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12189 2024-06-02T04:04:27.964 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12191 2024-06-02T04:04:27.964 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12192 2024-06-02T04:04:27.964 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12192_fsm 2024-06-02T04:04:27.965 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12192_vm 2024-06-02T04:04:27.965 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12194 2024-06-02T04:04:27.965 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12196 2024-06-02T04:04:27.965 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12197 2024-06-02T04:04:27.965 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12197_fsm 2024-06-02T04:04:27.965 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12197_vm 2024-06-02T04:04:27.965 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12199 2024-06-02T04:04:27.965 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12201 2024-06-02T04:04:27.965 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12202 2024-06-02T04:04:27.965 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12202_fsm 2024-06-02T04:04:27.965 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12202_vm 2024-06-02T04:04:27.966 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12204 2024-06-02T04:04:27.966 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12206 2024-06-02T04:04:27.966 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12207 2024-06-02T04:04:27.966 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12207_fsm 2024-06-02T04:04:27.966 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12207_vm 2024-06-02T04:04:27.966 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12209 2024-06-02T04:04:27.966 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12211 2024-06-02T04:04:27.966 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12212 2024-06-02T04:04:27.966 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12214 2024-06-02T04:04:27.966 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12216 2024-06-02T04:04:27.966 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Jun 2 04:04 1247 2024-06-02T04:04:27.966 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1247_fsm 2024-06-02T04:04:27.967 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1247_vm 2024-06-02T04:04:27.967 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Jun 2 04:04 1249 2024-06-02T04:04:27.967 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1249_fsm 2024-06-02T04:04:27.967 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1249_vm 2024-06-02T04:04:27.967 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Jun 2 04:04 1255 2024-06-02T04:04:27.967 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1255_fsm 2024-06-02T04:04:27.967 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1255_vm 2024-06-02T04:04:27.967 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Jun 2 04:04 1259 2024-06-02T04:04:27.967 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1259_fsm 2024-06-02T04:04:27.967 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1259_vm 2024-06-02T04:04:27.967 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 1417 2024-06-02T04:04:27.967 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 1417_vm 2024-06-02T04:04:27.967 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 1418 2024-06-02T04:04:27.967 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 1418_vm 2024-06-02T04:04:27.968 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 174 2024-06-02T04:04:27.968 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 175 2024-06-02T04:04:27.968 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2187 2024-06-02T04:04:27.968 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2224 2024-06-02T04:04:27.968 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2224_vm 2024-06-02T04:04:27.968 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2328 2024-06-02T04:04:27.968 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2328_vm 2024-06-02T04:04:27.968 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2336 2024-06-02T04:04:27.968 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2336_vm 2024-06-02T04:04:27.968 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2337 2024-06-02T04:04:27.968 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2600 2024-06-02T04:04:27.968 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2600_fsm 2024-06-02T04:04:27.968 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2600_vm 2024-06-02T04:04:27.968 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2601 2024-06-02T04:04:27.968 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2601_fsm 2024-06-02T04:04:27.969 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2601_vm 2024-06-02T04:04:27.969 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:04 2602 2024-06-02T04:04:27.969 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2602_fsm 2024-06-02T04:04:27.969 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2602_vm 2024-06-02T04:04:27.969 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 2603 2024-06-02T04:04:27.969 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2603_fsm 2024-06-02T04:04:27.969 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2603_vm 2024-06-02T04:04:27.969 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2604 2024-06-02T04:04:27.969 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2604_vm 2024-06-02T04:04:27.969 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2605 2024-06-02T04:04:27.969 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2605_fsm 2024-06-02T04:04:27.969 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2605_vm 2024-06-02T04:04:27.969 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2606 2024-06-02T04:04:27.969 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2606_fsm 2024-06-02T04:04:27.969 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2606_vm 2024-06-02T04:04:27.970 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2607 2024-06-02T04:04:27.970 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2607_fsm 2024-06-02T04:04:27.970 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2607_vm 2024-06-02T04:04:27.970 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Jun 2 04:04 2608 2024-06-02T04:04:27.970 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2608_fsm 2024-06-02T04:04:27.970 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2608_vm 2024-06-02T04:04:27.970 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Jun 2 04:04 2609 2024-06-02T04:04:27.970 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2609_fsm 2024-06-02T04:04:27.970 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2609_vm 2024-06-02T04:04:27.970 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2610 2024-06-02T04:04:27.970 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2610_fsm 2024-06-02T04:04:27.970 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2610_vm 2024-06-02T04:04:27.970 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2611 2024-06-02T04:04:27.971 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2611_vm 2024-06-02T04:04:27.971 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2612 2024-06-02T04:04:27.971 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2612_fsm 2024-06-02T04:04:27.971 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2612_vm 2024-06-02T04:04:27.971 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2613 2024-06-02T04:04:27.971 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2613_vm 2024-06-02T04:04:27.971 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2615 2024-06-02T04:04:27.971 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2615_fsm 2024-06-02T04:04:27.971 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2615_vm 2024-06-02T04:04:27.971 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2616 2024-06-02T04:04:27.971 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2616_fsm 2024-06-02T04:04:27.971 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2616_vm 2024-06-02T04:04:27.971 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Jun 2 04:04 2617 2024-06-02T04:04:27.971 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2617_fsm 2024-06-02T04:04:27.972 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2617_vm 2024-06-02T04:04:27.972 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Jun 2 04:04 2618 2024-06-02T04:04:27.972 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2618_fsm 2024-06-02T04:04:27.972 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2618_vm 2024-06-02T04:04:27.972 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Jun 2 04:04 2619 2024-06-02T04:04:27.972 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2619_fsm 2024-06-02T04:04:27.972 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2619_vm 2024-06-02T04:04:27.972 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2620 2024-06-02T04:04:27.972 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2620_vm 2024-06-02T04:04:27.972 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2650 2024-06-02T04:04:27.972 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2651 2024-06-02T04:04:27.972 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2652 2024-06-02T04:04:27.972 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:04 2653 2024-06-02T04:04:27.972 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:04 2654 2024-06-02T04:04:27.973 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 2655 2024-06-02T04:04:27.973 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2656 2024-06-02T04:04:27.973 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2657 2024-06-02T04:04:27.973 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Jun 2 04:04 2658 2024-06-02T04:04:27.973 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 04:04 2659 2024-06-02T04:04:27.973 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2660 2024-06-02T04:04:27.973 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2661 2024-06-02T04:04:27.973 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 2662 2024-06-02T04:04:27.973 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:04 2663 2024-06-02T04:04:27.973 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2664 2024-06-02T04:04:27.973 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2665 2024-06-02T04:04:27.973 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2666 2024-06-02T04:04:27.973 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2667 2024-06-02T04:04:27.973 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2668 2024-06-02T04:04:27.974 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2669 2024-06-02T04:04:27.974 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2670 2024-06-02T04:04:27.974 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 319488 Jun 2 04:04 2673 2024-06-02T04:04:27.974 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Jun 2 04:04 2674 2024-06-02T04:04:27.974 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Jun 2 04:04 2675 2024-06-02T04:04:27.974 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2678 2024-06-02T04:04:27.974 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2679 2024-06-02T04:04:27.974 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2680 2024-06-02T04:04:27.974 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2681 2024-06-02T04:04:27.974 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2682 2024-06-02T04:04:27.974 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2683 2024-06-02T04:04:27.974 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2684 2024-06-02T04:04:27.974 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2685 2024-06-02T04:04:27.975 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2686 2024-06-02T04:04:27.975 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2687 2024-06-02T04:04:27.975 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:04 2688 2024-06-02T04:04:27.975 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:04 2689 2024-06-02T04:04:27.975 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 04:04 2690 2024-06-02T04:04:27.975 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Jun 2 04:04 2691 2024-06-02T04:04:27.975 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2692 2024-06-02T04:04:27.975 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2693 2024-06-02T04:04:27.975 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2696 2024-06-02T04:04:27.975 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2699 2024-06-02T04:04:27.975 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2701 2024-06-02T04:04:27.975 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2702 2024-06-02T04:04:27.975 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2703 2024-06-02T04:04:27.975 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:04 2704 2024-06-02T04:04:27.976 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2753 2024-06-02T04:04:27.976 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2753_fsm 2024-06-02T04:04:27.976 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2753_vm 2024-06-02T04:04:27.976 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2754 2024-06-02T04:04:27.976 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2755 2024-06-02T04:04:27.976 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 2756 2024-06-02T04:04:27.976 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 2757 2024-06-02T04:04:27.976 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2830 2024-06-02T04:04:27.976 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2830_vm 2024-06-02T04:04:27.976 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2831 2024-06-02T04:04:27.976 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2832 2024-06-02T04:04:27.976 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2832_vm 2024-06-02T04:04:27.976 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2833 2024-06-02T04:04:27.976 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2834 2024-06-02T04:04:27.977 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2834_vm 2024-06-02T04:04:27.977 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2835 2024-06-02T04:04:27.977 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2836 2024-06-02T04:04:27.977 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2836_vm 2024-06-02T04:04:27.977 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2837 2024-06-02T04:04:27.977 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Jun 2 04:04 2838 2024-06-02T04:04:27.977 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2838_fsm 2024-06-02T04:04:27.977 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2838_vm 2024-06-02T04:04:27.977 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2839 2024-06-02T04:04:27.977 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2840 2024-06-02T04:04:27.977 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2840_fsm 2024-06-02T04:04:27.977 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2840_vm 2024-06-02T04:04:27.977 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2841 2024-06-02T04:04:27.977 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2995 2024-06-02T04:04:27.978 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2995_vm 2024-06-02T04:04:27.978 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2996 2024-06-02T04:04:27.978 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3079 2024-06-02T04:04:27.978 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3079_fsm 2024-06-02T04:04:27.978 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3079_vm 2024-06-02T04:04:27.978 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3080 2024-06-02T04:04:27.978 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3081 2024-06-02T04:04:27.978 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3085 2024-06-02T04:04:27.978 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3118 2024-06-02T04:04:27.978 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3118_vm 2024-06-02T04:04:27.978 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3119 2024-06-02T04:04:27.978 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3164 2024-06-02T04:04:27.978 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3256 2024-06-02T04:04:27.979 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3256_vm 2024-06-02T04:04:27.979 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3257 2024-06-02T04:04:27.979 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3258 2024-06-02T04:04:27.979 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3350 2024-06-02T04:04:27.979 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3350_vm 2024-06-02T04:04:27.979 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3351 2024-06-02T04:04:27.979 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3379 2024-06-02T04:04:27.979 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3380 2024-06-02T04:04:27.979 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3381 2024-06-02T04:04:27.979 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3381_vm 2024-06-02T04:04:27.979 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3394 2024-06-02T04:04:27.979 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3394_fsm 2024-06-02T04:04:27.979 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3394_vm 2024-06-02T04:04:27.979 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3395 2024-06-02T04:04:27.980 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3439 2024-06-02T04:04:27.980 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3439_vm 2024-06-02T04:04:27.980 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3440 2024-06-02T04:04:27.980 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:04 3455 2024-06-02T04:04:27.980 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3456 2024-06-02T04:04:27.980 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3456_fsm 2024-06-02T04:04:27.980 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3456_vm 2024-06-02T04:04:27.980 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3466 2024-06-02T04:04:27.980 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3466_vm 2024-06-02T04:04:27.980 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3467 2024-06-02T04:04:27.980 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3468 2024-06-02T04:04:27.980 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3501 2024-06-02T04:04:27.980 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3501_vm 2024-06-02T04:04:27.981 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3502 2024-06-02T04:04:27.981 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3503 2024-06-02T04:04:27.981 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3534 2024-06-02T04:04:27.981 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3541 2024-06-02T04:04:27.981 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3541_fsm 2024-06-02T04:04:27.981 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3541_vm 2024-06-02T04:04:27.981 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3542 2024-06-02T04:04:27.981 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3574 2024-06-02T04:04:27.981 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3575 2024-06-02T04:04:27.981 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3576 2024-06-02T04:04:27.981 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3576_vm 2024-06-02T04:04:27.981 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3596 2024-06-02T04:04:27.981 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3596_vm 2024-06-02T04:04:27.981 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3597 2024-06-02T04:04:27.981 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3598 2024-06-02T04:04:27.982 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3598_vm 2024-06-02T04:04:27.982 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3599 2024-06-02T04:04:27.982 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3600 2024-06-02T04:04:27.982 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3600_fsm 2024-06-02T04:04:27.982 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3600_vm 2024-06-02T04:04:27.982 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3601 2024-06-02T04:04:27.982 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3601_fsm 2024-06-02T04:04:27.982 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3601_vm 2024-06-02T04:04:27.982 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3602 2024-06-02T04:04:27.982 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3602_fsm 2024-06-02T04:04:27.982 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3602_vm 2024-06-02T04:04:27.982 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3603 2024-06-02T04:04:27.982 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3603_fsm 2024-06-02T04:04:27.983 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3603_vm 2024-06-02T04:04:27.983 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3604 2024-06-02T04:04:27.983 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3605 2024-06-02T04:04:27.983 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3606 2024-06-02T04:04:27.983 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3607 2024-06-02T04:04:27.983 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3608 2024-06-02T04:04:27.983 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 3609 2024-06-02T04:04:27.983 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3712 2024-06-02T04:04:27.983 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3764 2024-06-02T04:04:27.983 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3764_fsm 2024-06-02T04:04:27.983 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3764_vm 2024-06-02T04:04:27.983 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3766 2024-06-02T04:04:27.983 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3767 2024-06-02T04:04:27.984 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3997 2024-06-02T04:04:27.984 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 5002 2024-06-02T04:04:27.984 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 548 2024-06-02T04:04:27.984 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 549 2024-06-02T04:04:27.984 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6102 2024-06-02T04:04:27.984 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6102_vm 2024-06-02T04:04:27.984 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6104 2024-06-02T04:04:27.984 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6104_vm 2024-06-02T04:04:27.984 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6106 2024-06-02T04:04:27.984 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6106_vm 2024-06-02T04:04:27.984 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6110 2024-06-02T04:04:27.984 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6111 2024-06-02T04:04:27.984 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6112 2024-06-02T04:04:27.984 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6113 2024-06-02T04:04:27.984 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6117 2024-06-02T04:04:27.985 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 826 2024-06-02T04:04:27.985 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 826_vm 2024-06-02T04:04:27.985 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 827 2024-06-02T04:04:27.985 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 828 2024-06-02T04:04:27.985 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jun 2 04:04 pg_filenode.map 2024-06-02T04:04:27.985 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 04:04 PG_VERSION 2024-06-02T04:04:27.985 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:27.985 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/global: 2024-06-02T04:04:27.985 INFO:teuthology.orchestra.run.smithi123.stdout:total 553 2024-06-02T04:04:27.985 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Jun 2 04:04 . 2024-06-02T04:04:27.985 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 04:04 .. 2024-06-02T04:04:27.985 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1136 2024-06-02T04:04:27.985 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1136_fsm 2024-06-02T04:04:27.985 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1136_vm 2024-06-02T04:04:27.986 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 1137 2024-06-02T04:04:27.986 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1213 2024-06-02T04:04:27.986 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1213_fsm 2024-06-02T04:04:27.986 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1213_vm 2024-06-02T04:04:27.986 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1214 2024-06-02T04:04:27.986 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1214_fsm 2024-06-02T04:04:27.986 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1214_vm 2024-06-02T04:04:27.986 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 1232 2024-06-02T04:04:27.986 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 1233 2024-06-02T04:04:27.986 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1260 2024-06-02T04:04:27.986 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1260_fsm 2024-06-02T04:04:27.986 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1260_vm 2024-06-02T04:04:27.986 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1261 2024-06-02T04:04:27.986 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1261_fsm 2024-06-02T04:04:27.987 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1261_vm 2024-06-02T04:04:27.987 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1262 2024-06-02T04:04:27.987 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1262_fsm 2024-06-02T04:04:27.987 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1262_vm 2024-06-02T04:04:27.987 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2396 2024-06-02T04:04:27.987 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2396_fsm 2024-06-02T04:04:27.987 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2396_vm 2024-06-02T04:04:27.987 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2397 2024-06-02T04:04:27.987 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2671 2024-06-02T04:04:27.987 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2672 2024-06-02T04:04:27.987 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2676 2024-06-02T04:04:27.987 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2677 2024-06-02T04:04:27.987 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2694 2024-06-02T04:04:27.987 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2695 2024-06-02T04:04:27.988 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2697 2024-06-02T04:04:27.988 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2698 2024-06-02T04:04:27.988 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2846 2024-06-02T04:04:27.988 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2846_vm 2024-06-02T04:04:27.988 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2847 2024-06-02T04:04:27.988 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2964 2024-06-02T04:04:27.988 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2964_vm 2024-06-02T04:04:27.988 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2965 2024-06-02T04:04:27.988 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2966 2024-06-02T04:04:27.988 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2966_vm 2024-06-02T04:04:27.988 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2967 2024-06-02T04:04:27.988 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3592 2024-06-02T04:04:27.988 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3592_vm 2024-06-02T04:04:27.988 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3593 2024-06-02T04:04:27.989 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 4060 2024-06-02T04:04:27.989 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 4060_vm 2024-06-02T04:04:27.989 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 4061 2024-06-02T04:04:27.989 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6000 2024-06-02T04:04:27.989 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6000_vm 2024-06-02T04:04:27.989 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6001 2024-06-02T04:04:27.989 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6002 2024-06-02T04:04:27.989 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6100 2024-06-02T04:04:27.989 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6100_vm 2024-06-02T04:04:27.989 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6114 2024-06-02T04:04:27.989 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6115 2024-06-02T04:04:27.989 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 pg_control 2024-06-02T04:04:27.989 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jun 2 04:04 pg_filenode.map 2024-06-02T04:04:27.989 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:27.990 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/log: 2024-06-02T04:04:27.990 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:04:27.990 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 . 2024-06-02T04:04:27.990 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 04:04 .. 2024-06-02T04:04:27.990 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:27.990 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-06-02T04:04:27.990 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:04:27.990 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 . 2024-06-02T04:04:27.990 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 04:04 .. 2024-06-02T04:04:27.990 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:27.990 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-06-02T04:04:27.990 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:04:27.990 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 . 2024-06-02T04:04:27.991 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 04:04 .. 2024-06-02T04:04:27.991 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:27.991 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-06-02T04:04:27.991 INFO:teuthology.orchestra.run.smithi123.stdout:total 1 2024-06-02T04:04:27.991 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 04:04 . 2024-06-02T04:04:27.991 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 04:04 .. 2024-06-02T04:04:27.991 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 mappings 2024-06-02T04:04:27.991 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jun 2 04:04 replorigin_checkpoint 2024-06-02T04:04:27.991 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 snapshots 2024-06-02T04:04:27.991 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:27.991 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-06-02T04:04:27.991 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:04:27.991 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 . 2024-06-02T04:04:27.991 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 04:04 .. 2024-06-02T04:04:27.992 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:27.992 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-06-02T04:04:27.992 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:04:27.992 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 . 2024-06-02T04:04:27.992 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 04:04 .. 2024-06-02T04:04:27.992 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:27.992 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-06-02T04:04:27.992 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:04:27.992 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Jun 2 04:04 . 2024-06-02T04:04:27.992 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 04:04 .. 2024-06-02T04:04:27.992 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 04:04 members 2024-06-02T04:04:27.992 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 04:04 offsets 2024-06-02T04:04:27.992 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:27.993 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-06-02T04:04:27.993 INFO:teuthology.orchestra.run.smithi123.stdout:total 8 2024-06-02T04:04:27.993 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 04:04 . 2024-06-02T04:04:27.993 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Jun 2 04:04 .. 2024-06-02T04:04:27.993 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 0000 2024-06-02T04:04:27.993 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:27.993 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-06-02T04:04:27.993 INFO:teuthology.orchestra.run.smithi123.stdout:total 8 2024-06-02T04:04:27.993 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 04:04 . 2024-06-02T04:04:27.993 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Jun 2 04:04 .. 2024-06-02T04:04:27.993 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 0000 2024-06-02T04:04:27.994 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:27.994 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-06-02T04:04:27.994 INFO:teuthology.orchestra.run.smithi123.stdout:total 8 2024-06-02T04:04:27.994 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 04:04 . 2024-06-02T04:04:27.994 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 04:04 .. 2024-06-02T04:04:27.994 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 0000 2024-06-02T04:04:27.994 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:27.994 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-06-02T04:04:27.994 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:04:27.994 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 . 2024-06-02T04:04:27.994 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 04:04 .. 2024-06-02T04:04:27.994 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:27.994 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-06-02T04:04:27.994 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:04:27.995 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 . 2024-06-02T04:04:27.995 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 04:04 .. 2024-06-02T04:04:27.995 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:27.995 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-06-02T04:04:27.995 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:04:27.995 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 . 2024-06-02T04:04:27.995 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 04:04 .. 2024-06-02T04:04:27.995 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:27.995 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-06-02T04:04:27.995 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:04:27.995 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 . 2024-06-02T04:04:27.995 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 04:04 .. 2024-06-02T04:04:27.995 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:27.995 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-06-02T04:04:27.995 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:04:27.996 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 . 2024-06-02T04:04:27.996 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 04:04 .. 2024-06-02T04:04:27.996 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:27.996 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-06-02T04:04:27.996 INFO:teuthology.orchestra.run.smithi123.stdout:total 8 2024-06-02T04:04:27.996 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 04:04 . 2024-06-02T04:04:27.996 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 04:04 .. 2024-06-02T04:04:27.996 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 0000 2024-06-02T04:04:27.996 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:27.996 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-06-02T04:04:27.996 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:04:27.996 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 . 2024-06-02T04:04:27.996 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 04:04 .. 2024-06-02T04:04:27.996 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:27.996 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-06-02T04:04:27.997 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:04:27.997 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 . 2024-06-02T04:04:27.997 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 04:04 .. 2024-06-02T04:04:27.997 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:27.997 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-06-02T04:04:27.997 INFO:teuthology.orchestra.run.smithi123.stdout:total 16384 2024-06-02T04:04:27.997 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Jun 2 04:04 . 2024-06-02T04:04:27.997 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 04:04 .. 2024-06-02T04:04:27.997 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:04 000000010000000000000001 2024-06-02T04:04:27.997 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 archive_status 2024-06-02T04:04:27.997 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:27.997 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-06-02T04:04:27.997 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:04:27.997 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 . 2024-06-02T04:04:27.997 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Jun 2 04:04 .. 2024-06-02T04:04:27.998 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:04:27.998 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-06-02T04:04:27.998 INFO:teuthology.orchestra.run.smithi123.stdout:total 8 2024-06-02T04:04:27.998 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 04:04 . 2024-06-02T04:04:27.998 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Jun 2 04:04 .. 2024-06-02T04:04:27.998 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 0000 2024-06-02T04:04:27.998 DEBUG:teuthology.orchestra.run.smithi123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2024-06-02T04:04:28.115 DEBUG:teuthology.orchestra.run.smithi123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 32 -i' 2024-06-02T04:04:28.138 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:28 smithi123 ceph-mon[42885]: pgmap v264: 97 pgs: 97 active+clean; 745 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-06-02T04:04:28.160 INFO:teuthology.orchestra.run.smithi123.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2024-06-02T04:04:28.164 INFO:teuthology.orchestra.run.smithi123.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2024-06-02T04:04:28.167 INFO:teuthology.orchestra.run.smithi123.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2024-06-02T04:04:28.170 INFO:teuthology.orchestra.run.smithi123.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2024-06-02T04:04:28.187 INFO:teuthology.orchestra.run.smithi123.stderr:creating tables... 2024-06-02T04:04:28.246 INFO:teuthology.orchestra.run.smithi123.stderr:100000 of 3200000 tuples (3%) done (elapsed 0.06 s, remaining 1.77 s) 2024-06-02T04:04:28.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:28 smithi162 ceph-mon[47009]: pgmap v264: 97 pgs: 97 active+clean; 745 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-06-02T04:04:28.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:28 smithi136 ceph-mon[47443]: pgmap v264: 97 pgs: 97 active+clean; 745 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-06-02T04:04:28.407 INFO:teuthology.orchestra.run.smithi123.stderr:200000 of 3200000 tuples (6%) done (elapsed 0.22 s, remaining 3.27 s) 2024-06-02T04:04:28.562 INFO:teuthology.orchestra.run.smithi123.stderr:300000 of 3200000 tuples (9%) done (elapsed 0.37 s, remaining 3.61 s) 2024-06-02T04:04:28.641 INFO:teuthology.orchestra.run.smithi123.stderr:400000 of 3200000 tuples (12%) done (elapsed 0.45 s, remaining 3.16 s) 2024-06-02T04:04:28.816 INFO:teuthology.orchestra.run.smithi123.stderr:500000 of 3200000 tuples (15%) done (elapsed 0.63 s, remaining 3.39 s) 2024-06-02T04:04:28.984 INFO:teuthology.orchestra.run.smithi123.stderr:600000 of 3200000 tuples (18%) done (elapsed 0.80 s, remaining 3.45 s) 2024-06-02T04:04:29.059 INFO:teuthology.orchestra.run.smithi123.stderr:700000 of 3200000 tuples (21%) done (elapsed 0.87 s, remaining 3.11 s) 2024-06-02T04:04:29.213 INFO:teuthology.orchestra.run.smithi123.stderr:800000 of 3200000 tuples (25%) done (elapsed 1.02 s, remaining 3.07 s) 2024-06-02T04:04:29.386 INFO:teuthology.orchestra.run.smithi123.stderr:900000 of 3200000 tuples (28%) done (elapsed 1.20 s, remaining 3.06 s) 2024-06-02T04:04:29.470 INFO:teuthology.orchestra.run.smithi123.stderr:1000000 of 3200000 tuples (31%) done (elapsed 1.28 s, remaining 2.82 s) 2024-06-02T04:04:29.615 INFO:teuthology.orchestra.run.smithi123.stderr:1100000 of 3200000 tuples (34%) done (elapsed 1.43 s, remaining 2.72 s) 2024-06-02T04:04:29.705 INFO:teuthology.orchestra.run.smithi123.stderr:1200000 of 3200000 tuples (37%) done (elapsed 1.52 s, remaining 2.53 s) 2024-06-02T04:04:29.851 INFO:teuthology.orchestra.run.smithi123.stderr:1300000 of 3200000 tuples (40%) done (elapsed 1.66 s, remaining 2.43 s) 2024-06-02T04:04:30.027 INFO:teuthology.orchestra.run.smithi123.stderr:1400000 of 3200000 tuples (43%) done (elapsed 1.84 s, remaining 2.36 s) 2024-06-02T04:04:30.115 INFO:teuthology.orchestra.run.smithi123.stderr:1500000 of 3200000 tuples (46%) done (elapsed 1.93 s, remaining 2.18 s) 2024-06-02T04:04:30.260 INFO:teuthology.orchestra.run.smithi123.stderr:1600000 of 3200000 tuples (50%) done (elapsed 2.07 s, remaining 2.07 s) 2024-06-02T04:04:30.297 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:30 smithi162 ceph-mon[47009]: pgmap v265: 97 pgs: 97 active+clean; 9.1 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 760 KiB/s wr, 56 op/s 2024-06-02T04:04:30.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:30 smithi123 ceph-mon[42885]: pgmap v265: 97 pgs: 97 active+clean; 9.1 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 760 KiB/s wr, 56 op/s 2024-06-02T04:04:30.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:30 smithi136 ceph-mon[47443]: pgmap v265: 97 pgs: 97 active+clean; 9.1 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 760 KiB/s wr, 56 op/s 2024-06-02T04:04:30.358 INFO:teuthology.orchestra.run.smithi123.stderr:1700000 of 3200000 tuples (53%) done (elapsed 2.17 s, remaining 1.91 s) 2024-06-02T04:04:30.541 INFO:teuthology.orchestra.run.smithi123.stderr:1800000 of 3200000 tuples (56%) done (elapsed 2.35 s, remaining 1.83 s) 2024-06-02T04:04:30.672 INFO:teuthology.orchestra.run.smithi123.stderr:1900000 of 3200000 tuples (59%) done (elapsed 2.48 s, remaining 1.70 s) 2024-06-02T04:04:30.763 INFO:teuthology.orchestra.run.smithi123.stderr:2000000 of 3200000 tuples (62%) done (elapsed 2.57 s, remaining 1.54 s) 2024-06-02T04:04:30.908 INFO:teuthology.orchestra.run.smithi123.stderr:2100000 of 3200000 tuples (65%) done (elapsed 2.72 s, remaining 1.42 s) 2024-06-02T04:04:31.081 INFO:teuthology.orchestra.run.smithi123.stderr:2200000 of 3200000 tuples (68%) done (elapsed 2.89 s, remaining 1.31 s) 2024-06-02T04:04:31.178 INFO:teuthology.orchestra.run.smithi123.stderr:2300000 of 3200000 tuples (71%) done (elapsed 2.99 s, remaining 1.17 s) 2024-06-02T04:04:31.310 INFO:teuthology.orchestra.run.smithi123.stderr:2400000 of 3200000 tuples (75%) done (elapsed 3.12 s, remaining 1.04 s) 2024-06-02T04:04:31.471 INFO:teuthology.orchestra.run.smithi123.stderr:2500000 of 3200000 tuples (78%) done (elapsed 3.28 s, remaining 0.92 s) 2024-06-02T04:04:31.572 INFO:teuthology.orchestra.run.smithi123.stderr:2600000 of 3200000 tuples (81%) done (elapsed 3.38 s, remaining 0.78 s) 2024-06-02T04:04:31.708 INFO:teuthology.orchestra.run.smithi123.stderr:2700000 of 3200000 tuples (84%) done (elapsed 3.52 s, remaining 0.65 s) 2024-06-02T04:04:31.800 INFO:teuthology.orchestra.run.smithi123.stderr:2800000 of 3200000 tuples (87%) done (elapsed 3.61 s, remaining 0.52 s) 2024-06-02T04:04:31.956 INFO:teuthology.orchestra.run.smithi123.stderr:2900000 of 3200000 tuples (90%) done (elapsed 3.77 s, remaining 0.39 s) 2024-06-02T04:04:32.092 INFO:teuthology.orchestra.run.smithi123.stderr:3000000 of 3200000 tuples (93%) done (elapsed 3.90 s, remaining 0.26 s) 2024-06-02T04:04:32.201 INFO:teuthology.orchestra.run.smithi123.stderr:3100000 of 3200000 tuples (96%) done (elapsed 4.01 s, remaining 0.13 s) 2024-06-02T04:04:32.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:32 smithi162 ceph-mon[47009]: pgmap v266: 97 pgs: 97 active+clean; 60 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 7.6 MiB/s wr, 96 op/s 2024-06-02T04:04:32.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:32 smithi123 ceph-mon[42885]: pgmap v266: 97 pgs: 97 active+clean; 60 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 7.6 MiB/s wr, 96 op/s 2024-06-02T04:04:32.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:32 smithi136 ceph-mon[47443]: pgmap v266: 97 pgs: 97 active+clean; 60 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 7.6 MiB/s wr, 96 op/s 2024-06-02T04:04:32.351 INFO:teuthology.orchestra.run.smithi123.stderr:3200000 of 3200000 tuples (100%) done (elapsed 4.16 s, remaining 0.00 s) 2024-06-02T04:04:32.362 INFO:teuthology.orchestra.run.smithi123.stderr:vacuum... 2024-06-02T04:04:32.957 INFO:teuthology.orchestra.run.smithi123.stderr:set primary keys... 2024-06-02T04:04:34.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:34 smithi162 ceph-mon[47009]: pgmap v267: 97 pgs: 97 active+clean; 155 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 23 MiB/s wr, 118 op/s 2024-06-02T04:04:34.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:34 smithi123 ceph-mon[42885]: pgmap v267: 97 pgs: 97 active+clean; 155 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 23 MiB/s wr, 118 op/s 2024-06-02T04:04:34.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:34 smithi136 ceph-mon[47443]: pgmap v267: 97 pgs: 97 active+clean; 155 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 23 MiB/s wr, 118 op/s 2024-06-02T04:04:34.389 INFO:teuthology.orchestra.run.smithi123.stderr:done. 2024-06-02T04:04:34.391 DEBUG:teuthology.orchestra.run.smithi123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2024-06-02T04:04:34.488 INFO:teuthology.orchestra.run.smithi123.stderr:starting vacuum...end. 2024-06-02T04:04:36.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:36 smithi162 ceph-mon[47009]: pgmap v268: 97 pgs: 97 active+clean; 359 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 57 MiB/s wr, 150 op/s 2024-06-02T04:04:36.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:36 smithi123 ceph-mon[42885]: pgmap v268: 97 pgs: 97 active+clean; 359 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 57 MiB/s wr, 150 op/s 2024-06-02T04:04:36.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:36 smithi136 ceph-mon[47443]: pgmap v268: 97 pgs: 97 active+clean; 359 MiB data, 518 MiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 57 MiB/s wr, 150 op/s 2024-06-02T04:04:38.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:38 smithi162 ceph-mon[47009]: pgmap v269: 97 pgs: 97 active+clean; 553 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 71 MiB/s wr, 184 op/s 2024-06-02T04:04:38.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:38 smithi123 ceph-mon[42885]: pgmap v269: 97 pgs: 97 active+clean; 553 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 71 MiB/s wr, 184 op/s 2024-06-02T04:04:38.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:38 smithi136 ceph-mon[47443]: pgmap v269: 97 pgs: 97 active+clean; 553 MiB data, 615 MiB used, 1.0 TiB / 1.0 TiB avail; 375 KiB/s rd, 71 MiB/s wr, 184 op/s 2024-06-02T04:04:39.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 5.0 s, 3922.9 tps, lat 25.140 ms stddev 30.428 2024-06-02T04:04:40.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:40 smithi123 ceph-mon[42885]: pgmap v270: 97 pgs: 97 active+clean; 656 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 78 MiB/s wr, 215 op/s 2024-06-02T04:04:40.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:40 smithi136 ceph-mon[47443]: pgmap v270: 97 pgs: 97 active+clean; 656 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 78 MiB/s wr, 215 op/s 2024-06-02T04:04:40.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:40 smithi162 ceph-mon[47009]: pgmap v270: 97 pgs: 97 active+clean; 656 MiB data, 679 MiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 78 MiB/s wr, 215 op/s 2024-06-02T04:04:42.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:42 smithi123 ceph-mon[42885]: pgmap v271: 97 pgs: 97 active+clean; 1.0 GiB data, 826 MiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 102 MiB/s wr, 443 op/s 2024-06-02T04:04:42.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:42 smithi136 ceph-mon[47443]: pgmap v271: 97 pgs: 97 active+clean; 1.0 GiB data, 826 MiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 102 MiB/s wr, 443 op/s 2024-06-02T04:04:42.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:42 smithi162 ceph-mon[47009]: pgmap v271: 97 pgs: 97 active+clean; 1.0 GiB data, 826 MiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 102 MiB/s wr, 443 op/s 2024-06-02T04:04:44.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:44 smithi123 ceph-mon[42885]: pgmap v272: 97 pgs: 97 active+clean; 1.1 GiB data, 956 MiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 114 MiB/s wr, 624 op/s 2024-06-02T04:04:44.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:44 smithi136 ceph-mon[47443]: pgmap v272: 97 pgs: 97 active+clean; 1.1 GiB data, 956 MiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 114 MiB/s wr, 624 op/s 2024-06-02T04:04:44.490 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 10.0 s, 4531.8 tps, lat 22.032 ms stddev 34.203 2024-06-02T04:04:44.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:44 smithi162 ceph-mon[47009]: pgmap v272: 97 pgs: 97 active+clean; 1.1 GiB data, 956 MiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 114 MiB/s wr, 624 op/s 2024-06-02T04:04:46.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:46 smithi123 ceph-mon[42885]: pgmap v273: 97 pgs: 97 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 130 MiB/s wr, 920 op/s 2024-06-02T04:04:46.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:46 smithi136 ceph-mon[47443]: pgmap v273: 97 pgs: 97 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 130 MiB/s wr, 920 op/s 2024-06-02T04:04:46.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:46 smithi162 ceph-mon[47009]: pgmap v273: 97 pgs: 97 active+clean; 1.1 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 230 KiB/s rd, 130 MiB/s wr, 920 op/s 2024-06-02T04:04:48.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:48 smithi123 ceph-mon[42885]: pgmap v274: 97 pgs: 97 active+clean; 1.2 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 105 MiB/s wr, 1.02k op/s 2024-06-02T04:04:48.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:48 smithi136 ceph-mon[47443]: pgmap v274: 97 pgs: 97 active+clean; 1.2 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 105 MiB/s wr, 1.02k op/s 2024-06-02T04:04:48.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:48 smithi162 ceph-mon[47009]: pgmap v274: 97 pgs: 97 active+clean; 1.2 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 105 MiB/s wr, 1.02k op/s 2024-06-02T04:04:49.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 15.0 s, 5298.7 tps, lat 18.924 ms stddev 20.959 2024-06-02T04:04:50.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:50 smithi123 ceph-mon[42885]: pgmap v275: 97 pgs: 97 active+clean; 1.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 96 MiB/s wr, 1.07k op/s 2024-06-02T04:04:50.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:50 smithi136 ceph-mon[47443]: pgmap v275: 97 pgs: 97 active+clean; 1.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 96 MiB/s wr, 1.07k op/s 2024-06-02T04:04:50.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:50 smithi162 ceph-mon[47009]: pgmap v275: 97 pgs: 97 active+clean; 1.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 96 MiB/s wr, 1.07k op/s 2024-06-02T04:04:52.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:52 smithi123 ceph-mon[42885]: pgmap v276: 97 pgs: 97 active+clean; 1.3 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 102 MiB/s wr, 1.29k op/s 2024-06-02T04:04:52.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:52 smithi136 ceph-mon[47443]: pgmap v276: 97 pgs: 97 active+clean; 1.3 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 102 MiB/s wr, 1.29k op/s 2024-06-02T04:04:52.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:52 smithi162 ceph-mon[47009]: pgmap v276: 97 pgs: 97 active+clean; 1.3 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 102 MiB/s wr, 1.29k op/s 2024-06-02T04:04:54.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:54 smithi136 ceph-mon[47443]: pgmap v277: 97 pgs: 97 active+clean; 1.3 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 84 MiB/s wr, 1.20k op/s 2024-06-02T04:04:54.488 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 20.0 s, 4048.8 tps, lat 24.609 ms stddev 29.814 2024-06-02T04:04:54.550 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:54 smithi162 ceph-mon[47009]: pgmap v277: 97 pgs: 97 active+clean; 1.3 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 84 MiB/s wr, 1.20k op/s 2024-06-02T04:04:54.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:54 smithi123 ceph-mon[42885]: pgmap v277: 97 pgs: 97 active+clean; 1.3 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 84 MiB/s wr, 1.20k op/s 2024-06-02T04:04:56.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:56 smithi136 ceph-mon[47443]: pgmap v278: 97 pgs: 97 active+clean; 1.4 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 83 MiB/s wr, 1.33k op/s 2024-06-02T04:04:56.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:56 smithi162 ceph-mon[47009]: pgmap v278: 97 pgs: 97 active+clean; 1.4 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 83 MiB/s wr, 1.33k op/s 2024-06-02T04:04:56.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:56 smithi123 ceph-mon[42885]: pgmap v278: 97 pgs: 97 active+clean; 1.4 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 83 MiB/s wr, 1.33k op/s 2024-06-02T04:04:57.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:57 smithi162 ceph-mon[47009]: pgmap v279: 97 pgs: 97 active+clean; 1.4 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 62 MiB/s wr, 1.28k op/s 2024-06-02T04:04:57.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:57 smithi123 ceph-mon[42885]: pgmap v279: 97 pgs: 97 active+clean; 1.4 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 62 MiB/s wr, 1.28k op/s 2024-06-02T04:04:57.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:57 smithi136 ceph-mon[47443]: pgmap v279: 97 pgs: 97 active+clean; 1.4 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 62 MiB/s wr, 1.28k op/s 2024-06-02T04:04:59.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 25.0 s, 3838.6 tps, lat 26.140 ms stddev 49.834 2024-06-02T04:05:00.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:04:59 smithi162 ceph-mon[47009]: pgmap v280: 97 pgs: 97 active+clean; 1.4 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 59 MiB/s wr, 1.35k op/s 2024-06-02T04:05:00.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:04:59 smithi123 ceph-mon[42885]: pgmap v280: 97 pgs: 97 active+clean; 1.4 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 59 MiB/s wr, 1.35k op/s 2024-06-02T04:05:00.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:04:59 smithi136 ceph-mon[47443]: pgmap v280: 97 pgs: 97 active+clean; 1.4 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 59 MiB/s wr, 1.35k op/s 2024-06-02T04:05:02.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:01 smithi162 ceph-mon[47009]: pgmap v281: 97 pgs: 97 active+clean; 1.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 81 MiB/s wr, 2.25k op/s 2024-06-02T04:05:02.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:01 smithi123 ceph-mon[42885]: pgmap v281: 97 pgs: 97 active+clean; 1.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 81 MiB/s wr, 2.25k op/s 2024-06-02T04:05:02.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:01 smithi136 ceph-mon[47443]: pgmap v281: 97 pgs: 97 active+clean; 1.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 81 MiB/s wr, 2.25k op/s 2024-06-02T04:05:04.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:03 smithi162 ceph-mon[47009]: pgmap v282: 97 pgs: 97 active+clean; 1.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 79 MiB/s wr, 2.47k op/s 2024-06-02T04:05:04.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:03 smithi123 ceph-mon[42885]: pgmap v282: 97 pgs: 97 active+clean; 1.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 79 MiB/s wr, 2.47k op/s 2024-06-02T04:05:04.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:03 smithi136 ceph-mon[47443]: pgmap v282: 97 pgs: 97 active+clean; 1.5 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 79 MiB/s wr, 2.47k op/s 2024-06-02T04:05:04.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 30.0 s, 5081.1 tps, lat 19.659 ms stddev 21.987 2024-06-02T04:05:06.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:05 smithi162 ceph-mon[47009]: pgmap v283: 97 pgs: 97 active+clean; 1.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 78 MiB/s wr, 2.54k op/s 2024-06-02T04:05:06.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:05 smithi123 ceph-mon[42885]: pgmap v283: 97 pgs: 97 active+clean; 1.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 78 MiB/s wr, 2.54k op/s 2024-06-02T04:05:06.337 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:05 smithi136 ceph-mon[47443]: pgmap v283: 97 pgs: 97 active+clean; 1.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 78 MiB/s wr, 2.54k op/s 2024-06-02T04:05:08.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:07 smithi162 ceph-mon[47009]: pgmap v284: 97 pgs: 97 active+clean; 1.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 65 MiB/s wr, 2.44k op/s 2024-06-02T04:05:08.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:07 smithi123 ceph-mon[42885]: pgmap v284: 97 pgs: 97 active+clean; 1.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 65 MiB/s wr, 2.44k op/s 2024-06-02T04:05:08.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:07 smithi136 ceph-mon[47443]: pgmap v284: 97 pgs: 97 active+clean; 1.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 65 MiB/s wr, 2.44k op/s 2024-06-02T04:05:09.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:08 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:05:09.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:08 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:05:09.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:08 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:05:09.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 35.0 s, 4405.4 tps, lat 22.534 ms stddev 30.018 2024-06-02T04:05:10.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:09 smithi162 ceph-mon[47009]: pgmap v285: 97 pgs: 97 active+clean; 1.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 58 MiB/s wr, 2.30k op/s 2024-06-02T04:05:10.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:09 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:05:10.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:09 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:05:10.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:09 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:05:10.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:09 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:05:10.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:09 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:05:10.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:09 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:05:10.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:09 smithi123 ceph-mon[42885]: pgmap v285: 97 pgs: 97 active+clean; 1.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 58 MiB/s wr, 2.30k op/s 2024-06-02T04:05:10.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:09 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:05:10.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:09 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:05:10.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:09 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:05:10.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:09 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:05:10.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:09 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:05:10.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:09 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:05:10.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:09 smithi136 ceph-mon[47443]: pgmap v285: 97 pgs: 97 active+clean; 1.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 58 MiB/s wr, 2.30k op/s 2024-06-02T04:05:10.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:09 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:05:10.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:09 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:05:10.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:09 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:05:10.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:09 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:05:10.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:09 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:05:10.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:09 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:05:11.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:10 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:05:11.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:10 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:05:11.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:10 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:05:11.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:10 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:05:11.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:10 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:05:11.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:10 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:05:11.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:10 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:05:11.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:10 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:05:11.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:10 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:05:12.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:11 smithi162 ceph-mon[47009]: pgmap v286: 97 pgs: 97 active+clean; 1.5 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 63 MiB/s wr, 2.44k op/s 2024-06-02T04:05:12.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:11 smithi123 ceph-mon[42885]: pgmap v286: 97 pgs: 97 active+clean; 1.5 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 63 MiB/s wr, 2.44k op/s 2024-06-02T04:05:12.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:11 smithi136 ceph-mon[47443]: pgmap v286: 97 pgs: 97 active+clean; 1.5 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 63 MiB/s wr, 2.44k op/s 2024-06-02T04:05:14.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:13 smithi162 ceph-mon[47009]: pgmap v287: 97 pgs: 97 active+clean; 1.5 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 42 MiB/s wr, 1.68k op/s 2024-06-02T04:05:14.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:13 smithi123 ceph-mon[42885]: pgmap v287: 97 pgs: 97 active+clean; 1.5 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 42 MiB/s wr, 1.68k op/s 2024-06-02T04:05:14.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:13 smithi136 ceph-mon[47443]: pgmap v287: 97 pgs: 97 active+clean; 1.5 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 42 MiB/s wr, 1.68k op/s 2024-06-02T04:05:14.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 40.0 s, 4407.2 tps, lat 22.810 ms stddev 26.004 2024-06-02T04:05:16.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:15 smithi162 ceph-mon[47009]: pgmap v288: 97 pgs: 97 active+clean; 1.5 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 42 MiB/s wr, 1.49k op/s 2024-06-02T04:05:16.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:15 smithi123 ceph-mon[42885]: pgmap v288: 97 pgs: 97 active+clean; 1.5 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 42 MiB/s wr, 1.49k op/s 2024-06-02T04:05:16.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:15 smithi136 ceph-mon[47443]: pgmap v288: 97 pgs: 97 active+clean; 1.5 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 42 MiB/s wr, 1.49k op/s 2024-06-02T04:05:18.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:17 smithi162 ceph-mon[47009]: pgmap v289: 97 pgs: 97 active+clean; 1.5 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 48 MiB/s wr, 1.75k op/s 2024-06-02T04:05:18.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:17 smithi123 ceph-mon[42885]: pgmap v289: 97 pgs: 97 active+clean; 1.5 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 48 MiB/s wr, 1.75k op/s 2024-06-02T04:05:18.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:17 smithi136 ceph-mon[47443]: pgmap v289: 97 pgs: 97 active+clean; 1.5 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 48 MiB/s wr, 1.75k op/s 2024-06-02T04:05:19.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 45.0 s, 4311.1 tps, lat 23.268 ms stddev 47.182 2024-06-02T04:05:20.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:19 smithi162 ceph-mon[47009]: pgmap v290: 97 pgs: 97 active+clean; 1.5 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 48 MiB/s wr, 1.75k op/s 2024-06-02T04:05:20.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:19 smithi123 ceph-mon[42885]: pgmap v290: 97 pgs: 97 active+clean; 1.5 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 48 MiB/s wr, 1.75k op/s 2024-06-02T04:05:20.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:19 smithi136 ceph-mon[47443]: pgmap v290: 97 pgs: 97 active+clean; 1.5 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 48 MiB/s wr, 1.75k op/s 2024-06-02T04:05:22.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:21 smithi162 ceph-mon[47009]: pgmap v291: 97 pgs: 97 active+clean; 1.5 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 66 MiB/s wr, 2.49k op/s 2024-06-02T04:05:22.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:21 smithi123 ceph-mon[42885]: pgmap v291: 97 pgs: 97 active+clean; 1.5 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 66 MiB/s wr, 2.49k op/s 2024-06-02T04:05:22.343 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:21 smithi136 ceph-mon[47443]: pgmap v291: 97 pgs: 97 active+clean; 1.5 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 66 MiB/s wr, 2.49k op/s 2024-06-02T04:05:24.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:23 smithi162 ceph-mon[47009]: pgmap v292: 97 pgs: 97 active+clean; 1.5 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 57 MiB/s wr, 2.25k op/s 2024-06-02T04:05:24.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:23 smithi123 ceph-mon[42885]: pgmap v292: 97 pgs: 97 active+clean; 1.5 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 57 MiB/s wr, 2.25k op/s 2024-06-02T04:05:24.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:23 smithi136 ceph-mon[47443]: pgmap v292: 97 pgs: 97 active+clean; 1.5 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 57 MiB/s wr, 2.25k op/s 2024-06-02T04:05:24.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 50.0 s, 5191.5 tps, lat 19.261 ms stddev 21.358 2024-06-02T04:05:26.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:25 smithi162 ceph-mon[47009]: pgmap v293: 97 pgs: 97 active+clean; 1.5 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 56 MiB/s wr, 2.23k op/s 2024-06-02T04:05:26.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:25 smithi123 ceph-mon[42885]: pgmap v293: 97 pgs: 97 active+clean; 1.5 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 56 MiB/s wr, 2.23k op/s 2024-06-02T04:05:26.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:25 smithi136 ceph-mon[47443]: pgmap v293: 97 pgs: 97 active+clean; 1.5 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 56 MiB/s wr, 2.23k op/s 2024-06-02T04:05:28.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:28 smithi162 ceph-mon[47009]: pgmap v294: 97 pgs: 97 active+clean; 1.5 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 49 MiB/s wr, 2.08k op/s 2024-06-02T04:05:28.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:28 smithi123 ceph-mon[42885]: pgmap v294: 97 pgs: 97 active+clean; 1.5 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 49 MiB/s wr, 2.08k op/s 2024-06-02T04:05:28.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:28 smithi136 ceph-mon[47443]: pgmap v294: 97 pgs: 97 active+clean; 1.5 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 49 MiB/s wr, 2.08k op/s 2024-06-02T04:05:29.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 55.0 s, 4337.5 tps, lat 23.017 ms stddev 25.864 2024-06-02T04:05:30.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:30 smithi162 ceph-mon[47009]: pgmap v295: 97 pgs: 97 active+clean; 1.5 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 MiB/s wr, 1.64k op/s 2024-06-02T04:05:30.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:30 smithi123 ceph-mon[42885]: pgmap v295: 97 pgs: 97 active+clean; 1.5 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 MiB/s wr, 1.64k op/s 2024-06-02T04:05:30.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:30 smithi136 ceph-mon[47443]: pgmap v295: 97 pgs: 97 active+clean; 1.5 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 39 MiB/s wr, 1.64k op/s 2024-06-02T04:05:32.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:32 smithi162 ceph-mon[47009]: pgmap v296: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 38 MiB/s wr, 1.65k op/s 2024-06-02T04:05:32.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:32 smithi123 ceph-mon[42885]: pgmap v296: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 38 MiB/s wr, 1.65k op/s 2024-06-02T04:05:32.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:32 smithi136 ceph-mon[47443]: pgmap v296: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 38 MiB/s wr, 1.65k op/s 2024-06-02T04:05:34.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:34 smithi162 ceph-mon[47009]: pgmap v297: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 MiB/s wr, 951 op/s 2024-06-02T04:05:34.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:34 smithi123 ceph-mon[42885]: pgmap v297: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 MiB/s wr, 951 op/s 2024-06-02T04:05:34.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:34 smithi136 ceph-mon[47443]: pgmap v297: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 MiB/s wr, 951 op/s 2024-06-02T04:05:34.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 60.0 s, 4359.4 tps, lat 22.848 ms stddev 24.144 2024-06-02T04:05:36.325 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:36 smithi123 ceph-mon[42885]: pgmap v298: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 29 MiB/s wr, 1.14k op/s 2024-06-02T04:05:36.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:36 smithi136 ceph-mon[47443]: pgmap v298: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 29 MiB/s wr, 1.14k op/s 2024-06-02T04:05:36.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:36 smithi162 ceph-mon[47009]: pgmap v298: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 29 MiB/s wr, 1.14k op/s 2024-06-02T04:05:38.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:38 smithi136 ceph-mon[47443]: pgmap v299: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 34 MiB/s wr, 1.36k op/s 2024-06-02T04:05:38.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:38 smithi162 ceph-mon[47009]: pgmap v299: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 34 MiB/s wr, 1.36k op/s 2024-06-02T04:05:38.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:38 smithi123 ceph-mon[42885]: pgmap v299: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 34 MiB/s wr, 1.36k op/s 2024-06-02T04:05:39.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:39 smithi136 ceph-mon[47443]: mgrmap e18: x(active, since 7m), standbys: z, y 2024-06-02T04:05:39.488 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 65.0 s, 3671.6 tps, lat 27.372 ms stddev 45.231 2024-06-02T04:05:39.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:39 smithi162 ceph-mon[47009]: mgrmap e18: x(active, since 7m), standbys: z, y 2024-06-02T04:05:39.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:39 smithi123 ceph-mon[42885]: mgrmap e18: x(active, since 7m), standbys: z, y 2024-06-02T04:05:40.343 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:40 smithi136 ceph-mon[47443]: pgmap v300: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 37 MiB/s wr, 1.49k op/s 2024-06-02T04:05:40.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:40 smithi162 ceph-mon[47009]: pgmap v300: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 37 MiB/s wr, 1.49k op/s 2024-06-02T04:05:40.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:40 smithi123 ceph-mon[42885]: pgmap v300: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 37 MiB/s wr, 1.49k op/s 2024-06-02T04:05:42.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:42 smithi136 ceph-mon[47443]: pgmap v301: 97 pgs: 97 active+clean; 1.5 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 59 MiB/s wr, 2.28k op/s 2024-06-02T04:05:42.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:42 smithi162 ceph-mon[47009]: pgmap v301: 97 pgs: 97 active+clean; 1.5 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 59 MiB/s wr, 2.28k op/s 2024-06-02T04:05:42.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:42 smithi123 ceph-mon[42885]: pgmap v301: 97 pgs: 97 active+clean; 1.5 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 203 KiB/s rd, 59 MiB/s wr, 2.28k op/s 2024-06-02T04:05:44.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 70.0 s, 4871.4 tps, lat 20.557 ms stddev 21.429 2024-06-02T04:05:44.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:44 smithi162 ceph-mon[47009]: pgmap v302: 97 pgs: 97 active+clean; 1.5 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 57 MiB/s wr, 2.13k op/s 2024-06-02T04:05:44.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:44 smithi123 ceph-mon[42885]: pgmap v302: 97 pgs: 97 active+clean; 1.5 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 57 MiB/s wr, 2.13k op/s 2024-06-02T04:05:44.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:44 smithi136 ceph-mon[47443]: pgmap v302: 97 pgs: 97 active+clean; 1.5 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 57 MiB/s wr, 2.13k op/s 2024-06-02T04:05:46.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:46 smithi162 ceph-mon[47009]: pgmap v303: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 59 MiB/s wr, 2.17k op/s 2024-06-02T04:05:46.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:46 smithi123 ceph-mon[42885]: pgmap v303: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 59 MiB/s wr, 2.17k op/s 2024-06-02T04:05:46.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:46 smithi136 ceph-mon[47443]: pgmap v303: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 59 MiB/s wr, 2.17k op/s 2024-06-02T04:05:48.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:48 smithi162 ceph-mon[47009]: pgmap v304: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 51 MiB/s wr, 1.99k op/s 2024-06-02T04:05:48.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:48 smithi123 ceph-mon[42885]: pgmap v304: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 51 MiB/s wr, 1.99k op/s 2024-06-02T04:05:48.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:48 smithi136 ceph-mon[47443]: pgmap v304: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 51 MiB/s wr, 1.99k op/s 2024-06-02T04:05:49.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 75.0 s, 4615.5 tps, lat 21.585 ms stddev 24.228 2024-06-02T04:05:50.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:50 smithi162 ceph-mon[47009]: pgmap v305: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 44 MiB/s wr, 1.65k op/s 2024-06-02T04:05:50.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:50 smithi123 ceph-mon[42885]: pgmap v305: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 44 MiB/s wr, 1.65k op/s 2024-06-02T04:05:50.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:50 smithi136 ceph-mon[47443]: pgmap v305: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 44 MiB/s wr, 1.65k op/s 2024-06-02T04:05:52.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:52 smithi162 ceph-mon[47009]: pgmap v306: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 43 MiB/s wr, 1.66k op/s 2024-06-02T04:05:52.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:52 smithi123 ceph-mon[42885]: pgmap v306: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 43 MiB/s wr, 1.66k op/s 2024-06-02T04:05:52.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:52 smithi136 ceph-mon[47443]: pgmap v306: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 43 MiB/s wr, 1.66k op/s 2024-06-02T04:05:54.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 80.0 s, 4249.1 tps, lat 23.605 ms stddev 24.893 2024-06-02T04:05:54.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:54 smithi162 ceph-mon[47009]: pgmap v307: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 23 MiB/s wr, 948 op/s 2024-06-02T04:05:54.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:54 smithi123 ceph-mon[42885]: pgmap v307: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 23 MiB/s wr, 948 op/s 2024-06-02T04:05:54.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:54 smithi136 ceph-mon[47443]: pgmap v307: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 23 MiB/s wr, 948 op/s 2024-06-02T04:05:55.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:55 smithi162 ceph-mon[47009]: pgmap v308: 97 pgs: 97 active+clean; 1.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 28 MiB/s wr, 1.11k op/s 2024-06-02T04:05:55.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:55 smithi123 ceph-mon[42885]: pgmap v308: 97 pgs: 97 active+clean; 1.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 28 MiB/s wr, 1.11k op/s 2024-06-02T04:05:55.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:55 smithi136 ceph-mon[47443]: pgmap v308: 97 pgs: 97 active+clean; 1.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 28 MiB/s wr, 1.11k op/s 2024-06-02T04:05:58.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:57 smithi162 ceph-mon[47009]: pgmap v309: 97 pgs: 97 active+clean; 1.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 27 MiB/s wr, 1.04k op/s 2024-06-02T04:05:58.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:57 smithi123 ceph-mon[42885]: pgmap v309: 97 pgs: 97 active+clean; 1.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 27 MiB/s wr, 1.04k op/s 2024-06-02T04:05:58.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:57 smithi136 ceph-mon[47443]: pgmap v309: 97 pgs: 97 active+clean; 1.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 27 MiB/s wr, 1.04k op/s 2024-06-02T04:05:59.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 85.0 s, 3662.0 tps, lat 27.303 ms stddev 56.512 2024-06-02T04:06:00.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:05:59 smithi162 ceph-mon[47009]: pgmap v310: 97 pgs: 97 active+clean; 1.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 34 MiB/s wr, 1.33k op/s 2024-06-02T04:06:00.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:05:59 smithi123 ceph-mon[42885]: pgmap v310: 97 pgs: 97 active+clean; 1.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 34 MiB/s wr, 1.33k op/s 2024-06-02T04:06:00.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:05:59 smithi136 ceph-mon[47443]: pgmap v310: 97 pgs: 97 active+clean; 1.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 34 MiB/s wr, 1.33k op/s 2024-06-02T04:06:02.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:01 smithi162 ceph-mon[47009]: pgmap v311: 97 pgs: 97 active+clean; 1.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 54 MiB/s wr, 2.15k op/s 2024-06-02T04:06:02.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:01 smithi123 ceph-mon[42885]: pgmap v311: 97 pgs: 97 active+clean; 1.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 54 MiB/s wr, 2.15k op/s 2024-06-02T04:06:02.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:01 smithi136 ceph-mon[47443]: pgmap v311: 97 pgs: 97 active+clean; 1.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 54 MiB/s wr, 2.15k op/s 2024-06-02T04:06:04.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:03 smithi162 ceph-mon[47009]: pgmap v312: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 53 MiB/s wr, 2.08k op/s 2024-06-02T04:06:04.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:03 smithi123 ceph-mon[42885]: pgmap v312: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 53 MiB/s wr, 2.08k op/s 2024-06-02T04:06:04.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:03 smithi136 ceph-mon[47443]: pgmap v312: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 53 MiB/s wr, 2.08k op/s 2024-06-02T04:06:04.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 90.0 s, 4667.6 tps, lat 21.360 ms stddev 21.597 2024-06-02T04:06:06.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:05 smithi162 ceph-mon[47009]: pgmap v313: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 57 MiB/s wr, 2.17k op/s 2024-06-02T04:06:06.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:05 smithi123 ceph-mon[42885]: pgmap v313: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 57 MiB/s wr, 2.17k op/s 2024-06-02T04:06:06.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:05 smithi136 ceph-mon[47443]: pgmap v313: 97 pgs: 97 active+clean; 1.5 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 57 MiB/s wr, 2.17k op/s 2024-06-02T04:06:08.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:07 smithi162 ceph-mon[47009]: pgmap v314: 97 pgs: 97 active+clean; 1.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 50 MiB/s wr, 2.00k op/s 2024-06-02T04:06:08.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:07 smithi123 ceph-mon[42885]: pgmap v314: 97 pgs: 97 active+clean; 1.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 50 MiB/s wr, 2.00k op/s 2024-06-02T04:06:08.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:07 smithi136 ceph-mon[47443]: pgmap v314: 97 pgs: 97 active+clean; 1.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 50 MiB/s wr, 2.00k op/s 2024-06-02T04:06:09.495 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 95.0 s, 4678.3 tps, lat 21.430 ms stddev 23.842 2024-06-02T04:06:10.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:09 smithi162 ceph-mon[47009]: pgmap v315: 97 pgs: 97 active+clean; 1.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 48 MiB/s wr, 2.01k op/s 2024-06-02T04:06:10.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:09 smithi123 ceph-mon[42885]: pgmap v315: 97 pgs: 97 active+clean; 1.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 48 MiB/s wr, 2.01k op/s 2024-06-02T04:06:10.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:09 smithi136 ceph-mon[47443]: pgmap v315: 97 pgs: 97 active+clean; 1.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 48 MiB/s wr, 2.01k op/s 2024-06-02T04:06:11.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:10 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:06:11.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:10 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:06:11.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:10 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:06:12.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:11 smithi162 ceph-mon[47009]: pgmap v316: 97 pgs: 97 active+clean; 1.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 44 MiB/s wr, 1.88k op/s 2024-06-02T04:06:12.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:11 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:06:12.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:11 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:06:12.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:11 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:06:12.327 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:11 smithi123 ceph-mon[42885]: pgmap v316: 97 pgs: 97 active+clean; 1.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 44 MiB/s wr, 1.88k op/s 2024-06-02T04:06:12.328 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:11 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:06:12.328 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:11 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:06:12.328 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:11 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:06:12.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:11 smithi136 ceph-mon[47443]: pgmap v316: 97 pgs: 97 active+clean; 1.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 44 MiB/s wr, 1.88k op/s 2024-06-02T04:06:12.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:11 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:06:12.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:11 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:06:12.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:11 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:06:14.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:13 smithi162 ceph-mon[47009]: pgmap v317: 97 pgs: 97 active+clean; 1.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 24 MiB/s wr, 1.12k op/s 2024-06-02T04:06:14.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:13 smithi123 ceph-mon[42885]: pgmap v317: 97 pgs: 97 active+clean; 1.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 24 MiB/s wr, 1.12k op/s 2024-06-02T04:06:14.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:13 smithi136 ceph-mon[47443]: pgmap v317: 97 pgs: 97 active+clean; 1.5 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 24 MiB/s wr, 1.12k op/s 2024-06-02T04:06:14.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 100.0 s, 3637.5 tps, lat 27.466 ms stddev 29.912 2024-06-02T04:06:16.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:15 smithi162 ceph-mon[47009]: pgmap v318: 97 pgs: 97 active+clean; 1.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 24 MiB/s wr, 1.18k op/s 2024-06-02T04:06:16.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:15 smithi123 ceph-mon[42885]: pgmap v318: 97 pgs: 97 active+clean; 1.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 24 MiB/s wr, 1.18k op/s 2024-06-02T04:06:16.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:15 smithi136 ceph-mon[47443]: pgmap v318: 97 pgs: 97 active+clean; 1.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 24 MiB/s wr, 1.18k op/s 2024-06-02T04:06:18.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:17 smithi162 ceph-mon[47009]: pgmap v319: 97 pgs: 97 active+clean; 1.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 MiB/s wr, 1.11k op/s 2024-06-02T04:06:18.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:17 smithi123 ceph-mon[42885]: pgmap v319: 97 pgs: 97 active+clean; 1.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 MiB/s wr, 1.11k op/s 2024-06-02T04:06:18.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:17 smithi136 ceph-mon[47443]: pgmap v319: 97 pgs: 97 active+clean; 1.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 22 MiB/s wr, 1.11k op/s 2024-06-02T04:06:19.488 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 105.0 s, 4024.4 tps, lat 24.877 ms stddev 26.770 2024-06-02T04:06:20.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:19 smithi162 ceph-mon[47009]: pgmap v320: 97 pgs: 97 active+clean; 1.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 1.12k op/s 2024-06-02T04:06:20.325 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:19 smithi123 ceph-mon[42885]: pgmap v320: 97 pgs: 97 active+clean; 1.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 1.12k op/s 2024-06-02T04:06:20.340 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:19 smithi136 ceph-mon[47443]: pgmap v320: 97 pgs: 97 active+clean; 1.5 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 1.12k op/s 2024-06-02T04:06:22.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:21 smithi162 ceph-mon[47009]: pgmap v321: 97 pgs: 97 active+clean; 1.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 30 MiB/s wr, 1.26k op/s 2024-06-02T04:06:22.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:21 smithi123 ceph-mon[42885]: pgmap v321: 97 pgs: 97 active+clean; 1.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 30 MiB/s wr, 1.26k op/s 2024-06-02T04:06:22.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:21 smithi136 ceph-mon[47443]: pgmap v321: 97 pgs: 97 active+clean; 1.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 30 MiB/s wr, 1.26k op/s 2024-06-02T04:06:24.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:23 smithi162 ceph-mon[47009]: pgmap v322: 97 pgs: 97 active+clean; 1.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 MiB/s wr, 1.38k op/s 2024-06-02T04:06:24.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:23 smithi123 ceph-mon[42885]: pgmap v322: 97 pgs: 97 active+clean; 1.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 MiB/s wr, 1.38k op/s 2024-06-02T04:06:24.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:23 smithi136 ceph-mon[47443]: pgmap v322: 97 pgs: 97 active+clean; 1.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 34 MiB/s wr, 1.38k op/s 2024-06-02T04:06:24.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 110.0 s, 3692.6 tps, lat 27.100 ms stddev 48.782 2024-06-02T04:06:26.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:25 smithi162 ceph-mon[47009]: pgmap v323: 97 pgs: 97 active+clean; 1.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 50 MiB/s wr, 1.98k op/s 2024-06-02T04:06:26.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:25 smithi123 ceph-mon[42885]: pgmap v323: 97 pgs: 97 active+clean; 1.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 50 MiB/s wr, 1.98k op/s 2024-06-02T04:06:26.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:26 smithi136 ceph-mon[47443]: pgmap v323: 97 pgs: 97 active+clean; 1.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 50 MiB/s wr, 1.98k op/s 2024-06-02T04:06:28.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:28 smithi162 ceph-mon[47009]: pgmap v324: 97 pgs: 97 active+clean; 1.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 51 MiB/s wr, 1.93k op/s 2024-06-02T04:06:28.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:28 smithi123 ceph-mon[42885]: pgmap v324: 97 pgs: 97 active+clean; 1.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 51 MiB/s wr, 1.93k op/s 2024-06-02T04:06:28.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:28 smithi136 ceph-mon[47443]: pgmap v324: 97 pgs: 97 active+clean; 1.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 51 MiB/s wr, 1.93k op/s 2024-06-02T04:06:29.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 115.0 s, 4269.2 tps, lat 23.381 ms stddev 26.469 2024-06-02T04:06:30.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:30 smithi162 ceph-mon[47009]: pgmap v325: 97 pgs: 97 active+clean; 1.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 50 MiB/s wr, 1.86k op/s 2024-06-02T04:06:30.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:30 smithi123 ceph-mon[42885]: pgmap v325: 97 pgs: 97 active+clean; 1.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 50 MiB/s wr, 1.86k op/s 2024-06-02T04:06:30.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:30 smithi136 ceph-mon[47443]: pgmap v325: 97 pgs: 97 active+clean; 1.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 50 MiB/s wr, 1.86k op/s 2024-06-02T04:06:32.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:32 smithi162 ceph-mon[47009]: pgmap v326: 97 pgs: 97 active+clean; 1.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 52 MiB/s wr, 1.98k op/s 2024-06-02T04:06:32.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:32 smithi123 ceph-mon[42885]: pgmap v326: 97 pgs: 97 active+clean; 1.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 52 MiB/s wr, 1.98k op/s 2024-06-02T04:06:32.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:32 smithi136 ceph-mon[47443]: pgmap v326: 97 pgs: 97 active+clean; 1.5 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 52 MiB/s wr, 1.98k op/s 2024-06-02T04:06:34.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:34 smithi123 ceph-mon[42885]: pgmap v327: 97 pgs: 97 active+clean; 1.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 45 MiB/s wr, 1.80k op/s 2024-06-02T04:06:34.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:34 smithi136 ceph-mon[47443]: pgmap v327: 97 pgs: 97 active+clean; 1.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 45 MiB/s wr, 1.80k op/s 2024-06-02T04:06:34.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 120.0 s, 4055.3 tps, lat 24.622 ms stddev 25.660 2024-06-02T04:06:34.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:34 smithi162 ceph-mon[47009]: pgmap v327: 97 pgs: 97 active+clean; 1.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 45 MiB/s wr, 1.80k op/s 2024-06-02T04:06:36.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:36 smithi136 ceph-mon[47443]: pgmap v328: 97 pgs: 97 active+clean; 1.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 41 MiB/s wr, 1.59k op/s 2024-06-02T04:06:36.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:36 smithi162 ceph-mon[47009]: pgmap v328: 97 pgs: 97 active+clean; 1.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 41 MiB/s wr, 1.59k op/s 2024-06-02T04:06:36.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:36 smithi123 ceph-mon[42885]: pgmap v328: 97 pgs: 97 active+clean; 1.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 41 MiB/s wr, 1.59k op/s 2024-06-02T04:06:38.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:38 smithi162 ceph-mon[47009]: pgmap v329: 97 pgs: 97 active+clean; 1.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 938 op/s 2024-06-02T04:06:38.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:38 smithi123 ceph-mon[42885]: pgmap v329: 97 pgs: 97 active+clean; 1.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 938 op/s 2024-06-02T04:06:38.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:38 smithi136 ceph-mon[47443]: pgmap v329: 97 pgs: 97 active+clean; 1.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 938 op/s 2024-06-02T04:06:39.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 125.0 s, 2883.6 tps, lat 34.600 ms stddev 36.414 2024-06-02T04:06:40.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:40 smithi162 ceph-mon[47009]: pgmap v330: 97 pgs: 97 active+clean; 1.5 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 MiB/s wr, 868 op/s 2024-06-02T04:06:40.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:40 smithi123 ceph-mon[42885]: pgmap v330: 97 pgs: 97 active+clean; 1.5 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 MiB/s wr, 868 op/s 2024-06-02T04:06:40.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:40 smithi136 ceph-mon[47443]: pgmap v330: 97 pgs: 97 active+clean; 1.5 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 MiB/s wr, 868 op/s 2024-06-02T04:06:42.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:42 smithi162 ceph-mon[47009]: pgmap v331: 97 pgs: 97 active+clean; 1.5 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 28 MiB/s wr, 1.12k op/s 2024-06-02T04:06:42.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:42 smithi123 ceph-mon[42885]: pgmap v331: 97 pgs: 97 active+clean; 1.5 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 28 MiB/s wr, 1.12k op/s 2024-06-02T04:06:42.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:42 smithi136 ceph-mon[47443]: pgmap v331: 97 pgs: 97 active+clean; 1.5 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 28 MiB/s wr, 1.12k op/s 2024-06-02T04:06:43.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:43 smithi162 ceph-mon[47009]: pgmap v332: 97 pgs: 97 active+clean; 1.5 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 28 MiB/s wr, 1.10k op/s 2024-06-02T04:06:43.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:43 smithi123 ceph-mon[42885]: pgmap v332: 97 pgs: 97 active+clean; 1.5 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 28 MiB/s wr, 1.10k op/s 2024-06-02T04:06:43.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:43 smithi136 ceph-mon[47443]: pgmap v332: 97 pgs: 97 active+clean; 1.5 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 28 MiB/s wr, 1.10k op/s 2024-06-02T04:06:44.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 130.0 s, 2663.6 tps, lat 37.645 ms stddev 56.425 2024-06-02T04:06:46.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:45 smithi162 ceph-mon[47009]: pgmap v333: 97 pgs: 97 active+clean; 1.5 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 42 MiB/s wr, 1.71k op/s 2024-06-02T04:06:46.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:45 smithi123 ceph-mon[42885]: pgmap v333: 97 pgs: 97 active+clean; 1.5 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 42 MiB/s wr, 1.71k op/s 2024-06-02T04:06:46.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:45 smithi136 ceph-mon[47443]: pgmap v333: 97 pgs: 97 active+clean; 1.5 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 42 MiB/s wr, 1.71k op/s 2024-06-02T04:06:48.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:48 smithi162 ceph-mon[47009]: pgmap v334: 97 pgs: 97 active+clean; 1.5 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 46 MiB/s wr, 1.92k op/s 2024-06-02T04:06:48.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:47 smithi123 ceph-mon[42885]: pgmap v334: 97 pgs: 97 active+clean; 1.5 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 46 MiB/s wr, 1.92k op/s 2024-06-02T04:06:48.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:47 smithi136 ceph-mon[47443]: pgmap v334: 97 pgs: 97 active+clean; 1.5 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 46 MiB/s wr, 1.92k op/s 2024-06-02T04:06:49.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 135.0 s, 3923.4 tps, lat 25.518 ms stddev 28.202 2024-06-02T04:06:50.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:50 smithi162 ceph-mon[47009]: pgmap v335: 97 pgs: 97 active+clean; 1.5 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 55 MiB/s wr, 2.23k op/s 2024-06-02T04:06:50.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:50 smithi123 ceph-mon[42885]: pgmap v335: 97 pgs: 97 active+clean; 1.5 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 55 MiB/s wr, 2.23k op/s 2024-06-02T04:06:50.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:50 smithi136 ceph-mon[47443]: pgmap v335: 97 pgs: 97 active+clean; 1.5 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 55 MiB/s wr, 2.23k op/s 2024-06-02T04:06:52.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:52 smithi162 ceph-mon[47009]: pgmap v336: 97 pgs: 97 active+clean; 1.5 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 57 MiB/s wr, 2.29k op/s 2024-06-02T04:06:52.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:52 smithi123 ceph-mon[42885]: pgmap v336: 97 pgs: 97 active+clean; 1.5 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 57 MiB/s wr, 2.29k op/s 2024-06-02T04:06:52.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:52 smithi136 ceph-mon[47443]: pgmap v336: 97 pgs: 97 active+clean; 1.5 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 57 MiB/s wr, 2.29k op/s 2024-06-02T04:06:54.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:54 smithi123 ceph-mon[42885]: pgmap v337: 97 pgs: 97 active+clean; 1.5 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 51 MiB/s wr, 2.06k op/s 2024-06-02T04:06:54.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:54 smithi136 ceph-mon[47443]: pgmap v337: 97 pgs: 97 active+clean; 1.5 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 51 MiB/s wr, 2.06k op/s 2024-06-02T04:06:54.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 140.0 s, 3794.0 tps, lat 26.182 ms stddev 28.383 2024-06-02T04:06:54.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:54 smithi162 ceph-mon[47009]: pgmap v337: 97 pgs: 97 active+clean; 1.5 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 51 MiB/s wr, 2.06k op/s 2024-06-02T04:06:56.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:56 smithi136 ceph-mon[47443]: pgmap v338: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 MiB/s wr, 1.99k op/s 2024-06-02T04:06:56.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:56 smithi162 ceph-mon[47009]: pgmap v338: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 MiB/s wr, 1.99k op/s 2024-06-02T04:06:56.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:56 smithi123 ceph-mon[42885]: pgmap v338: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 48 MiB/s wr, 1.99k op/s 2024-06-02T04:06:58.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:06:58 smithi136 ceph-mon[47443]: pgmap v339: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 34 MiB/s wr, 1.37k op/s 2024-06-02T04:06:58.551 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:06:58 smithi162 ceph-mon[47009]: pgmap v339: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 34 MiB/s wr, 1.37k op/s 2024-06-02T04:06:58.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:06:58 smithi123 ceph-mon[42885]: pgmap v339: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 34 MiB/s wr, 1.37k op/s 2024-06-02T04:06:59.490 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 145.0 s, 2254.4 tps, lat 44.578 ms stddev 52.459 2024-06-02T04:07:00.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:00 smithi136 ceph-mon[47443]: pgmap v340: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 29 MiB/s wr, 1.10k op/s 2024-06-02T04:07:00.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:00 smithi162 ceph-mon[47009]: pgmap v340: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 29 MiB/s wr, 1.10k op/s 2024-06-02T04:07:00.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:00 smithi123 ceph-mon[42885]: pgmap v340: 97 pgs: 97 active+clean; 1.5 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 29 MiB/s wr, 1.10k op/s 2024-06-02T04:07:02.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:02 smithi162 ceph-mon[47009]: pgmap v341: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 MiB/s wr, 1.00k op/s 2024-06-02T04:07:02.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:02 smithi123 ceph-mon[42885]: pgmap v341: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 MiB/s wr, 1.00k op/s 2024-06-02T04:07:02.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:02 smithi136 ceph-mon[47443]: pgmap v341: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 MiB/s wr, 1.00k op/s 2024-06-02T04:07:03.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:03 smithi162 ceph-mon[47009]: pgmap v342: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 24 MiB/s wr, 969 op/s 2024-06-02T04:07:03.575 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:03 smithi123 ceph-mon[42885]: pgmap v342: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 24 MiB/s wr, 969 op/s 2024-06-02T04:07:03.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:03 smithi136 ceph-mon[47443]: pgmap v342: 97 pgs: 97 active+clean; 1.5 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 24 MiB/s wr, 969 op/s 2024-06-02T04:07:04.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 150.0 s, 2564.0 tps, lat 39.029 ms stddev 47.497 2024-06-02T04:07:06.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:05 smithi162 ceph-mon[47009]: pgmap v343: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 1.08k op/s 2024-06-02T04:07:06.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:05 smithi123 ceph-mon[42885]: pgmap v343: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 1.08k op/s 2024-06-02T04:07:06.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:05 smithi136 ceph-mon[47443]: pgmap v343: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 28 MiB/s wr, 1.08k op/s 2024-06-02T04:07:08.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:07 smithi162 ceph-mon[47009]: pgmap v344: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 32 MiB/s wr, 1.22k op/s 2024-06-02T04:07:08.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:07 smithi123 ceph-mon[42885]: pgmap v344: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 32 MiB/s wr, 1.22k op/s 2024-06-02T04:07:08.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:07 smithi136 ceph-mon[47443]: pgmap v344: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 32 MiB/s wr, 1.22k op/s 2024-06-02T04:07:09.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 155.0 s, 2485.4 tps, lat 40.327 ms stddev 63.630 2024-06-02T04:07:10.301 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:09 smithi162 ceph-mon[47009]: pgmap v345: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 MiB/s wr, 1.83k op/s 2024-06-02T04:07:10.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:09 smithi123 ceph-mon[42885]: pgmap v345: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 MiB/s wr, 1.83k op/s 2024-06-02T04:07:10.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:09 smithi136 ceph-mon[47443]: pgmap v345: 97 pgs: 97 active+clean; 1.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 43 MiB/s wr, 1.83k op/s 2024-06-02T04:07:12.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:11 smithi162 ceph-mon[47009]: pgmap v346: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 55 MiB/s wr, 2.38k op/s 2024-06-02T04:07:12.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:11 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:07:12.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:11 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:07:12.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:11 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:07:12.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:11 smithi123 ceph-mon[42885]: pgmap v346: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 55 MiB/s wr, 2.38k op/s 2024-06-02T04:07:12.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:11 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:07:12.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:11 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:07:12.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:11 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:07:12.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:11 smithi136 ceph-mon[47443]: pgmap v346: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 55 MiB/s wr, 2.38k op/s 2024-06-02T04:07:12.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:11 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:07:12.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:11 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:07:12.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:11 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:07:13.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:12 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:07:13.331 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:12 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:07:13.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:12 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:07:14.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:14 smithi162 ceph-mon[47009]: pgmap v347: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 50 MiB/s wr, 2.22k op/s 2024-06-02T04:07:14.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:14 smithi123 ceph-mon[42885]: pgmap v347: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 50 MiB/s wr, 2.22k op/s 2024-06-02T04:07:14.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:14 smithi136 ceph-mon[47443]: pgmap v347: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 50 MiB/s wr, 2.22k op/s 2024-06-02T04:07:14.488 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 160.0 s, 3292.8 tps, lat 30.366 ms stddev 33.554 2024-06-02T04:07:16.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:16 smithi162 ceph-mon[47009]: pgmap v348: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 52 MiB/s wr, 2.27k op/s 2024-06-02T04:07:16.325 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:16 smithi123 ceph-mon[42885]: pgmap v348: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 52 MiB/s wr, 2.27k op/s 2024-06-02T04:07:16.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:16 smithi136 ceph-mon[47443]: pgmap v348: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 52 MiB/s wr, 2.27k op/s 2024-06-02T04:07:18.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:18 smithi162 ceph-mon[47009]: pgmap v349: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 48 MiB/s wr, 2.17k op/s 2024-06-02T04:07:18.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:18 smithi123 ceph-mon[42885]: pgmap v349: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 48 MiB/s wr, 2.17k op/s 2024-06-02T04:07:18.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:18 smithi136 ceph-mon[47443]: pgmap v349: 97 pgs: 97 active+clean; 1.5 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 48 MiB/s wr, 2.17k op/s 2024-06-02T04:07:19.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 165.0 s, 3231.6 tps, lat 30.824 ms stddev 32.691 2024-06-02T04:07:20.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:20 smithi162 ceph-mon[47009]: pgmap v350: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 MiB/s wr, 2.00k op/s 2024-06-02T04:07:20.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:20 smithi123 ceph-mon[42885]: pgmap v350: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 MiB/s wr, 2.00k op/s 2024-06-02T04:07:20.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:20 smithi136 ceph-mon[47443]: pgmap v350: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 MiB/s wr, 2.00k op/s 2024-06-02T04:07:22.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:22 smithi162 ceph-mon[47009]: pgmap v351: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 33 MiB/s wr, 1.44k op/s 2024-06-02T04:07:22.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:22 smithi123 ceph-mon[42885]: pgmap v351: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 33 MiB/s wr, 1.44k op/s 2024-06-02T04:07:22.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:22 smithi136 ceph-mon[47443]: pgmap v351: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 33 MiB/s wr, 1.44k op/s 2024-06-02T04:07:24.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:24 smithi162 ceph-mon[47009]: pgmap v352: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 21 MiB/s wr, 892 op/s 2024-06-02T04:07:24.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:24 smithi123 ceph-mon[42885]: pgmap v352: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 21 MiB/s wr, 892 op/s 2024-06-02T04:07:24.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:24 smithi136 ceph-mon[47443]: pgmap v352: 97 pgs: 97 active+clean; 1.5 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 21 MiB/s wr, 892 op/s 2024-06-02T04:07:24.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 170.0 s, 1970.6 tps, lat 50.820 ms stddev 58.721 2024-06-02T04:07:26.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:26 smithi123 ceph-mon[42885]: pgmap v353: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 25 MiB/s wr, 1.03k op/s 2024-06-02T04:07:26.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:26 smithi136 ceph-mon[47443]: pgmap v353: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 25 MiB/s wr, 1.03k op/s 2024-06-02T04:07:26.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:26 smithi162 ceph-mon[47009]: pgmap v353: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 25 MiB/s wr, 1.03k op/s 2024-06-02T04:07:28.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:28 smithi123 ceph-mon[42885]: pgmap v354: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 23 MiB/s wr, 959 op/s 2024-06-02T04:07:28.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:28 smithi136 ceph-mon[47443]: pgmap v354: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 23 MiB/s wr, 959 op/s 2024-06-02T04:07:28.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:28 smithi162 ceph-mon[47009]: pgmap v354: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 23 MiB/s wr, 959 op/s 2024-06-02T04:07:29.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 175.0 s, 2315.6 tps, lat 42.875 ms stddev 46.990 2024-06-02T04:07:30.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:30 smithi136 ceph-mon[47443]: pgmap v355: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 24 MiB/s wr, 1.01k op/s 2024-06-02T04:07:30.557 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:30 smithi162 ceph-mon[47009]: pgmap v355: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 24 MiB/s wr, 1.01k op/s 2024-06-02T04:07:30.575 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:30 smithi123 ceph-mon[42885]: pgmap v355: 97 pgs: 97 active+clean; 1.5 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 24 MiB/s wr, 1.01k op/s 2024-06-02T04:07:32.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:32 smithi162 ceph-mon[47009]: pgmap v356: 97 pgs: 97 active+clean; 1.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 31 MiB/s wr, 1.28k op/s 2024-06-02T04:07:32.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:32 smithi123 ceph-mon[42885]: pgmap v356: 97 pgs: 97 active+clean; 1.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 31 MiB/s wr, 1.28k op/s 2024-06-02T04:07:32.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:32 smithi136 ceph-mon[47443]: pgmap v356: 97 pgs: 97 active+clean; 1.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 31 MiB/s wr, 1.28k op/s 2024-06-02T04:07:34.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 180.0 s, 2401.2 tps, lat 41.866 ms stddev 88.957 2024-06-02T04:07:34.552 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:34 smithi162 ceph-mon[47009]: pgmap v357: 97 pgs: 97 active+clean; 1.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 40 MiB/s wr, 1.71k op/s 2024-06-02T04:07:34.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:34 smithi123 ceph-mon[42885]: pgmap v357: 97 pgs: 97 active+clean; 1.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 40 MiB/s wr, 1.71k op/s 2024-06-02T04:07:34.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:34 smithi136 ceph-mon[47443]: pgmap v357: 97 pgs: 97 active+clean; 1.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 40 MiB/s wr, 1.71k op/s 2024-06-02T04:07:36.556 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:36 smithi162 ceph-mon[47009]: pgmap v358: 97 pgs: 97 active+clean; 1.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 55 MiB/s wr, 2.37k op/s 2024-06-02T04:07:36.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:36 smithi123 ceph-mon[42885]: pgmap v358: 97 pgs: 97 active+clean; 1.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 55 MiB/s wr, 2.37k op/s 2024-06-02T04:07:36.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:36 smithi136 ceph-mon[47443]: pgmap v358: 97 pgs: 97 active+clean; 1.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 55 MiB/s wr, 2.37k op/s 2024-06-02T04:07:38.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:38 smithi162 ceph-mon[47009]: pgmap v359: 97 pgs: 97 active+clean; 1.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 50 MiB/s wr, 2.15k op/s 2024-06-02T04:07:38.575 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:38 smithi123 ceph-mon[42885]: pgmap v359: 97 pgs: 97 active+clean; 1.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 50 MiB/s wr, 2.15k op/s 2024-06-02T04:07:38.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:38 smithi136 ceph-mon[47443]: pgmap v359: 97 pgs: 97 active+clean; 1.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 50 MiB/s wr, 2.15k op/s 2024-06-02T04:07:39.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 185.0 s, 2923.3 tps, lat 34.331 ms stddev 37.970 2024-06-02T04:07:40.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:40 smithi162 ceph-mon[47009]: pgmap v360: 97 pgs: 97 active+clean; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 MiB/s wr, 2.22k op/s 2024-06-02T04:07:40.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:40 smithi123 ceph-mon[42885]: pgmap v360: 97 pgs: 97 active+clean; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 MiB/s wr, 2.22k op/s 2024-06-02T04:07:40.594 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:40 smithi136 ceph-mon[47443]: pgmap v360: 97 pgs: 97 active+clean; 1.6 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 50 MiB/s wr, 2.22k op/s 2024-06-02T04:07:42.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:42 smithi162 ceph-mon[47009]: pgmap v361: 97 pgs: 97 active+clean; 1.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 50 MiB/s wr, 2.23k op/s 2024-06-02T04:07:42.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:42 smithi123 ceph-mon[42885]: pgmap v361: 97 pgs: 97 active+clean; 1.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 50 MiB/s wr, 2.23k op/s 2024-06-02T04:07:42.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:42 smithi136 ceph-mon[47443]: pgmap v361: 97 pgs: 97 active+clean; 1.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 50 MiB/s wr, 2.23k op/s 2024-06-02T04:07:44.495 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 190.0 s, 3037.6 tps, lat 32.747 ms stddev 37.426 2024-06-02T04:07:44.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:44 smithi162 ceph-mon[47009]: pgmap v362: 97 pgs: 97 active+clean; 1.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 43 MiB/s wr, 1.96k op/s 2024-06-02T04:07:44.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:44 smithi123 ceph-mon[42885]: pgmap v362: 97 pgs: 97 active+clean; 1.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 43 MiB/s wr, 1.96k op/s 2024-06-02T04:07:44.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:44 smithi136 ceph-mon[47443]: pgmap v362: 97 pgs: 97 active+clean; 1.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 43 MiB/s wr, 1.96k op/s 2024-06-02T04:07:46.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:46 smithi162 ceph-mon[47009]: pgmap v363: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 38 MiB/s wr, 1.61k op/s 2024-06-02T04:07:46.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:46 smithi123 ceph-mon[42885]: pgmap v363: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 38 MiB/s wr, 1.61k op/s 2024-06-02T04:07:46.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:46 smithi136 ceph-mon[47443]: pgmap v363: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 38 MiB/s wr, 1.61k op/s 2024-06-02T04:07:48.550 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:48 smithi162 ceph-mon[47009]: pgmap v364: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 21 MiB/s wr, 900 op/s 2024-06-02T04:07:48.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:48 smithi123 ceph-mon[42885]: pgmap v364: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 21 MiB/s wr, 900 op/s 2024-06-02T04:07:48.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:48 smithi136 ceph-mon[47443]: pgmap v364: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 21 MiB/s wr, 900 op/s 2024-06-02T04:07:49.488 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 195.0 s, 1997.6 tps, lat 50.314 ms stddev 58.466 2024-06-02T04:07:49.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:49 smithi162 ceph-mon[47009]: pgmap v365: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 989 op/s 2024-06-02T04:07:49.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:49 smithi123 ceph-mon[42885]: pgmap v365: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 989 op/s 2024-06-02T04:07:49.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:49 smithi136 ceph-mon[47443]: pgmap v365: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 989 op/s 2024-06-02T04:07:52.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:52 smithi162 ceph-mon[47009]: pgmap v366: 97 pgs: 97 active+clean; 1.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 25 MiB/s wr, 982 op/s 2024-06-02T04:07:52.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:52 smithi123 ceph-mon[42885]: pgmap v366: 97 pgs: 97 active+clean; 1.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 25 MiB/s wr, 982 op/s 2024-06-02T04:07:52.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:52 smithi136 ceph-mon[47443]: pgmap v366: 97 pgs: 97 active+clean; 1.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 25 MiB/s wr, 982 op/s 2024-06-02T04:07:54.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:54 smithi162 ceph-mon[47009]: pgmap v367: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 26 MiB/s wr, 948 op/s 2024-06-02T04:07:54.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:54 smithi123 ceph-mon[42885]: pgmap v367: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 26 MiB/s wr, 948 op/s 2024-06-02T04:07:54.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:54 smithi136 ceph-mon[47443]: pgmap v367: 97 pgs: 97 active+clean; 1.6 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 26 MiB/s wr, 948 op/s 2024-06-02T04:07:54.490 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 200.0 s, 2234.8 tps, lat 44.704 ms stddev 49.288 2024-06-02T04:07:56.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:56 smithi123 ceph-mon[42885]: pgmap v368: 97 pgs: 97 active+clean; 1.6 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 29 MiB/s wr, 1.01k op/s 2024-06-02T04:07:56.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:56 smithi136 ceph-mon[47443]: pgmap v368: 97 pgs: 97 active+clean; 1.6 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 29 MiB/s wr, 1.01k op/s 2024-06-02T04:07:56.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:56 smithi162 ceph-mon[47009]: pgmap v368: 97 pgs: 97 active+clean; 1.6 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 29 MiB/s wr, 1.01k op/s 2024-06-02T04:07:58.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:07:58 smithi123 ceph-mon[42885]: pgmap v369: 97 pgs: 97 active+clean; 1.6 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 32 MiB/s wr, 1.25k op/s 2024-06-02T04:07:58.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:07:58 smithi136 ceph-mon[47443]: pgmap v369: 97 pgs: 97 active+clean; 1.6 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 32 MiB/s wr, 1.25k op/s 2024-06-02T04:07:58.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:07:58 smithi162 ceph-mon[47009]: pgmap v369: 97 pgs: 97 active+clean; 1.6 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 32 MiB/s wr, 1.25k op/s 2024-06-02T04:07:59.490 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 205.0 s, 2133.1 tps, lat 46.723 ms stddev 80.043 2024-06-02T04:08:00.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:00 smithi136 ceph-mon[47443]: pgmap v370: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 45 MiB/s wr, 1.85k op/s 2024-06-02T04:08:00.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:00 smithi162 ceph-mon[47009]: pgmap v370: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 45 MiB/s wr, 1.85k op/s 2024-06-02T04:08:00.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:00 smithi123 ceph-mon[42885]: pgmap v370: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 45 MiB/s wr, 1.85k op/s 2024-06-02T04:08:02.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:02 smithi136 ceph-mon[47443]: pgmap v371: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 52 MiB/s wr, 2.19k op/s 2024-06-02T04:08:02.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:02 smithi162 ceph-mon[47009]: pgmap v371: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 52 MiB/s wr, 2.19k op/s 2024-06-02T04:08:02.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:02 smithi123 ceph-mon[42885]: pgmap v371: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 52 MiB/s wr, 2.19k op/s 2024-06-02T04:08:04.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 210.0 s, 2789.1 tps, lat 35.636 ms stddev 36.515 2024-06-02T04:08:04.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:04 smithi162 ceph-mon[47009]: pgmap v372: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 50 MiB/s wr, 2.16k op/s 2024-06-02T04:08:04.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:04 smithi123 ceph-mon[42885]: pgmap v372: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 50 MiB/s wr, 2.16k op/s 2024-06-02T04:08:04.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:04 smithi136 ceph-mon[47443]: pgmap v372: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 50 MiB/s wr, 2.16k op/s 2024-06-02T04:08:06.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:06 smithi162 ceph-mon[47009]: pgmap v373: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 49 MiB/s wr, 2.15k op/s 2024-06-02T04:08:06.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:06 smithi123 ceph-mon[42885]: pgmap v373: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 49 MiB/s wr, 2.15k op/s 2024-06-02T04:08:06.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:06 smithi136 ceph-mon[47443]: pgmap v373: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 49 MiB/s wr, 2.15k op/s 2024-06-02T04:08:08.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:08 smithi162 ceph-mon[47009]: pgmap v374: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 45 MiB/s wr, 2.03k op/s 2024-06-02T04:08:08.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:08 smithi123 ceph-mon[42885]: pgmap v374: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 45 MiB/s wr, 2.03k op/s 2024-06-02T04:08:08.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:08 smithi136 ceph-mon[47443]: pgmap v374: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 45 MiB/s wr, 2.03k op/s 2024-06-02T04:08:09.494 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 215.0 s, 3038.3 tps, lat 33.179 ms stddev 38.195 2024-06-02T04:08:10.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:10 smithi162 ceph-mon[47009]: pgmap v375: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 MiB/s wr, 1.74k op/s 2024-06-02T04:08:10.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:10 smithi123 ceph-mon[42885]: pgmap v375: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 MiB/s wr, 1.74k op/s 2024-06-02T04:08:10.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:10 smithi136 ceph-mon[47443]: pgmap v375: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 40 MiB/s wr, 1.74k op/s 2024-06-02T04:08:12.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:12 smithi162 ceph-mon[47009]: pgmap v376: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 29 MiB/s wr, 1.20k op/s 2024-06-02T04:08:12.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:12 smithi123 ceph-mon[42885]: pgmap v376: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 29 MiB/s wr, 1.20k op/s 2024-06-02T04:08:12.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:12 smithi136 ceph-mon[47443]: pgmap v376: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 29 MiB/s wr, 1.20k op/s 2024-06-02T04:08:13.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:13 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:08:13.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:13 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:08:13.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:13 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:08:13.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:13 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:08:13.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:13 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:08:13.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:13 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:08:13.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:13 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:08:13.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:13 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:08:13.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:13 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:08:14.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 220.0 s, 2674.9 tps, lat 37.274 ms stddev 41.088 2024-06-02T04:08:14.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:14 smithi162 ceph-mon[47009]: pgmap v377: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 21 MiB/s wr, 892 op/s 2024-06-02T04:08:14.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:14 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:08:14.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:14 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:08:14.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:14 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:08:14.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:14 smithi123 ceph-mon[42885]: pgmap v377: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 21 MiB/s wr, 892 op/s 2024-06-02T04:08:14.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:14 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:08:14.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:14 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:08:14.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:14 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:08:14.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:14 smithi136 ceph-mon[47443]: pgmap v377: 97 pgs: 97 active+clean; 1.6 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 21 MiB/s wr, 892 op/s 2024-06-02T04:08:14.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:14 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:08:14.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:14 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:08:14.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:14 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:08:16.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:16 smithi162 ceph-mon[47009]: pgmap v378: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 MiB/s wr, 913 op/s 2024-06-02T04:08:16.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:16 smithi123 ceph-mon[42885]: pgmap v378: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 MiB/s wr, 913 op/s 2024-06-02T04:08:16.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:16 smithi136 ceph-mon[47443]: pgmap v378: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 MiB/s wr, 913 op/s 2024-06-02T04:08:18.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:18 smithi162 ceph-mon[47009]: pgmap v379: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 21 MiB/s wr, 879 op/s 2024-06-02T04:08:18.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:18 smithi123 ceph-mon[42885]: pgmap v379: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 21 MiB/s wr, 879 op/s 2024-06-02T04:08:18.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:18 smithi136 ceph-mon[47443]: pgmap v379: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 21 MiB/s wr, 879 op/s 2024-06-02T04:08:19.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 225.0 s, 2997.4 tps, lat 33.453 ms stddev 36.634 2024-06-02T04:08:20.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:20 smithi162 ceph-mon[47009]: pgmap v380: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 958 op/s 2024-06-02T04:08:20.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:20 smithi123 ceph-mon[42885]: pgmap v380: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 958 op/s 2024-06-02T04:08:20.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:20 smithi136 ceph-mon[47443]: pgmap v380: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 958 op/s 2024-06-02T04:08:22.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:22 smithi162 ceph-mon[47009]: pgmap v381: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 912 op/s 2024-06-02T04:08:22.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:22 smithi123 ceph-mon[42885]: pgmap v381: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 912 op/s 2024-06-02T04:08:22.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:22 smithi136 ceph-mon[47443]: pgmap v381: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 912 op/s 2024-06-02T04:08:24.488 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 230.0 s, 2075.2 tps, lat 48.240 ms stddev 80.477 2024-06-02T04:08:24.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:24 smithi162 ceph-mon[47009]: pgmap v382: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 24 MiB/s wr, 933 op/s 2024-06-02T04:08:24.576 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:24 smithi123 ceph-mon[42885]: pgmap v382: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 24 MiB/s wr, 933 op/s 2024-06-02T04:08:24.593 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:24 smithi136 ceph-mon[47443]: pgmap v382: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 24 MiB/s wr, 933 op/s 2024-06-02T04:08:26.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:26 smithi162 ceph-mon[47009]: pgmap v383: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 37 MiB/s wr, 1.46k op/s 2024-06-02T04:08:26.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:26 smithi123 ceph-mon[42885]: pgmap v383: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 37 MiB/s wr, 1.46k op/s 2024-06-02T04:08:26.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:26 smithi136 ceph-mon[47443]: pgmap v383: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 37 MiB/s wr, 1.46k op/s 2024-06-02T04:08:28.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:28 smithi162 ceph-mon[47009]: pgmap v384: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 40 MiB/s wr, 1.65k op/s 2024-06-02T04:08:28.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:28 smithi123 ceph-mon[42885]: pgmap v384: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 40 MiB/s wr, 1.65k op/s 2024-06-02T04:08:28.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:28 smithi136 ceph-mon[47443]: pgmap v384: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 40 MiB/s wr, 1.65k op/s 2024-06-02T04:08:29.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 235.0 s, 3173.6 tps, lat 31.529 ms stddev 35.244 2024-06-02T04:08:30.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:30 smithi162 ceph-mon[47009]: pgmap v385: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 46 MiB/s wr, 1.93k op/s 2024-06-02T04:08:30.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:30 smithi123 ceph-mon[42885]: pgmap v385: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 46 MiB/s wr, 1.93k op/s 2024-06-02T04:08:30.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:30 smithi136 ceph-mon[47443]: pgmap v385: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 46 MiB/s wr, 1.93k op/s 2024-06-02T04:08:32.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:32 smithi162 ceph-mon[47009]: pgmap v386: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 47 MiB/s wr, 1.99k op/s 2024-06-02T04:08:32.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:32 smithi123 ceph-mon[42885]: pgmap v386: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 47 MiB/s wr, 1.99k op/s 2024-06-02T04:08:32.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:32 smithi136 ceph-mon[47443]: pgmap v386: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 47 MiB/s wr, 1.99k op/s 2024-06-02T04:08:34.495 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 240.0 s, 2864.4 tps, lat 34.720 ms stddev 37.861 2024-06-02T04:08:34.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:34 smithi162 ceph-mon[47009]: pgmap v387: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 46 MiB/s wr, 1.98k op/s 2024-06-02T04:08:34.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:34 smithi123 ceph-mon[42885]: pgmap v387: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 46 MiB/s wr, 1.98k op/s 2024-06-02T04:08:34.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:34 smithi136 ceph-mon[47443]: pgmap v387: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 46 MiB/s wr, 1.98k op/s 2024-06-02T04:08:36.550 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:36 smithi162 ceph-mon[47009]: pgmap v388: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 45 MiB/s wr, 2.00k op/s 2024-06-02T04:08:36.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:36 smithi123 ceph-mon[42885]: pgmap v388: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 45 MiB/s wr, 2.00k op/s 2024-06-02T04:08:36.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:36 smithi136 ceph-mon[47443]: pgmap v388: 97 pgs: 97 active+clean; 1.6 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 45 MiB/s wr, 2.00k op/s 2024-06-02T04:08:38.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:38 smithi162 ceph-mon[47009]: pgmap v389: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 30 MiB/s wr, 1.33k op/s 2024-06-02T04:08:38.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:38 smithi123 ceph-mon[42885]: pgmap v389: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 30 MiB/s wr, 1.33k op/s 2024-06-02T04:08:38.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:38 smithi136 ceph-mon[47443]: pgmap v389: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 30 MiB/s wr, 1.33k op/s 2024-06-02T04:08:39.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 245.0 s, 3020.9 tps, lat 33.226 ms stddev 38.669 2024-06-02T04:08:40.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:40 smithi162 ceph-mon[47009]: pgmap v390: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 25 MiB/s wr, 1.07k op/s 2024-06-02T04:08:40.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:40 smithi123 ceph-mon[42885]: pgmap v390: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 25 MiB/s wr, 1.07k op/s 2024-06-02T04:08:40.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:40 smithi136 ceph-mon[47443]: pgmap v390: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 25 MiB/s wr, 1.07k op/s 2024-06-02T04:08:42.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:42 smithi162 ceph-mon[47009]: pgmap v391: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 19 MiB/s wr, 841 op/s 2024-06-02T04:08:42.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:42 smithi123 ceph-mon[42885]: pgmap v391: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 19 MiB/s wr, 841 op/s 2024-06-02T04:08:42.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:42 smithi136 ceph-mon[47443]: pgmap v391: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 19 MiB/s wr, 841 op/s 2024-06-02T04:08:44.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 250.0 s, 3025.4 tps, lat 33.140 ms stddev 38.592 2024-06-02T04:08:44.551 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:44 smithi162 ceph-mon[47009]: pgmap v392: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 790 op/s 2024-06-02T04:08:44.575 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:44 smithi123 ceph-mon[42885]: pgmap v392: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 790 op/s 2024-06-02T04:08:44.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:44 smithi136 ceph-mon[47443]: pgmap v392: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 MiB/s wr, 790 op/s 2024-06-02T04:08:46.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:46 smithi162 ceph-mon[47009]: pgmap v393: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 892 op/s 2024-06-02T04:08:46.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:46 smithi123 ceph-mon[42885]: pgmap v393: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 892 op/s 2024-06-02T04:08:46.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:46 smithi136 ceph-mon[47443]: pgmap v393: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 892 op/s 2024-06-02T04:08:48.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:48 smithi162 ceph-mon[47009]: pgmap v394: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 803 op/s 2024-06-02T04:08:48.582 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:48 smithi123 ceph-mon[42885]: pgmap v394: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 803 op/s 2024-06-02T04:08:48.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:48 smithi136 ceph-mon[47443]: pgmap v394: 97 pgs: 97 active+clean; 1.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 803 op/s 2024-06-02T04:08:49.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 255.0 s, 2514.6 tps, lat 39.665 ms stddev 46.846 2024-06-02T04:08:50.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:50 smithi162 ceph-mon[47009]: pgmap v395: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 857 op/s 2024-06-02T04:08:50.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:50 smithi123 ceph-mon[42885]: pgmap v395: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 857 op/s 2024-06-02T04:08:50.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:50 smithi136 ceph-mon[47443]: pgmap v395: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 857 op/s 2024-06-02T04:08:52.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:52 smithi162 ceph-mon[47009]: pgmap v396: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 MiB/s wr, 919 op/s 2024-06-02T04:08:52.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:52 smithi123 ceph-mon[42885]: pgmap v396: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 MiB/s wr, 919 op/s 2024-06-02T04:08:52.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:52 smithi136 ceph-mon[47443]: pgmap v396: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 MiB/s wr, 919 op/s 2024-06-02T04:08:54.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 260.0 s, 2564.6 tps, lat 39.034 ms stddev 42.157 2024-06-02T04:08:54.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:54 smithi162 ceph-mon[47009]: pgmap v397: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 MiB/s wr, 970 op/s 2024-06-02T04:08:54.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:54 smithi123 ceph-mon[42885]: pgmap v397: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 MiB/s wr, 970 op/s 2024-06-02T04:08:54.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:54 smithi136 ceph-mon[47443]: pgmap v397: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 MiB/s wr, 970 op/s 2024-06-02T04:08:55.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:55 smithi162 ceph-mon[47009]: pgmap v398: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 21 MiB/s wr, 1.01k op/s 2024-06-02T04:08:55.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:55 smithi123 ceph-mon[42885]: pgmap v398: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 21 MiB/s wr, 1.01k op/s 2024-06-02T04:08:55.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:55 smithi136 ceph-mon[47443]: pgmap v398: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 21 MiB/s wr, 1.01k op/s 2024-06-02T04:08:58.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:08:58 smithi123 ceph-mon[42885]: pgmap v399: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 21 MiB/s wr, 883 op/s 2024-06-02T04:08:58.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:08:58 smithi136 ceph-mon[47443]: pgmap v399: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 21 MiB/s wr, 883 op/s 2024-06-02T04:08:58.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:08:58 smithi162 ceph-mon[47009]: pgmap v399: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 21 MiB/s wr, 883 op/s 2024-06-02T04:08:59.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 265.0 s, 2726.0 tps, lat 36.596 ms stddev 42.693 2024-06-02T04:09:00.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:00 smithi162 ceph-mon[47009]: pgmap v400: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 MiB/s wr, 900 op/s 2024-06-02T04:09:00.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:00 smithi123 ceph-mon[42885]: pgmap v400: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 MiB/s wr, 900 op/s 2024-06-02T04:09:00.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:00 smithi136 ceph-mon[47443]: pgmap v400: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 22 MiB/s wr, 900 op/s 2024-06-02T04:09:02.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:02 smithi162 ceph-mon[47009]: pgmap v401: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 24 MiB/s wr, 934 op/s 2024-06-02T04:09:02.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:02 smithi123 ceph-mon[42885]: pgmap v401: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 24 MiB/s wr, 934 op/s 2024-06-02T04:09:02.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:02 smithi136 ceph-mon[47443]: pgmap v401: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 24 MiB/s wr, 934 op/s 2024-06-02T04:09:04.488 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 270.0 s, 2358.4 tps, lat 42.620 ms stddev 96.099 2024-06-02T04:09:04.555 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:04 smithi162 ceph-mon[47009]: pgmap v402: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 35 MiB/s wr, 1.44k op/s 2024-06-02T04:09:04.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:04 smithi123 ceph-mon[42885]: pgmap v402: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 35 MiB/s wr, 1.44k op/s 2024-06-02T04:09:04.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:04 smithi136 ceph-mon[47443]: pgmap v402: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 35 MiB/s wr, 1.44k op/s 2024-06-02T04:09:06.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:06 smithi162 ceph-mon[47009]: pgmap v403: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 48 MiB/s wr, 2.05k op/s 2024-06-02T04:09:06.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:06 smithi123 ceph-mon[42885]: pgmap v403: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 48 MiB/s wr, 2.05k op/s 2024-06-02T04:09:06.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:06 smithi136 ceph-mon[47443]: pgmap v403: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 48 MiB/s wr, 2.05k op/s 2024-06-02T04:09:08.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:08 smithi162 ceph-mon[47009]: pgmap v404: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 MiB/s wr, 1.89k op/s 2024-06-02T04:09:08.577 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:08 smithi123 ceph-mon[42885]: pgmap v404: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 MiB/s wr, 1.89k op/s 2024-06-02T04:09:08.591 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:08 smithi136 ceph-mon[47443]: pgmap v404: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 44 MiB/s wr, 1.89k op/s 2024-06-02T04:09:09.488 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 275.0 s, 2749.6 tps, lat 36.261 ms stddev 42.057 2024-06-02T04:09:10.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:10 smithi162 ceph-mon[47009]: pgmap v405: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 44 MiB/s wr, 1.92k op/s 2024-06-02T04:09:10.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:10 smithi123 ceph-mon[42885]: pgmap v405: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 44 MiB/s wr, 1.92k op/s 2024-06-02T04:09:10.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:10 smithi136 ceph-mon[47443]: pgmap v405: 97 pgs: 97 active+clean; 1.6 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 44 MiB/s wr, 1.92k op/s 2024-06-02T04:09:12.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:12 smithi162 ceph-mon[47009]: pgmap v406: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 45 MiB/s wr, 2.02k op/s 2024-06-02T04:09:12.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:12 smithi123 ceph-mon[42885]: pgmap v406: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 45 MiB/s wr, 2.02k op/s 2024-06-02T04:09:12.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:12 smithi136 ceph-mon[47443]: pgmap v406: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 45 MiB/s wr, 2.02k op/s 2024-06-02T04:09:14.490 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 280.0 s, 2756.0 tps, lat 36.243 ms stddev 41.885 2024-06-02T04:09:14.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:14 smithi162 ceph-mon[47009]: pgmap v407: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 45 MiB/s wr, 2.09k op/s 2024-06-02T04:09:14.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:14 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:09:14.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:14 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:09:14.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:14 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:09:14.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:14 smithi123 ceph-mon[42885]: pgmap v407: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 45 MiB/s wr, 2.09k op/s 2024-06-02T04:09:14.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:14 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:09:14.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:14 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:09:14.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:14 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:09:14.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:14 smithi136 ceph-mon[47443]: pgmap v407: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 45 MiB/s wr, 2.09k op/s 2024-06-02T04:09:14.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:14 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:09:14.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:14 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:09:14.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:14 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:09:15.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:15 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:09:15.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:15 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:09:15.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:15 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:09:15.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:15 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:09:15.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:15 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:09:15.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:15 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:09:15.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:15 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:09:15.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:15 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:09:15.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:15 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:09:15.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:15 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:09:15.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:15 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:09:15.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:15 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:09:15.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:15 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:09:15.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:15 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:09:15.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:15 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:09:16.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:16 smithi162 ceph-mon[47009]: pgmap v408: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 33 MiB/s wr, 1.55k op/s 2024-06-02T04:09:16.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:16 smithi123 ceph-mon[42885]: pgmap v408: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 33 MiB/s wr, 1.55k op/s 2024-06-02T04:09:16.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:16 smithi136 ceph-mon[47443]: pgmap v408: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 33 MiB/s wr, 1.55k op/s 2024-06-02T04:09:18.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:18 smithi162 ceph-mon[47009]: pgmap v409: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 16 MiB/s wr, 855 op/s 2024-06-02T04:09:18.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:18 smithi123 ceph-mon[42885]: pgmap v409: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 16 MiB/s wr, 855 op/s 2024-06-02T04:09:18.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:18 smithi136 ceph-mon[47443]: pgmap v409: 97 pgs: 97 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 16 MiB/s wr, 855 op/s 2024-06-02T04:09:19.488 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 285.0 s, 3152.5 tps, lat 31.560 ms stddev 35.724 2024-06-02T04:09:20.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:20 smithi162 ceph-mon[47009]: pgmap v410: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 17 MiB/s wr, 937 op/s 2024-06-02T04:09:20.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:20 smithi123 ceph-mon[42885]: pgmap v410: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 17 MiB/s wr, 937 op/s 2024-06-02T04:09:20.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:20 smithi136 ceph-mon[47443]: pgmap v410: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 17 MiB/s wr, 937 op/s 2024-06-02T04:09:22.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:22 smithi162 ceph-mon[47009]: pgmap v411: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 17 MiB/s wr, 990 op/s 2024-06-02T04:09:22.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:22 smithi123 ceph-mon[42885]: pgmap v411: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 17 MiB/s wr, 990 op/s 2024-06-02T04:09:22.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:22 smithi136 ceph-mon[47443]: pgmap v411: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 17 MiB/s wr, 990 op/s 2024-06-02T04:09:24.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 290.0 s, 2666.1 tps, lat 37.728 ms stddev 43.762 2024-06-02T04:09:24.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:24 smithi162 ceph-mon[47009]: pgmap v412: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 15 MiB/s wr, 927 op/s 2024-06-02T04:09:24.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:24 smithi123 ceph-mon[42885]: pgmap v412: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 15 MiB/s wr, 927 op/s 2024-06-02T04:09:24.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:24 smithi136 ceph-mon[47443]: pgmap v412: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 15 MiB/s wr, 927 op/s 2024-06-02T04:09:26.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:26 smithi162 ceph-mon[47009]: pgmap v413: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 893 op/s 2024-06-02T04:09:26.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:26 smithi123 ceph-mon[42885]: pgmap v413: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 893 op/s 2024-06-02T04:09:26.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:26 smithi136 ceph-mon[47443]: pgmap v413: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 893 op/s 2024-06-02T04:09:28.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:28 smithi162 ceph-mon[47009]: pgmap v414: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 13 MiB/s wr, 794 op/s 2024-06-02T04:09:28.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:28 smithi123 ceph-mon[42885]: pgmap v414: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 13 MiB/s wr, 794 op/s 2024-06-02T04:09:28.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:28 smithi136 ceph-mon[47443]: pgmap v414: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 13 MiB/s wr, 794 op/s 2024-06-02T04:09:29.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 295.0 s, 2067.2 tps, lat 48.292 ms stddev 61.404 2024-06-02T04:09:30.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:30 smithi162 ceph-mon[47009]: pgmap v415: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 13 MiB/s wr, 768 op/s 2024-06-02T04:09:30.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:30 smithi123 ceph-mon[42885]: pgmap v415: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 13 MiB/s wr, 768 op/s 2024-06-02T04:09:30.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:30 smithi136 ceph-mon[47443]: pgmap v415: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 13 MiB/s wr, 768 op/s 2024-06-02T04:09:32.553 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:32 smithi162 ceph-mon[47009]: pgmap v416: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 818 op/s 2024-06-02T04:09:32.576 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:32 smithi123 ceph-mon[42885]: pgmap v416: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 818 op/s 2024-06-02T04:09:32.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:32 smithi136 ceph-mon[47443]: pgmap v416: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 MiB/s wr, 818 op/s 2024-06-02T04:09:34.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 300.0 s, 2732.3 tps, lat 36.679 ms stddev 42.767 2024-06-02T04:09:34.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:34 smithi162 ceph-mon[47009]: pgmap v417: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 MiB/s wr, 835 op/s 2024-06-02T04:09:34.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:34 smithi123 ceph-mon[42885]: pgmap v417: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 MiB/s wr, 835 op/s 2024-06-02T04:09:34.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:34 smithi136 ceph-mon[47443]: pgmap v417: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 MiB/s wr, 835 op/s 2024-06-02T04:09:36.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:36 smithi162 ceph-mon[47009]: pgmap v418: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 MiB/s wr, 916 op/s 2024-06-02T04:09:36.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:36 smithi123 ceph-mon[42885]: pgmap v418: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 MiB/s wr, 916 op/s 2024-06-02T04:09:36.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:36 smithi136 ceph-mon[47443]: pgmap v418: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 MiB/s wr, 916 op/s 2024-06-02T04:09:38.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:38 smithi162 ceph-mon[47009]: pgmap v419: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 791 op/s 2024-06-02T04:09:38.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:38 smithi123 ceph-mon[42885]: pgmap v419: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 791 op/s 2024-06-02T04:09:38.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:38 smithi136 ceph-mon[47443]: pgmap v419: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 MiB/s wr, 791 op/s 2024-06-02T04:09:39.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 305.0 s, 2502.1 tps, lat 38.515 ms stddev 42.774 2024-06-02T04:09:40.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:40 smithi162 ceph-mon[47009]: pgmap v420: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 MiB/s wr, 835 op/s 2024-06-02T04:09:40.577 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:40 smithi123 ceph-mon[42885]: pgmap v420: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 MiB/s wr, 835 op/s 2024-06-02T04:09:40.591 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:40 smithi136 ceph-mon[47443]: pgmap v420: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 MiB/s wr, 835 op/s 2024-06-02T04:09:41.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:41 smithi162 ceph-mon[47009]: pgmap v421: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 MiB/s wr, 912 op/s 2024-06-02T04:09:41.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:41 smithi123 ceph-mon[42885]: pgmap v421: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 MiB/s wr, 912 op/s 2024-06-02T04:09:41.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:41 smithi136 ceph-mon[47443]: pgmap v421: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 MiB/s wr, 912 op/s 2024-06-02T04:09:44.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:44 smithi162 ceph-mon[47009]: pgmap v422: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 34 MiB/s wr, 1.44k op/s 2024-06-02T04:09:44.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:44 smithi123 ceph-mon[42885]: pgmap v422: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 34 MiB/s wr, 1.44k op/s 2024-06-02T04:09:44.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:44 smithi136 ceph-mon[47443]: pgmap v422: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 34 MiB/s wr, 1.44k op/s 2024-06-02T04:09:44.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 310.0 s, 2056.8 tps, lat 50.465 ms stddev 93.036 2024-06-02T04:09:46.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:46 smithi123 ceph-mon[42885]: pgmap v423: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 46 MiB/s wr, 2.04k op/s 2024-06-02T04:09:46.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:46 smithi136 ceph-mon[47443]: pgmap v423: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 46 MiB/s wr, 2.04k op/s 2024-06-02T04:09:46.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:46 smithi162 ceph-mon[47009]: pgmap v423: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 46 MiB/s wr, 2.04k op/s 2024-06-02T04:09:48.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:48 smithi136 ceph-mon[47443]: pgmap v424: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 41 MiB/s wr, 1.90k op/s 2024-06-02T04:09:48.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:48 smithi162 ceph-mon[47009]: pgmap v424: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 41 MiB/s wr, 1.90k op/s 2024-06-02T04:09:48.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:48 smithi123 ceph-mon[42885]: pgmap v424: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 41 MiB/s wr, 1.90k op/s 2024-06-02T04:09:49.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 315.0 s, 2694.4 tps, lat 36.986 ms stddev 43.185 2024-06-02T04:09:50.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:50 smithi136 ceph-mon[47443]: pgmap v425: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 44 MiB/s wr, 1.97k op/s 2024-06-02T04:09:50.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:50 smithi162 ceph-mon[47009]: pgmap v425: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 44 MiB/s wr, 1.97k op/s 2024-06-02T04:09:50.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:50 smithi123 ceph-mon[42885]: pgmap v425: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 44 MiB/s wr, 1.97k op/s 2024-06-02T04:09:52.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:52 smithi162 ceph-mon[47009]: pgmap v426: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 42 MiB/s wr, 1.99k op/s 2024-06-02T04:09:52.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:52 smithi123 ceph-mon[42885]: pgmap v426: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 42 MiB/s wr, 1.99k op/s 2024-06-02T04:09:52.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:52 smithi136 ceph-mon[47443]: pgmap v426: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 42 MiB/s wr, 1.99k op/s 2024-06-02T04:09:54.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 320.0 s, 2621.7 tps, lat 38.267 ms stddev 44.262 2024-06-02T04:09:54.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:54 smithi162 ceph-mon[47009]: pgmap v427: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 41 MiB/s wr, 1.95k op/s 2024-06-02T04:09:54.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:54 smithi123 ceph-mon[42885]: pgmap v427: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 41 MiB/s wr, 1.95k op/s 2024-06-02T04:09:54.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:54 smithi136 ceph-mon[47443]: pgmap v427: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 41 MiB/s wr, 1.95k op/s 2024-06-02T04:09:56.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:56 smithi162 ceph-mon[47009]: pgmap v428: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 29 MiB/s wr, 1.39k op/s 2024-06-02T04:09:56.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:56 smithi123 ceph-mon[42885]: pgmap v428: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 29 MiB/s wr, 1.39k op/s 2024-06-02T04:09:56.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:56 smithi136 ceph-mon[47443]: pgmap v428: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 29 MiB/s wr, 1.39k op/s 2024-06-02T04:09:58.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:09:58 smithi162 ceph-mon[47009]: pgmap v429: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 14 MiB/s wr, 685 op/s 2024-06-02T04:09:58.577 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:09:58 smithi123 ceph-mon[42885]: pgmap v429: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 14 MiB/s wr, 685 op/s 2024-06-02T04:09:58.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:09:58 smithi136 ceph-mon[47443]: pgmap v429: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 14 MiB/s wr, 685 op/s 2024-06-02T04:09:59.488 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 325.0 s, 2837.9 tps, lat 35.231 ms stddev 40.248 2024-06-02T04:10:00.554 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:00 smithi162 ceph-mon[47009]: pgmap v430: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 15 MiB/s wr, 701 op/s 2024-06-02T04:10:00.554 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:00 smithi162 ceph-mon[47009]: overall HEALTH_OK 2024-06-02T04:10:00.576 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:00 smithi123 ceph-mon[42885]: pgmap v430: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 15 MiB/s wr, 701 op/s 2024-06-02T04:10:00.576 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:00 smithi123 ceph-mon[42885]: overall HEALTH_OK 2024-06-02T04:10:00.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:00 smithi136 ceph-mon[47443]: pgmap v430: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 15 MiB/s wr, 701 op/s 2024-06-02T04:10:00.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:00 smithi136 ceph-mon[47443]: overall HEALTH_OK 2024-06-02T04:10:02.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:02 smithi162 ceph-mon[47009]: pgmap v431: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 741 op/s 2024-06-02T04:10:02.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:02 smithi123 ceph-mon[42885]: pgmap v431: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 741 op/s 2024-06-02T04:10:02.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:02 smithi136 ceph-mon[47443]: pgmap v431: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 14 MiB/s wr, 741 op/s 2024-06-02T04:10:04.488 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 330.0 s, 2711.2 tps, lat 36.901 ms stddev 44.683 2024-06-02T04:10:04.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:04 smithi162 ceph-mon[47009]: pgmap v432: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 13 MiB/s wr, 707 op/s 2024-06-02T04:10:04.580 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:04 smithi123 ceph-mon[42885]: pgmap v432: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 13 MiB/s wr, 707 op/s 2024-06-02T04:10:04.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:04 smithi136 ceph-mon[47443]: pgmap v432: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 13 MiB/s wr, 707 op/s 2024-06-02T04:10:06.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:06 smithi162 ceph-mon[47009]: pgmap v433: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 775 op/s 2024-06-02T04:10:06.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:06 smithi123 ceph-mon[42885]: pgmap v433: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 775 op/s 2024-06-02T04:10:06.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:06 smithi136 ceph-mon[47443]: pgmap v433: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 775 op/s 2024-06-02T04:10:08.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:08 smithi162 ceph-mon[47009]: pgmap v434: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 12 MiB/s wr, 700 op/s 2024-06-02T04:10:08.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:08 smithi123 ceph-mon[42885]: pgmap v434: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 12 MiB/s wr, 700 op/s 2024-06-02T04:10:08.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:08 smithi136 ceph-mon[47443]: pgmap v434: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 12 MiB/s wr, 700 op/s 2024-06-02T04:10:09.488 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 335.0 s, 2148.2 tps, lat 45.922 ms stddev 55.376 2024-06-02T04:10:10.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:10 smithi162 ceph-mon[47009]: pgmap v435: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 727 op/s 2024-06-02T04:10:10.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:10 smithi123 ceph-mon[42885]: pgmap v435: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 727 op/s 2024-06-02T04:10:10.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:10 smithi136 ceph-mon[47443]: pgmap v435: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 727 op/s 2024-06-02T04:10:12.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:12 smithi162 ceph-mon[47009]: pgmap v436: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 787 op/s 2024-06-02T04:10:12.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:12 smithi123 ceph-mon[42885]: pgmap v436: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 787 op/s 2024-06-02T04:10:12.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:12 smithi136 ceph-mon[47443]: pgmap v436: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 787 op/s 2024-06-02T04:10:13.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:13 smithi136 ceph-mon[47443]: pgmap v437: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 852 op/s 2024-06-02T04:10:13.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:13 smithi162 ceph-mon[47009]: pgmap v437: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 852 op/s 2024-06-02T04:10:13.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:13 smithi123 ceph-mon[42885]: pgmap v437: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 852 op/s 2024-06-02T04:10:14.488 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 340.0 s, 1960.4 tps, lat 51.292 ms stddev 58.705 2024-06-02T04:10:15.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:14 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:10:15.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:14 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:10:15.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:14 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:10:16.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:15 smithi162 ceph-mon[47009]: pgmap v438: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 980 op/s 2024-06-02T04:10:16.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:15 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:10:16.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:15 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:10:16.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:15 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:10:16.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:15 smithi123 ceph-mon[42885]: pgmap v438: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 980 op/s 2024-06-02T04:10:16.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:15 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:10:16.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:15 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:10:16.323 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:15 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:10:16.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:15 smithi136 ceph-mon[47443]: pgmap v438: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 19 MiB/s wr, 980 op/s 2024-06-02T04:10:16.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:15 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:10:16.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:15 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:10:16.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:15 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:10:18.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:18 smithi123 ceph-mon[42885]: pgmap v439: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 17 MiB/s wr, 876 op/s 2024-06-02T04:10:18.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:18 smithi136 ceph-mon[47443]: pgmap v439: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 17 MiB/s wr, 876 op/s 2024-06-02T04:10:18.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:18 smithi162 ceph-mon[47009]: pgmap v439: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 17 MiB/s wr, 876 op/s 2024-06-02T04:10:19.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 345.0 s, 2134.4 tps, lat 47.046 ms stddev 52.866 2024-06-02T04:10:20.327 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:20 smithi123 ceph-mon[42885]: pgmap v440: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 17 MiB/s wr, 880 op/s 2024-06-02T04:10:20.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:20 smithi136 ceph-mon[47443]: pgmap v440: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 17 MiB/s wr, 880 op/s 2024-06-02T04:10:20.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:20 smithi162 ceph-mon[47009]: pgmap v440: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 17 MiB/s wr, 880 op/s 2024-06-02T04:10:22.341 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:22 smithi136 ceph-mon[47443]: pgmap v441: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 20 MiB/s wr, 965 op/s 2024-06-02T04:10:22.551 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:22 smithi162 ceph-mon[47009]: pgmap v441: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 20 MiB/s wr, 965 op/s 2024-06-02T04:10:22.577 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:22 smithi123 ceph-mon[42885]: pgmap v441: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 20 MiB/s wr, 965 op/s 2024-06-02T04:10:24.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 350.0 s, 1608.5 tps, lat 57.956 ms stddev 94.068 2024-06-02T04:10:24.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:24 smithi162 ceph-mon[47009]: pgmap v442: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 21 MiB/s wr, 971 op/s 2024-06-02T04:10:24.575 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:24 smithi123 ceph-mon[42885]: pgmap v442: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 21 MiB/s wr, 971 op/s 2024-06-02T04:10:24.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:24 smithi136 ceph-mon[47443]: pgmap v442: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 21 MiB/s wr, 971 op/s 2024-06-02T04:10:26.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:26 smithi162 ceph-mon[47009]: pgmap v443: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 31 MiB/s wr, 1.42k op/s 2024-06-02T04:10:26.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:26 smithi123 ceph-mon[42885]: pgmap v443: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 31 MiB/s wr, 1.42k op/s 2024-06-02T04:10:26.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:26 smithi136 ceph-mon[47443]: pgmap v443: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 31 MiB/s wr, 1.42k op/s 2024-06-02T04:10:28.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:28 smithi162 ceph-mon[47009]: pgmap v444: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 33 MiB/s wr, 1.58k op/s 2024-06-02T04:10:28.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:28 smithi123 ceph-mon[42885]: pgmap v444: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 33 MiB/s wr, 1.58k op/s 2024-06-02T04:10:28.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:28 smithi136 ceph-mon[47443]: pgmap v444: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 33 MiB/s wr, 1.58k op/s 2024-06-02T04:10:29.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 355.0 s, 2493.7 tps, lat 42.410 ms stddev 60.694 2024-06-02T04:10:30.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:30 smithi162 ceph-mon[47009]: pgmap v445: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 40 MiB/s wr, 1.89k op/s 2024-06-02T04:10:30.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:30 smithi123 ceph-mon[42885]: pgmap v445: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 40 MiB/s wr, 1.89k op/s 2024-06-02T04:10:30.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:30 smithi136 ceph-mon[47443]: pgmap v445: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 40 MiB/s wr, 1.89k op/s 2024-06-02T04:10:32.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:32 smithi162 ceph-mon[47009]: pgmap v446: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 MiB/s wr, 1.96k op/s 2024-06-02T04:10:32.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:32 smithi123 ceph-mon[42885]: pgmap v446: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 MiB/s wr, 1.96k op/s 2024-06-02T04:10:32.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:32 smithi136 ceph-mon[47443]: pgmap v446: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 42 MiB/s wr, 1.96k op/s 2024-06-02T04:10:34.490 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 360.0 s, 2421.6 tps, lat 41.590 ms stddev 48.504 2024-06-02T04:10:34.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:34 smithi162 ceph-mon[47009]: pgmap v447: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 MiB/s wr, 1.91k op/s 2024-06-02T04:10:34.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:34 smithi123 ceph-mon[42885]: pgmap v447: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 MiB/s wr, 1.91k op/s 2024-06-02T04:10:34.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:34 smithi136 ceph-mon[47443]: pgmap v447: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 40 MiB/s wr, 1.91k op/s 2024-06-02T04:10:36.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:36 smithi162 ceph-mon[47009]: pgmap v448: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 38 MiB/s wr, 1.89k op/s 2024-06-02T04:10:36.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:36 smithi123 ceph-mon[42885]: pgmap v448: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 38 MiB/s wr, 1.89k op/s 2024-06-02T04:10:36.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:36 smithi136 ceph-mon[47443]: pgmap v448: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 38 MiB/s wr, 1.89k op/s 2024-06-02T04:10:38.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:38 smithi162 ceph-mon[47009]: pgmap v449: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 26 MiB/s wr, 1.29k op/s 2024-06-02T04:10:38.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:38 smithi123 ceph-mon[42885]: pgmap v449: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 26 MiB/s wr, 1.29k op/s 2024-06-02T04:10:38.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:38 smithi136 ceph-mon[47443]: pgmap v449: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 26 MiB/s wr, 1.29k op/s 2024-06-02T04:10:39.488 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 365.0 s, 2423.3 tps, lat 41.554 ms stddev 44.979 2024-06-02T04:10:40.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:40 smithi162 ceph-mon[47009]: pgmap v450: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 20 MiB/s wr, 1.01k op/s 2024-06-02T04:10:40.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:40 smithi123 ceph-mon[42885]: pgmap v450: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 20 MiB/s wr, 1.01k op/s 2024-06-02T04:10:40.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:40 smithi136 ceph-mon[47443]: pgmap v450: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 20 MiB/s wr, 1.01k op/s 2024-06-02T04:10:42.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:42 smithi162 ceph-mon[47009]: pgmap v451: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 13 MiB/s wr, 724 op/s 2024-06-02T04:10:42.576 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:42 smithi123 ceph-mon[42885]: pgmap v451: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 13 MiB/s wr, 724 op/s 2024-06-02T04:10:42.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:42 smithi136 ceph-mon[47443]: pgmap v451: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 13 MiB/s wr, 724 op/s 2024-06-02T04:10:44.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 370.0 s, 2489.0 tps, lat 39.993 ms stddev 44.179 2024-06-02T04:10:44.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:44 smithi162 ceph-mon[47009]: pgmap v452: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 714 op/s 2024-06-02T04:10:44.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:44 smithi123 ceph-mon[42885]: pgmap v452: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 714 op/s 2024-06-02T04:10:44.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:44 smithi136 ceph-mon[47443]: pgmap v452: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 714 op/s 2024-06-02T04:10:46.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:46 smithi162 ceph-mon[47009]: pgmap v453: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 13 MiB/s wr, 760 op/s 2024-06-02T04:10:46.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:46 smithi123 ceph-mon[42885]: pgmap v453: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 13 MiB/s wr, 760 op/s 2024-06-02T04:10:46.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:46 smithi136 ceph-mon[47443]: pgmap v453: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 13 MiB/s wr, 760 op/s 2024-06-02T04:10:48.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:48 smithi162 ceph-mon[47009]: pgmap v454: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 716 op/s 2024-06-02T04:10:48.578 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:48 smithi123 ceph-mon[42885]: pgmap v454: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 716 op/s 2024-06-02T04:10:48.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:48 smithi136 ceph-mon[47443]: pgmap v454: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 716 op/s 2024-06-02T04:10:49.488 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 375.0 s, 2240.0 tps, lat 44.475 ms stddev 50.688 2024-06-02T04:10:50.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:50 smithi162 ceph-mon[47009]: pgmap v455: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 747 op/s 2024-06-02T04:10:50.837 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:50 smithi136 ceph-mon[47443]: pgmap v455: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 747 op/s 2024-06-02T04:10:50.837 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:50 smithi123 ceph-mon[42885]: pgmap v455: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 747 op/s 2024-06-02T04:10:52.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:52 smithi162 ceph-mon[47009]: pgmap v456: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 817 op/s 2024-06-02T04:10:52.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:52 smithi123 ceph-mon[42885]: pgmap v456: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 817 op/s 2024-06-02T04:10:52.594 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:52 smithi136 ceph-mon[47443]: pgmap v456: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 817 op/s 2024-06-02T04:10:54.490 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 380.0 s, 2258.4 tps, lat 43.674 ms stddev 54.963 2024-06-02T04:10:54.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:54 smithi162 ceph-mon[47009]: pgmap v457: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 13 MiB/s wr, 802 op/s 2024-06-02T04:10:54.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:54 smithi123 ceph-mon[42885]: pgmap v457: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 13 MiB/s wr, 802 op/s 2024-06-02T04:10:54.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:54 smithi136 ceph-mon[47443]: pgmap v457: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 13 MiB/s wr, 802 op/s 2024-06-02T04:10:56.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:56 smithi162 ceph-mon[47009]: pgmap v458: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 845 op/s 2024-06-02T04:10:56.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:56 smithi123 ceph-mon[42885]: pgmap v458: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 845 op/s 2024-06-02T04:10:56.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:56 smithi136 ceph-mon[47443]: pgmap v458: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 845 op/s 2024-06-02T04:10:58.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:10:58 smithi162 ceph-mon[47009]: pgmap v459: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 11 MiB/s wr, 721 op/s 2024-06-02T04:10:58.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:10:58 smithi123 ceph-mon[42885]: pgmap v459: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 11 MiB/s wr, 721 op/s 2024-06-02T04:10:58.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:10:58 smithi136 ceph-mon[47443]: pgmap v459: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 11 MiB/s wr, 721 op/s 2024-06-02T04:10:59.499 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 385.0 s, 1943.6 tps, lat 51.873 ms stddev 62.583 2024-06-02T04:11:00.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:00 smithi123 ceph-mon[42885]: pgmap v460: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 13 MiB/s wr, 790 op/s 2024-06-02T04:11:00.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:00 smithi136 ceph-mon[47443]: pgmap v460: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 13 MiB/s wr, 790 op/s 2024-06-02T04:11:00.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:00 smithi162 ceph-mon[47009]: pgmap v460: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 13 MiB/s wr, 790 op/s 2024-06-02T04:11:02.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:02 smithi123 ceph-mon[42885]: pgmap v461: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 853 op/s 2024-06-02T04:11:02.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:02 smithi136 ceph-mon[47443]: pgmap v461: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 853 op/s 2024-06-02T04:11:02.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:02 smithi162 ceph-mon[47009]: pgmap v461: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 853 op/s 2024-06-02T04:11:04.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 390.0 s, 2184.2 tps, lat 46.179 ms stddev 53.562 2024-06-02T04:11:04.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:04 smithi123 ceph-mon[42885]: pgmap v462: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 17 MiB/s wr, 829 op/s 2024-06-02T04:11:04.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:04 smithi136 ceph-mon[47443]: pgmap v462: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 17 MiB/s wr, 829 op/s 2024-06-02T04:11:04.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:04 smithi162 ceph-mon[47009]: pgmap v462: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 17 MiB/s wr, 829 op/s 2024-06-02T04:11:06.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:06 smithi162 ceph-mon[47009]: pgmap v463: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 MiB/s wr, 894 op/s 2024-06-02T04:11:06.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:06 smithi123 ceph-mon[42885]: pgmap v463: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 MiB/s wr, 894 op/s 2024-06-02T04:11:06.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:06 smithi136 ceph-mon[47443]: pgmap v463: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 21 MiB/s wr, 894 op/s 2024-06-02T04:11:07.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:07 smithi162 ceph-mon[47009]: pgmap v464: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 19 MiB/s wr, 759 op/s 2024-06-02T04:11:07.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:07 smithi123 ceph-mon[42885]: pgmap v464: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 19 MiB/s wr, 759 op/s 2024-06-02T04:11:07.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:07 smithi136 ceph-mon[47443]: pgmap v464: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 19 MiB/s wr, 759 op/s 2024-06-02T04:11:09.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 395.0 s, 1344.9 tps, lat 71.173 ms stddev 107.641 2024-06-02T04:11:10.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:10 smithi162 ceph-mon[47009]: pgmap v465: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 20 MiB/s wr, 815 op/s 2024-06-02T04:11:10.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:10 smithi123 ceph-mon[42885]: pgmap v465: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 20 MiB/s wr, 815 op/s 2024-06-02T04:11:10.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:10 smithi136 ceph-mon[47443]: pgmap v465: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 20 MiB/s wr, 815 op/s 2024-06-02T04:11:12.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:12 smithi162 ceph-mon[47009]: pgmap v466: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 32 MiB/s wr, 1.31k op/s 2024-06-02T04:11:12.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:12 smithi123 ceph-mon[42885]: pgmap v466: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 32 MiB/s wr, 1.31k op/s 2024-06-02T04:11:12.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:12 smithi136 ceph-mon[47443]: pgmap v466: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 32 MiB/s wr, 1.31k op/s 2024-06-02T04:11:14.491 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 400.0 s, 2092.9 tps, lat 49.212 ms stddev 74.316 2024-06-02T04:11:14.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:14 smithi162 ceph-mon[47009]: pgmap v467: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 41 MiB/s wr, 1.82k op/s 2024-06-02T04:11:14.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:14 smithi123 ceph-mon[42885]: pgmap v467: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 41 MiB/s wr, 1.82k op/s 2024-06-02T04:11:14.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:14 smithi136 ceph-mon[47443]: pgmap v467: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 41 MiB/s wr, 1.82k op/s 2024-06-02T04:11:16.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:16 smithi162 ceph-mon[47009]: pgmap v468: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 MiB/s wr, 2.07k op/s 2024-06-02T04:11:16.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:16 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:11:16.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:16 smithi123 ceph-mon[42885]: pgmap v468: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 MiB/s wr, 2.07k op/s 2024-06-02T04:11:16.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:16 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:11:16.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:16 smithi136 ceph-mon[47443]: pgmap v468: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 MiB/s wr, 2.07k op/s 2024-06-02T04:11:16.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:16 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:11:17.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:17 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:11:17.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:17 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:11:17.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:17 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:11:17.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:11:17.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:11:17.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:11:17.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:17 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:11:17.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:17 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:11:17.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:17 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:11:18.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:18 smithi162 ceph-mon[47009]: pgmap v469: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 41 MiB/s wr, 1.96k op/s 2024-06-02T04:11:18.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:18 smithi123 ceph-mon[42885]: pgmap v469: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 41 MiB/s wr, 1.96k op/s 2024-06-02T04:11:18.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:18 smithi136 ceph-mon[47443]: pgmap v469: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 41 MiB/s wr, 1.96k op/s 2024-06-02T04:11:19.492 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 405.0 s, 2054.8 tps, lat 49.263 ms stddev 60.979 2024-06-02T04:11:20.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:20 smithi162 ceph-mon[47009]: pgmap v470: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 MiB/s wr, 2.03k op/s 2024-06-02T04:11:20.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:20 smithi123 ceph-mon[42885]: pgmap v470: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 MiB/s wr, 2.03k op/s 2024-06-02T04:11:20.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:20 smithi136 ceph-mon[47443]: pgmap v470: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 MiB/s wr, 2.03k op/s 2024-06-02T04:11:22.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:22 smithi162 ceph-mon[47009]: pgmap v471: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 MiB/s wr, 2.05k op/s 2024-06-02T04:11:22.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:22 smithi123 ceph-mon[42885]: pgmap v471: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 MiB/s wr, 2.05k op/s 2024-06-02T04:11:22.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:22 smithi136 ceph-mon[47443]: pgmap v471: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 MiB/s wr, 2.05k op/s 2024-06-02T04:11:24.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 410.0 s, 2611.4 tps, lat 38.385 ms stddev 41.286 2024-06-02T04:11:24.550 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:24 smithi162 ceph-mon[47009]: pgmap v472: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 30 MiB/s wr, 1.54k op/s 2024-06-02T04:11:24.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:24 smithi123 ceph-mon[42885]: pgmap v472: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 30 MiB/s wr, 1.54k op/s 2024-06-02T04:11:24.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:24 smithi136 ceph-mon[47443]: pgmap v472: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 30 MiB/s wr, 1.54k op/s 2024-06-02T04:11:26.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:26 smithi162 ceph-mon[47009]: pgmap v473: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 20 MiB/s wr, 1.01k op/s 2024-06-02T04:11:26.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:26 smithi123 ceph-mon[42885]: pgmap v473: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 20 MiB/s wr, 1.01k op/s 2024-06-02T04:11:26.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:26 smithi136 ceph-mon[47443]: pgmap v473: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 20 MiB/s wr, 1.01k op/s 2024-06-02T04:11:28.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:28 smithi162 ceph-mon[47009]: pgmap v474: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 14 MiB/s wr, 675 op/s 2024-06-02T04:11:28.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:28 smithi123 ceph-mon[42885]: pgmap v474: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 14 MiB/s wr, 675 op/s 2024-06-02T04:11:28.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:28 smithi136 ceph-mon[47443]: pgmap v474: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 14 MiB/s wr, 675 op/s 2024-06-02T04:11:29.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 415.0 s, 2451.9 tps, lat 40.882 ms stddev 46.865 2024-06-02T04:11:30.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:30 smithi162 ceph-mon[47009]: pgmap v475: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 14 MiB/s wr, 729 op/s 2024-06-02T04:11:30.575 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:30 smithi123 ceph-mon[42885]: pgmap v475: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 14 MiB/s wr, 729 op/s 2024-06-02T04:11:30.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:30 smithi136 ceph-mon[47443]: pgmap v475: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 14 MiB/s wr, 729 op/s 2024-06-02T04:11:32.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:32 smithi162 ceph-mon[47009]: pgmap v476: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 740 op/s 2024-06-02T04:11:32.576 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:32 smithi123 ceph-mon[42885]: pgmap v476: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 740 op/s 2024-06-02T04:11:32.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:32 smithi136 ceph-mon[47443]: pgmap v476: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 740 op/s 2024-06-02T04:11:34.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 420.0 s, 1811.6 tps, lat 55.072 ms stddev 64.404 2024-06-02T04:11:34.551 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:34 smithi162 ceph-mon[47009]: pgmap v477: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 712 op/s 2024-06-02T04:11:34.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:34 smithi123 ceph-mon[42885]: pgmap v477: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 712 op/s 2024-06-02T04:11:34.591 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:34 smithi136 ceph-mon[47443]: pgmap v477: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 712 op/s 2024-06-02T04:11:36.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:36 smithi162 ceph-mon[47009]: pgmap v478: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 MiB/s wr, 752 op/s 2024-06-02T04:11:36.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:36 smithi123 ceph-mon[42885]: pgmap v478: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 MiB/s wr, 752 op/s 2024-06-02T04:11:36.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:36 smithi136 ceph-mon[47443]: pgmap v478: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 MiB/s wr, 752 op/s 2024-06-02T04:11:38.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:38 smithi162 ceph-mon[47009]: pgmap v479: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 640 op/s 2024-06-02T04:11:38.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:38 smithi123 ceph-mon[42885]: pgmap v479: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 640 op/s 2024-06-02T04:11:38.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:38 smithi136 ceph-mon[47443]: pgmap v479: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 640 op/s 2024-06-02T04:11:39.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 425.0 s, 1450.2 tps, lat 68.768 ms stddev 74.958 2024-06-02T04:11:40.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:40 smithi123 ceph-mon[42885]: pgmap v480: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 MiB/s wr, 735 op/s 2024-06-02T04:11:40.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:40 smithi136 ceph-mon[47443]: pgmap v480: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 MiB/s wr, 735 op/s 2024-06-02T04:11:40.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:40 smithi162 ceph-mon[47009]: pgmap v480: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 MiB/s wr, 735 op/s 2024-06-02T04:11:42.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:42 smithi123 ceph-mon[42885]: pgmap v481: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 16 MiB/s wr, 788 op/s 2024-06-02T04:11:42.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:42 smithi136 ceph-mon[47443]: pgmap v481: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 16 MiB/s wr, 788 op/s 2024-06-02T04:11:42.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:42 smithi162 ceph-mon[47009]: pgmap v481: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 16 MiB/s wr, 788 op/s 2024-06-02T04:11:44.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 430.0 s, 1976.6 tps, lat 50.288 ms stddev 57.256 2024-06-02T04:11:44.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:44 smithi123 ceph-mon[42885]: pgmap v482: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 MiB/s wr, 790 op/s 2024-06-02T04:11:44.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:44 smithi136 ceph-mon[47443]: pgmap v482: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 MiB/s wr, 790 op/s 2024-06-02T04:11:44.803 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:44 smithi162 ceph-mon[47009]: pgmap v482: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 18 MiB/s wr, 790 op/s 2024-06-02T04:11:46.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:46 smithi123 ceph-mon[42885]: pgmap v483: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 MiB/s wr, 865 op/s 2024-06-02T04:11:46.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:46 smithi136 ceph-mon[47443]: pgmap v483: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 MiB/s wr, 865 op/s 2024-06-02T04:11:46.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:46 smithi162 ceph-mon[47009]: pgmap v483: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 21 MiB/s wr, 865 op/s 2024-06-02T04:11:48.576 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:48 smithi123 ceph-mon[42885]: pgmap v484: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 MiB/s wr, 755 op/s 2024-06-02T04:11:48.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:48 smithi136 ceph-mon[47443]: pgmap v484: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 MiB/s wr, 755 op/s 2024-06-02T04:11:48.800 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:48 smithi162 ceph-mon[47009]: pgmap v484: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 18 MiB/s wr, 755 op/s 2024-06-02T04:11:49.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 435.0 s, 1310.0 tps, lat 77.006 ms stddev 119.287 2024-06-02T04:11:50.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:50 smithi123 ceph-mon[42885]: pgmap v485: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 21 MiB/s wr, 862 op/s 2024-06-02T04:11:50.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:50 smithi136 ceph-mon[47443]: pgmap v485: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 21 MiB/s wr, 862 op/s 2024-06-02T04:11:50.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:50 smithi162 ceph-mon[47009]: pgmap v485: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 21 MiB/s wr, 862 op/s 2024-06-02T04:11:52.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:52 smithi123 ceph-mon[42885]: pgmap v486: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 31 MiB/s wr, 1.41k op/s 2024-06-02T04:11:52.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:52 smithi136 ceph-mon[47443]: pgmap v486: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 31 MiB/s wr, 1.41k op/s 2024-06-02T04:11:52.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:52 smithi162 ceph-mon[47009]: pgmap v486: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 31 MiB/s wr, 1.41k op/s 2024-06-02T04:11:54.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 440.0 s, 1834.9 tps, lat 53.725 ms stddev 59.604 2024-06-02T04:11:54.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:54 smithi136 ceph-mon[47443]: pgmap v487: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 40 MiB/s wr, 1.94k op/s 2024-06-02T04:11:54.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:54 smithi162 ceph-mon[47009]: pgmap v487: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 40 MiB/s wr, 1.94k op/s 2024-06-02T04:11:54.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:54 smithi123 ceph-mon[42885]: pgmap v487: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 40 MiB/s wr, 1.94k op/s 2024-06-02T04:11:56.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:56 smithi136 ceph-mon[47443]: pgmap v488: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 MiB/s wr, 2.03k op/s 2024-06-02T04:11:56.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:56 smithi162 ceph-mon[47009]: pgmap v488: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 MiB/s wr, 2.03k op/s 2024-06-02T04:11:56.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:56 smithi123 ceph-mon[42885]: pgmap v488: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 MiB/s wr, 2.03k op/s 2024-06-02T04:11:58.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:11:58 smithi136 ceph-mon[47443]: pgmap v489: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 MiB/s wr, 1.89k op/s 2024-06-02T04:11:58.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:11:58 smithi162 ceph-mon[47009]: pgmap v489: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 MiB/s wr, 1.89k op/s 2024-06-02T04:11:58.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:11:58 smithi123 ceph-mon[42885]: pgmap v489: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 MiB/s wr, 1.89k op/s 2024-06-02T04:11:59.490 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 445.0 s, 1972.8 tps, lat 51.183 ms stddev 55.875 2024-06-02T04:12:00.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:00 smithi162 ceph-mon[47009]: pgmap v490: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 38 MiB/s wr, 1.93k op/s 2024-06-02T04:12:00.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:00 smithi123 ceph-mon[42885]: pgmap v490: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 38 MiB/s wr, 1.93k op/s 2024-06-02T04:12:00.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:00 smithi136 ceph-mon[47443]: pgmap v490: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 38 MiB/s wr, 1.93k op/s 2024-06-02T04:12:01.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:01 smithi162 ceph-mon[47009]: pgmap v491: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 MiB/s wr, 1.89k op/s 2024-06-02T04:12:01.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:01 smithi123 ceph-mon[42885]: pgmap v491: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 MiB/s wr, 1.89k op/s 2024-06-02T04:12:01.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:01 smithi136 ceph-mon[47443]: pgmap v491: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 MiB/s wr, 1.89k op/s 2024-06-02T04:12:04.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 450.0 s, 1954.3 tps, lat 51.523 ms stddev 59.660 2024-06-02T04:12:04.550 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:04 smithi162 ceph-mon[47009]: pgmap v492: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 MiB/s wr, 1.33k op/s 2024-06-02T04:12:04.578 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:04 smithi123 ceph-mon[42885]: pgmap v492: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 MiB/s wr, 1.33k op/s 2024-06-02T04:12:04.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:04 smithi136 ceph-mon[47443]: pgmap v492: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 MiB/s wr, 1.33k op/s 2024-06-02T04:12:06.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:06 smithi162 ceph-mon[47009]: pgmap v493: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 18 MiB/s wr, 777 op/s 2024-06-02T04:12:06.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:06 smithi123 ceph-mon[42885]: pgmap v493: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 18 MiB/s wr, 777 op/s 2024-06-02T04:12:06.593 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:06 smithi136 ceph-mon[47443]: pgmap v493: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 18 MiB/s wr, 777 op/s 2024-06-02T04:12:08.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:08 smithi162 ceph-mon[47009]: pgmap v494: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 13 MiB/s wr, 584 op/s 2024-06-02T04:12:08.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:08 smithi123 ceph-mon[42885]: pgmap v494: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 13 MiB/s wr, 584 op/s 2024-06-02T04:12:08.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:08 smithi136 ceph-mon[47443]: pgmap v494: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 13 MiB/s wr, 584 op/s 2024-06-02T04:12:09.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 455.0 s, 1946.6 tps, lat 51.135 ms stddev 53.854 2024-06-02T04:12:10.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:10 smithi162 ceph-mon[47009]: pgmap v495: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 658 op/s 2024-06-02T04:12:10.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:10 smithi123 ceph-mon[42885]: pgmap v495: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 658 op/s 2024-06-02T04:12:10.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:10 smithi136 ceph-mon[47443]: pgmap v495: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 658 op/s 2024-06-02T04:12:12.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:12 smithi162 ceph-mon[47009]: pgmap v496: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 14 MiB/s wr, 681 op/s 2024-06-02T04:12:12.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:12 smithi123 ceph-mon[42885]: pgmap v496: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 14 MiB/s wr, 681 op/s 2024-06-02T04:12:12.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:12 smithi136 ceph-mon[47443]: pgmap v496: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 14 MiB/s wr, 681 op/s 2024-06-02T04:12:14.491 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 460.0 s, 1851.2 tps, lat 53.149 ms stddev 61.282 2024-06-02T04:12:14.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:14 smithi136 ceph-mon[47443]: pgmap v497: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 14 MiB/s wr, 679 op/s 2024-06-02T04:12:14.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:14 smithi162 ceph-mon[47009]: pgmap v497: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 14 MiB/s wr, 679 op/s 2024-06-02T04:12:14.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:14 smithi123 ceph-mon[42885]: pgmap v497: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 14 MiB/s wr, 679 op/s 2024-06-02T04:12:16.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:16 smithi162 ceph-mon[47009]: pgmap v498: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 728 op/s 2024-06-02T04:12:16.826 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:16 smithi123 ceph-mon[42885]: pgmap v498: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 728 op/s 2024-06-02T04:12:16.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:16 smithi136 ceph-mon[47443]: pgmap v498: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 728 op/s 2024-06-02T04:12:17.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:17 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:12:17.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:17 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:12:17.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:17 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:12:17.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:17 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:12:17.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:17 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:12:17.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:17 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:12:17.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:17 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:12:17.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:17 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:12:17.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:17 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:12:17.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:17 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:12:17.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:17 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:12:17.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:17 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:12:17.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:12:17.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:12:17.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:12:17.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:12:17.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:12:17.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:12:17.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:12:17.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:12:17.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:12:17.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:12:17.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:12:17.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:17 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:12:17.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:17 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:12:17.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:17 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:12:17.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:17 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:12:17.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:17 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:12:17.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:17 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:12:17.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:17 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:12:17.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:17 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:12:17.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:17 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:12:17.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:17 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:12:17.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:17 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:12:17.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:17 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:12:17.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:17 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:12:18.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:18 smithi162 ceph-mon[47009]: pgmap v499: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 658 op/s 2024-06-02T04:12:18.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:18 smithi162 ceph-mon[47009]: Adjusting osd_memory_target on smithi136 to 182.4M 2024-06-02T04:12:18.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:18 smithi162 ceph-mon[47009]: Unable to set osd_memory_target on smithi136 to 191358361: error parsing value: Value '191358361' is below minimum 939524096 2024-06-02T04:12:18.800 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:18 smithi162 ceph-mon[47009]: Adjusting osd_memory_target on smithi123 to 182.5M 2024-06-02T04:12:18.800 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:18 smithi162 ceph-mon[47009]: Unable to set osd_memory_target on smithi123 to 191371980: error parsing value: Value '191371980' is below minimum 939524096 2024-06-02T04:12:18.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:18 smithi123 ceph-mon[42885]: pgmap v499: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 658 op/s 2024-06-02T04:12:18.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:18 smithi123 ceph-mon[42885]: Adjusting osd_memory_target on smithi136 to 182.4M 2024-06-02T04:12:18.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:18 smithi123 ceph-mon[42885]: Unable to set osd_memory_target on smithi136 to 191358361: error parsing value: Value '191358361' is below minimum 939524096 2024-06-02T04:12:18.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:18 smithi123 ceph-mon[42885]: Adjusting osd_memory_target on smithi123 to 182.5M 2024-06-02T04:12:18.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:18 smithi123 ceph-mon[42885]: Unable to set osd_memory_target on smithi123 to 191371980: error parsing value: Value '191371980' is below minimum 939524096 2024-06-02T04:12:18.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:18 smithi136 ceph-mon[47443]: pgmap v499: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 658 op/s 2024-06-02T04:12:18.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:18 smithi136 ceph-mon[47443]: Adjusting osd_memory_target on smithi136 to 182.4M 2024-06-02T04:12:18.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:18 smithi136 ceph-mon[47443]: Unable to set osd_memory_target on smithi136 to 191358361: error parsing value: Value '191358361' is below minimum 939524096 2024-06-02T04:12:18.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:18 smithi136 ceph-mon[47443]: Adjusting osd_memory_target on smithi123 to 182.5M 2024-06-02T04:12:18.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:18 smithi136 ceph-mon[47443]: Unable to set osd_memory_target on smithi123 to 191371980: error parsing value: Value '191371980' is below minimum 939524096 2024-06-02T04:12:19.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 465.0 s, 1393.8 tps, lat 72.734 ms stddev 93.110 2024-06-02T04:12:19.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:19 smithi162 ceph-mon[47009]: pgmap v500: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 797 op/s 2024-06-02T04:12:19.831 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:19 smithi123 ceph-mon[42885]: pgmap v500: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 797 op/s 2024-06-02T04:12:19.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:19 smithi136 ceph-mon[47443]: pgmap v500: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 MiB/s wr, 797 op/s 2024-06-02T04:12:22.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:22 smithi162 ceph-mon[47009]: pgmap v501: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 17 MiB/s wr, 864 op/s 2024-06-02T04:12:22.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:22 smithi123 ceph-mon[42885]: pgmap v501: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 17 MiB/s wr, 864 op/s 2024-06-02T04:12:22.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:22 smithi136 ceph-mon[47443]: pgmap v501: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 17 MiB/s wr, 864 op/s 2024-06-02T04:12:24.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 470.0 s, 1816.4 tps, lat 54.773 ms stddev 58.936 2024-06-02T04:12:24.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:24 smithi162 ceph-mon[47009]: pgmap v502: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 19 MiB/s wr, 917 op/s 2024-06-02T04:12:24.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:24 smithi123 ceph-mon[42885]: pgmap v502: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 19 MiB/s wr, 917 op/s 2024-06-02T04:12:24.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:24 smithi136 ceph-mon[47443]: pgmap v502: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 19 MiB/s wr, 917 op/s 2024-06-02T04:12:26.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:26 smithi162 ceph-mon[47009]: pgmap v503: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 21 MiB/s wr, 956 op/s 2024-06-02T04:12:26.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:26 smithi123 ceph-mon[42885]: pgmap v503: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 21 MiB/s wr, 956 op/s 2024-06-02T04:12:26.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:26 smithi136 ceph-mon[47443]: pgmap v503: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 21 MiB/s wr, 956 op/s 2024-06-02T04:12:28.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:28 smithi162 ceph-mon[47009]: pgmap v504: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 19 MiB/s wr, 829 op/s 2024-06-02T04:12:28.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:28 smithi123 ceph-mon[42885]: pgmap v504: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 19 MiB/s wr, 829 op/s 2024-06-02T04:12:28.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:28 smithi136 ceph-mon[47443]: pgmap v504: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 19 MiB/s wr, 829 op/s 2024-06-02T04:12:29.497 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 475.0 s, 1664.9 tps, lat 60.066 ms stddev 67.245 2024-06-02T04:12:30.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:30 smithi162 ceph-mon[47009]: pgmap v505: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 867 op/s 2024-06-02T04:12:30.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:30 smithi123 ceph-mon[42885]: pgmap v505: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 867 op/s 2024-06-02T04:12:30.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:30 smithi136 ceph-mon[47443]: pgmap v505: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 867 op/s 2024-06-02T04:12:32.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:32 smithi162 ceph-mon[47009]: pgmap v506: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 19 MiB/s wr, 833 op/s 2024-06-02T04:12:32.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:32 smithi123 ceph-mon[42885]: pgmap v506: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 19 MiB/s wr, 833 op/s 2024-06-02T04:12:32.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:32 smithi136 ceph-mon[47443]: pgmap v506: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 19 MiB/s wr, 833 op/s 2024-06-02T04:12:34.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 480.0 s, 1301.6 tps, lat 76.571 ms stddev 144.728 2024-06-02T04:12:34.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:34 smithi162 ceph-mon[47009]: pgmap v507: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 27 MiB/s wr, 1.32k op/s 2024-06-02T04:12:34.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:34 smithi123 ceph-mon[42885]: pgmap v507: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 27 MiB/s wr, 1.32k op/s 2024-06-02T04:12:34.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:34 smithi136 ceph-mon[47443]: pgmap v507: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 27 MiB/s wr, 1.32k op/s 2024-06-02T04:12:36.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:36 smithi162 ceph-mon[47009]: pgmap v508: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 38 MiB/s wr, 1.97k op/s 2024-06-02T04:12:36.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:36 smithi123 ceph-mon[42885]: pgmap v508: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 38 MiB/s wr, 1.97k op/s 2024-06-02T04:12:36.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:36 smithi136 ceph-mon[47443]: pgmap v508: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 38 MiB/s wr, 1.97k op/s 2024-06-02T04:12:38.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:38 smithi162 ceph-mon[47009]: pgmap v509: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 35 MiB/s wr, 1.82k op/s 2024-06-02T04:12:38.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:38 smithi123 ceph-mon[42885]: pgmap v509: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 35 MiB/s wr, 1.82k op/s 2024-06-02T04:12:38.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:38 smithi136 ceph-mon[47443]: pgmap v509: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 35 MiB/s wr, 1.82k op/s 2024-06-02T04:12:39.491 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 485.0 s, 2280.5 tps, lat 44.466 ms stddev 54.274 2024-06-02T04:12:40.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:40 smithi162 ceph-mon[47009]: pgmap v510: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 38 MiB/s wr, 1.99k op/s 2024-06-02T04:12:40.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:40 smithi123 ceph-mon[42885]: pgmap v510: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 38 MiB/s wr, 1.99k op/s 2024-06-02T04:12:40.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:40 smithi136 ceph-mon[47443]: pgmap v510: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 38 MiB/s wr, 1.99k op/s 2024-06-02T04:12:42.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:42 smithi162 ceph-mon[47009]: pgmap v511: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 38 MiB/s wr, 2.01k op/s 2024-06-02T04:12:42.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:42 smithi123 ceph-mon[42885]: pgmap v511: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 38 MiB/s wr, 2.01k op/s 2024-06-02T04:12:42.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:42 smithi136 ceph-mon[47443]: pgmap v511: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 38 MiB/s wr, 2.01k op/s 2024-06-02T04:12:44.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 490.0 s, 2064.7 tps, lat 48.068 ms stddev 57.951 2024-06-02T04:12:44.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:44 smithi162 ceph-mon[47009]: pgmap v512: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 36 MiB/s wr, 1.98k op/s 2024-06-02T04:12:44.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:44 smithi123 ceph-mon[42885]: pgmap v512: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 36 MiB/s wr, 1.98k op/s 2024-06-02T04:12:44.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:44 smithi136 ceph-mon[47443]: pgmap v512: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 36 MiB/s wr, 1.98k op/s 2024-06-02T04:12:46.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:46 smithi162 ceph-mon[47009]: pgmap v513: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 29 MiB/s wr, 1.52k op/s 2024-06-02T04:12:46.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:46 smithi123 ceph-mon[42885]: pgmap v513: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 29 MiB/s wr, 1.52k op/s 2024-06-02T04:12:46.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:46 smithi136 ceph-mon[47443]: pgmap v513: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 29 MiB/s wr, 1.52k op/s 2024-06-02T04:12:48.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:48 smithi162 ceph-mon[47009]: pgmap v514: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 13 MiB/s wr, 690 op/s 2024-06-02T04:12:48.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:48 smithi123 ceph-mon[42885]: pgmap v514: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 13 MiB/s wr, 690 op/s 2024-06-02T04:12:48.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:48 smithi136 ceph-mon[47443]: pgmap v514: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 13 MiB/s wr, 690 op/s 2024-06-02T04:12:49.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 495.0 s, 2102.2 tps, lat 47.816 ms stddev 55.829 2024-06-02T04:12:50.550 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:50 smithi162 ceph-mon[47009]: pgmap v515: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 16 MiB/s wr, 895 op/s 2024-06-02T04:12:50.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:50 smithi123 ceph-mon[42885]: pgmap v515: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 16 MiB/s wr, 895 op/s 2024-06-02T04:12:50.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:50 smithi136 ceph-mon[47443]: pgmap v515: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 16 MiB/s wr, 895 op/s 2024-06-02T04:12:52.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:52 smithi162 ceph-mon[47009]: pgmap v516: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 813 op/s 2024-06-02T04:12:52.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:52 smithi123 ceph-mon[42885]: pgmap v516: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 813 op/s 2024-06-02T04:12:52.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:52 smithi136 ceph-mon[47443]: pgmap v516: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 MiB/s wr, 813 op/s 2024-06-02T04:12:54.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 500.0 s, 2310.9 tps, lat 43.104 ms stddev 48.906 2024-06-02T04:12:54.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:54 smithi162 ceph-mon[47009]: pgmap v517: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 854 op/s 2024-06-02T04:12:54.580 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:54 smithi123 ceph-mon[42885]: pgmap v517: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 854 op/s 2024-06-02T04:12:54.593 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:54 smithi136 ceph-mon[47443]: pgmap v517: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 854 op/s 2024-06-02T04:12:56.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:56 smithi162 ceph-mon[47009]: pgmap v518: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 MiB/s wr, 911 op/s 2024-06-02T04:12:56.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:56 smithi123 ceph-mon[42885]: pgmap v518: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 MiB/s wr, 911 op/s 2024-06-02T04:12:56.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:56 smithi136 ceph-mon[47443]: pgmap v518: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 MiB/s wr, 911 op/s 2024-06-02T04:12:58.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:12:58 smithi162 ceph-mon[47009]: pgmap v519: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 705 op/s 2024-06-02T04:12:58.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:12:58 smithi123 ceph-mon[42885]: pgmap v519: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 705 op/s 2024-06-02T04:12:58.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:12:58 smithi136 ceph-mon[47443]: pgmap v519: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 705 op/s 2024-06-02T04:12:59.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 505.0 s, 2255.4 tps, lat 44.470 ms stddev 51.446 2024-06-02T04:13:00.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:00 smithi162 ceph-mon[47009]: pgmap v520: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 MiB/s wr, 845 op/s 2024-06-02T04:13:00.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:00 smithi123 ceph-mon[42885]: pgmap v520: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 MiB/s wr, 845 op/s 2024-06-02T04:13:00.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:00 smithi136 ceph-mon[47443]: pgmap v520: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 MiB/s wr, 845 op/s 2024-06-02T04:13:02.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:02 smithi123 ceph-mon[42885]: pgmap v521: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 13 MiB/s wr, 797 op/s 2024-06-02T04:13:02.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:02 smithi136 ceph-mon[47443]: pgmap v521: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 13 MiB/s wr, 797 op/s 2024-06-02T04:13:02.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:02 smithi162 ceph-mon[47009]: pgmap v521: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 13 MiB/s wr, 797 op/s 2024-06-02T04:13:04.494 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 510.0 s, 1972.3 tps, lat 50.318 ms stddev 59.574 2024-06-02T04:13:04.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:04 smithi123 ceph-mon[42885]: pgmap v522: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 12 MiB/s wr, 767 op/s 2024-06-02T04:13:04.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:04 smithi136 ceph-mon[47443]: pgmap v522: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 12 MiB/s wr, 767 op/s 2024-06-02T04:13:04.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:04 smithi162 ceph-mon[47009]: pgmap v522: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 12 MiB/s wr, 767 op/s 2024-06-02T04:13:06.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:06 smithi136 ceph-mon[47443]: pgmap v523: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 747 op/s 2024-06-02T04:13:06.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:06 smithi162 ceph-mon[47009]: pgmap v523: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 747 op/s 2024-06-02T04:13:06.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:06 smithi123 ceph-mon[42885]: pgmap v523: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 747 op/s 2024-06-02T04:13:08.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:08 smithi162 ceph-mon[47009]: pgmap v524: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.6 MiB/s wr, 575 op/s 2024-06-02T04:13:08.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:08 smithi123 ceph-mon[42885]: pgmap v524: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.6 MiB/s wr, 575 op/s 2024-06-02T04:13:08.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:08 smithi136 ceph-mon[47443]: pgmap v524: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.6 MiB/s wr, 575 op/s 2024-06-02T04:13:09.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 515.0 s, 1125.3 tps, lat 89.376 ms stddev 104.460 2024-06-02T04:13:10.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:10 smithi162 ceph-mon[47009]: pgmap v525: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 754 op/s 2024-06-02T04:13:10.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:10 smithi123 ceph-mon[42885]: pgmap v525: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 754 op/s 2024-06-02T04:13:10.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:10 smithi136 ceph-mon[47443]: pgmap v525: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 754 op/s 2024-06-02T04:13:11.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:11 smithi162 ceph-mon[47009]: pgmap v526: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 770 op/s 2024-06-02T04:13:11.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:11 smithi123 ceph-mon[42885]: pgmap v526: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 770 op/s 2024-06-02T04:13:11.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:11 smithi136 ceph-mon[47443]: pgmap v526: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 770 op/s 2024-06-02T04:13:14.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 520.0 s, 2040.8 tps, lat 49.238 ms stddev 63.261 2024-06-02T04:13:14.556 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:14 smithi162 ceph-mon[47009]: pgmap v527: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 765 op/s 2024-06-02T04:13:14.578 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:14 smithi123 ceph-mon[42885]: pgmap v527: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 765 op/s 2024-06-02T04:13:14.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:14 smithi136 ceph-mon[47443]: pgmap v527: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 765 op/s 2024-06-02T04:13:16.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:16 smithi162 ceph-mon[47009]: pgmap v528: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 859 op/s 2024-06-02T04:13:16.584 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:16 smithi123 ceph-mon[42885]: pgmap v528: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 859 op/s 2024-06-02T04:13:16.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:16 smithi136 ceph-mon[47443]: pgmap v528: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 859 op/s 2024-06-02T04:13:18.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:18 smithi162 ceph-mon[47009]: pgmap v529: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 14 MiB/s wr, 706 op/s 2024-06-02T04:13:18.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:18 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:13:18.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:18 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:13:18.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:18 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:13:18.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:18 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:13:18.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:18 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:13:18.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:18 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:13:18.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:18 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:13:18.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:18 smithi123 ceph-mon[42885]: pgmap v529: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 14 MiB/s wr, 706 op/s 2024-06-02T04:13:18.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:18 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:13:18.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:18 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:13:18.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:18 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:13:18.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:18 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:13:18.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:18 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:13:18.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:18 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:13:18.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:18 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:13:18.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:18 smithi136 ceph-mon[47443]: pgmap v529: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 14 MiB/s wr, 706 op/s 2024-06-02T04:13:18.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:18 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:13:18.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:18 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:13:18.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:18 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:13:18.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:18 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:13:18.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:18 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-06-02T04:13:18.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:18 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:13:18.590 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:18 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:13:19.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 525.0 s, 1856.4 tps, lat 53.556 ms stddev 59.884 2024-06-02T04:13:19.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:19 smithi162 ceph-mon[47009]: Adjusting osd_memory_target on smithi162 to 182.5M 2024-06-02T04:13:19.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:19 smithi162 ceph-mon[47009]: Unable to set osd_memory_target on smithi162 to 191374848: error parsing value: Value '191374848' is below minimum 939524096 2024-06-02T04:13:19.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:19 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:13:19.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:19 smithi123 ceph-mon[42885]: Adjusting osd_memory_target on smithi162 to 182.5M 2024-06-02T04:13:19.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:19 smithi123 ceph-mon[42885]: Unable to set osd_memory_target on smithi162 to 191374848: error parsing value: Value '191374848' is below minimum 939524096 2024-06-02T04:13:19.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:19 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:13:19.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:19 smithi136 ceph-mon[47443]: Adjusting osd_memory_target on smithi162 to 182.5M 2024-06-02T04:13:19.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:19 smithi136 ceph-mon[47443]: Unable to set osd_memory_target on smithi162 to 191374848: error parsing value: Value '191374848' is below minimum 939524096 2024-06-02T04:13:19.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:19 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:13:20.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:20 smithi162 ceph-mon[47009]: pgmap v530: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 18 MiB/s wr, 891 op/s 2024-06-02T04:13:20.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:20 smithi123 ceph-mon[42885]: pgmap v530: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 18 MiB/s wr, 891 op/s 2024-06-02T04:13:20.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:20 smithi136 ceph-mon[47443]: pgmap v530: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 18 MiB/s wr, 891 op/s 2024-06-02T04:13:22.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:22 smithi162 ceph-mon[47009]: pgmap v531: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 19 MiB/s wr, 873 op/s 2024-06-02T04:13:22.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:22 smithi123 ceph-mon[42885]: pgmap v531: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 19 MiB/s wr, 873 op/s 2024-06-02T04:13:22.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:22 smithi136 ceph-mon[47443]: pgmap v531: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 19 MiB/s wr, 873 op/s 2024-06-02T04:13:24.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 530.0 s, 1558.4 tps, lat 57.517 ms stddev 64.537 2024-06-02T04:13:24.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:24 smithi162 ceph-mon[47009]: pgmap v532: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 20 MiB/s wr, 930 op/s 2024-06-02T04:13:24.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:24 smithi123 ceph-mon[42885]: pgmap v532: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 20 MiB/s wr, 930 op/s 2024-06-02T04:13:24.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:24 smithi136 ceph-mon[47443]: pgmap v532: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 20 MiB/s wr, 930 op/s 2024-06-02T04:13:26.802 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:26 smithi162 ceph-mon[47009]: pgmap v533: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 30 MiB/s wr, 1.47k op/s 2024-06-02T04:13:26.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:26 smithi123 ceph-mon[42885]: pgmap v533: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 30 MiB/s wr, 1.47k op/s 2024-06-02T04:13:26.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:26 smithi136 ceph-mon[47443]: pgmap v533: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 30 MiB/s wr, 1.47k op/s 2024-06-02T04:13:28.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:28 smithi162 ceph-mon[47009]: pgmap v534: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 24 MiB/s wr, 1.25k op/s 2024-06-02T04:13:28.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:28 smithi123 ceph-mon[42885]: pgmap v534: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 24 MiB/s wr, 1.25k op/s 2024-06-02T04:13:28.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:28 smithi136 ceph-mon[47443]: pgmap v534: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 24 MiB/s wr, 1.25k op/s 2024-06-02T04:13:29.490 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 535.0 s, 1965.1 tps, lat 56.535 ms stddev 122.854 2024-06-02T04:13:30.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:30 smithi162 ceph-mon[47009]: pgmap v535: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 38 MiB/s wr, 2.00k op/s 2024-06-02T04:13:30.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:30 smithi123 ceph-mon[42885]: pgmap v535: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 38 MiB/s wr, 2.00k op/s 2024-06-02T04:13:30.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:30 smithi136 ceph-mon[47443]: pgmap v535: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 38 MiB/s wr, 2.00k op/s 2024-06-02T04:13:31.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:31 smithi162 ceph-mon[47009]: pgmap v536: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 MiB/s wr, 1.99k op/s 2024-06-02T04:13:31.826 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:31 smithi123 ceph-mon[42885]: pgmap v536: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 MiB/s wr, 1.99k op/s 2024-06-02T04:13:31.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:31 smithi136 ceph-mon[47443]: pgmap v536: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 MiB/s wr, 1.99k op/s 2024-06-02T04:13:34.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 540.0 s, 2037.6 tps, lat 49.178 ms stddev 54.566 2024-06-02T04:13:34.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:34 smithi162 ceph-mon[47009]: pgmap v537: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 35 MiB/s wr, 1.96k op/s 2024-06-02T04:13:34.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:34 smithi123 ceph-mon[42885]: pgmap v537: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 35 MiB/s wr, 1.96k op/s 2024-06-02T04:13:34.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:34 smithi136 ceph-mon[47443]: pgmap v537: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 35 MiB/s wr, 1.96k op/s 2024-06-02T04:13:36.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:36 smithi123 ceph-mon[42885]: pgmap v538: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 34 MiB/s wr, 1.89k op/s 2024-06-02T04:13:36.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:36 smithi136 ceph-mon[47443]: pgmap v538: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 34 MiB/s wr, 1.89k op/s 2024-06-02T04:13:36.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:36 smithi162 ceph-mon[47009]: pgmap v538: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 34 MiB/s wr, 1.89k op/s 2024-06-02T04:13:38.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:38 smithi123 ceph-mon[42885]: pgmap v539: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 21 MiB/s wr, 1.20k op/s 2024-06-02T04:13:38.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:38 smithi136 ceph-mon[47443]: pgmap v539: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 21 MiB/s wr, 1.20k op/s 2024-06-02T04:13:38.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:38 smithi162 ceph-mon[47009]: pgmap v539: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 21 MiB/s wr, 1.20k op/s 2024-06-02T04:13:39.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 545.0 s, 1808.0 tps, lat 54.524 ms stddev 61.496 2024-06-02T04:13:40.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:40 smithi136 ceph-mon[47443]: pgmap v540: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 25 MiB/s wr, 1.36k op/s 2024-06-02T04:13:40.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:40 smithi162 ceph-mon[47009]: pgmap v540: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 25 MiB/s wr, 1.36k op/s 2024-06-02T04:13:40.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:40 smithi123 ceph-mon[42885]: pgmap v540: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 25 MiB/s wr, 1.36k op/s 2024-06-02T04:13:42.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:42 smithi136 ceph-mon[47443]: pgmap v541: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 739 op/s 2024-06-02T04:13:42.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:42 smithi162 ceph-mon[47009]: pgmap v541: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 739 op/s 2024-06-02T04:13:42.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:42 smithi123 ceph-mon[42885]: pgmap v541: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 739 op/s 2024-06-02T04:13:44.497 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 550.0 s, 1806.2 tps, lat 55.549 ms stddev 64.363 2024-06-02T04:13:44.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:44 smithi162 ceph-mon[47009]: pgmap v542: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 671 op/s 2024-06-02T04:13:44.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:44 smithi123 ceph-mon[42885]: pgmap v542: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 671 op/s 2024-06-02T04:13:44.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:44 smithi136 ceph-mon[47443]: pgmap v542: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 671 op/s 2024-06-02T04:13:46.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:46 smithi162 ceph-mon[47009]: pgmap v543: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 709 op/s 2024-06-02T04:13:46.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:46 smithi123 ceph-mon[42885]: pgmap v543: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 709 op/s 2024-06-02T04:13:46.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:46 smithi136 ceph-mon[47443]: pgmap v543: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 709 op/s 2024-06-02T04:13:48.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:48 smithi162 ceph-mon[47009]: pgmap v544: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.9 MiB/s wr, 564 op/s 2024-06-02T04:13:48.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:48 smithi123 ceph-mon[42885]: pgmap v544: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.9 MiB/s wr, 564 op/s 2024-06-02T04:13:48.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:48 smithi136 ceph-mon[47443]: pgmap v544: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.9 MiB/s wr, 564 op/s 2024-06-02T04:13:49.491 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 555.0 s, 1902.0 tps, lat 52.682 ms stddev 60.184 2024-06-02T04:13:50.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:50 smithi162 ceph-mon[47009]: pgmap v545: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 740 op/s 2024-06-02T04:13:50.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:50 smithi123 ceph-mon[42885]: pgmap v545: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 740 op/s 2024-06-02T04:13:50.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:50 smithi136 ceph-mon[47443]: pgmap v545: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 740 op/s 2024-06-02T04:13:52.800 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:52 smithi162 ceph-mon[47009]: pgmap v546: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 11 MiB/s wr, 725 op/s 2024-06-02T04:13:52.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:52 smithi123 ceph-mon[42885]: pgmap v546: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 11 MiB/s wr, 725 op/s 2024-06-02T04:13:52.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:52 smithi136 ceph-mon[47443]: pgmap v546: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 11 MiB/s wr, 725 op/s 2024-06-02T04:13:54.488 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 560.0 s, 1809.8 tps, lat 55.246 ms stddev 62.350 2024-06-02T04:13:54.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:54 smithi162 ceph-mon[47009]: pgmap v547: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 11 MiB/s wr, 775 op/s 2024-06-02T04:13:54.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:54 smithi123 ceph-mon[42885]: pgmap v547: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 11 MiB/s wr, 775 op/s 2024-06-02T04:13:54.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:54 smithi136 ceph-mon[47443]: pgmap v547: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 11 MiB/s wr, 775 op/s 2024-06-02T04:13:55.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:55 smithi162 ceph-mon[47009]: pgmap v548: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 795 op/s 2024-06-02T04:13:55.827 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:55 smithi123 ceph-mon[42885]: pgmap v548: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 795 op/s 2024-06-02T04:13:55.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:55 smithi136 ceph-mon[47443]: pgmap v548: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 795 op/s 2024-06-02T04:13:58.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:13:58 smithi162 ceph-mon[47009]: pgmap v549: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 8.5 MiB/s wr, 655 op/s 2024-06-02T04:13:58.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:13:58 smithi123 ceph-mon[42885]: pgmap v549: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 8.5 MiB/s wr, 655 op/s 2024-06-02T04:13:58.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:13:58 smithi136 ceph-mon[47443]: pgmap v549: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 8.5 MiB/s wr, 655 op/s 2024-06-02T04:13:59.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 565.0 s, 1653.2 tps, lat 60.536 ms stddev 68.206 2024-06-02T04:14:00.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:00 smithi162 ceph-mon[47009]: pgmap v550: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 814 op/s 2024-06-02T04:14:00.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:00 smithi123 ceph-mon[42885]: pgmap v550: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 814 op/s 2024-06-02T04:14:00.595 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:00 smithi136 ceph-mon[47443]: pgmap v550: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 814 op/s 2024-06-02T04:14:02.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:02 smithi162 ceph-mon[47009]: pgmap v551: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 10 MiB/s wr, 764 op/s 2024-06-02T04:14:02.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:02 smithi123 ceph-mon[42885]: pgmap v551: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 10 MiB/s wr, 764 op/s 2024-06-02T04:14:02.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:02 smithi136 ceph-mon[47443]: pgmap v551: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 10 MiB/s wr, 764 op/s 2024-06-02T04:14:04.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 570.0 s, 1685.8 tps, lat 58.733 ms stddev 62.154 2024-06-02T04:14:04.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:04 smithi123 ceph-mon[42885]: pgmap v552: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 8.7 MiB/s wr, 705 op/s 2024-06-02T04:14:04.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:04 smithi136 ceph-mon[47443]: pgmap v552: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 8.7 MiB/s wr, 705 op/s 2024-06-02T04:14:04.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:04 smithi162 ceph-mon[47009]: pgmap v552: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 8.7 MiB/s wr, 705 op/s 2024-06-02T04:14:06.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:06 smithi123 ceph-mon[42885]: pgmap v553: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.2 MiB/s wr, 666 op/s 2024-06-02T04:14:06.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:06 smithi136 ceph-mon[47443]: pgmap v553: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.2 MiB/s wr, 666 op/s 2024-06-02T04:14:06.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:06 smithi162 ceph-mon[47009]: pgmap v553: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.2 MiB/s wr, 666 op/s 2024-06-02T04:14:08.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:08 smithi162 ceph-mon[47009]: pgmap v554: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.9 MiB/s wr, 588 op/s 2024-06-02T04:14:08.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:08 smithi123 ceph-mon[42885]: pgmap v554: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.9 MiB/s wr, 588 op/s 2024-06-02T04:14:08.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:08 smithi136 ceph-mon[47443]: pgmap v554: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.9 MiB/s wr, 588 op/s 2024-06-02T04:14:09.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 575.0 s, 1415.6 tps, lat 71.529 ms stddev 78.314 2024-06-02T04:14:10.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:10 smithi162 ceph-mon[47009]: pgmap v555: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 MiB/s wr, 773 op/s 2024-06-02T04:14:10.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:10 smithi123 ceph-mon[42885]: pgmap v555: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 MiB/s wr, 773 op/s 2024-06-02T04:14:10.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:10 smithi136 ceph-mon[47443]: pgmap v555: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 MiB/s wr, 773 op/s 2024-06-02T04:14:12.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:12 smithi162 ceph-mon[47009]: pgmap v556: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 778 op/s 2024-06-02T04:14:12.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:12 smithi123 ceph-mon[42885]: pgmap v556: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 778 op/s 2024-06-02T04:14:12.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:12 smithi136 ceph-mon[47443]: pgmap v556: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 778 op/s 2024-06-02T04:14:14.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 580.0 s, 1787.5 tps, lat 55.737 ms stddev 59.452 2024-06-02T04:14:14.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:14 smithi162 ceph-mon[47009]: pgmap v557: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 MiB/s wr, 780 op/s 2024-06-02T04:14:14.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:14 smithi123 ceph-mon[42885]: pgmap v557: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 MiB/s wr, 780 op/s 2024-06-02T04:14:14.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:14 smithi136 ceph-mon[47443]: pgmap v557: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 15 MiB/s wr, 780 op/s 2024-06-02T04:14:16.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:16 smithi162 ceph-mon[47009]: pgmap v558: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 773 op/s 2024-06-02T04:14:16.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:16 smithi123 ceph-mon[42885]: pgmap v558: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 773 op/s 2024-06-02T04:14:16.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:16 smithi136 ceph-mon[47443]: pgmap v558: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 773 op/s 2024-06-02T04:14:18.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:18 smithi162 ceph-mon[47009]: pgmap v559: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 16 MiB/s wr, 719 op/s 2024-06-02T04:14:18.830 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:18 smithi123 ceph-mon[42885]: pgmap v559: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 16 MiB/s wr, 719 op/s 2024-06-02T04:14:18.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:18 smithi136 ceph-mon[47443]: pgmap v559: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 16 MiB/s wr, 719 op/s 2024-06-02T04:14:19.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 585.0 s, 1860.2 tps, lat 53.449 ms stddev 61.214 2024-06-02T04:14:19.802 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:19 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:14:19.802 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:19 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:14:19.802 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:19 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:14:19.803 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:19 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:14:19.824 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:19 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:14:19.824 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:19 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:14:19.824 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:19 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:14:19.824 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:19 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:14:19.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:19 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:14:19.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:19 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:14:19.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:19 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:14:19.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:19 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:14:20.804 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:20 smithi162 ceph-mon[47009]: pgmap v560: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 843 op/s 2024-06-02T04:14:20.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:20 smithi123 ceph-mon[42885]: pgmap v560: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 843 op/s 2024-06-02T04:14:20.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:20 smithi136 ceph-mon[47443]: pgmap v560: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 843 op/s 2024-06-02T04:14:21.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:21 smithi162 ceph-mon[47009]: pgmap v561: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 18 MiB/s wr, 806 op/s 2024-06-02T04:14:21.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:21 smithi123 ceph-mon[42885]: pgmap v561: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 18 MiB/s wr, 806 op/s 2024-06-02T04:14:21.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:21 smithi136 ceph-mon[47443]: pgmap v561: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 18 MiB/s wr, 806 op/s 2024-06-02T04:14:24.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 590.0 s, 1219.0 tps, lat 82.693 ms stddev 169.944 2024-06-02T04:14:24.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:24 smithi162 ceph-mon[47009]: pgmap v562: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 17 MiB/s wr, 752 op/s 2024-06-02T04:14:24.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:24 smithi123 ceph-mon[42885]: pgmap v562: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 17 MiB/s wr, 752 op/s 2024-06-02T04:14:24.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:24 smithi136 ceph-mon[47443]: pgmap v562: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 17 MiB/s wr, 752 op/s 2024-06-02T04:14:26.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:26 smithi162 ceph-mon[47009]: pgmap v563: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 MiB/s wr, 1.37k op/s 2024-06-02T04:14:26.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:26 smithi123 ceph-mon[42885]: pgmap v563: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 MiB/s wr, 1.37k op/s 2024-06-02T04:14:26.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:26 smithi136 ceph-mon[47443]: pgmap v563: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 27 MiB/s wr, 1.37k op/s 2024-06-02T04:14:28.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:28 smithi162 ceph-mon[47009]: pgmap v564: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 35 MiB/s wr, 1.85k op/s 2024-06-02T04:14:28.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:28 smithi123 ceph-mon[42885]: pgmap v564: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 35 MiB/s wr, 1.85k op/s 2024-06-02T04:14:28.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:28 smithi136 ceph-mon[47443]: pgmap v564: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 35 MiB/s wr, 1.85k op/s 2024-06-02T04:14:29.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 595.0 s, 1797.0 tps, lat 55.321 ms stddev 63.842 2024-06-02T04:14:30.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:30 smithi136 ceph-mon[47443]: pgmap v565: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 MiB/s wr, 2.02k op/s 2024-06-02T04:14:30.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:30 smithi162 ceph-mon[47009]: pgmap v565: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 MiB/s wr, 2.02k op/s 2024-06-02T04:14:30.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:30 smithi123 ceph-mon[42885]: pgmap v565: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 37 MiB/s wr, 2.02k op/s 2024-06-02T04:14:32.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:32 smithi136 ceph-mon[47443]: pgmap v566: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 MiB/s wr, 1.98k op/s 2024-06-02T04:14:32.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:32 smithi162 ceph-mon[47009]: pgmap v566: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 MiB/s wr, 1.98k op/s 2024-06-02T04:14:32.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:32 smithi123 ceph-mon[42885]: pgmap v566: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 MiB/s wr, 1.98k op/s 2024-06-02T04:14:34.488 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 600.0 s, 2320.6 tps, lat 43.093 ms stddev 53.004 2024-06-02T04:14:34.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:34 smithi162 ceph-mon[47009]: pgmap v567: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 33 MiB/s wr, 1.86k op/s 2024-06-02T04:14:34.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:34 smithi123 ceph-mon[42885]: pgmap v567: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 33 MiB/s wr, 1.86k op/s 2024-06-02T04:14:34.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:34 smithi136 ceph-mon[47443]: pgmap v567: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 33 MiB/s wr, 1.86k op/s 2024-06-02T04:14:36.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:36 smithi162 ceph-mon[47009]: pgmap v568: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 35 MiB/s wr, 1.91k op/s 2024-06-02T04:14:36.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:36 smithi123 ceph-mon[42885]: pgmap v568: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 35 MiB/s wr, 1.91k op/s 2024-06-02T04:14:36.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:36 smithi136 ceph-mon[47443]: pgmap v568: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 35 MiB/s wr, 1.91k op/s 2024-06-02T04:14:38.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:38 smithi162 ceph-mon[47009]: pgmap v569: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 23 MiB/s wr, 1.25k op/s 2024-06-02T04:14:38.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:38 smithi123 ceph-mon[42885]: pgmap v569: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 23 MiB/s wr, 1.25k op/s 2024-06-02T04:14:38.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:38 smithi136 ceph-mon[47443]: pgmap v569: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 23 MiB/s wr, 1.25k op/s 2024-06-02T04:14:39.490 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 605.0 s, 1733.2 tps, lat 58.275 ms stddev 69.015 2024-06-02T04:14:40.801 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:40 smithi162 ceph-mon[47009]: pgmap v570: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 15 MiB/s wr, 825 op/s 2024-06-02T04:14:40.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:40 smithi123 ceph-mon[42885]: pgmap v570: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 15 MiB/s wr, 825 op/s 2024-06-02T04:14:40.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:40 smithi136 ceph-mon[47443]: pgmap v570: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 15 MiB/s wr, 825 op/s 2024-06-02T04:14:42.800 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:42 smithi162 ceph-mon[47009]: pgmap v571: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 675 op/s 2024-06-02T04:14:42.826 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:42 smithi123 ceph-mon[42885]: pgmap v571: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 675 op/s 2024-06-02T04:14:42.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:42 smithi136 ceph-mon[47443]: pgmap v571: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 675 op/s 2024-06-02T04:14:44.488 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 610.0 s, 1627.0 tps, lat 61.285 ms stddev 75.016 2024-06-02T04:14:44.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:44 smithi162 ceph-mon[47009]: pgmap v572: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 610 op/s 2024-06-02T04:14:44.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:44 smithi123 ceph-mon[42885]: pgmap v572: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 610 op/s 2024-06-02T04:14:44.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:44 smithi136 ceph-mon[47443]: pgmap v572: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 11 MiB/s wr, 610 op/s 2024-06-02T04:14:46.803 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:46 smithi162 ceph-mon[47009]: pgmap v573: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 698 op/s 2024-06-02T04:14:46.827 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:46 smithi123 ceph-mon[42885]: pgmap v573: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 698 op/s 2024-06-02T04:14:46.841 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:46 smithi136 ceph-mon[47443]: pgmap v573: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 13 MiB/s wr, 698 op/s 2024-06-02T04:14:48.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:48 smithi162 ceph-mon[47009]: pgmap v574: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.6 MiB/s wr, 634 op/s 2024-06-02T04:14:48.825 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:48 smithi123 ceph-mon[42885]: pgmap v574: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.6 MiB/s wr, 634 op/s 2024-06-02T04:14:48.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:48 smithi136 ceph-mon[47443]: pgmap v574: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.6 MiB/s wr, 634 op/s 2024-06-02T04:14:49.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 615.0 s, 2014.4 tps, lat 49.611 ms stddev 59.248 2024-06-02T04:14:50.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:50 smithi162 ceph-mon[47009]: pgmap v575: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 721 op/s 2024-06-02T04:14:50.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:50 smithi123 ceph-mon[42885]: pgmap v575: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 721 op/s 2024-06-02T04:14:50.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:50 smithi136 ceph-mon[47443]: pgmap v575: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 721 op/s 2024-06-02T04:14:51.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:51 smithi162 ceph-mon[47009]: pgmap v576: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 10 MiB/s wr, 690 op/s 2024-06-02T04:14:51.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:51 smithi123 ceph-mon[42885]: pgmap v576: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 10 MiB/s wr, 690 op/s 2024-06-02T04:14:51.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:51 smithi136 ceph-mon[47443]: pgmap v576: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 10 MiB/s wr, 690 op/s 2024-06-02T04:14:54.492 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 620.0 s, 1807.3 tps, lat 55.103 ms stddev 63.603 2024-06-02T04:14:54.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:54 smithi162 ceph-mon[47009]: pgmap v577: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 9.2 MiB/s wr, 657 op/s 2024-06-02T04:14:54.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:54 smithi123 ceph-mon[42885]: pgmap v577: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 9.2 MiB/s wr, 657 op/s 2024-06-02T04:14:54.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:54 smithi136 ceph-mon[47443]: pgmap v577: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 9.2 MiB/s wr, 657 op/s 2024-06-02T04:14:56.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:56 smithi162 ceph-mon[47009]: pgmap v578: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 775 op/s 2024-06-02T04:14:56.574 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:56 smithi123 ceph-mon[42885]: pgmap v578: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 775 op/s 2024-06-02T04:14:56.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:56 smithi136 ceph-mon[47443]: pgmap v578: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 775 op/s 2024-06-02T04:14:58.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:14:58 smithi162 ceph-mon[47009]: pgmap v579: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 11 MiB/s wr, 792 op/s 2024-06-02T04:14:58.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:14:58 smithi123 ceph-mon[42885]: pgmap v579: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 11 MiB/s wr, 792 op/s 2024-06-02T04:14:58.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:14:58 smithi136 ceph-mon[47443]: pgmap v579: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 11 MiB/s wr, 792 op/s 2024-06-02T04:14:59.492 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 625.0 s, 1954.4 tps, lat 51.627 ms stddev 57.929 2024-06-02T04:15:00.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:00 smithi162 ceph-mon[47009]: pgmap v580: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 796 op/s 2024-06-02T04:15:00.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:00 smithi123 ceph-mon[42885]: pgmap v580: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 796 op/s 2024-06-02T04:15:00.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:00 smithi136 ceph-mon[47443]: pgmap v580: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 796 op/s 2024-06-02T04:15:02.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:02 smithi162 ceph-mon[47009]: pgmap v581: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.8 MiB/s wr, 727 op/s 2024-06-02T04:15:02.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:02 smithi123 ceph-mon[42885]: pgmap v581: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.8 MiB/s wr, 727 op/s 2024-06-02T04:15:02.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:02 smithi136 ceph-mon[47443]: pgmap v581: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.8 MiB/s wr, 727 op/s 2024-06-02T04:15:04.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 630.0 s, 1496.2 tps, lat 66.438 ms stddev 79.220 2024-06-02T04:15:04.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:04 smithi162 ceph-mon[47009]: pgmap v582: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.4 MiB/s wr, 704 op/s 2024-06-02T04:15:04.575 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:04 smithi123 ceph-mon[42885]: pgmap v582: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.4 MiB/s wr, 704 op/s 2024-06-02T04:15:04.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:04 smithi136 ceph-mon[47443]: pgmap v582: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.4 MiB/s wr, 704 op/s 2024-06-02T04:15:06.550 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:06 smithi162 ceph-mon[47009]: pgmap v583: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 738 op/s 2024-06-02T04:15:06.577 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:06 smithi123 ceph-mon[42885]: pgmap v583: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 738 op/s 2024-06-02T04:15:06.591 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:06 smithi136 ceph-mon[47443]: pgmap v583: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 738 op/s 2024-06-02T04:15:08.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:08 smithi162 ceph-mon[47009]: pgmap v584: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 734 op/s 2024-06-02T04:15:08.578 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:08 smithi123 ceph-mon[42885]: pgmap v584: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 734 op/s 2024-06-02T04:15:08.589 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:08 smithi136 ceph-mon[47443]: pgmap v584: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 734 op/s 2024-06-02T04:15:09.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 635.0 s, 1128.6 tps, lat 87.839 ms stddev 98.262 2024-06-02T04:15:10.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:10 smithi162 ceph-mon[47009]: pgmap v585: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 747 op/s 2024-06-02T04:15:10.576 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:10 smithi123 ceph-mon[42885]: pgmap v585: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 747 op/s 2024-06-02T04:15:10.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:10 smithi136 ceph-mon[47443]: pgmap v585: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 747 op/s 2024-06-02T04:15:12.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:12 smithi162 ceph-mon[47009]: pgmap v586: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 758 op/s 2024-06-02T04:15:12.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:12 smithi123 ceph-mon[42885]: pgmap v586: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 758 op/s 2024-06-02T04:15:12.594 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:12 smithi136 ceph-mon[47443]: pgmap v586: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 758 op/s 2024-06-02T04:15:14.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 640.0 s, 1612.0 tps, lat 61.532 ms stddev 68.561 2024-06-02T04:15:14.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:14 smithi162 ceph-mon[47009]: pgmap v587: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 749 op/s 2024-06-02T04:15:14.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:14 smithi123 ceph-mon[42885]: pgmap v587: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 749 op/s 2024-06-02T04:15:14.593 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:14 smithi136 ceph-mon[47443]: pgmap v587: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 749 op/s 2024-06-02T04:15:16.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:16 smithi123 ceph-mon[42885]: pgmap v588: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 827 op/s 2024-06-02T04:15:16.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:16 smithi136 ceph-mon[47443]: pgmap v588: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 827 op/s 2024-06-02T04:15:16.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:16 smithi162 ceph-mon[47009]: pgmap v588: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 16 MiB/s wr, 827 op/s 2024-06-02T04:15:18.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:18 smithi123 ceph-mon[42885]: pgmap v589: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 15 MiB/s wr, 796 op/s 2024-06-02T04:15:18.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:18 smithi136 ceph-mon[47443]: pgmap v589: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 15 MiB/s wr, 796 op/s 2024-06-02T04:15:18.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:18 smithi162 ceph-mon[47009]: pgmap v589: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 15 MiB/s wr, 796 op/s 2024-06-02T04:15:19.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 645.0 s, 1684.1 tps, lat 59.887 ms stddev 67.684 2024-06-02T04:15:20.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:20 smithi123 ceph-mon[42885]: pgmap v590: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 800 op/s 2024-06-02T04:15:20.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:20 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:15:20.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:20 smithi136 ceph-mon[47443]: pgmap v590: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 800 op/s 2024-06-02T04:15:20.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:20 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:15:20.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:20 smithi162 ceph-mon[47009]: pgmap v590: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 800 op/s 2024-06-02T04:15:20.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:20 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:15:22.306 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:21 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:15:22.306 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:21 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:15:22.306 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:21 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:15:22.306 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:21 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:15:22.306 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:21 smithi162 ceph-mon[47009]: pgmap v591: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 15 MiB/s wr, 714 op/s 2024-06-02T04:15:22.306 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:21 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:15:22.306 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:21 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:15:22.325 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:21 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:15:22.325 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:21 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:15:22.326 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:21 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:15:22.326 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:21 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:15:22.326 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:21 smithi123 ceph-mon[42885]: pgmap v591: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 15 MiB/s wr, 714 op/s 2024-06-02T04:15:22.326 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:21 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:15:22.326 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:21 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:15:22.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:21 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:15:22.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:21 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:15:22.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:21 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:15:22.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:21 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:15:22.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:21 smithi136 ceph-mon[47443]: pgmap v591: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 15 MiB/s wr, 714 op/s 2024-06-02T04:15:22.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:21 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:15:22.339 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:21 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:15:23.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:22 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:15:23.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:22 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:15:23.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:22 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:15:23.327 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:22 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:15:23.327 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:22 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:15:23.327 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:22 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:15:23.340 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:22 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:15:23.340 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:22 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:15:23.340 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:22 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:15:24.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:23 smithi162 ceph-mon[47009]: pgmap v592: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 15 MiB/s wr, 689 op/s 2024-06-02T04:15:24.336 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:23 smithi123 ceph-mon[42885]: pgmap v592: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 15 MiB/s wr, 689 op/s 2024-06-02T04:15:24.342 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:23 smithi136 ceph-mon[47443]: pgmap v592: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 15 MiB/s wr, 689 op/s 2024-06-02T04:15:24.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 650.0 s, 1358.3 tps, lat 74.323 ms stddev 86.949 2024-06-02T04:15:26.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:26 smithi123 ceph-mon[42885]: pgmap v593: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 780 op/s 2024-06-02T04:15:26.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:26 smithi136 ceph-mon[47443]: pgmap v593: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 780 op/s 2024-06-02T04:15:26.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:26 smithi162 ceph-mon[47009]: pgmap v593: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 780 op/s 2024-06-02T04:15:28.573 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:28 smithi123 ceph-mon[42885]: pgmap v594: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 17 MiB/s wr, 960 op/s 2024-06-02T04:15:28.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:28 smithi136 ceph-mon[47443]: pgmap v594: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 17 MiB/s wr, 960 op/s 2024-06-02T04:15:28.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:28 smithi162 ceph-mon[47009]: pgmap v594: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 17 MiB/s wr, 960 op/s 2024-06-02T04:15:29.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 655.0 s, 1311.2 tps, lat 76.272 ms stddev 128.881 2024-06-02T04:15:30.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:30 smithi123 ceph-mon[42885]: pgmap v595: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 31 MiB/s wr, 1.73k op/s 2024-06-02T04:15:30.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:30 smithi136 ceph-mon[47443]: pgmap v595: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 31 MiB/s wr, 1.73k op/s 2024-06-02T04:15:30.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:30 smithi162 ceph-mon[47009]: pgmap v595: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 31 MiB/s wr, 1.73k op/s 2024-06-02T04:15:32.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:32 smithi162 ceph-mon[47009]: pgmap v596: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 32 MiB/s wr, 1.87k op/s 2024-06-02T04:15:32.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:32 smithi123 ceph-mon[42885]: pgmap v596: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 32 MiB/s wr, 1.87k op/s 2024-06-02T04:15:32.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:32 smithi136 ceph-mon[47443]: pgmap v596: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 32 MiB/s wr, 1.87k op/s 2024-06-02T04:15:34.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 660.0 s, 1947.4 tps, lat 51.341 ms stddev 60.103 2024-06-02T04:15:34.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:34 smithi162 ceph-mon[47009]: pgmap v597: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 31 MiB/s wr, 1.88k op/s 2024-06-02T04:15:34.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:34 smithi123 ceph-mon[42885]: pgmap v597: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 31 MiB/s wr, 1.88k op/s 2024-06-02T04:15:34.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:34 smithi136 ceph-mon[47443]: pgmap v597: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 31 MiB/s wr, 1.88k op/s 2024-06-02T04:15:36.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:36 smithi162 ceph-mon[47009]: pgmap v598: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 34 MiB/s wr, 1.96k op/s 2024-06-02T04:15:36.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:36 smithi123 ceph-mon[42885]: pgmap v598: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 34 MiB/s wr, 1.96k op/s 2024-06-02T04:15:36.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:36 smithi136 ceph-mon[47443]: pgmap v598: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 34 MiB/s wr, 1.96k op/s 2024-06-02T04:15:38.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:38 smithi162 ceph-mon[47009]: pgmap v599: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 32 MiB/s wr, 1.87k op/s 2024-06-02T04:15:38.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:38 smithi123 ceph-mon[42885]: pgmap v599: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 32 MiB/s wr, 1.87k op/s 2024-06-02T04:15:38.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:38 smithi136 ceph-mon[47443]: pgmap v599: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 32 MiB/s wr, 1.87k op/s 2024-06-02T04:15:39.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 665.0 s, 1643.8 tps, lat 60.726 ms stddev 72.009 2024-06-02T04:15:40.800 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:40 smithi162 ceph-mon[47009]: pgmap v600: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 29 MiB/s wr, 1.67k op/s 2024-06-02T04:15:40.824 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:40 smithi123 ceph-mon[42885]: pgmap v600: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 29 MiB/s wr, 1.67k op/s 2024-06-02T04:15:40.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:40 smithi136 ceph-mon[47443]: pgmap v600: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 29 MiB/s wr, 1.67k op/s 2024-06-02T04:15:42.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:42 smithi162 ceph-mon[47009]: pgmap v601: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 879 op/s 2024-06-02T04:15:42.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:42 smithi123 ceph-mon[42885]: pgmap v601: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 879 op/s 2024-06-02T04:15:42.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:42 smithi136 ceph-mon[47443]: pgmap v601: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 MiB/s wr, 879 op/s 2024-06-02T04:15:44.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 670.0 s, 1660.6 tps, lat 60.252 ms stddev 66.542 2024-06-02T04:15:44.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:44 smithi162 ceph-mon[47009]: pgmap v602: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 648 op/s 2024-06-02T04:15:44.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:44 smithi123 ceph-mon[42885]: pgmap v602: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 648 op/s 2024-06-02T04:15:44.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:44 smithi136 ceph-mon[47443]: pgmap v602: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 648 op/s 2024-06-02T04:15:46.803 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:46 smithi162 ceph-mon[47009]: pgmap v603: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 689 op/s 2024-06-02T04:15:46.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:46 smithi123 ceph-mon[42885]: pgmap v603: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 689 op/s 2024-06-02T04:15:46.841 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:46 smithi136 ceph-mon[47443]: pgmap v603: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 689 op/s 2024-06-02T04:15:48.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:48 smithi162 ceph-mon[47009]: pgmap v604: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.9 MiB/s wr, 627 op/s 2024-06-02T04:15:48.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:48 smithi123 ceph-mon[42885]: pgmap v604: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.9 MiB/s wr, 627 op/s 2024-06-02T04:15:48.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:48 smithi136 ceph-mon[47443]: pgmap v604: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.9 MiB/s wr, 627 op/s 2024-06-02T04:15:49.490 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 675.0 s, 1972.3 tps, lat 50.620 ms stddev 61.531 2024-06-02T04:15:50.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:50 smithi162 ceph-mon[47009]: pgmap v605: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 725 op/s 2024-06-02T04:15:50.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:50 smithi123 ceph-mon[42885]: pgmap v605: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 725 op/s 2024-06-02T04:15:50.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:50 smithi136 ceph-mon[47443]: pgmap v605: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 725 op/s 2024-06-02T04:15:52.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:52 smithi162 ceph-mon[47009]: pgmap v606: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 613 op/s 2024-06-02T04:15:52.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:52 smithi123 ceph-mon[42885]: pgmap v606: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 613 op/s 2024-06-02T04:15:52.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:52 smithi136 ceph-mon[47443]: pgmap v606: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 613 op/s 2024-06-02T04:15:54.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 680.0 s, 1609.8 tps, lat 62.384 ms stddev 75.313 2024-06-02T04:15:54.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:54 smithi162 ceph-mon[47009]: pgmap v607: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 648 op/s 2024-06-02T04:15:54.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:54 smithi123 ceph-mon[42885]: pgmap v607: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 648 op/s 2024-06-02T04:15:54.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:54 smithi136 ceph-mon[47443]: pgmap v607: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 648 op/s 2024-06-02T04:15:56.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:56 smithi162 ceph-mon[47009]: pgmap v608: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 769 op/s 2024-06-02T04:15:56.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:56 smithi123 ceph-mon[42885]: pgmap v608: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 769 op/s 2024-06-02T04:15:56.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:56 smithi136 ceph-mon[47443]: pgmap v608: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 769 op/s 2024-06-02T04:15:58.801 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:15:58 smithi162 ceph-mon[47009]: pgmap v609: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 11 MiB/s wr, 718 op/s 2024-06-02T04:15:58.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:15:58 smithi123 ceph-mon[42885]: pgmap v609: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 11 MiB/s wr, 718 op/s 2024-06-02T04:15:58.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:15:58 smithi136 ceph-mon[47443]: pgmap v609: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 11 MiB/s wr, 718 op/s 2024-06-02T04:15:59.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 685.0 s, 1937.6 tps, lat 51.615 ms stddev 66.543 2024-06-02T04:16:00.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:00 smithi162 ceph-mon[47009]: pgmap v610: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 798 op/s 2024-06-02T04:16:00.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:00 smithi123 ceph-mon[42885]: pgmap v610: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 798 op/s 2024-06-02T04:16:00.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:00 smithi136 ceph-mon[47443]: pgmap v610: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 798 op/s 2024-06-02T04:16:02.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:02 smithi162 ceph-mon[47009]: pgmap v611: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 8.6 MiB/s wr, 642 op/s 2024-06-02T04:16:02.833 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:02 smithi123 ceph-mon[42885]: pgmap v611: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 8.6 MiB/s wr, 642 op/s 2024-06-02T04:16:02.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:02 smithi136 ceph-mon[47443]: pgmap v611: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 8.6 MiB/s wr, 642 op/s 2024-06-02T04:16:04.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 690.0 s, 2392.6 tps, lat 41.655 ms stddev 52.911 2024-06-02T04:16:04.805 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:04 smithi162 ceph-mon[47009]: pgmap v612: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 9.3 MiB/s wr, 701 op/s 2024-06-02T04:16:04.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:04 smithi123 ceph-mon[42885]: pgmap v612: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 9.3 MiB/s wr, 701 op/s 2024-06-02T04:16:04.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:04 smithi136 ceph-mon[47443]: pgmap v612: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 9.3 MiB/s wr, 701 op/s 2024-06-02T04:16:06.804 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:06 smithi162 ceph-mon[47009]: pgmap v613: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 793 op/s 2024-06-02T04:16:06.831 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:06 smithi123 ceph-mon[42885]: pgmap v613: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 793 op/s 2024-06-02T04:16:06.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:06 smithi136 ceph-mon[47443]: pgmap v613: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 793 op/s 2024-06-02T04:16:08.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:08 smithi162 ceph-mon[47009]: pgmap v614: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 11 MiB/s wr, 703 op/s 2024-06-02T04:16:08.825 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:08 smithi123 ceph-mon[42885]: pgmap v614: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 11 MiB/s wr, 703 op/s 2024-06-02T04:16:08.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:08 smithi136 ceph-mon[47443]: pgmap v614: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 11 MiB/s wr, 703 op/s 2024-06-02T04:16:09.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 695.0 s, 997.1 tps, lat 97.808 ms stddev 113.640 2024-06-02T04:16:10.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:10 smithi162 ceph-mon[47009]: pgmap v615: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 749 op/s 2024-06-02T04:16:10.828 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:10 smithi123 ceph-mon[42885]: pgmap v615: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 749 op/s 2024-06-02T04:16:10.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:10 smithi136 ceph-mon[47443]: pgmap v615: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 749 op/s 2024-06-02T04:16:12.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:12 smithi162 ceph-mon[47009]: pgmap v616: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 637 op/s 2024-06-02T04:16:12.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:12 smithi123 ceph-mon[42885]: pgmap v616: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 637 op/s 2024-06-02T04:16:12.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:12 smithi136 ceph-mon[47443]: pgmap v616: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 637 op/s 2024-06-02T04:16:14.494 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 700.0 s, 1367.9 tps, lat 74.343 ms stddev 83.846 2024-06-02T04:16:14.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:14 smithi162 ceph-mon[47009]: pgmap v617: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 716 op/s 2024-06-02T04:16:14.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:14 smithi123 ceph-mon[42885]: pgmap v617: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 716 op/s 2024-06-02T04:16:14.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:14 smithi136 ceph-mon[47443]: pgmap v617: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 716 op/s 2024-06-02T04:16:16.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:16 smithi162 ceph-mon[47009]: pgmap v618: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 824 op/s 2024-06-02T04:16:16.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:16 smithi123 ceph-mon[42885]: pgmap v618: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 824 op/s 2024-06-02T04:16:16.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:16 smithi136 ceph-mon[47443]: pgmap v618: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 824 op/s 2024-06-02T04:16:18.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:18 smithi123 ceph-mon[42885]: pgmap v619: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 728 op/s 2024-06-02T04:16:18.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:18 smithi136 ceph-mon[47443]: pgmap v619: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 728 op/s 2024-06-02T04:16:19.052 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:18 smithi162 ceph-mon[47009]: pgmap v619: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 728 op/s 2024-06-02T04:16:19.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 705.0 s, 1759.9 tps, lat 57.462 ms stddev 64.605 2024-06-02T04:16:20.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:20 smithi136 ceph-mon[47443]: pgmap v620: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 713 op/s 2024-06-02T04:16:21.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:20 smithi162 ceph-mon[47009]: pgmap v620: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 713 op/s 2024-06-02T04:16:21.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:20 smithi123 ceph-mon[42885]: pgmap v620: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 MiB/s wr, 713 op/s 2024-06-02T04:16:22.846 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:22 smithi136 ceph-mon[47443]: pgmap v621: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 15 MiB/s wr, 693 op/s 2024-06-02T04:16:22.846 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:22 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:16:23.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:22 smithi162 ceph-mon[47009]: pgmap v621: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 15 MiB/s wr, 693 op/s 2024-06-02T04:16:23.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:22 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:16:23.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:22 smithi123 ceph-mon[42885]: pgmap v621: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 15 MiB/s wr, 693 op/s 2024-06-02T04:16:23.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:22 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:16:23.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:23 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:16:23.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:23 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:16:23.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:23 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:16:24.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:23 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:16:24.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:23 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:16:24.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:23 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:16:24.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:23 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:16:24.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:23 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:16:24.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:23 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:16:24.488 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 710.0 s, 1330.8 tps, lat 74.620 ms stddev 82.695 2024-06-02T04:16:24.841 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:24 smithi136 ceph-mon[47443]: pgmap v622: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 15 MiB/s wr, 713 op/s 2024-06-02T04:16:25.051 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:24 smithi162 ceph-mon[47009]: pgmap v622: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 15 MiB/s wr, 713 op/s 2024-06-02T04:16:25.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:24 smithi123 ceph-mon[42885]: pgmap v622: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 15 MiB/s wr, 713 op/s 2024-06-02T04:16:27.057 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:26 smithi162 ceph-mon[47009]: pgmap v623: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 17 MiB/s wr, 796 op/s 2024-06-02T04:16:27.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:26 smithi123 ceph-mon[42885]: pgmap v623: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 17 MiB/s wr, 796 op/s 2024-06-02T04:16:27.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:26 smithi136 ceph-mon[47443]: pgmap v623: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 17 MiB/s wr, 796 op/s 2024-06-02T04:16:29.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:28 smithi162 ceph-mon[47009]: pgmap v624: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 16 MiB/s wr, 757 op/s 2024-06-02T04:16:29.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:28 smithi123 ceph-mon[42885]: pgmap v624: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 16 MiB/s wr, 757 op/s 2024-06-02T04:16:29.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:28 smithi136 ceph-mon[47443]: pgmap v624: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 16 MiB/s wr, 757 op/s 2024-06-02T04:16:29.488 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 715.0 s, 1194.8 tps, lat 83.225 ms stddev 138.592 2024-06-02T04:16:30.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:29 smithi162 ceph-mon[47009]: pgmap v625: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 MiB/s wr, 1.18k op/s 2024-06-02T04:16:30.075 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:29 smithi123 ceph-mon[42885]: pgmap v625: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 MiB/s wr, 1.18k op/s 2024-06-02T04:16:30.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:29 smithi136 ceph-mon[47443]: pgmap v625: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 25 MiB/s wr, 1.18k op/s 2024-06-02T04:16:32.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:32 smithi136 ceph-mon[47443]: pgmap v626: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 31 MiB/s wr, 1.52k op/s 2024-06-02T04:16:32.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:32 smithi162 ceph-mon[47009]: pgmap v626: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 31 MiB/s wr, 1.52k op/s 2024-06-02T04:16:32.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:32 smithi123 ceph-mon[42885]: pgmap v626: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 31 MiB/s wr, 1.52k op/s 2024-06-02T04:16:34.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 720.0 s, 1757.2 tps, lat 56.943 ms stddev 63.560 2024-06-02T04:16:34.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:34 smithi136 ceph-mon[47443]: pgmap v627: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 36 MiB/s wr, 1.81k op/s 2024-06-02T04:16:34.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:34 smithi162 ceph-mon[47009]: pgmap v627: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 36 MiB/s wr, 1.81k op/s 2024-06-02T04:16:34.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:34 smithi123 ceph-mon[42885]: pgmap v627: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 36 MiB/s wr, 1.81k op/s 2024-06-02T04:16:36.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:36 smithi162 ceph-mon[47009]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 38 MiB/s wr, 1.90k op/s 2024-06-02T04:16:36.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:36 smithi123 ceph-mon[42885]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 38 MiB/s wr, 1.90k op/s 2024-06-02T04:16:36.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:36 smithi136 ceph-mon[47443]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 38 MiB/s wr, 1.90k op/s 2024-06-02T04:16:38.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:38 smithi162 ceph-mon[47009]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 35 MiB/s wr, 1.79k op/s 2024-06-02T04:16:38.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:38 smithi123 ceph-mon[42885]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 35 MiB/s wr, 1.79k op/s 2024-06-02T04:16:38.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:38 smithi136 ceph-mon[47443]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 35 MiB/s wr, 1.79k op/s 2024-06-02T04:16:39.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 725.0 s, 1734.6 tps, lat 58.101 ms stddev 66.821 2024-06-02T04:16:40.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:40 smithi162 ceph-mon[47009]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 36 MiB/s wr, 1.74k op/s 2024-06-02T04:16:40.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:40 smithi123 ceph-mon[42885]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 36 MiB/s wr, 1.74k op/s 2024-06-02T04:16:40.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:40 smithi136 ceph-mon[47443]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 36 MiB/s wr, 1.74k op/s 2024-06-02T04:16:42.802 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:42 smithi162 ceph-mon[47009]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 26 MiB/s wr, 1.30k op/s 2024-06-02T04:16:42.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:42 smithi123 ceph-mon[42885]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 26 MiB/s wr, 1.30k op/s 2024-06-02T04:16:42.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:42 smithi136 ceph-mon[47443]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 26 MiB/s wr, 1.30k op/s 2024-06-02T04:16:44.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 730.0 s, 1576.2 tps, lat 63.426 ms stddev 71.572 2024-06-02T04:16:44.800 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:44 smithi162 ceph-mon[47009]: pgmap v632: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 19 MiB/s wr, 942 op/s 2024-06-02T04:16:44.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:44 smithi123 ceph-mon[42885]: pgmap v632: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 19 MiB/s wr, 942 op/s 2024-06-02T04:16:44.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:44 smithi136 ceph-mon[47443]: pgmap v632: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 19 MiB/s wr, 942 op/s 2024-06-02T04:16:46.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:46 smithi162 ceph-mon[47009]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 14 MiB/s wr, 724 op/s 2024-06-02T04:16:46.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:46 smithi123 ceph-mon[42885]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 14 MiB/s wr, 724 op/s 2024-06-02T04:16:46.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:46 smithi136 ceph-mon[47443]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 14 MiB/s wr, 724 op/s 2024-06-02T04:16:48.800 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:48 smithi162 ceph-mon[47009]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 637 op/s 2024-06-02T04:16:48.830 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:48 smithi123 ceph-mon[42885]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 637 op/s 2024-06-02T04:16:48.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:48 smithi136 ceph-mon[47443]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 637 op/s 2024-06-02T04:16:49.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 735.0 s, 1642.2 tps, lat 60.705 ms stddev 69.640 2024-06-02T04:16:50.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:50 smithi162 ceph-mon[47009]: pgmap v635: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 634 op/s 2024-06-02T04:16:50.825 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:50 smithi123 ceph-mon[42885]: pgmap v635: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 634 op/s 2024-06-02T04:16:50.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:50 smithi136 ceph-mon[47443]: pgmap v635: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 634 op/s 2024-06-02T04:16:52.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:52 smithi162 ceph-mon[47009]: pgmap v636: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.4 MiB/s wr, 596 op/s 2024-06-02T04:16:52.825 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:52 smithi123 ceph-mon[42885]: pgmap v636: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.4 MiB/s wr, 596 op/s 2024-06-02T04:16:52.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:52 smithi136 ceph-mon[47443]: pgmap v636: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.4 MiB/s wr, 596 op/s 2024-06-02T04:16:54.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 740.0 s, 1945.3 tps, lat 51.448 ms stddev 64.455 2024-06-02T04:16:54.803 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:54 smithi162 ceph-mon[47009]: pgmap v637: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 632 op/s 2024-06-02T04:16:54.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:54 smithi123 ceph-mon[42885]: pgmap v637: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 632 op/s 2024-06-02T04:16:54.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:54 smithi136 ceph-mon[47443]: pgmap v637: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 632 op/s 2024-06-02T04:16:56.802 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:56 smithi162 ceph-mon[47009]: pgmap v638: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 795 op/s 2024-06-02T04:16:56.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:56 smithi123 ceph-mon[42885]: pgmap v638: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 795 op/s 2024-06-02T04:16:56.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:56 smithi136 ceph-mon[47443]: pgmap v638: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 795 op/s 2024-06-02T04:16:58.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:16:58 smithi162 ceph-mon[47009]: pgmap v639: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 704 op/s 2024-06-02T04:16:58.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:16:58 smithi123 ceph-mon[42885]: pgmap v639: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 704 op/s 2024-06-02T04:16:58.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:16:58 smithi136 ceph-mon[47443]: pgmap v639: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 704 op/s 2024-06-02T04:16:59.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 745.0 s, 1817.2 tps, lat 55.291 ms stddev 63.304 2024-06-02T04:17:00.800 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:00 smithi162 ceph-mon[47009]: pgmap v640: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 754 op/s 2024-06-02T04:17:00.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:00 smithi123 ceph-mon[42885]: pgmap v640: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 754 op/s 2024-06-02T04:17:00.837 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:00 smithi136 ceph-mon[47443]: pgmap v640: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 754 op/s 2024-06-02T04:17:02.811 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:02 smithi162 ceph-mon[47009]: pgmap v641: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 759 op/s 2024-06-02T04:17:02.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:02 smithi123 ceph-mon[42885]: pgmap v641: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 759 op/s 2024-06-02T04:17:02.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:02 smithi136 ceph-mon[47443]: pgmap v641: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 759 op/s 2024-06-02T04:17:04.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 750.0 s, 1179.8 tps, lat 83.958 ms stddev 91.979 2024-06-02T04:17:04.809 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:04 smithi162 ceph-mon[47009]: pgmap v642: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 767 op/s 2024-06-02T04:17:04.825 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:04 smithi123 ceph-mon[42885]: pgmap v642: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 767 op/s 2024-06-02T04:17:04.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:04 smithi136 ceph-mon[47443]: pgmap v642: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 767 op/s 2024-06-02T04:17:06.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:06 smithi162 ceph-mon[47009]: pgmap v643: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 859 op/s 2024-06-02T04:17:06.826 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:06 smithi123 ceph-mon[42885]: pgmap v643: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 859 op/s 2024-06-02T04:17:06.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:06 smithi136 ceph-mon[47443]: pgmap v643: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 MiB/s wr, 859 op/s 2024-06-02T04:17:08.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:08 smithi162 ceph-mon[47009]: pgmap v644: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 733 op/s 2024-06-02T04:17:08.825 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:08 smithi123 ceph-mon[42885]: pgmap v644: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 733 op/s 2024-06-02T04:17:08.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:08 smithi136 ceph-mon[47443]: pgmap v644: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 733 op/s 2024-06-02T04:17:09.491 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 755.0 s, 1308.4 tps, lat 76.448 ms stddev 91.450 2024-06-02T04:17:10.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:10 smithi162 ceph-mon[47009]: pgmap v645: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 672 op/s 2024-06-02T04:17:10.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:10 smithi123 ceph-mon[42885]: pgmap v645: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 672 op/s 2024-06-02T04:17:10.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:10 smithi136 ceph-mon[47443]: pgmap v645: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 MiB/s wr, 672 op/s 2024-06-02T04:17:12.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:12 smithi123 ceph-mon[42885]: pgmap v646: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 15 MiB/s wr, 712 op/s 2024-06-02T04:17:12.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:12 smithi136 ceph-mon[47443]: pgmap v646: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 15 MiB/s wr, 712 op/s 2024-06-02T04:17:13.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:12 smithi162 ceph-mon[47009]: pgmap v646: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 15 MiB/s wr, 712 op/s 2024-06-02T04:17:14.490 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 760.0 s, 1329.0 tps, lat 75.798 ms stddev 80.103 2024-06-02T04:17:14.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:14 smithi123 ceph-mon[42885]: pgmap v647: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 16 MiB/s wr, 709 op/s 2024-06-02T04:17:14.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:14 smithi136 ceph-mon[47443]: pgmap v647: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 16 MiB/s wr, 709 op/s 2024-06-02T04:17:15.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:14 smithi162 ceph-mon[47009]: pgmap v647: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 16 MiB/s wr, 709 op/s 2024-06-02T04:17:16.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:16 smithi136 ceph-mon[47443]: pgmap v648: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 803 op/s 2024-06-02T04:17:17.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:16 smithi162 ceph-mon[47009]: pgmap v648: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 803 op/s 2024-06-02T04:17:17.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:16 smithi123 ceph-mon[42885]: pgmap v648: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 18 MiB/s wr, 803 op/s 2024-06-02T04:17:19.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:18 smithi162 ceph-mon[47009]: pgmap v649: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 16 MiB/s wr, 694 op/s 2024-06-02T04:17:19.078 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:18 smithi123 ceph-mon[42885]: pgmap v649: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 16 MiB/s wr, 694 op/s 2024-06-02T04:17:19.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:18 smithi136 ceph-mon[47443]: pgmap v649: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 16 MiB/s wr, 694 op/s 2024-06-02T04:17:19.490 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 765.0 s, 1396.6 tps, lat 71.827 ms stddev 76.968 2024-06-02T04:17:21.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:20 smithi162 ceph-mon[47009]: pgmap v650: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 14 MiB/s wr, 603 op/s 2024-06-02T04:17:21.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:20 smithi123 ceph-mon[42885]: pgmap v650: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 14 MiB/s wr, 603 op/s 2024-06-02T04:17:21.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:20 smithi136 ceph-mon[47443]: pgmap v650: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 14 MiB/s wr, 603 op/s 2024-06-02T04:17:22.576 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:22 smithi123 ceph-mon[42885]: pgmap v651: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 17 MiB/s wr, 756 op/s 2024-06-02T04:17:22.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:22 smithi136 ceph-mon[47443]: pgmap v651: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 17 MiB/s wr, 756 op/s 2024-06-02T04:17:22.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:22 smithi162 ceph-mon[47009]: pgmap v651: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 17 MiB/s wr, 756 op/s 2024-06-02T04:17:23.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:23 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:17:23.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:23 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:17:23.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:23 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:17:24.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 770.0 s, 1043.6 tps, lat 95.290 ms stddev 156.462 2024-06-02T04:17:24.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:24 smithi136 ceph-mon[47443]: pgmap v652: 97 pgs: 97 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 20 MiB/s wr, 1.02k op/s 2024-06-02T04:17:24.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:24 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:17:24.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:24 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:17:24.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:24 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:17:24.802 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:24 smithi162 ceph-mon[47009]: pgmap v652: 97 pgs: 97 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 20 MiB/s wr, 1.02k op/s 2024-06-02T04:17:24.802 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:24 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:17:24.802 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:24 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:17:24.802 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:24 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:17:24.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:24 smithi123 ceph-mon[42885]: pgmap v652: 97 pgs: 97 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 20 MiB/s wr, 1.02k op/s 2024-06-02T04:17:24.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:24 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:17:24.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:24 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:17:24.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:24 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:17:26.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:26 smithi136 ceph-mon[47443]: pgmap v653: 97 pgs: 97 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 37 MiB/s wr, 1.92k op/s 2024-06-02T04:17:26.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:26 smithi162 ceph-mon[47009]: pgmap v653: 97 pgs: 97 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 37 MiB/s wr, 1.92k op/s 2024-06-02T04:17:26.828 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:26 smithi123 ceph-mon[42885]: pgmap v653: 97 pgs: 97 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 37 MiB/s wr, 1.92k op/s 2024-06-02T04:17:28.803 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:28 smithi162 ceph-mon[47009]: pgmap v654: 97 pgs: 97 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 34 MiB/s wr, 1.87k op/s 2024-06-02T04:17:28.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:28 smithi123 ceph-mon[42885]: pgmap v654: 97 pgs: 97 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 34 MiB/s wr, 1.87k op/s 2024-06-02T04:17:28.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:28 smithi136 ceph-mon[47443]: pgmap v654: 97 pgs: 97 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 34 MiB/s wr, 1.87k op/s 2024-06-02T04:17:29.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 775.0 s, 1573.6 tps, lat 63.542 ms stddev 69.783 2024-06-02T04:17:30.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:30 smithi162 ceph-mon[47009]: pgmap v655: 97 pgs: 97 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 35 MiB/s wr, 1.85k op/s 2024-06-02T04:17:30.831 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:30 smithi123 ceph-mon[42885]: pgmap v655: 97 pgs: 97 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 35 MiB/s wr, 1.85k op/s 2024-06-02T04:17:30.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:30 smithi136 ceph-mon[47443]: pgmap v655: 97 pgs: 97 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 35 MiB/s wr, 1.85k op/s 2024-06-02T04:17:32.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:32 smithi162 ceph-mon[47009]: pgmap v656: 97 pgs: 97 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 37 MiB/s wr, 1.99k op/s 2024-06-02T04:17:32.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:32 smithi123 ceph-mon[42885]: pgmap v656: 97 pgs: 97 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 37 MiB/s wr, 1.99k op/s 2024-06-02T04:17:32.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:32 smithi136 ceph-mon[47443]: pgmap v656: 97 pgs: 97 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 37 MiB/s wr, 1.99k op/s 2024-06-02T04:17:34.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 780.0 s, 1732.8 tps, lat 58.244 ms stddev 65.674 2024-06-02T04:17:34.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:34 smithi162 ceph-mon[47009]: pgmap v657: 97 pgs: 97 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 35 MiB/s wr, 1.89k op/s 2024-06-02T04:17:34.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:34 smithi123 ceph-mon[42885]: pgmap v657: 97 pgs: 97 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 35 MiB/s wr, 1.89k op/s 2024-06-02T04:17:34.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:34 smithi136 ceph-mon[47443]: pgmap v657: 97 pgs: 97 active+clean; 1.7 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 35 MiB/s wr, 1.89k op/s 2024-06-02T04:17:36.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:36 smithi162 ceph-mon[47009]: pgmap v658: 97 pgs: 97 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 31 MiB/s wr, 1.61k op/s 2024-06-02T04:17:36.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:36 smithi123 ceph-mon[42885]: pgmap v658: 97 pgs: 97 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 31 MiB/s wr, 1.61k op/s 2024-06-02T04:17:36.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:36 smithi136 ceph-mon[47443]: pgmap v658: 97 pgs: 97 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 31 MiB/s wr, 1.61k op/s 2024-06-02T04:17:38.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:38 smithi162 ceph-mon[47009]: pgmap v659: 97 pgs: 97 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 633 op/s 2024-06-02T04:17:38.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:38 smithi123 ceph-mon[42885]: pgmap v659: 97 pgs: 97 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 633 op/s 2024-06-02T04:17:38.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:38 smithi136 ceph-mon[47443]: pgmap v659: 97 pgs: 97 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 633 op/s 2024-06-02T04:17:39.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 785.0 s, 1722.8 tps, lat 57.605 ms stddev 65.847 2024-06-02T04:17:40.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:40 smithi162 ceph-mon[47009]: pgmap v660: 97 pgs: 97 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 611 op/s 2024-06-02T04:17:40.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:40 smithi123 ceph-mon[42885]: pgmap v660: 97 pgs: 97 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 611 op/s 2024-06-02T04:17:40.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:40 smithi136 ceph-mon[47443]: pgmap v660: 97 pgs: 97 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 611 op/s 2024-06-02T04:17:42.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:42 smithi162 ceph-mon[47009]: pgmap v661: 97 pgs: 97 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 704 op/s 2024-06-02T04:17:42.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:42 smithi123 ceph-mon[42885]: pgmap v661: 97 pgs: 97 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 704 op/s 2024-06-02T04:17:42.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:42 smithi136 ceph-mon[47443]: pgmap v661: 97 pgs: 97 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 704 op/s 2024-06-02T04:17:44.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 790.0 s, 1807.4 tps, lat 55.202 ms stddev 63.420 2024-06-02T04:17:44.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:44 smithi162 ceph-mon[47009]: pgmap v662: 97 pgs: 97 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 628 op/s 2024-06-02T04:17:44.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:44 smithi123 ceph-mon[42885]: pgmap v662: 97 pgs: 97 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 628 op/s 2024-06-02T04:17:44.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:44 smithi136 ceph-mon[47443]: pgmap v662: 97 pgs: 97 active+clean; 1.7 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 628 op/s 2024-06-02T04:17:46.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:46 smithi162 ceph-mon[47009]: pgmap v663: 97 pgs: 97 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 732 op/s 2024-06-02T04:17:46.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:46 smithi123 ceph-mon[42885]: pgmap v663: 97 pgs: 97 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 732 op/s 2024-06-02T04:17:46.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:46 smithi136 ceph-mon[47443]: pgmap v663: 97 pgs: 97 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 732 op/s 2024-06-02T04:17:48.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:48 smithi162 ceph-mon[47009]: pgmap v664: 97 pgs: 97 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 572 op/s 2024-06-02T04:17:48.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:48 smithi123 ceph-mon[42885]: pgmap v664: 97 pgs: 97 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 572 op/s 2024-06-02T04:17:48.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:48 smithi136 ceph-mon[47443]: pgmap v664: 97 pgs: 97 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 11 MiB/s wr, 572 op/s 2024-06-02T04:17:49.488 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 795.0 s, 1482.8 tps, lat 67.194 ms stddev 79.245 2024-06-02T04:17:50.808 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:50 smithi162 ceph-mon[47009]: pgmap v665: 97 pgs: 97 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 648 op/s 2024-06-02T04:17:50.828 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:50 smithi123 ceph-mon[42885]: pgmap v665: 97 pgs: 97 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 648 op/s 2024-06-02T04:17:50.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:50 smithi136 ceph-mon[47443]: pgmap v665: 97 pgs: 97 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 648 op/s 2024-06-02T04:17:52.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:52 smithi162 ceph-mon[47009]: pgmap v666: 97 pgs: 97 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 686 op/s 2024-06-02T04:17:52.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:52 smithi123 ceph-mon[42885]: pgmap v666: 97 pgs: 97 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 686 op/s 2024-06-02T04:17:52.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:52 smithi136 ceph-mon[47443]: pgmap v666: 97 pgs: 97 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 686 op/s 2024-06-02T04:17:54.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 800.0 s, 1626.8 tps, lat 61.340 ms stddev 68.225 2024-06-02T04:17:54.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:54 smithi162 ceph-mon[47009]: pgmap v667: 97 pgs: 97 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 10 MiB/s wr, 652 op/s 2024-06-02T04:17:54.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:54 smithi123 ceph-mon[42885]: pgmap v667: 97 pgs: 97 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 10 MiB/s wr, 652 op/s 2024-06-02T04:17:54.841 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:54 smithi136 ceph-mon[47443]: pgmap v667: 97 pgs: 97 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 10 MiB/s wr, 652 op/s 2024-06-02T04:17:56.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:56 smithi162 ceph-mon[47009]: pgmap v668: 97 pgs: 97 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 754 op/s 2024-06-02T04:17:56.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:56 smithi123 ceph-mon[42885]: pgmap v668: 97 pgs: 97 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 754 op/s 2024-06-02T04:17:56.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:56 smithi136 ceph-mon[47443]: pgmap v668: 97 pgs: 97 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 754 op/s 2024-06-02T04:17:59.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:17:58 smithi162 ceph-mon[47009]: pgmap v669: 97 pgs: 97 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 7.6 MiB/s wr, 573 op/s 2024-06-02T04:17:59.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:17:58 smithi123 ceph-mon[42885]: pgmap v669: 97 pgs: 97 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 7.6 MiB/s wr, 573 op/s 2024-06-02T04:17:59.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:17:58 smithi136 ceph-mon[47443]: pgmap v669: 97 pgs: 97 active+clean; 1.7 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 7.6 MiB/s wr, 573 op/s 2024-06-02T04:17:59.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 805.0 s, 1153.6 tps, lat 87.143 ms stddev 104.114 2024-06-02T04:18:01.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:00 smithi162 ceph-mon[47009]: pgmap v670: 97 pgs: 97 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.7 MiB/s wr, 670 op/s 2024-06-02T04:18:01.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:00 smithi123 ceph-mon[42885]: pgmap v670: 97 pgs: 97 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.7 MiB/s wr, 670 op/s 2024-06-02T04:18:01.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:00 smithi136 ceph-mon[47443]: pgmap v670: 97 pgs: 97 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.7 MiB/s wr, 670 op/s 2024-06-02T04:18:03.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:02 smithi162 ceph-mon[47009]: pgmap v671: 97 pgs: 97 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 842 op/s 2024-06-02T04:18:03.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:02 smithi123 ceph-mon[42885]: pgmap v671: 97 pgs: 97 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 842 op/s 2024-06-02T04:18:03.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:02 smithi136 ceph-mon[47443]: pgmap v671: 97 pgs: 97 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 842 op/s 2024-06-02T04:18:04.488 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 810.0 s, 1187.8 tps, lat 83.149 ms stddev 93.652 2024-06-02T04:18:05.053 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:04 smithi162 ceph-mon[47009]: pgmap v672: 97 pgs: 97 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 810 op/s 2024-06-02T04:18:05.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:04 smithi123 ceph-mon[42885]: pgmap v672: 97 pgs: 97 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 810 op/s 2024-06-02T04:18:05.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:04 smithi136 ceph-mon[47443]: pgmap v672: 97 pgs: 97 active+clean; 1.7 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 810 op/s 2024-06-02T04:18:07.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:06 smithi162 ceph-mon[47009]: pgmap v673: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 903 op/s 2024-06-02T04:18:07.076 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:06 smithi123 ceph-mon[42885]: pgmap v673: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 903 op/s 2024-06-02T04:18:07.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:06 smithi136 ceph-mon[47443]: pgmap v673: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 903 op/s 2024-06-02T04:18:09.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:08 smithi162 ceph-mon[47009]: pgmap v674: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 12 MiB/s wr, 724 op/s 2024-06-02T04:18:09.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:08 smithi123 ceph-mon[42885]: pgmap v674: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 12 MiB/s wr, 724 op/s 2024-06-02T04:18:09.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:08 smithi136 ceph-mon[47443]: pgmap v674: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 12 MiB/s wr, 724 op/s 2024-06-02T04:18:09.488 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 815.0 s, 1577.6 tps, lat 64.489 ms stddev 81.912 2024-06-02T04:18:11.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:10 smithi162 ceph-mon[47009]: pgmap v675: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 14 MiB/s wr, 812 op/s 2024-06-02T04:18:11.080 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:10 smithi123 ceph-mon[42885]: pgmap v675: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 14 MiB/s wr, 812 op/s 2024-06-02T04:18:11.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:10 smithi136 ceph-mon[47443]: pgmap v675: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 14 MiB/s wr, 812 op/s 2024-06-02T04:18:13.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:12 smithi162 ceph-mon[47009]: pgmap v676: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 872 op/s 2024-06-02T04:18:13.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:12 smithi123 ceph-mon[42885]: pgmap v676: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 872 op/s 2024-06-02T04:18:13.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:12 smithi136 ceph-mon[47443]: pgmap v676: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 872 op/s 2024-06-02T04:18:14.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 820.0 s, 1671.6 tps, lat 59.497 ms stddev 67.734 2024-06-02T04:18:15.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:14 smithi162 ceph-mon[47009]: pgmap v677: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 15 MiB/s wr, 726 op/s 2024-06-02T04:18:15.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:14 smithi123 ceph-mon[42885]: pgmap v677: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 15 MiB/s wr, 726 op/s 2024-06-02T04:18:15.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:14 smithi136 ceph-mon[47443]: pgmap v677: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 15 MiB/s wr, 726 op/s 2024-06-02T04:18:17.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:16 smithi162 ceph-mon[47009]: pgmap v678: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 17 MiB/s wr, 779 op/s 2024-06-02T04:18:17.078 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:16 smithi123 ceph-mon[42885]: pgmap v678: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 17 MiB/s wr, 779 op/s 2024-06-02T04:18:17.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:16 smithi136 ceph-mon[47443]: pgmap v678: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 17 MiB/s wr, 779 op/s 2024-06-02T04:18:19.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:18 smithi162 ceph-mon[47009]: pgmap v679: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 14 MiB/s wr, 600 op/s 2024-06-02T04:18:19.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:18 smithi123 ceph-mon[42885]: pgmap v679: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 14 MiB/s wr, 600 op/s 2024-06-02T04:18:19.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:18 smithi136 ceph-mon[47443]: pgmap v679: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 14 MiB/s wr, 600 op/s 2024-06-02T04:18:19.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 825.0 s, 1386.2 tps, lat 72.157 ms stddev 82.944 2024-06-02T04:18:21.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:20 smithi162 ceph-mon[47009]: pgmap v680: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 15 MiB/s wr, 684 op/s 2024-06-02T04:18:21.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:20 smithi123 ceph-mon[42885]: pgmap v680: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 15 MiB/s wr, 684 op/s 2024-06-02T04:18:21.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:20 smithi136 ceph-mon[47443]: pgmap v680: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 15 MiB/s wr, 684 op/s 2024-06-02T04:18:22.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:21 smithi162 ceph-mon[47009]: pgmap v681: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 19 MiB/s wr, 929 op/s 2024-06-02T04:18:22.324 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:21 smithi123 ceph-mon[42885]: pgmap v681: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 19 MiB/s wr, 929 op/s 2024-06-02T04:18:22.340 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:21 smithi136 ceph-mon[47443]: pgmap v681: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 19 MiB/s wr, 929 op/s 2024-06-02T04:18:24.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 830.0 s, 1094.0 tps, lat 90.890 ms stddev 161.668 2024-06-02T04:18:24.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:24 smithi162 ceph-mon[47009]: pgmap v682: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 23 MiB/s wr, 1.30k op/s 2024-06-02T04:18:24.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:24 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:18:24.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:24 smithi123 ceph-mon[42885]: pgmap v682: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 23 MiB/s wr, 1.30k op/s 2024-06-02T04:18:24.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:24 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:18:24.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:24 smithi136 ceph-mon[47443]: pgmap v682: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 23 MiB/s wr, 1.30k op/s 2024-06-02T04:18:24.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:24 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:18:25.805 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:25 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:18:25.805 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:25 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:18:25.806 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:25 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:18:25.806 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:25 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:18:25.806 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:25 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:18:25.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:25 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:18:25.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:25 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:18:25.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:25 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:18:25.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:25 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:18:25.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:25 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:18:25.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:25 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:18:25.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:25 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:18:25.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:25 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:18:25.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:25 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:18:25.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:25 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:18:26.800 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:26 smithi162 ceph-mon[47009]: pgmap v683: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 33 MiB/s wr, 2.03k op/s 2024-06-02T04:18:26.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:26 smithi123 ceph-mon[42885]: pgmap v683: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 33 MiB/s wr, 2.03k op/s 2024-06-02T04:18:26.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:26 smithi136 ceph-mon[47443]: pgmap v683: 97 pgs: 97 active+clean; 1.7 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 33 MiB/s wr, 2.03k op/s 2024-06-02T04:18:28.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:28 smithi162 ceph-mon[47009]: pgmap v684: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 30 MiB/s wr, 1.93k op/s 2024-06-02T04:18:28.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:28 smithi123 ceph-mon[42885]: pgmap v684: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 30 MiB/s wr, 1.93k op/s 2024-06-02T04:18:28.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:28 smithi136 ceph-mon[47443]: pgmap v684: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 30 MiB/s wr, 1.93k op/s 2024-06-02T04:18:29.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 835.0 s, 1519.8 tps, lat 66.626 ms stddev 84.262 2024-06-02T04:18:30.800 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:30 smithi162 ceph-mon[47009]: pgmap v685: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 30 MiB/s wr, 1.97k op/s 2024-06-02T04:18:30.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:30 smithi123 ceph-mon[42885]: pgmap v685: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 30 MiB/s wr, 1.97k op/s 2024-06-02T04:18:30.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:30 smithi136 ceph-mon[47443]: pgmap v685: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 30 MiB/s wr, 1.97k op/s 2024-06-02T04:18:32.801 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:32 smithi162 ceph-mon[47009]: pgmap v686: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 32 MiB/s wr, 2.05k op/s 2024-06-02T04:18:32.827 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:32 smithi123 ceph-mon[42885]: pgmap v686: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 32 MiB/s wr, 2.05k op/s 2024-06-02T04:18:32.842 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:32 smithi136 ceph-mon[47443]: pgmap v686: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 32 MiB/s wr, 2.05k op/s 2024-06-02T04:18:34.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 840.0 s, 1416.2 tps, lat 69.979 ms stddev 79.124 2024-06-02T04:18:34.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:34 smithi162 ceph-mon[47009]: pgmap v687: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 27 MiB/s wr, 1.79k op/s 2024-06-02T04:18:34.824 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:34 smithi123 ceph-mon[42885]: pgmap v687: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 27 MiB/s wr, 1.79k op/s 2024-06-02T04:18:34.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:34 smithi136 ceph-mon[47443]: pgmap v687: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 27 MiB/s wr, 1.79k op/s 2024-06-02T04:18:36.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:36 smithi162 ceph-mon[47009]: pgmap v688: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 22 MiB/s wr, 1.39k op/s 2024-06-02T04:18:36.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:36 smithi123 ceph-mon[42885]: pgmap v688: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 22 MiB/s wr, 1.39k op/s 2024-06-02T04:18:36.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:36 smithi136 ceph-mon[47443]: pgmap v688: 97 pgs: 97 active+clean; 1.7 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 22 MiB/s wr, 1.39k op/s 2024-06-02T04:18:38.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:38 smithi162 ceph-mon[47009]: pgmap v689: 97 pgs: 97 active+clean; 1.7 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.7 MiB/s wr, 590 op/s 2024-06-02T04:18:38.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:38 smithi123 ceph-mon[42885]: pgmap v689: 97 pgs: 97 active+clean; 1.7 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.7 MiB/s wr, 590 op/s 2024-06-02T04:18:38.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:38 smithi136 ceph-mon[47443]: pgmap v689: 97 pgs: 97 active+clean; 1.7 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.7 MiB/s wr, 590 op/s 2024-06-02T04:18:39.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 845.0 s, 1586.2 tps, lat 63.091 ms stddev 71.153 2024-06-02T04:18:40.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:40 smithi162 ceph-mon[47009]: pgmap v690: 97 pgs: 97 active+clean; 1.7 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 644 op/s 2024-06-02T04:18:40.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:40 smithi123 ceph-mon[42885]: pgmap v690: 97 pgs: 97 active+clean; 1.7 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 644 op/s 2024-06-02T04:18:40.837 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:40 smithi136 ceph-mon[47443]: pgmap v690: 97 pgs: 97 active+clean; 1.7 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 644 op/s 2024-06-02T04:18:42.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:42 smithi123 ceph-mon[42885]: pgmap v691: 97 pgs: 97 active+clean; 1.7 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 678 op/s 2024-06-02T04:18:42.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:42 smithi136 ceph-mon[47443]: pgmap v691: 97 pgs: 97 active+clean; 1.7 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 678 op/s 2024-06-02T04:18:43.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:42 smithi162 ceph-mon[47009]: pgmap v691: 97 pgs: 97 active+clean; 1.7 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 678 op/s 2024-06-02T04:18:44.492 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 850.0 s, 1526.9 tps, lat 65.685 ms stddev 76.409 2024-06-02T04:18:44.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:44 smithi123 ceph-mon[42885]: pgmap v692: 97 pgs: 97 active+clean; 1.7 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.8 MiB/s wr, 613 op/s 2024-06-02T04:18:44.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:44 smithi136 ceph-mon[47443]: pgmap v692: 97 pgs: 97 active+clean; 1.7 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.8 MiB/s wr, 613 op/s 2024-06-02T04:18:45.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:44 smithi162 ceph-mon[47009]: pgmap v692: 97 pgs: 97 active+clean; 1.7 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.8 MiB/s wr, 613 op/s 2024-06-02T04:18:46.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:46 smithi123 ceph-mon[42885]: pgmap v693: 97 pgs: 97 active+clean; 1.7 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.8 MiB/s wr, 651 op/s 2024-06-02T04:18:46.837 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:46 smithi136 ceph-mon[47443]: pgmap v693: 97 pgs: 97 active+clean; 1.7 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.8 MiB/s wr, 651 op/s 2024-06-02T04:18:47.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:46 smithi162 ceph-mon[47009]: pgmap v693: 97 pgs: 97 active+clean; 1.7 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.8 MiB/s wr, 651 op/s 2024-06-02T04:18:49.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:48 smithi162 ceph-mon[47009]: pgmap v694: 97 pgs: 97 active+clean; 1.7 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 8.4 MiB/s wr, 555 op/s 2024-06-02T04:18:49.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:48 smithi123 ceph-mon[42885]: pgmap v694: 97 pgs: 97 active+clean; 1.7 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 8.4 MiB/s wr, 555 op/s 2024-06-02T04:18:49.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:48 smithi136 ceph-mon[47443]: pgmap v694: 97 pgs: 97 active+clean; 1.7 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 8.4 MiB/s wr, 555 op/s 2024-06-02T04:18:49.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 855.0 s, 1476.5 tps, lat 68.085 ms stddev 71.064 2024-06-02T04:18:51.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:50 smithi162 ceph-mon[47009]: pgmap v695: 97 pgs: 97 active+clean; 1.7 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 630 op/s 2024-06-02T04:18:51.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:50 smithi123 ceph-mon[42885]: pgmap v695: 97 pgs: 97 active+clean; 1.7 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 630 op/s 2024-06-02T04:18:51.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:50 smithi136 ceph-mon[47443]: pgmap v695: 97 pgs: 97 active+clean; 1.7 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 10 MiB/s wr, 630 op/s 2024-06-02T04:18:53.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:52 smithi162 ceph-mon[47009]: pgmap v696: 97 pgs: 97 active+clean; 1.7 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 MiB/s wr, 662 op/s 2024-06-02T04:18:53.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:52 smithi123 ceph-mon[42885]: pgmap v696: 97 pgs: 97 active+clean; 1.7 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 MiB/s wr, 662 op/s 2024-06-02T04:18:53.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:52 smithi136 ceph-mon[47443]: pgmap v696: 97 pgs: 97 active+clean; 1.7 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 MiB/s wr, 662 op/s 2024-06-02T04:18:54.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 860.0 s, 1653.8 tps, lat 59.592 ms stddev 65.372 2024-06-02T04:18:55.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:54 smithi162 ceph-mon[47009]: pgmap v697: 97 pgs: 97 active+clean; 1.7 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.5 MiB/s wr, 642 op/s 2024-06-02T04:18:55.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:54 smithi123 ceph-mon[42885]: pgmap v697: 97 pgs: 97 active+clean; 1.7 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.5 MiB/s wr, 642 op/s 2024-06-02T04:18:55.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:54 smithi136 ceph-mon[47443]: pgmap v697: 97 pgs: 97 active+clean; 1.7 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.5 MiB/s wr, 642 op/s 2024-06-02T04:18:57.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:56 smithi162 ceph-mon[47009]: pgmap v698: 97 pgs: 97 active+clean; 1.7 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.3 MiB/s wr, 681 op/s 2024-06-02T04:18:57.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:56 smithi123 ceph-mon[42885]: pgmap v698: 97 pgs: 97 active+clean; 1.7 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.3 MiB/s wr, 681 op/s 2024-06-02T04:18:57.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:56 smithi136 ceph-mon[47443]: pgmap v698: 97 pgs: 97 active+clean; 1.7 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.3 MiB/s wr, 681 op/s 2024-06-02T04:18:59.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:18:58 smithi162 ceph-mon[47009]: pgmap v699: 97 pgs: 97 active+clean; 1.7 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 9.2 MiB/s wr, 636 op/s 2024-06-02T04:18:59.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:18:58 smithi123 ceph-mon[42885]: pgmap v699: 97 pgs: 97 active+clean; 1.7 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 9.2 MiB/s wr, 636 op/s 2024-06-02T04:18:59.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:18:58 smithi136 ceph-mon[47443]: pgmap v699: 97 pgs: 97 active+clean; 1.7 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 9.2 MiB/s wr, 636 op/s 2024-06-02T04:18:59.488 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 865.0 s, 1529.6 tps, lat 66.305 ms stddev 73.063 2024-06-02T04:19:01.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:00 smithi162 ceph-mon[47009]: pgmap v700: 97 pgs: 97 active+clean; 1.7 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.7 MiB/s wr, 686 op/s 2024-06-02T04:19:01.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:00 smithi123 ceph-mon[42885]: pgmap v700: 97 pgs: 97 active+clean; 1.7 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.7 MiB/s wr, 686 op/s 2024-06-02T04:19:01.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:00 smithi136 ceph-mon[47443]: pgmap v700: 97 pgs: 97 active+clean; 1.7 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 9.7 MiB/s wr, 686 op/s 2024-06-02T04:19:03.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:02 smithi123 ceph-mon[42885]: pgmap v701: 97 pgs: 97 active+clean; 1.7 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 9.5 MiB/s wr, 757 op/s 2024-06-02T04:19:03.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:02 smithi136 ceph-mon[47443]: pgmap v701: 97 pgs: 97 active+clean; 1.7 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 9.5 MiB/s wr, 757 op/s 2024-06-02T04:19:03.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:02 smithi162 ceph-mon[47009]: pgmap v701: 97 pgs: 97 active+clean; 1.7 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 9.5 MiB/s wr, 757 op/s 2024-06-02T04:19:04.298 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:03 smithi162 ceph-mon[47009]: pgmap v702: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 9.3 MiB/s wr, 731 op/s 2024-06-02T04:19:04.322 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:03 smithi123 ceph-mon[42885]: pgmap v702: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 9.3 MiB/s wr, 731 op/s 2024-06-02T04:19:04.338 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:03 smithi136 ceph-mon[47443]: pgmap v702: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 9.3 MiB/s wr, 731 op/s 2024-06-02T04:19:04.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 870.0 s, 1774.6 tps, lat 56.515 ms stddev 63.820 2024-06-02T04:19:06.802 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:06 smithi162 ceph-mon[47009]: pgmap v703: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.7 MiB/s wr, 772 op/s 2024-06-02T04:19:06.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:06 smithi123 ceph-mon[42885]: pgmap v703: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.7 MiB/s wr, 772 op/s 2024-06-02T04:19:06.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:06 smithi136 ceph-mon[47443]: pgmap v703: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.7 MiB/s wr, 772 op/s 2024-06-02T04:19:08.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:08 smithi162 ceph-mon[47009]: pgmap v704: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 8.4 MiB/s wr, 670 op/s 2024-06-02T04:19:08.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:08 smithi123 ceph-mon[42885]: pgmap v704: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 8.4 MiB/s wr, 670 op/s 2024-06-02T04:19:08.845 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:08 smithi136 ceph-mon[47443]: pgmap v704: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 8.4 MiB/s wr, 670 op/s 2024-06-02T04:19:09.488 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 875.0 s, 1475.8 tps, lat 66.400 ms stddev 76.115 2024-06-02T04:19:10.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:10 smithi162 ceph-mon[47009]: pgmap v705: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.1 MiB/s wr, 712 op/s 2024-06-02T04:19:10.825 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:10 smithi123 ceph-mon[42885]: pgmap v705: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.1 MiB/s wr, 712 op/s 2024-06-02T04:19:10.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:10 smithi136 ceph-mon[47443]: pgmap v705: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.1 MiB/s wr, 712 op/s 2024-06-02T04:19:12.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:12 smithi123 ceph-mon[42885]: pgmap v706: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 802 op/s 2024-06-02T04:19:12.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:12 smithi136 ceph-mon[47443]: pgmap v706: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 802 op/s 2024-06-02T04:19:13.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:12 smithi162 ceph-mon[47009]: pgmap v706: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 802 op/s 2024-06-02T04:19:14.493 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 880.0 s, 1140.8 tps, lat 88.556 ms stddev 111.751 2024-06-02T04:19:14.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:14 smithi123 ceph-mon[42885]: pgmap v707: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 747 op/s 2024-06-02T04:19:14.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:14 smithi136 ceph-mon[47443]: pgmap v707: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 747 op/s 2024-06-02T04:19:15.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:14 smithi162 ceph-mon[47009]: pgmap v707: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 747 op/s 2024-06-02T04:19:16.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:16 smithi123 ceph-mon[42885]: pgmap v708: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 804 op/s 2024-06-02T04:19:16.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:16 smithi136 ceph-mon[47443]: pgmap v708: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 804 op/s 2024-06-02T04:19:17.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:16 smithi162 ceph-mon[47009]: pgmap v708: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 804 op/s 2024-06-02T04:19:19.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:18 smithi162 ceph-mon[47009]: pgmap v709: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 11 MiB/s wr, 696 op/s 2024-06-02T04:19:19.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:18 smithi123 ceph-mon[42885]: pgmap v709: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 11 MiB/s wr, 696 op/s 2024-06-02T04:19:19.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:18 smithi136 ceph-mon[47443]: pgmap v709: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 11 MiB/s wr, 696 op/s 2024-06-02T04:19:19.488 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 885.0 s, 1483.2 tps, lat 67.766 ms stddev 75.705 2024-06-02T04:19:21.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:20 smithi162 ceph-mon[47009]: pgmap v710: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 14 MiB/s wr, 761 op/s 2024-06-02T04:19:21.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:20 smithi123 ceph-mon[42885]: pgmap v710: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 14 MiB/s wr, 761 op/s 2024-06-02T04:19:21.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:20 smithi136 ceph-mon[47443]: pgmap v710: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 14 MiB/s wr, 761 op/s 2024-06-02T04:19:22.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:22 smithi162 ceph-mon[47009]: pgmap v711: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 15 MiB/s wr, 800 op/s 2024-06-02T04:19:22.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:22 smithi123 ceph-mon[42885]: pgmap v711: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 15 MiB/s wr, 800 op/s 2024-06-02T04:19:22.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:22 smithi136 ceph-mon[47443]: pgmap v711: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 15 MiB/s wr, 800 op/s 2024-06-02T04:19:24.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 890.0 s, 1655.0 tps, lat 60.156 ms stddev 69.930 2024-06-02T04:19:24.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:24 smithi162 ceph-mon[47009]: pgmap v712: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 15 MiB/s wr, 718 op/s 2024-06-02T04:19:24.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:24 smithi123 ceph-mon[42885]: pgmap v712: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 15 MiB/s wr, 718 op/s 2024-06-02T04:19:24.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:24 smithi136 ceph-mon[47443]: pgmap v712: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 15 MiB/s wr, 718 op/s 2024-06-02T04:19:26.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:26 smithi162 ceph-mon[47009]: pgmap v713: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 16 MiB/s wr, 760 op/s 2024-06-02T04:19:26.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:26 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:19:26.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:26 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:19:26.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:26 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:19:26.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:26 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:19:26.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:26 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:19:26.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:26 smithi123 ceph-mon[42885]: pgmap v713: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 16 MiB/s wr, 760 op/s 2024-06-02T04:19:26.824 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:26 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:19:26.824 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:26 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:19:26.824 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:26 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:19:26.824 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:26 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:19:26.824 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:26 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:19:26.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:26 smithi136 ceph-mon[47443]: pgmap v713: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 16 MiB/s wr, 760 op/s 2024-06-02T04:19:26.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:26 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-06-02T04:19:26.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:26 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:19:26.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:26 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:19:26.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:26 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:19:26.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:26 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:19:27.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:27 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:19:27.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:27 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:19:27.799 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:27 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:19:27.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:27 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:19:27.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:27 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:19:27.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:27 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:19:27.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:27 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-06-02T04:19:27.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:27 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-06-02T04:19:27.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:27 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' 2024-06-02T04:19:29.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:28 smithi123 ceph-mon[42885]: pgmap v714: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 14 MiB/s wr, 631 op/s 2024-06-02T04:19:29.073 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:28 smithi162 ceph-mon[47009]: pgmap v714: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 14 MiB/s wr, 631 op/s 2024-06-02T04:19:29.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:28 smithi136 ceph-mon[47443]: pgmap v714: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 14 MiB/s wr, 631 op/s 2024-06-02T04:19:29.489 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 895.0 s, 1184.3 tps, lat 84.886 ms stddev 99.756 2024-06-02T04:19:31.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:30 smithi123 ceph-mon[42885]: pgmap v715: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 16 MiB/s wr, 710 op/s 2024-06-02T04:19:31.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:30 smithi136 ceph-mon[47443]: pgmap v715: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 16 MiB/s wr, 710 op/s 2024-06-02T04:19:31.200 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:30 smithi162 ceph-mon[47009]: pgmap v715: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 16 MiB/s wr, 710 op/s 2024-06-02T04:19:33.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:32 smithi123 ceph-mon[42885]: pgmap v716: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 791 op/s 2024-06-02T04:19:33.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:32 smithi136 ceph-mon[47443]: pgmap v716: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 791 op/s 2024-06-02T04:19:33.353 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:32 smithi162 ceph-mon[47009]: pgmap v716: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 15 MiB/s wr, 791 op/s 2024-06-02T04:19:34.488 INFO:teuthology.orchestra.run.smithi123.stderr:progress: 900.0 s, 985.7 tps, lat 101.341 ms stddev 150.174 2024-06-02T04:19:34.698 INFO:teuthology.orchestra.run.smithi123.stdout:transaction type: 2024-06-02T04:19:34.698 INFO:teuthology.orchestra.run.smithi123.stdout:scaling factor: 32 2024-06-02T04:19:34.699 INFO:teuthology.orchestra.run.smithi123.stdout:query mode: simple 2024-06-02T04:19:34.699 INFO:teuthology.orchestra.run.smithi123.stdout:number of clients: 100 2024-06-02T04:19:34.699 INFO:teuthology.orchestra.run.smithi123.stdout:number of threads: 4 2024-06-02T04:19:34.699 INFO:teuthology.orchestra.run.smithi123.stdout:duration: 900 s 2024-06-02T04:19:34.699 INFO:teuthology.orchestra.run.smithi123.stdout:number of transactions actually processed: 2069024 2024-06-02T04:19:34.699 INFO:teuthology.orchestra.run.smithi123.stdout:latency average = 43.501 ms 2024-06-02T04:19:34.699 INFO:teuthology.orchestra.run.smithi123.stdout:latency stddev = 61.716 ms 2024-06-02T04:19:34.699 INFO:teuthology.orchestra.run.smithi123.stdout:tps = 2298.380339 (including connections establishing) 2024-06-02T04:19:34.699 INFO:teuthology.orchestra.run.smithi123.stdout:tps = 2298.385163 (excluding connections establishing) 2024-06-02T04:19:34.703 DEBUG:teuthology.orchestra.run.smithi123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2024-06-02T04:19:35.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:34 smithi123 ceph-mon[42885]: pgmap v717: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 20 MiB/s wr, 1.13k op/s 2024-06-02T04:19:35.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:34 smithi136 ceph-mon[47443]: pgmap v717: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 20 MiB/s wr, 1.13k op/s 2024-06-02T04:19:35.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:34 smithi162 ceph-mon[47009]: pgmap v717: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 20 MiB/s wr, 1.13k op/s 2024-06-02T04:19:36.299 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:35 smithi162 ceph-mon[47009]: pgmap v718: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 29 MiB/s wr, 1.77k op/s 2024-06-02T04:19:36.325 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:35 smithi123 ceph-mon[42885]: pgmap v718: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 29 MiB/s wr, 1.77k op/s 2024-06-02T04:19:36.341 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:35 smithi136 ceph-mon[47443]: pgmap v718: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 29 MiB/s wr, 1.77k op/s 2024-06-02T04:19:38.824 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:38 smithi123 ceph-mon[42885]: pgmap v719: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 29 MiB/s wr, 1.83k op/s 2024-06-02T04:19:38.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:38 smithi136 ceph-mon[47443]: pgmap v719: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 29 MiB/s wr, 1.83k op/s 2024-06-02T04:19:39.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:38 smithi162 ceph-mon[47009]: pgmap v719: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 29 MiB/s wr, 1.83k op/s 2024-06-02T04:19:40.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:40 smithi136 ceph-mon[47443]: pgmap v720: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 30 MiB/s wr, 2.04k op/s 2024-06-02T04:19:41.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:40 smithi162 ceph-mon[47009]: pgmap v720: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 30 MiB/s wr, 2.04k op/s 2024-06-02T04:19:41.139 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:40 smithi123 ceph-mon[42885]: pgmap v720: 97 pgs: 97 active+clean; 1.7 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 30 MiB/s wr, 2.04k op/s 2024-06-02T04:19:42.703 DEBUG:teuthology.orchestra.run.smithi123:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-06-02T04:19:42.823 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/: 2024-06-02T04:19:42.823 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:19:42.823 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 04:04 . 2024-06-02T04:19:42.824 INFO:teuthology.orchestra.run.smithi123.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Jun 2 04:04 .. 2024-06-02T04:19:42.824 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 04:19 data 2024-06-02T04:19:42.824 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:19:42.824 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data: 2024-06-02T04:19:42.824 INFO:teuthology.orchestra.run.smithi123.stdout:total 31 2024-06-02T04:19:42.824 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 04:19 . 2024-06-02T04:19:42.824 INFO:teuthology.orchestra.run.smithi123.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 04:04 .. 2024-06-02T04:19:42.824 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Jun 2 04:04 base 2024-06-02T04:19:42.824 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 Jun 2 04:04 current_logfiles 2024-06-02T04:19:42.824 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 59 Jun 2 04:04 global 2024-06-02T04:19:42.824 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 04:04 log 2024-06-02T04:19:42.824 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 pg_commit_ts 2024-06-02T04:19:42.825 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 pg_dynshmem 2024-06-02T04:19:42.825 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4269 Jun 2 04:04 pg_hba.conf 2024-06-02T04:19:42.825 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Jun 2 04:04 pg_ident.conf 2024-06-02T04:19:42.825 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 04:19 pg_logical 2024-06-02T04:19:42.825 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Jun 2 04:04 pg_multixact 2024-06-02T04:19:42.825 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 04:04 pg_notify 2024-06-02T04:19:42.825 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 pg_replslot 2024-06-02T04:19:42.825 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 pg_serial 2024-06-02T04:19:42.825 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 pg_snapshots 2024-06-02T04:19:42.825 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 04:19 pg_stat 2024-06-02T04:19:42.825 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:19 pg_stat_tmp 2024-06-02T04:19:42.825 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 04:19 pg_subtrans 2024-06-02T04:19:42.826 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 pg_tblspc 2024-06-02T04:19:42.826 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 pg_twophase 2024-06-02T04:19:42.826 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 04:04 PG_VERSION 2024-06-02T04:19:42.826 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 64 Jun 2 04:19 pg_wal 2024-06-02T04:19:42.826 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Jun 2 04:10 pg_xact 2024-06-02T04:19:42.826 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Jun 2 04:04 postgresql.auto.conf 2024-06-02T04:19:42.826 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 22989 Jun 2 04:04 postgresql.conf 2024-06-02T04:19:42.826 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 Jun 2 04:04 postmaster.opts 2024-06-02T04:19:42.826 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:19:42.826 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/base: 2024-06-02T04:19:42.826 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:19:42.826 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Jun 2 04:04 . 2024-06-02T04:19:42.827 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 04:19 .. 2024-06-02T04:19:42.827 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Jun 2 04:04 1 2024-06-02T04:19:42.827 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Jun 2 04:04 12346 2024-06-02T04:19:42.827 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 308 Jun 2 04:04 12347 2024-06-02T04:19:42.827 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 pgsql_tmp 2024-06-02T04:19:42.827 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:19:42.827 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/base/1: 2024-06-02T04:19:42.827 INFO:teuthology.orchestra.run.smithi123.stdout:total 7193 2024-06-02T04:19:42.827 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Jun 2 04:04 . 2024-06-02T04:19:42.827 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Jun 2 04:04 .. 2024-06-02T04:19:42.827 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 112 2024-06-02T04:19:42.827 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 113 2024-06-02T04:19:42.827 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jun 2 04:04 12182 2024-06-02T04:19:42.828 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12182_fsm 2024-06-02T04:19:42.828 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12182_vm 2024-06-02T04:19:42.828 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12184 2024-06-02T04:19:42.828 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12186 2024-06-02T04:19:42.828 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12187 2024-06-02T04:19:42.828 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12187_fsm 2024-06-02T04:19:42.828 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12187_vm 2024-06-02T04:19:42.828 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12189 2024-06-02T04:19:42.828 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12191 2024-06-02T04:19:42.828 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12192 2024-06-02T04:19:42.828 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12192_fsm 2024-06-02T04:19:42.828 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12192_vm 2024-06-02T04:19:42.829 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12194 2024-06-02T04:19:42.829 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12196 2024-06-02T04:19:42.829 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12197 2024-06-02T04:19:42.829 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12197_fsm 2024-06-02T04:19:42.829 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12197_vm 2024-06-02T04:19:42.829 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12199 2024-06-02T04:19:42.829 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12201 2024-06-02T04:19:42.829 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12202 2024-06-02T04:19:42.829 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12202_fsm 2024-06-02T04:19:42.829 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12202_vm 2024-06-02T04:19:42.829 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12204 2024-06-02T04:19:42.829 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12206 2024-06-02T04:19:42.829 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12207 2024-06-02T04:19:42.829 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12207_fsm 2024-06-02T04:19:42.830 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12207_vm 2024-06-02T04:19:42.830 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12209 2024-06-02T04:19:42.830 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12211 2024-06-02T04:19:42.830 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12212 2024-06-02T04:19:42.830 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12214 2024-06-02T04:19:42.830 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12216 2024-06-02T04:19:42.830 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Jun 2 04:04 1247 2024-06-02T04:19:42.830 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1247_fsm 2024-06-02T04:19:42.830 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1247_vm 2024-06-02T04:19:42.830 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Jun 2 04:04 1249 2024-06-02T04:19:42.830 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1249_fsm 2024-06-02T04:19:42.830 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1249_vm 2024-06-02T04:19:42.830 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Jun 2 04:04 1255 2024-06-02T04:19:42.831 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1255_fsm 2024-06-02T04:19:42.831 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1255_vm 2024-06-02T04:19:42.831 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Jun 2 04:04 1259 2024-06-02T04:19:42.831 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1259_fsm 2024-06-02T04:19:42.831 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1259_vm 2024-06-02T04:19:42.831 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 1417 2024-06-02T04:19:42.831 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 1417_vm 2024-06-02T04:19:42.831 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 1418 2024-06-02T04:19:42.831 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 1418_vm 2024-06-02T04:19:42.831 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 174 2024-06-02T04:19:42.831 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 175 2024-06-02T04:19:42.831 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2187 2024-06-02T04:19:42.831 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2224 2024-06-02T04:19:42.832 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2224_vm 2024-06-02T04:19:42.832 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2328 2024-06-02T04:19:42.832 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2328_vm 2024-06-02T04:19:42.832 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2336 2024-06-02T04:19:42.832 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2336_vm 2024-06-02T04:19:42.832 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2337 2024-06-02T04:19:42.832 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2600 2024-06-02T04:19:42.832 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2600_fsm 2024-06-02T04:19:42.832 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2600_vm 2024-06-02T04:19:42.832 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2601 2024-06-02T04:19:42.832 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2601_fsm 2024-06-02T04:19:42.832 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2601_vm 2024-06-02T04:19:42.833 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:04 2602 2024-06-02T04:19:42.833 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2602_fsm 2024-06-02T04:19:42.833 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2602_vm 2024-06-02T04:19:42.833 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 2603 2024-06-02T04:19:42.833 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2603_fsm 2024-06-02T04:19:42.833 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2603_vm 2024-06-02T04:19:42.833 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2604 2024-06-02T04:19:42.833 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2604_vm 2024-06-02T04:19:42.833 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2605 2024-06-02T04:19:42.833 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2605_fsm 2024-06-02T04:19:42.833 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2605_vm 2024-06-02T04:19:42.833 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2606 2024-06-02T04:19:42.833 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2606_fsm 2024-06-02T04:19:42.834 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2606_vm 2024-06-02T04:19:42.834 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2607 2024-06-02T04:19:42.834 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2607_fsm 2024-06-02T04:19:42.834 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2607_vm 2024-06-02T04:19:42.834 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Jun 2 04:04 2608 2024-06-02T04:19:42.834 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2608_fsm 2024-06-02T04:19:42.834 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2608_vm 2024-06-02T04:19:42.834 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Jun 2 04:04 2609 2024-06-02T04:19:42.834 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2609_fsm 2024-06-02T04:19:42.834 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2609_vm 2024-06-02T04:19:42.834 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2610 2024-06-02T04:19:42.835 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2610_fsm 2024-06-02T04:19:42.835 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2610_vm 2024-06-02T04:19:42.835 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2611 2024-06-02T04:19:42.835 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2611_vm 2024-06-02T04:19:42.835 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2612 2024-06-02T04:19:42.835 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2612_fsm 2024-06-02T04:19:42.835 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2612_vm 2024-06-02T04:19:42.835 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2613 2024-06-02T04:19:42.835 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2613_vm 2024-06-02T04:19:42.835 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2615 2024-06-02T04:19:42.835 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2615_fsm 2024-06-02T04:19:42.835 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2615_vm 2024-06-02T04:19:42.835 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2616 2024-06-02T04:19:42.835 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2616_fsm 2024-06-02T04:19:42.836 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2616_vm 2024-06-02T04:19:42.836 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Jun 2 04:04 2617 2024-06-02T04:19:42.836 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2617_fsm 2024-06-02T04:19:42.836 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2617_vm 2024-06-02T04:19:42.836 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Jun 2 04:04 2618 2024-06-02T04:19:42.836 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2618_fsm 2024-06-02T04:19:42.836 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2618_vm 2024-06-02T04:19:42.836 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Jun 2 04:04 2619 2024-06-02T04:19:42.836 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2619_fsm 2024-06-02T04:19:42.836 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2619_vm 2024-06-02T04:19:42.836 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2620 2024-06-02T04:19:42.836 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2620_vm 2024-06-02T04:19:42.836 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2650 2024-06-02T04:19:42.837 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2651 2024-06-02T04:19:42.837 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2652 2024-06-02T04:19:42.837 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:04 2653 2024-06-02T04:19:42.837 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:04 2654 2024-06-02T04:19:42.837 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 2655 2024-06-02T04:19:42.837 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2656 2024-06-02T04:19:42.837 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2657 2024-06-02T04:19:42.837 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Jun 2 04:04 2658 2024-06-02T04:19:42.837 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 04:04 2659 2024-06-02T04:19:42.837 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2660 2024-06-02T04:19:42.837 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2661 2024-06-02T04:19:42.837 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 2662 2024-06-02T04:19:42.837 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:04 2663 2024-06-02T04:19:42.837 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2664 2024-06-02T04:19:42.838 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2665 2024-06-02T04:19:42.838 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2666 2024-06-02T04:19:42.838 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2667 2024-06-02T04:19:42.838 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2668 2024-06-02T04:19:42.838 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2669 2024-06-02T04:19:42.838 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2670 2024-06-02T04:19:42.838 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 319488 Jun 2 04:04 2673 2024-06-02T04:19:42.838 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Jun 2 04:04 2674 2024-06-02T04:19:42.838 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Jun 2 04:04 2675 2024-06-02T04:19:42.838 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2678 2024-06-02T04:19:42.838 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2679 2024-06-02T04:19:42.838 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2680 2024-06-02T04:19:42.839 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2681 2024-06-02T04:19:42.839 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2682 2024-06-02T04:19:42.839 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2683 2024-06-02T04:19:42.839 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2684 2024-06-02T04:19:42.839 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2685 2024-06-02T04:19:42.839 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2686 2024-06-02T04:19:42.839 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2687 2024-06-02T04:19:42.839 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:04 2688 2024-06-02T04:19:42.839 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:04 2689 2024-06-02T04:19:42.839 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 04:04 2690 2024-06-02T04:19:42.839 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Jun 2 04:04 2691 2024-06-02T04:19:42.839 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2692 2024-06-02T04:19:42.839 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2693 2024-06-02T04:19:42.839 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2696 2024-06-02T04:19:42.840 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2699 2024-06-02T04:19:42.840 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2701 2024-06-02T04:19:42.840 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2702 2024-06-02T04:19:42.840 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2703 2024-06-02T04:19:42.840 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:04 2704 2024-06-02T04:19:42.840 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2753 2024-06-02T04:19:42.840 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2753_fsm 2024-06-02T04:19:42.840 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2753_vm 2024-06-02T04:19:42.840 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2754 2024-06-02T04:19:42.840 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2755 2024-06-02T04:19:42.840 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 2756 2024-06-02T04:19:42.840 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 2757 2024-06-02T04:19:42.841 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2830 2024-06-02T04:19:42.841 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2830_vm 2024-06-02T04:19:42.841 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2831 2024-06-02T04:19:42.841 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2832 2024-06-02T04:19:42.841 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2832_vm 2024-06-02T04:19:42.841 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2833 2024-06-02T04:19:42.841 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2834 2024-06-02T04:19:42.841 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2834_vm 2024-06-02T04:19:42.841 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2835 2024-06-02T04:19:42.841 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2836 2024-06-02T04:19:42.841 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2836_vm 2024-06-02T04:19:42.841 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2837 2024-06-02T04:19:42.841 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Jun 2 04:04 2838 2024-06-02T04:19:42.841 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2838_fsm 2024-06-02T04:19:42.842 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2838_vm 2024-06-02T04:19:42.842 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2839 2024-06-02T04:19:42.842 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2840 2024-06-02T04:19:42.842 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2840_fsm 2024-06-02T04:19:42.842 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2840_vm 2024-06-02T04:19:42.842 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2841 2024-06-02T04:19:42.842 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2995 2024-06-02T04:19:42.842 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2995_vm 2024-06-02T04:19:42.842 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2996 2024-06-02T04:19:42.842 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3079 2024-06-02T04:19:42.842 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3079_fsm 2024-06-02T04:19:42.842 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3079_vm 2024-06-02T04:19:42.842 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3080 2024-06-02T04:19:42.843 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3081 2024-06-02T04:19:42.843 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3085 2024-06-02T04:19:42.843 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3118 2024-06-02T04:19:42.843 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3118_vm 2024-06-02T04:19:42.843 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3119 2024-06-02T04:19:42.843 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3164 2024-06-02T04:19:42.843 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3256 2024-06-02T04:19:42.843 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3256_vm 2024-06-02T04:19:42.843 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3257 2024-06-02T04:19:42.843 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3258 2024-06-02T04:19:42.843 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3350 2024-06-02T04:19:42.843 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3350_vm 2024-06-02T04:19:42.843 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3351 2024-06-02T04:19:42.844 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3379 2024-06-02T04:19:42.844 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3380 2024-06-02T04:19:42.844 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3381 2024-06-02T04:19:42.844 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3381_vm 2024-06-02T04:19:42.844 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3394 2024-06-02T04:19:42.844 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3394_fsm 2024-06-02T04:19:42.844 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3394_vm 2024-06-02T04:19:42.844 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3395 2024-06-02T04:19:42.844 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3439 2024-06-02T04:19:42.844 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3439_vm 2024-06-02T04:19:42.844 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3440 2024-06-02T04:19:42.844 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:04 3455 2024-06-02T04:19:42.844 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3456 2024-06-02T04:19:42.845 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3456_fsm 2024-06-02T04:19:42.845 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3456_vm 2024-06-02T04:19:42.845 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3466 2024-06-02T04:19:42.845 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3466_vm 2024-06-02T04:19:42.845 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3467 2024-06-02T04:19:42.845 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3468 2024-06-02T04:19:42.845 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3501 2024-06-02T04:19:42.845 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3501_vm 2024-06-02T04:19:42.845 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3502 2024-06-02T04:19:42.845 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3503 2024-06-02T04:19:42.845 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3534 2024-06-02T04:19:42.845 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3541 2024-06-02T04:19:42.845 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3541_fsm 2024-06-02T04:19:42.845 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3541_vm 2024-06-02T04:19:42.846 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3542 2024-06-02T04:19:42.846 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3574 2024-06-02T04:19:42.846 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3575 2024-06-02T04:19:42.846 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3576 2024-06-02T04:19:42.846 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3576_vm 2024-06-02T04:19:42.846 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3596 2024-06-02T04:19:42.846 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3596_vm 2024-06-02T04:19:42.846 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3597 2024-06-02T04:19:42.846 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3598 2024-06-02T04:19:42.846 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3598_vm 2024-06-02T04:19:42.846 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3599 2024-06-02T04:19:42.846 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3600 2024-06-02T04:19:42.846 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3600_fsm 2024-06-02T04:19:42.847 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3600_vm 2024-06-02T04:19:42.847 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3601 2024-06-02T04:19:42.847 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3601_fsm 2024-06-02T04:19:42.847 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3601_vm 2024-06-02T04:19:42.847 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3602 2024-06-02T04:19:42.847 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3602_fsm 2024-06-02T04:19:42.847 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3602_vm 2024-06-02T04:19:42.847 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3603 2024-06-02T04:19:42.847 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3603_fsm 2024-06-02T04:19:42.847 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3603_vm 2024-06-02T04:19:42.850 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3604 2024-06-02T04:19:42.850 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3605 2024-06-02T04:19:42.850 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3606 2024-06-02T04:19:42.850 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3607 2024-06-02T04:19:42.850 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3608 2024-06-02T04:19:42.850 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 3609 2024-06-02T04:19:42.850 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3712 2024-06-02T04:19:42.850 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3764 2024-06-02T04:19:42.850 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3764_fsm 2024-06-02T04:19:42.850 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3764_vm 2024-06-02T04:19:42.850 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3766 2024-06-02T04:19:42.851 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3767 2024-06-02T04:19:42.851 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3997 2024-06-02T04:19:42.851 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 5002 2024-06-02T04:19:42.851 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 548 2024-06-02T04:19:42.851 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 549 2024-06-02T04:19:42.851 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6102 2024-06-02T04:19:42.851 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6102_vm 2024-06-02T04:19:42.851 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6104 2024-06-02T04:19:42.851 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6104_vm 2024-06-02T04:19:42.851 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6106 2024-06-02T04:19:42.851 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6106_vm 2024-06-02T04:19:42.851 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6110 2024-06-02T04:19:42.851 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6111 2024-06-02T04:19:42.852 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6112 2024-06-02T04:19:42.852 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6113 2024-06-02T04:19:42.852 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6117 2024-06-02T04:19:42.852 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 826 2024-06-02T04:19:42.852 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 826_vm 2024-06-02T04:19:42.852 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 827 2024-06-02T04:19:42.852 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 828 2024-06-02T04:19:42.852 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jun 2 04:04 pg_filenode.map 2024-06-02T04:19:42.852 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 04:04 PG_VERSION 2024-06-02T04:19:42.852 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:19:42.852 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/base/12346: 2024-06-02T04:19:42.852 INFO:teuthology.orchestra.run.smithi123.stdout:total 7193 2024-06-02T04:19:42.852 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 293 Jun 2 04:04 . 2024-06-02T04:19:42.853 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Jun 2 04:04 .. 2024-06-02T04:19:42.853 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 112 2024-06-02T04:19:42.853 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 113 2024-06-02T04:19:42.853 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jun 2 04:04 12182 2024-06-02T04:19:42.853 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12182_fsm 2024-06-02T04:19:42.853 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12182_vm 2024-06-02T04:19:42.853 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12184 2024-06-02T04:19:42.853 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12186 2024-06-02T04:19:42.853 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12187 2024-06-02T04:19:42.854 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12187_fsm 2024-06-02T04:19:42.854 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12187_vm 2024-06-02T04:19:42.854 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12189 2024-06-02T04:19:42.854 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12191 2024-06-02T04:19:42.854 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12192 2024-06-02T04:19:42.854 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12192_fsm 2024-06-02T04:19:42.854 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12192_vm 2024-06-02T04:19:42.854 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12194 2024-06-02T04:19:42.854 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12196 2024-06-02T04:19:42.854 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12197 2024-06-02T04:19:42.854 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12197_fsm 2024-06-02T04:19:42.854 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12197_vm 2024-06-02T04:19:42.855 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12199 2024-06-02T04:19:42.855 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12201 2024-06-02T04:19:42.855 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12202 2024-06-02T04:19:42.855 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12202_fsm 2024-06-02T04:19:42.855 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12202_vm 2024-06-02T04:19:42.855 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12204 2024-06-02T04:19:42.855 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12206 2024-06-02T04:19:42.855 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12207 2024-06-02T04:19:42.855 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12207_fsm 2024-06-02T04:19:42.855 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12207_vm 2024-06-02T04:19:42.855 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12209 2024-06-02T04:19:42.855 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12211 2024-06-02T04:19:42.855 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12212 2024-06-02T04:19:42.856 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12214 2024-06-02T04:19:42.856 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12216 2024-06-02T04:19:42.856 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Jun 2 04:04 1247 2024-06-02T04:19:42.856 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1247_fsm 2024-06-02T04:19:42.856 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1247_vm 2024-06-02T04:19:42.856 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Jun 2 04:04 1249 2024-06-02T04:19:42.856 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1249_fsm 2024-06-02T04:19:42.856 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1249_vm 2024-06-02T04:19:42.856 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Jun 2 04:04 1255 2024-06-02T04:19:42.856 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1255_fsm 2024-06-02T04:19:42.856 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1255_vm 2024-06-02T04:19:42.856 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Jun 2 04:04 1259 2024-06-02T04:19:42.856 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1259_fsm 2024-06-02T04:19:42.856 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1259_vm 2024-06-02T04:19:42.857 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 1417 2024-06-02T04:19:42.857 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 1417_vm 2024-06-02T04:19:42.857 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 1418 2024-06-02T04:19:42.857 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 1418_vm 2024-06-02T04:19:42.857 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 174 2024-06-02T04:19:42.857 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 175 2024-06-02T04:19:42.857 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2187 2024-06-02T04:19:42.857 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2224 2024-06-02T04:19:42.857 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2224_vm 2024-06-02T04:19:42.857 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2328 2024-06-02T04:19:42.857 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2328_vm 2024-06-02T04:19:42.857 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2336 2024-06-02T04:19:42.858 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2336_vm 2024-06-02T04:19:42.858 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2337 2024-06-02T04:19:42.858 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2600 2024-06-02T04:19:42.858 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2600_fsm 2024-06-02T04:19:42.858 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2600_vm 2024-06-02T04:19:42.858 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2601 2024-06-02T04:19:42.858 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2601_fsm 2024-06-02T04:19:42.858 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2601_vm 2024-06-02T04:19:42.858 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:04 2602 2024-06-02T04:19:42.858 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2602_fsm 2024-06-02T04:19:42.858 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2602_vm 2024-06-02T04:19:42.858 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 2603 2024-06-02T04:19:42.859 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2603_fsm 2024-06-02T04:19:42.859 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2603_vm 2024-06-02T04:19:42.859 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2604 2024-06-02T04:19:42.859 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2604_vm 2024-06-02T04:19:42.859 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2605 2024-06-02T04:19:42.859 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2605_fsm 2024-06-02T04:19:42.859 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2605_vm 2024-06-02T04:19:42.859 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2606 2024-06-02T04:19:42.859 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2606_fsm 2024-06-02T04:19:42.859 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2606_vm 2024-06-02T04:19:42.859 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2607 2024-06-02T04:19:42.859 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2607_fsm 2024-06-02T04:19:42.859 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2607_vm 2024-06-02T04:19:42.859 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Jun 2 04:04 2608 2024-06-02T04:19:42.860 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2608_fsm 2024-06-02T04:19:42.860 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2608_vm 2024-06-02T04:19:42.860 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Jun 2 04:04 2609 2024-06-02T04:19:42.860 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2609_fsm 2024-06-02T04:19:42.860 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2609_vm 2024-06-02T04:19:42.860 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2610 2024-06-02T04:19:42.860 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2610_fsm 2024-06-02T04:19:42.860 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2610_vm 2024-06-02T04:19:42.860 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2611 2024-06-02T04:19:42.860 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2611_vm 2024-06-02T04:19:42.860 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2612 2024-06-02T04:19:42.860 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2612_fsm 2024-06-02T04:19:42.860 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2612_vm 2024-06-02T04:19:42.861 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2613 2024-06-02T04:19:42.861 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2613_vm 2024-06-02T04:19:42.861 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2615 2024-06-02T04:19:42.861 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2615_fsm 2024-06-02T04:19:42.861 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2615_vm 2024-06-02T04:19:42.861 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2616 2024-06-02T04:19:42.861 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2616_fsm 2024-06-02T04:19:42.861 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2616_vm 2024-06-02T04:19:42.861 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Jun 2 04:04 2617 2024-06-02T04:19:42.861 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2617_fsm 2024-06-02T04:19:42.861 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2617_vm 2024-06-02T04:19:42.861 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Jun 2 04:04 2618 2024-06-02T04:19:42.861 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2618_fsm 2024-06-02T04:19:42.861 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2618_vm 2024-06-02T04:19:42.862 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Jun 2 04:04 2619 2024-06-02T04:19:42.862 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2619_fsm 2024-06-02T04:19:42.862 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2619_vm 2024-06-02T04:19:42.862 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2620 2024-06-02T04:19:42.862 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2620_vm 2024-06-02T04:19:42.862 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2650 2024-06-02T04:19:42.862 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2651 2024-06-02T04:19:42.862 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2652 2024-06-02T04:19:42.862 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:04 2653 2024-06-02T04:19:42.862 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:04 2654 2024-06-02T04:19:42.862 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 2655 2024-06-02T04:19:42.862 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2656 2024-06-02T04:19:42.862 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2657 2024-06-02T04:19:42.863 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Jun 2 04:04 2658 2024-06-02T04:19:42.863 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 04:04 2659 2024-06-02T04:19:42.863 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2660 2024-06-02T04:19:42.863 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2661 2024-06-02T04:19:42.863 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 2662 2024-06-02T04:19:42.863 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:04 2663 2024-06-02T04:19:42.863 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2664 2024-06-02T04:19:42.863 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2665 2024-06-02T04:19:42.863 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2666 2024-06-02T04:19:42.863 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2667 2024-06-02T04:19:42.863 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2668 2024-06-02T04:19:42.863 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2669 2024-06-02T04:19:42.863 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2670 2024-06-02T04:19:42.864 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 319488 Jun 2 04:04 2673 2024-06-02T04:19:42.864 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Jun 2 04:04 2674 2024-06-02T04:19:42.864 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Jun 2 04:04 2675 2024-06-02T04:19:42.864 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2678 2024-06-02T04:19:42.864 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2679 2024-06-02T04:19:42.864 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2680 2024-06-02T04:19:42.864 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2681 2024-06-02T04:19:42.864 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2682 2024-06-02T04:19:42.864 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2683 2024-06-02T04:19:42.864 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2684 2024-06-02T04:19:42.864 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2685 2024-06-02T04:19:42.864 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2686 2024-06-02T04:19:42.864 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2687 2024-06-02T04:19:42.865 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:04 2688 2024-06-02T04:19:42.865 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:04 2689 2024-06-02T04:19:42.865 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 04:04 2690 2024-06-02T04:19:42.865 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Jun 2 04:04 2691 2024-06-02T04:19:42.865 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2692 2024-06-02T04:19:42.865 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2693 2024-06-02T04:19:42.865 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2696 2024-06-02T04:19:42.865 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2699 2024-06-02T04:19:42.865 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2701 2024-06-02T04:19:42.865 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2702 2024-06-02T04:19:42.865 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2703 2024-06-02T04:19:42.865 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:04 2704 2024-06-02T04:19:42.865 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2753 2024-06-02T04:19:42.866 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2753_fsm 2024-06-02T04:19:42.866 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2753_vm 2024-06-02T04:19:42.866 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2754 2024-06-02T04:19:42.866 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2755 2024-06-02T04:19:42.866 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 2756 2024-06-02T04:19:42.866 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 2757 2024-06-02T04:19:42.866 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2830 2024-06-02T04:19:42.866 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2830_vm 2024-06-02T04:19:42.866 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2831 2024-06-02T04:19:42.866 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2832 2024-06-02T04:19:42.866 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2832_vm 2024-06-02T04:19:42.866 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2833 2024-06-02T04:19:42.866 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2834 2024-06-02T04:19:42.867 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2834_vm 2024-06-02T04:19:42.867 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2835 2024-06-02T04:19:42.867 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2836 2024-06-02T04:19:42.867 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2836_vm 2024-06-02T04:19:42.867 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2837 2024-06-02T04:19:42.867 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Jun 2 04:04 2838 2024-06-02T04:19:42.867 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2838_fsm 2024-06-02T04:19:42.867 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2838_vm 2024-06-02T04:19:42.867 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2839 2024-06-02T04:19:42.867 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2840 2024-06-02T04:19:42.867 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2840_fsm 2024-06-02T04:19:42.867 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2840_vm 2024-06-02T04:19:42.867 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2841 2024-06-02T04:19:42.868 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2995 2024-06-02T04:19:42.868 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2995_vm 2024-06-02T04:19:42.868 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2996 2024-06-02T04:19:42.868 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3079 2024-06-02T04:19:42.868 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3079_fsm 2024-06-02T04:19:42.868 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3079_vm 2024-06-02T04:19:42.868 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3080 2024-06-02T04:19:42.868 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3081 2024-06-02T04:19:42.868 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3085 2024-06-02T04:19:42.868 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3118 2024-06-02T04:19:42.868 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3118_vm 2024-06-02T04:19:42.868 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3119 2024-06-02T04:19:42.868 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3164 2024-06-02T04:19:42.869 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3256 2024-06-02T04:19:42.869 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3256_vm 2024-06-02T04:19:42.869 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3257 2024-06-02T04:19:42.869 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3258 2024-06-02T04:19:42.869 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3350 2024-06-02T04:19:42.869 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3350_vm 2024-06-02T04:19:42.869 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3351 2024-06-02T04:19:42.869 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3379 2024-06-02T04:19:42.869 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3380 2024-06-02T04:19:42.869 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3381 2024-06-02T04:19:42.869 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3381_vm 2024-06-02T04:19:42.869 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3394 2024-06-02T04:19:42.869 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3394_fsm 2024-06-02T04:19:42.869 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3394_vm 2024-06-02T04:19:42.870 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3395 2024-06-02T04:19:42.870 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3439 2024-06-02T04:19:42.870 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3439_vm 2024-06-02T04:19:42.870 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3440 2024-06-02T04:19:42.870 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:04 3455 2024-06-02T04:19:42.870 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3456 2024-06-02T04:19:42.870 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3456_fsm 2024-06-02T04:19:42.870 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3456_vm 2024-06-02T04:19:42.870 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3466 2024-06-02T04:19:42.870 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3466_vm 2024-06-02T04:19:42.870 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3467 2024-06-02T04:19:42.870 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3468 2024-06-02T04:19:42.871 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3501 2024-06-02T04:19:42.871 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3501_vm 2024-06-02T04:19:42.871 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3502 2024-06-02T04:19:42.871 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3503 2024-06-02T04:19:42.871 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3534 2024-06-02T04:19:42.871 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3541 2024-06-02T04:19:42.871 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3541_fsm 2024-06-02T04:19:42.871 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3541_vm 2024-06-02T04:19:42.871 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3542 2024-06-02T04:19:42.871 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3574 2024-06-02T04:19:42.871 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3575 2024-06-02T04:19:42.871 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3576 2024-06-02T04:19:42.871 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3576_vm 2024-06-02T04:19:42.872 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3596 2024-06-02T04:19:42.872 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3596_vm 2024-06-02T04:19:42.872 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3597 2024-06-02T04:19:42.872 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3598 2024-06-02T04:19:42.872 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3598_vm 2024-06-02T04:19:42.872 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3599 2024-06-02T04:19:42.872 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3600 2024-06-02T04:19:42.872 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3600_fsm 2024-06-02T04:19:42.872 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3600_vm 2024-06-02T04:19:42.872 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3601 2024-06-02T04:19:42.872 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3601_fsm 2024-06-02T04:19:42.872 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3601_vm 2024-06-02T04:19:42.872 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3602 2024-06-02T04:19:42.873 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3602_fsm 2024-06-02T04:19:42.873 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3602_vm 2024-06-02T04:19:42.873 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3603 2024-06-02T04:19:42.873 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3603_fsm 2024-06-02T04:19:42.873 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3603_vm 2024-06-02T04:19:42.873 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3604 2024-06-02T04:19:42.873 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3605 2024-06-02T04:19:42.873 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3606 2024-06-02T04:19:42.873 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3607 2024-06-02T04:19:42.873 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3608 2024-06-02T04:19:42.873 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 3609 2024-06-02T04:19:42.873 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3712 2024-06-02T04:19:42.873 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3764 2024-06-02T04:19:42.874 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3764_fsm 2024-06-02T04:19:42.874 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3764_vm 2024-06-02T04:19:42.874 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3766 2024-06-02T04:19:42.874 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3767 2024-06-02T04:19:42.874 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3997 2024-06-02T04:19:42.874 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 5002 2024-06-02T04:19:42.874 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 548 2024-06-02T04:19:42.874 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 549 2024-06-02T04:19:42.874 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6102 2024-06-02T04:19:42.874 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6102_vm 2024-06-02T04:19:42.874 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6104 2024-06-02T04:19:42.874 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6104_vm 2024-06-02T04:19:42.875 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6106 2024-06-02T04:19:42.875 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6106_vm 2024-06-02T04:19:42.875 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6110 2024-06-02T04:19:42.875 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6111 2024-06-02T04:19:42.875 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6112 2024-06-02T04:19:42.875 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6113 2024-06-02T04:19:42.875 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6117 2024-06-02T04:19:42.875 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 826 2024-06-02T04:19:42.875 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 826_vm 2024-06-02T04:19:42.875 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 827 2024-06-02T04:19:42.875 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 828 2024-06-02T04:19:42.875 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jun 2 04:04 pg_filenode.map 2024-06-02T04:19:42.875 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 04:04 PG_VERSION 2024-06-02T04:19:42.875 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:19:42.876 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/base/12347: 2024-06-02T04:19:42.876 INFO:teuthology.orchestra.run.smithi123.stdout:total 670736 2024-06-02T04:19:42.876 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 308 Jun 2 04:04 . 2024-06-02T04:19:42.876 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Jun 2 04:04 .. 2024-06-02T04:19:42.876 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 112 2024-06-02T04:19:42.876 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 113 2024-06-02T04:19:42.876 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jun 2 04:04 12182 2024-06-02T04:19:42.876 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12182_fsm 2024-06-02T04:19:42.876 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12182_vm 2024-06-02T04:19:42.876 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12184 2024-06-02T04:19:42.876 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12186 2024-06-02T04:19:42.876 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12187 2024-06-02T04:19:42.876 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12187_fsm 2024-06-02T04:19:42.877 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12187_vm 2024-06-02T04:19:42.877 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12189 2024-06-02T04:19:42.877 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12191 2024-06-02T04:19:42.877 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12192 2024-06-02T04:19:42.877 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12192_fsm 2024-06-02T04:19:42.877 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12192_vm 2024-06-02T04:19:42.877 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12194 2024-06-02T04:19:42.877 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12196 2024-06-02T04:19:42.877 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12197 2024-06-02T04:19:42.877 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12197_fsm 2024-06-02T04:19:42.877 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12197_vm 2024-06-02T04:19:42.877 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12199 2024-06-02T04:19:42.877 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12201 2024-06-02T04:19:42.878 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12202 2024-06-02T04:19:42.878 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12202_fsm 2024-06-02T04:19:42.878 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12202_vm 2024-06-02T04:19:42.878 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12204 2024-06-02T04:19:42.878 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12206 2024-06-02T04:19:42.878 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12207 2024-06-02T04:19:42.878 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 12207_fsm 2024-06-02T04:19:42.878 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12207_vm 2024-06-02T04:19:42.878 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12209 2024-06-02T04:19:42.878 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12211 2024-06-02T04:19:42.878 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12212 2024-06-02T04:19:42.878 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 12214 2024-06-02T04:19:42.878 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 12216 2024-06-02T04:19:42.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Jun 2 04:04 1247 2024-06-02T04:19:42.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1247_fsm 2024-06-02T04:19:42.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1247_vm 2024-06-02T04:19:42.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Jun 2 04:04 1249 2024-06-02T04:19:42.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1249_fsm 2024-06-02T04:19:42.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1249_vm 2024-06-02T04:19:42.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Jun 2 04:04 1255 2024-06-02T04:19:42.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1255_fsm 2024-06-02T04:19:42.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1255_vm 2024-06-02T04:19:42.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Jun 2 04:19 1259 2024-06-02T04:19:42.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1259_fsm 2024-06-02T04:19:42.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1259_vm 2024-06-02T04:19:42.879 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 1417 2024-06-02T04:19:42.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 1417_vm 2024-06-02T04:19:42.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 1418 2024-06-02T04:19:42.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 1418_vm 2024-06-02T04:19:42.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 12386304 Jun 2 04:19 16387 2024-06-02T04:19:42.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:19 16387_fsm 2024-06-02T04:19:42.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:19 16387_vm 2024-06-02T04:19:42.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 10207232 Jun 2 04:19 16393 2024-06-02T04:19:42.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:19 16393_fsm 2024-06-02T04:19:42.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:19 16393_vm 2024-06-02T04:19:42.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 473178112 Jun 2 04:19 16396 2024-06-02T04:19:42.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 139264 Jun 2 04:19 16396_fsm 2024-06-02T04:19:42.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:06 16396_vm 2024-06-02T04:19:42.880 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Jun 2 04:19 16397 2024-06-02T04:19:42.881 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 532480 Jun 2 04:19 16399 2024-06-02T04:19:42.881 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 74203136 Jun 2 04:19 16401 2024-06-02T04:19:42.881 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 108396544 Jun 2 04:19 16403 2024-06-02T04:19:42.881 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:19 16403_fsm 2024-06-02T04:19:42.881 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 174 2024-06-02T04:19:42.881 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 175 2024-06-02T04:19:42.881 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2187 2024-06-02T04:19:42.881 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2224 2024-06-02T04:19:42.881 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2224_vm 2024-06-02T04:19:42.881 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2328 2024-06-02T04:19:42.881 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2328_vm 2024-06-02T04:19:42.881 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2336 2024-06-02T04:19:42.881 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2336_vm 2024-06-02T04:19:42.881 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2337 2024-06-02T04:19:42.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2600 2024-06-02T04:19:42.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2600_fsm 2024-06-02T04:19:42.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2600_vm 2024-06-02T04:19:42.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2601 2024-06-02T04:19:42.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2601_fsm 2024-06-02T04:19:42.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2601_vm 2024-06-02T04:19:42.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:04 2602 2024-06-02T04:19:42.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2602_fsm 2024-06-02T04:19:42.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2602_vm 2024-06-02T04:19:42.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 2603 2024-06-02T04:19:42.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2603_fsm 2024-06-02T04:19:42.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2603_vm 2024-06-02T04:19:42.882 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2604 2024-06-02T04:19:42.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2604_vm 2024-06-02T04:19:42.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2605 2024-06-02T04:19:42.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2605_fsm 2024-06-02T04:19:42.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2605_vm 2024-06-02T04:19:42.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2606 2024-06-02T04:19:42.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2606_fsm 2024-06-02T04:19:42.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2606_vm 2024-06-02T04:19:42.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2607 2024-06-02T04:19:42.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2607_fsm 2024-06-02T04:19:42.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2607_vm 2024-06-02T04:19:42.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 450560 Jun 2 04:04 2608 2024-06-02T04:19:42.883 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2608_fsm 2024-06-02T04:19:42.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2608_vm 2024-06-02T04:19:42.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Jun 2 04:04 2609 2024-06-02T04:19:42.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2609_fsm 2024-06-02T04:19:42.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2609_vm 2024-06-02T04:19:42.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 2610 2024-06-02T04:19:42.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2610_fsm 2024-06-02T04:19:42.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2610_vm 2024-06-02T04:19:42.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2611 2024-06-02T04:19:42.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2611_vm 2024-06-02T04:19:42.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2612 2024-06-02T04:19:42.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2612_fsm 2024-06-02T04:19:42.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2612_vm 2024-06-02T04:19:42.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2613 2024-06-02T04:19:42.884 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2613_vm 2024-06-02T04:19:42.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2615 2024-06-02T04:19:42.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2615_fsm 2024-06-02T04:19:42.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2615_vm 2024-06-02T04:19:42.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2616 2024-06-02T04:19:42.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2616_fsm 2024-06-02T04:19:42.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2616_vm 2024-06-02T04:19:42.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Jun 2 04:04 2617 2024-06-02T04:19:42.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2617_fsm 2024-06-02T04:19:42.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2617_vm 2024-06-02T04:19:42.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Jun 2 04:04 2618 2024-06-02T04:19:42.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2618_fsm 2024-06-02T04:19:42.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2618_vm 2024-06-02T04:19:42.885 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 155648 Jun 2 04:18 2619 2024-06-02T04:19:42.886 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:08 2619_fsm 2024-06-02T04:19:42.886 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2619_vm 2024-06-02T04:19:42.886 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2620 2024-06-02T04:19:42.886 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2620_vm 2024-06-02T04:19:42.886 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2650 2024-06-02T04:19:42.886 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2651 2024-06-02T04:19:42.886 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2652 2024-06-02T04:19:42.886 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:04 2653 2024-06-02T04:19:42.886 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:04 2654 2024-06-02T04:19:42.886 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 2655 2024-06-02T04:19:42.886 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2656 2024-06-02T04:19:42.886 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2657 2024-06-02T04:19:42.886 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Jun 2 04:04 2658 2024-06-02T04:19:42.887 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 04:04 2659 2024-06-02T04:19:42.887 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2660 2024-06-02T04:19:42.887 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2661 2024-06-02T04:19:42.887 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 2662 2024-06-02T04:19:42.887 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:04 2663 2024-06-02T04:19:42.887 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2664 2024-06-02T04:19:42.887 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2665 2024-06-02T04:19:42.887 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2666 2024-06-02T04:19:42.887 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2667 2024-06-02T04:19:42.887 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2668 2024-06-02T04:19:42.887 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2669 2024-06-02T04:19:42.887 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2670 2024-06-02T04:19:42.887 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 319488 Jun 2 04:04 2673 2024-06-02T04:19:42.887 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Jun 2 04:04 2674 2024-06-02T04:19:42.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Jun 2 04:04 2675 2024-06-02T04:19:42.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2678 2024-06-02T04:19:42.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2679 2024-06-02T04:19:42.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2680 2024-06-02T04:19:42.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2681 2024-06-02T04:19:42.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2682 2024-06-02T04:19:42.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2683 2024-06-02T04:19:42.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2684 2024-06-02T04:19:42.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2685 2024-06-02T04:19:42.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2686 2024-06-02T04:19:42.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2687 2024-06-02T04:19:42.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:04 2688 2024-06-02T04:19:42.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jun 2 04:04 2689 2024-06-02T04:19:42.888 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jun 2 04:04 2690 2024-06-02T04:19:42.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Jun 2 04:04 2691 2024-06-02T04:19:42.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2692 2024-06-02T04:19:42.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2693 2024-06-02T04:19:42.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:08 2696 2024-06-02T04:19:42.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2699 2024-06-02T04:19:42.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2701 2024-06-02T04:19:42.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2702 2024-06-02T04:19:42.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2703 2024-06-02T04:19:42.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:04 2704 2024-06-02T04:19:42.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2753 2024-06-02T04:19:42.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2753_fsm 2024-06-02T04:19:42.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2753_vm 2024-06-02T04:19:42.889 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2754 2024-06-02T04:19:42.890 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2755 2024-06-02T04:19:42.890 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 2756 2024-06-02T04:19:42.890 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 2757 2024-06-02T04:19:42.890 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2830 2024-06-02T04:19:42.890 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2830_vm 2024-06-02T04:19:42.890 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2831 2024-06-02T04:19:42.890 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2832 2024-06-02T04:19:42.890 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2832_vm 2024-06-02T04:19:42.890 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2833 2024-06-02T04:19:42.890 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2834 2024-06-02T04:19:42.890 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2834_vm 2024-06-02T04:19:42.890 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2835 2024-06-02T04:19:42.890 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2836 2024-06-02T04:19:42.891 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2836_vm 2024-06-02T04:19:42.891 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2837 2024-06-02T04:19:42.891 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Jun 2 04:04 2838 2024-06-02T04:19:42.891 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2838_fsm 2024-06-02T04:19:42.891 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2838_vm 2024-06-02T04:19:42.891 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2839 2024-06-02T04:19:42.891 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2840 2024-06-02T04:19:42.892 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2840_fsm 2024-06-02T04:19:42.892 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2840_vm 2024-06-02T04:19:42.892 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2841 2024-06-02T04:19:42.892 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2995 2024-06-02T04:19:42.892 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2995_vm 2024-06-02T04:19:42.892 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2996 2024-06-02T04:19:42.892 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3079 2024-06-02T04:19:42.892 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3079_fsm 2024-06-02T04:19:42.892 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3079_vm 2024-06-02T04:19:42.892 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3080 2024-06-02T04:19:42.892 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3081 2024-06-02T04:19:42.893 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3085 2024-06-02T04:19:42.893 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3118 2024-06-02T04:19:42.893 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3118_vm 2024-06-02T04:19:42.893 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3119 2024-06-02T04:19:42.893 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3164 2024-06-02T04:19:42.893 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3256 2024-06-02T04:19:42.893 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3256_vm 2024-06-02T04:19:42.893 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3257 2024-06-02T04:19:42.893 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3258 2024-06-02T04:19:42.893 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3350 2024-06-02T04:19:42.893 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3350_vm 2024-06-02T04:19:42.893 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3351 2024-06-02T04:19:42.893 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3379 2024-06-02T04:19:42.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3380 2024-06-02T04:19:42.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3381 2024-06-02T04:19:42.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3381_vm 2024-06-02T04:19:42.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3394 2024-06-02T04:19:42.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3394_fsm 2024-06-02T04:19:42.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3394_vm 2024-06-02T04:19:42.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3395 2024-06-02T04:19:42.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3439 2024-06-02T04:19:42.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3439_vm 2024-06-02T04:19:42.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3440 2024-06-02T04:19:42.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jun 2 04:04 3455 2024-06-02T04:19:42.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3456 2024-06-02T04:19:42.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3456_fsm 2024-06-02T04:19:42.894 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3456_vm 2024-06-02T04:19:42.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3466 2024-06-02T04:19:42.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3466_vm 2024-06-02T04:19:42.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3467 2024-06-02T04:19:42.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3468 2024-06-02T04:19:42.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3501 2024-06-02T04:19:42.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3501_vm 2024-06-02T04:19:42.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3502 2024-06-02T04:19:42.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3503 2024-06-02T04:19:42.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3534 2024-06-02T04:19:42.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3541 2024-06-02T04:19:42.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3541_fsm 2024-06-02T04:19:42.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3541_vm 2024-06-02T04:19:42.895 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3542 2024-06-02T04:19:42.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3574 2024-06-02T04:19:42.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3575 2024-06-02T04:19:42.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3576 2024-06-02T04:19:42.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3576_vm 2024-06-02T04:19:42.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3596 2024-06-02T04:19:42.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3596_vm 2024-06-02T04:19:42.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3597 2024-06-02T04:19:42.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3598 2024-06-02T04:19:42.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3598_vm 2024-06-02T04:19:42.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3599 2024-06-02T04:19:42.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3600 2024-06-02T04:19:42.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3600_fsm 2024-06-02T04:19:42.896 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3600_vm 2024-06-02T04:19:42.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3601 2024-06-02T04:19:42.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3601_fsm 2024-06-02T04:19:42.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3601_vm 2024-06-02T04:19:42.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3602 2024-06-02T04:19:42.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3602_fsm 2024-06-02T04:19:42.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3602_vm 2024-06-02T04:19:42.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3603 2024-06-02T04:19:42.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3603_fsm 2024-06-02T04:19:42.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3603_vm 2024-06-02T04:19:42.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3604 2024-06-02T04:19:42.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3605 2024-06-02T04:19:42.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3606 2024-06-02T04:19:42.897 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3607 2024-06-02T04:19:42.898 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3608 2024-06-02T04:19:42.898 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jun 2 04:04 3609 2024-06-02T04:19:42.898 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3712 2024-06-02T04:19:42.898 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3764 2024-06-02T04:19:42.898 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 3764_fsm 2024-06-02T04:19:42.898 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3764_vm 2024-06-02T04:19:42.898 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3766 2024-06-02T04:19:42.898 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 3767 2024-06-02T04:19:42.898 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3997 2024-06-02T04:19:42.898 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 5002 2024-06-02T04:19:42.898 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 548 2024-06-02T04:19:42.898 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 549 2024-06-02T04:19:42.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6102 2024-06-02T04:19:42.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6102_vm 2024-06-02T04:19:42.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6104 2024-06-02T04:19:42.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6104_vm 2024-06-02T04:19:42.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6106 2024-06-02T04:19:42.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6106_vm 2024-06-02T04:19:42.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6110 2024-06-02T04:19:42.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6111 2024-06-02T04:19:42.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6112 2024-06-02T04:19:42.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6113 2024-06-02T04:19:42.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6117 2024-06-02T04:19:42.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 826 2024-06-02T04:19:42.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 826_vm 2024-06-02T04:19:42.899 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 827 2024-06-02T04:19:42.900 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 828 2024-06-02T04:19:42.900 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jun 2 04:04 pg_filenode.map 2024-06-02T04:19:42.900 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 137860 Jun 2 04:04 pg_internal.init 2024-06-02T04:19:42.900 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 04:04 PG_VERSION 2024-06-02T04:19:42.900 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:19:42.900 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2024-06-02T04:19:42.900 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:19:42.900 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 . 2024-06-02T04:19:42.900 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Jun 2 04:04 .. 2024-06-02T04:19:42.900 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:19:42.900 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/global: 2024-06-02T04:19:42.900 INFO:teuthology.orchestra.run.smithi123.stdout:total 574 2024-06-02T04:19:42.900 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 59 Jun 2 04:04 . 2024-06-02T04:19:42.901 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 04:19 .. 2024-06-02T04:19:42.901 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1136 2024-06-02T04:19:42.901 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1136_fsm 2024-06-02T04:19:42.901 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1136_vm 2024-06-02T04:19:42.901 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 1137 2024-06-02T04:19:42.901 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1213 2024-06-02T04:19:42.901 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1213_fsm 2024-06-02T04:19:42.901 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1213_vm 2024-06-02T04:19:42.901 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1214 2024-06-02T04:19:42.901 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1214_fsm 2024-06-02T04:19:42.901 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1214_vm 2024-06-02T04:19:42.901 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 1232 2024-06-02T04:19:42.901 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 1233 2024-06-02T04:19:42.902 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1260 2024-06-02T04:19:42.902 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1260_fsm 2024-06-02T04:19:42.902 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1260_vm 2024-06-02T04:19:42.902 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1261 2024-06-02T04:19:42.902 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1261_fsm 2024-06-02T04:19:42.902 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1261_vm 2024-06-02T04:19:42.902 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1262 2024-06-02T04:19:42.902 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 1262_fsm 2024-06-02T04:19:42.902 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 1262_vm 2024-06-02T04:19:42.902 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2396 2024-06-02T04:19:42.902 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jun 2 04:04 2396_fsm 2024-06-02T04:19:42.902 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2396_vm 2024-06-02T04:19:42.902 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2397 2024-06-02T04:19:42.903 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2671 2024-06-02T04:19:42.903 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2672 2024-06-02T04:19:42.903 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2676 2024-06-02T04:19:42.903 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2677 2024-06-02T04:19:42.903 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2694 2024-06-02T04:19:42.903 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2695 2024-06-02T04:19:42.905 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2697 2024-06-02T04:19:42.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jun 2 04:04 2698 2024-06-02T04:19:42.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2846 2024-06-02T04:19:42.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2846_vm 2024-06-02T04:19:42.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2847 2024-06-02T04:19:42.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2964 2024-06-02T04:19:42.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2964_vm 2024-06-02T04:19:42.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2965 2024-06-02T04:19:42.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2966 2024-06-02T04:19:42.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 2966_vm 2024-06-02T04:19:42.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 2967 2024-06-02T04:19:42.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3592 2024-06-02T04:19:42.906 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 3592_vm 2024-06-02T04:19:42.907 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 3593 2024-06-02T04:19:42.907 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 4060 2024-06-02T04:19:42.907 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 4060_vm 2024-06-02T04:19:42.907 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 4061 2024-06-02T04:19:42.907 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6000 2024-06-02T04:19:42.907 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6000_vm 2024-06-02T04:19:42.907 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6001 2024-06-02T04:19:42.907 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6002 2024-06-02T04:19:42.907 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6100 2024-06-02T04:19:42.907 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 6100_vm 2024-06-02T04:19:42.907 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6114 2024-06-02T04:19:42.907 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 6115 2024-06-02T04:19:42.907 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:19 pg_control 2024-06-02T04:19:42.908 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jun 2 04:04 pg_filenode.map 2024-06-02T04:19:42.908 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 21644 Jun 2 04:04 pg_internal.init 2024-06-02T04:19:42.908 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:19:42.908 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/log: 2024-06-02T04:19:42.908 INFO:teuthology.orchestra.run.smithi123.stdout:total 3 2024-06-02T04:19:42.908 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 04:04 . 2024-06-02T04:19:42.908 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 04:19 .. 2024-06-02T04:19:42.908 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3019 Jun 2 04:19 postgresql-Sun.log 2024-06-02T04:19:42.908 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:19:42.908 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-06-02T04:19:42.908 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:19:42.908 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 . 2024-06-02T04:19:42.908 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 04:19 .. 2024-06-02T04:19:42.908 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:19:42.909 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-06-02T04:19:42.909 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:19:42.909 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 . 2024-06-02T04:19:42.909 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 04:19 .. 2024-06-02T04:19:42.909 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:19:42.909 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-06-02T04:19:42.909 INFO:teuthology.orchestra.run.smithi123.stdout:total 1 2024-06-02T04:19:42.909 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 04:19 . 2024-06-02T04:19:42.909 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 04:19 .. 2024-06-02T04:19:42.909 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 mappings 2024-06-02T04:19:42.909 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jun 2 04:19 replorigin_checkpoint 2024-06-02T04:19:42.909 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 snapshots 2024-06-02T04:19:42.909 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:19:42.909 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-06-02T04:19:42.910 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:19:42.910 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 . 2024-06-02T04:19:42.910 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 04:19 .. 2024-06-02T04:19:42.910 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:19:42.910 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-06-02T04:19:42.910 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:19:42.910 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 . 2024-06-02T04:19:42.911 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 04:19 .. 2024-06-02T04:19:42.911 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:19:42.911 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-06-02T04:19:42.911 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:19:42.911 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Jun 2 04:04 . 2024-06-02T04:19:42.911 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 04:19 .. 2024-06-02T04:19:42.912 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 04:04 members 2024-06-02T04:19:42.912 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 04:04 offsets 2024-06-02T04:19:42.912 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:19:42.912 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-06-02T04:19:42.912 INFO:teuthology.orchestra.run.smithi123.stdout:total 8 2024-06-02T04:19:42.912 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 04:04 . 2024-06-02T04:19:42.912 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Jun 2 04:04 .. 2024-06-02T04:19:42.912 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 0000 2024-06-02T04:19:42.912 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:19:42.912 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-06-02T04:19:42.912 INFO:teuthology.orchestra.run.smithi123.stdout:total 8 2024-06-02T04:19:42.912 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 04:04 . 2024-06-02T04:19:42.913 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Jun 2 04:04 .. 2024-06-02T04:19:42.913 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 0000 2024-06-02T04:19:42.913 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:19:42.913 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-06-02T04:19:42.913 INFO:teuthology.orchestra.run.smithi123.stdout:total 8 2024-06-02T04:19:42.913 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 04:04 . 2024-06-02T04:19:42.913 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 04:19 .. 2024-06-02T04:19:42.913 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jun 2 04:04 0000 2024-06-02T04:19:42.913 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:19:42.913 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-06-02T04:19:42.913 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:19:42.913 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 . 2024-06-02T04:19:42.913 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 04:19 .. 2024-06-02T04:19:42.914 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:19:42.914 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-06-02T04:19:42.914 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:19:42.914 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 . 2024-06-02T04:19:42.914 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 04:19 .. 2024-06-02T04:19:42.914 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:19:42.914 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-06-02T04:19:42.914 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:19:42.914 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 . 2024-06-02T04:19:42.914 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 04:19 .. 2024-06-02T04:19:42.914 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:19:42.914 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-06-02T04:19:42.915 INFO:teuthology.orchestra.run.smithi123.stdout:total 13 2024-06-02T04:19:42.915 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jun 2 04:19 . 2024-06-02T04:19:42.915 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 04:19 .. 2024-06-02T04:19:42.915 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1864 Jun 2 04:19 db_0.stat 2024-06-02T04:19:42.915 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 9300 Jun 2 04:19 db_12347.stat 2024-06-02T04:19:42.915 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 607 Jun 2 04:19 global.stat 2024-06-02T04:19:42.915 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:19:42.915 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-06-02T04:19:42.915 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:19:42.915 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:19 . 2024-06-02T04:19:42.915 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 04:19 .. 2024-06-02T04:19:42.915 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:19:42.915 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-06-02T04:19:42.916 INFO:teuthology.orchestra.run.smithi123.stdout:total 152 2024-06-02T04:19:42.916 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Jun 2 04:19 . 2024-06-02T04:19:42.916 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 04:19 .. 2024-06-02T04:19:42.916 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 155648 Jun 2 04:19 001F 2024-06-02T04:19:42.916 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:19:42.916 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-06-02T04:19:42.916 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:19:42.916 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 . 2024-06-02T04:19:42.916 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 04:19 .. 2024-06-02T04:19:42.916 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:19:42.916 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-06-02T04:19:42.916 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:19:42.916 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 . 2024-06-02T04:19:42.917 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 04:19 .. 2024-06-02T04:19:42.917 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:19:42.917 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-06-02T04:19:42.917 INFO:teuthology.orchestra.run.smithi123.stdout:total 1032192 2024-06-02T04:19:42.917 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 64 Jun 2 04:19 . 2024-06-02T04:19:42.917 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 04:19 .. 2024-06-02T04:19:42.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:19 000000010000000200000059 2024-06-02T04:19:42.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:19 00000001000000020000005A 2024-06-02T04:19:42.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:19 00000001000000020000005B 2024-06-02T04:19:42.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:19 00000001000000020000005C 2024-06-02T04:19:42.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:19 00000001000000020000005D 2024-06-02T04:19:42.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:19 00000001000000020000005E 2024-06-02T04:19:42.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:19 00000001000000020000005F 2024-06-02T04:19:42.917 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:19 000000010000000200000060 2024-06-02T04:19:42.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:19 000000010000000200000061 2024-06-02T04:19:42.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:19 000000010000000200000062 2024-06-02T04:19:42.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:19 000000010000000200000063 2024-06-02T04:19:42.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:19 000000010000000200000064 2024-06-02T04:19:42.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:19 000000010000000200000065 2024-06-02T04:19:42.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:19 000000010000000200000066 2024-06-02T04:19:42.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:17 000000010000000200000067 2024-06-02T04:19:42.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:17 000000010000000200000068 2024-06-02T04:19:42.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:17 000000010000000200000069 2024-06-02T04:19:42.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:17 00000001000000020000006A 2024-06-02T04:19:42.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:17 00000001000000020000006B 2024-06-02T04:19:42.918 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:17 00000001000000020000006C 2024-06-02T04:19:42.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:17 00000001000000020000006D 2024-06-02T04:19:42.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:17 00000001000000020000006E 2024-06-02T04:19:42.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:17 00000001000000020000006F 2024-06-02T04:19:42.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:17 000000010000000200000070 2024-06-02T04:19:42.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:17 000000010000000200000071 2024-06-02T04:19:42.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:17 000000010000000200000072 2024-06-02T04:19:42.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:17 000000010000000200000073 2024-06-02T04:19:42.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:17 000000010000000200000074 2024-06-02T04:19:42.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:17 000000010000000200000075 2024-06-02T04:19:42.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:17 000000010000000200000076 2024-06-02T04:19:42.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:17 000000010000000200000077 2024-06-02T04:19:42.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:17 000000010000000200000078 2024-06-02T04:19:42.919 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:17 000000010000000200000079 2024-06-02T04:19:42.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:17 00000001000000020000007A 2024-06-02T04:19:42.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:17 00000001000000020000007B 2024-06-02T04:19:42.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:17 00000001000000020000007C 2024-06-02T04:19:42.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:17 00000001000000020000007D 2024-06-02T04:19:42.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:17 00000001000000020000007E 2024-06-02T04:19:42.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:18 00000001000000020000007F 2024-06-02T04:19:42.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:18 000000010000000200000080 2024-06-02T04:19:42.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:18 000000010000000200000081 2024-06-02T04:19:42.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:18 000000010000000200000082 2024-06-02T04:19:42.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:18 000000010000000200000083 2024-06-02T04:19:42.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:17 000000010000000200000084 2024-06-02T04:19:42.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:18 000000010000000200000085 2024-06-02T04:19:42.920 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:18 000000010000000200000086 2024-06-02T04:19:42.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:18 000000010000000200000087 2024-06-02T04:19:42.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:18 000000010000000200000088 2024-06-02T04:19:42.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:18 000000010000000200000089 2024-06-02T04:19:42.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:18 00000001000000020000008A 2024-06-02T04:19:42.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:18 00000001000000020000008B 2024-06-02T04:19:42.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:19 00000001000000020000008C 2024-06-02T04:19:42.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:18 00000001000000020000008D 2024-06-02T04:19:42.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:18 00000001000000020000008E 2024-06-02T04:19:42.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:18 00000001000000020000008F 2024-06-02T04:19:42.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:18 000000010000000200000090 2024-06-02T04:19:42.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:19 000000010000000200000091 2024-06-02T04:19:42.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:18 000000010000000200000092 2024-06-02T04:19:42.921 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:18 000000010000000200000093 2024-06-02T04:19:42.922 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:18 000000010000000200000094 2024-06-02T04:19:42.922 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:18 000000010000000200000095 2024-06-02T04:19:42.922 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:18 000000010000000200000096 2024-06-02T04:19:42.922 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jun 2 04:18 000000010000000200000097 2024-06-02T04:19:42.922 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 archive_status 2024-06-02T04:19:42.922 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:19:42.922 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-06-02T04:19:42.922 INFO:teuthology.orchestra.run.smithi123.stdout:total 0 2024-06-02T04:19:42.922 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jun 2 04:04 . 2024-06-02T04:19:42.922 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 64 Jun 2 04:19 .. 2024-06-02T04:19:42.922 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:19:42.922 INFO:teuthology.orchestra.run.smithi123.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-06-02T04:19:42.923 INFO:teuthology.orchestra.run.smithi123.stdout:total 512 2024-06-02T04:19:42.923 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Jun 2 04:10 . 2024-06-02T04:19:42.923 INFO:teuthology.orchestra.run.smithi123.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Jun 2 04:19 .. 2024-06-02T04:19:42.923 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 262144 Jun 2 04:10 0000 2024-06-02T04:19:42.923 INFO:teuthology.orchestra.run.smithi123.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 262144 Jun 2 04:19 0001 2024-06-02T04:19:42.923 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:42 smithi123 ceph-mon[42885]: pgmap v721: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 31 MiB/s wr, 2.18k op/s 2024-06-02T04:19:42.924 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-06-02T04:19:42.934 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:19:43.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:42 smithi162 ceph-mon[47009]: pgmap v721: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 31 MiB/s wr, 2.18k op/s 2024-06-02T04:19:43.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:42 smithi136 ceph-mon[47443]: pgmap v721: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 31 MiB/s wr, 2.18k op/s 2024-06-02T04:19:43.180 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.178+0000 7fc2583f0700 1 -- 172.21.15.123:0/2924295120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc250106b70 msgr2=0x7fc250108fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:19:43.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.178+0000 7fc2583f0700 1 --2- 172.21.15.123:0/2924295120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc250106b70 0x7fc250108fe0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc248009990 tx=0x7fc248009ca0 comp rx=0 tx=0).stop 2024-06-02T04:19:43.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.178+0000 7fc2583f0700 1 -- 172.21.15.123:0/2924295120 shutdown_connections 2024-06-02T04:19:43.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.178+0000 7fc2583f0700 1 --2- 172.21.15.123:0/2924295120 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc250106b70 0x7fc250108fe0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:43.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.178+0000 7fc2583f0700 1 --2- 172.21.15.123:0/2924295120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc250101910 0x7fc250103d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:43.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.178+0000 7fc2583f0700 1 --2- 172.21.15.123:0/2924295120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc250104240 0x7fc250106630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:43.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.178+0000 7fc2583f0700 1 -- 172.21.15.123:0/2924295120 >> 172.21.15.123:0/2924295120 conn(0x7fc2500fb300 msgr2=0x7fc2500fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:19:43.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.178+0000 7fc2583f0700 1 -- 172.21.15.123:0/2924295120 shutdown_connections 2024-06-02T04:19:43.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.178+0000 7fc2583f0700 1 -- 172.21.15.123:0/2924295120 wait complete. 2024-06-02T04:19:43.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.179+0000 7fc2583f0700 1 Processor -- start 2024-06-02T04:19:43.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.179+0000 7fc2583f0700 1 -- start start 2024-06-02T04:19:43.181 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.179+0000 7fc2583f0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc250101910 0x7fc250101230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:19:43.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.179+0000 7fc2583f0700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc250104240 0x7fc2500ff8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:19:43.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.179+0000 7fc2583f0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc250106b70 0x7fc2500ffe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:19:43.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.179+0000 7fc2583f0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2501005a0 con 0x7fc250101910 2024-06-02T04:19:43.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.179+0000 7fc2583f0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc250100710 con 0x7fc250106b70 2024-06-02T04:19:43.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.179+0000 7fc2583f0700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2501a0dd0 con 0x7fc250104240 2024-06-02T04:19:43.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.179+0000 7fc25618c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc250101910 0x7fc250101230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:19:43.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.179+0000 7fc25618c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc250101910 0x7fc250101230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42590/0 (socket says 172.21.15.123:42590) 2024-06-02T04:19:43.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.179+0000 7fc25618c700 1 -- 172.21.15.123:0/2162265907 learned_addr learned my addr 172.21.15.123:0/2162265907 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:19:43.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.179+0000 7fc25698d700 1 --2- 172.21.15.123:0/2162265907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc250106b70 0x7fc2500ffe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:19:43.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.179+0000 7fc25598b700 1 --2- 172.21.15.123:0/2162265907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc250104240 0x7fc2500ff8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:19:43.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.179+0000 7fc25618c700 1 -- 172.21.15.123:0/2162265907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc250104240 msgr2=0x7fc2500ff8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:19:43.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.179+0000 7fc25618c700 1 --2- 172.21.15.123:0/2162265907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc250104240 0x7fc2500ff8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:43.182 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.179+0000 7fc25618c700 1 -- 172.21.15.123:0/2162265907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc250106b70 msgr2=0x7fc2500ffe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:19:43.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.179+0000 7fc25618c700 1 --2- 172.21.15.123:0/2162265907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc250106b70 0x7fc2500ffe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:43.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.179+0000 7fc25618c700 1 -- 172.21.15.123:0/2162265907 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2480095f0 con 0x7fc250101910 2024-06-02T04:19:43.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.180+0000 7fc25618c700 1 --2- 172.21.15.123:0/2162265907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc250101910 0x7fc250101230 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc24000ada0 tx=0x7fc24000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:19:43.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.180+0000 7fc24f7fe700 1 -- 172.21.15.123:0/2162265907 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24000f070 con 0x7fc250101910 2024-06-02T04:19:43.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.180+0000 7fc24f7fe700 1 -- 172.21.15.123:0/2162265907 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc24000ae90 con 0x7fc250101910 2024-06-02T04:19:43.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.180+0000 7fc2583f0700 1 -- 172.21.15.123:0/2162265907 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2501a1060 con 0x7fc250101910 2024-06-02T04:19:43.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.180+0000 7fc24f7fe700 1 -- 172.21.15.123:0/2162265907 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2400053e0 con 0x7fc250101910 2024-06-02T04:19:43.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.180+0000 7fc2583f0700 1 -- 172.21.15.123:0/2162265907 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2501a15c0 con 0x7fc250101910 2024-06-02T04:19:43.183 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.181+0000 7fc2583f0700 1 -- 172.21.15.123:0/2162265907 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2500fce80 con 0x7fc250101910 2024-06-02T04:19:43.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.182+0000 7fc24f7fe700 1 -- 172.21.15.123:0/2162265907 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fc24000c920 con 0x7fc250101910 2024-06-02T04:19:43.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.182+0000 7fc24f7fe700 1 --2- 172.21.15.123:0/2162265907 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc2380a11a0 0x7fc2380a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:19:43.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.182+0000 7fc25598b700 1 --2- 172.21.15.123:0/2162265907 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc2380a11a0 0x7fc2380a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:19:43.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.182+0000 7fc24f7fe700 1 -- 172.21.15.123:0/2162265907 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fc2400cbde0 con 0x7fc250101910 2024-06-02T04:19:43.184 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.183+0000 7fc25598b700 1 --2- 172.21.15.123:0/2162265907 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc2380a11a0 0x7fc2380a3660 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc244009bf0 tx=0x7fc244009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:19:43.187 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.187+0000 7fc24f7fe700 1 -- 172.21.15.123:0/2162265907 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc2400956c0 con 0x7fc250101910 2024-06-02T04:19:43.388 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.388+0000 7fc2583f0700 1 -- 172.21.15.123:0/2162265907 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc25010c6c0 con 0x7fc250101910 2024-06-02T04:19:43.389 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.390+0000 7fc24f7fe700 1 -- 172.21.15.123:0/2162265907 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22468 (secure 0 0 0) 0x7fc240098ce0 con 0x7fc250101910 2024-06-02T04:19:43.390 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:19:43.390 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":84,"fsid":"1b432ae0-2094-11ef-bc9b-c7b262605968","created":"2024-06-02T03:57:17.383774+0000","modified":"2024-06-02T04:04:08.620765+0000","last_up_change":"2024-06-02T04:02:34.535591+0000","last_in_change":"2024-06-02T04:02:18.346560+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T03:59:57.079448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:03:05.199881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:03:05.853741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d9d8fb5a-dac5-4b14-98e5-665bdbc696ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6803","nonce":2763421276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6805","nonce":2763421276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6809","nonce":2763421276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6807","nonce":2763421276}]},"public_addr":"172.21.15.123:6803/2763421276","cluster_addr":"172.21.15.123:6805/2763421276","heartbeat_back_addr":"172.21.15.123:6809/2763421276","heartbeat_front_addr":"172.21.15.123:6807/2763421276","state":["exists","up"]},{"osd":1,"uuid":"121bbe3c-bb76-4ec4-9596-37db68fbf1ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6801","nonce":956325510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6803","nonce":956325510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6807","nonce":956325510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6805","nonce":956325510}]},"public_addr":"172.21.15.136:6801/956325510","cluster_addr":"172.21.15.136:6803/956325510","heartbeat_back_addr":"172.21.15.136:6807/956325510","heartbeat_front_addr":"172.21.15.136:6805/956325510","state":["exists","up"]},{"osd":2,"uuid":"df9edf0d-f9f0-4699-a6ed-bbcf2dfb1b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6801","nonce":2915749676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6803","nonce":2915749676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6807","nonce":2915749676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6805","nonce":2915749676}]},"public_addr":"172.21.15.162:6801/2915749676","cluster_addr":"172.21.15.162:6803/2915749676","heartbeat_back_addr":"172.21.15.162:6807/2915749676","heartbeat_front_addr":"172.21.15.162:6805/2915749676","state":["exists","up"]},{"osd":3,"uuid":"3e070364-12c6-4780-b2be-f6e933e65773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6811","nonce":1403773143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6813","nonce":1403773143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6817","nonce":1403773143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6815","nonce":1403773143}]},"public_addr":"172.21.15.123:6811/1403773143","cluster_addr":"172.21.15.123:6813/1403773143","heartbeat_back_addr":"172.21.15.123:6817/1403773143","heartbeat_front_addr":"172.21.15.123:6815/1403773143","state":["exists","up"]},{"osd":4,"uuid":"87dd92dd-73c8-4785-bf8a-3756d79dee90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6809","nonce":1403526782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6811","nonce":1403526782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6815","nonce":1403526782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6813","nonce":1403526782}]},"public_addr":"172.21.15.136:6809/1403526782","cluster_addr":"172.21.15.136:6811/1403526782","heartbeat_back_addr":"172.21.15.136:6815/1403526782","heartbeat_front_addr":"172.21.15.136:6813/1403526782","state":["exists","up"]},{"osd":5,"uuid":"1a730863-6b56-43b7-a115-c80d3c8f3ee3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6809","nonce":3094256489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6811","nonce":3094256489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6815","nonce":3094256489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6813","nonce":3094256489}]},"public_addr":"172.21.15.162:6809/3094256489","cluster_addr":"172.21.15.162:6811/3094256489","heartbeat_back_addr":"172.21.15.162:6815/3094256489","heartbeat_front_addr":"172.21.15.162:6813/3094256489","state":["exists","up"]},{"osd":6,"uuid":"6f170b85-6c47-49ff-ba5b-7fe0596a4ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6819","nonce":3025820432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6821","nonce":3025820432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6825","nonce":3025820432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6823","nonce":3025820432}]},"public_addr":"172.21.15.123:6819/3025820432","cluster_addr":"172.21.15.123:6821/3025820432","heartbeat_back_addr":"172.21.15.123:6825/3025820432","heartbeat_front_addr":"172.21.15.123:6823/3025820432","state":["exists","up"]},{"osd":7,"uuid":"ee66bb7a-6c0d-4e5a-b717-258a39f93a87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6817","nonce":1948829505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6819","nonce":1948829505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6823","nonce":1948829505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6821","nonce":1948829505}]},"public_addr":"172.21.15.136:6817/1948829505","cluster_addr":"172.21.15.136:6819/1948829505","heartbeat_back_addr":"172.21.15.136:6823/1948829505","heartbeat_front_addr":"172.21.15.136:6821/1948829505","state":["exists","up"]},{"osd":8,"uuid":"0ff77e33-53a5-43ef-85da-2036a1fcdb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6817","nonce":1590839230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6819","nonce":1590839230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6823","nonce":1590839230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6821","nonce":1590839230}]},"public_addr":"172.21.15.162:6817/1590839230","cluster_addr":"172.21.15.162:6819/1590839230","heartbeat_back_addr":"172.21.15.162:6823/1590839230","heartbeat_front_addr":"172.21.15.162:6821/1590839230","state":["exists","up"]},{"osd":9,"uuid":"1670731c-5e8f-4cbc-8f35-6aeb14ea3075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6827","nonce":608720685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6829","nonce":608720685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6833","nonce":608720685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6831","nonce":608720685}]},"public_addr":"172.21.15.123:6827/608720685","cluster_addr":"172.21.15.123:6829/608720685","heartbeat_back_addr":"172.21.15.123:6833/608720685","heartbeat_front_addr":"172.21.15.123:6831/608720685","state":["exists","up"]},{"osd":10,"uuid":"ae138b96-13e7-46ac-9d4d-48308132465d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6825","nonce":3777263126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6827","nonce":3777263126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6831","nonce":3777263126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6829","nonce":3777263126}]},"public_addr":"172.21.15.136:6825/3777263126","cluster_addr":"172.21.15.136:6827/3777263126","heartbeat_back_addr":"172.21.15.136:6831/3777263126","heartbeat_front_addr":"172.21.15.136:6829/3777263126","state":["exists","up"]},{"osd":11,"uuid":"69f4ede0-7e9b-4edb-be54-01f74f002a06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6825","nonce":704809754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6827","nonce":704809754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6831","nonce":704809754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6829","nonce":704809754}]},"public_addr":"172.21.15.162:6825/704809754","cluster_addr":"172.21.15.162:6827/704809754","heartbeat_back_addr":"172.21.15.162:6831/704809754","heartbeat_front_addr":"172.21.15.162:6829/704809754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:19.188506+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:36.535261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:54.242294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:11.815314+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:29.512086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:46.874319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:04.437358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:22.312520+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:39.917998+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:57.340043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:15.252797+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:32.898924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:0/69783025":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/10165744":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/2081407856":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/4026642298":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/1442330765":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/1595718606":"2024-06-03T03:57:45.611046+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:19:43.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.392+0000 7fc2583f0700 1 -- 172.21.15.123:0/2162265907 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc2380a11a0 msgr2=0x7fc2380a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:19:43.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.392+0000 7fc2583f0700 1 --2- 172.21.15.123:0/2162265907 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc2380a11a0 0x7fc2380a3660 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc244009bf0 tx=0x7fc244009260 comp rx=0 tx=0).stop 2024-06-02T04:19:43.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.392+0000 7fc2583f0700 1 -- 172.21.15.123:0/2162265907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc250101910 msgr2=0x7fc250101230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:19:43.392 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.392+0000 7fc2583f0700 1 --2- 172.21.15.123:0/2162265907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc250101910 0x7fc250101230 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc24000ada0 tx=0x7fc24000c330 comp rx=0 tx=0).stop 2024-06-02T04:19:43.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.392+0000 7fc2583f0700 1 -- 172.21.15.123:0/2162265907 shutdown_connections 2024-06-02T04:19:43.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.392+0000 7fc2583f0700 1 --2- 172.21.15.123:0/2162265907 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fc2380a11a0 0x7fc2380a3660 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:43.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.392+0000 7fc2583f0700 1 --2- 172.21.15.123:0/2162265907 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc250106b70 0x7fc2500ffe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:43.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.392+0000 7fc2583f0700 1 --2- 172.21.15.123:0/2162265907 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fc250101910 0x7fc250101230 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:43.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.392+0000 7fc2583f0700 1 --2- 172.21.15.123:0/2162265907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc250104240 0x7fc2500ff8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:43.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.392+0000 7fc2583f0700 1 -- 172.21.15.123:0/2162265907 >> 172.21.15.123:0/2162265907 conn(0x7fc2500fb300 msgr2=0x7fc250102270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:19:43.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.392+0000 7fc2583f0700 1 -- 172.21.15.123:0/2162265907 shutdown_connections 2024-06-02T04:19:43.393 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.392+0000 7fc2583f0700 1 -- 172.21.15.123:0/2162265907 wait complete. 2024-06-02T04:19:43.405 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T03:59:57.079448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-02T04:03:05.199881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-02T04:03:05.853741+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-02T04:19:43.405 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-02T04:19:43.532 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.530+0000 7f6ea61fa700 1 -- 172.21.15.123:0/3626937824 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ea00ffe80 msgr2=0x7f6ea01002a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:19:43.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.530+0000 7f6ea61fa700 1 --2- 172.21.15.123:0/3626937824 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ea00ffe80 0x7f6ea01002a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6e90009990 tx=0x7f6e90009ca0 comp rx=0 tx=0).stop 2024-06-02T04:19:43.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.530+0000 7f6ea61fa700 1 -- 172.21.15.123:0/3626937824 shutdown_connections 2024-06-02T04:19:43.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.530+0000 7f6ea61fa700 1 --2- 172.21.15.123:0/3626937824 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ea0101990 0x7f6ea01082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:43.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.531+0000 7f6ea61fa700 1 --2- 172.21.15.123:0/3626937824 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ea00ffe80 0x7f6ea01002a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:43.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.531+0000 7f6ea61fa700 1 --2- 172.21.15.123:0/3626937824 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ea0100fd0 0x7f6ea0101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:43.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.531+0000 7f6ea61fa700 1 -- 172.21.15.123:0/3626937824 >> 172.21.15.123:0/3626937824 conn(0x7f6ea00fb430 msgr2=0x7f6ea00fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:19:43.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.531+0000 7f6ea61fa700 1 -- 172.21.15.123:0/3626937824 shutdown_connections 2024-06-02T04:19:43.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.531+0000 7f6ea61fa700 1 -- 172.21.15.123:0/3626937824 wait complete. 2024-06-02T04:19:43.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.531+0000 7f6ea61fa700 1 Processor -- start 2024-06-02T04:19:43.533 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.531+0000 7f6ea61fa700 1 -- start start 2024-06-02T04:19:43.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.531+0000 7f6ea61fa700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ea00ffe80 0x7f6ea0199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:19:43.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.531+0000 7f6ea61fa700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ea0100fd0 0x7f6ea0199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:19:43.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.531+0000 7f6ea61fa700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ea0101990 0x7f6ea01a07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:19:43.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.531+0000 7f6ea61fa700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea01a0d80 con 0x7f6ea00ffe80 2024-06-02T04:19:43.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.531+0000 7f6ea61fa700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea01a0ec0 con 0x7f6ea0101990 2024-06-02T04:19:43.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.531+0000 7f6ea61fa700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea01a1050 con 0x7f6ea0100fd0 2024-06-02T04:19:43.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.532+0000 7f6e9f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ea00ffe80 0x7f6ea0199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:19:43.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.532+0000 7f6e9f7fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ea00ffe80 0x7f6ea0199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42608/0 (socket says 172.21.15.123:42608) 2024-06-02T04:19:43.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.532+0000 7f6e9f7fe700 1 -- 172.21.15.123:0/3379413573 learned_addr learned my addr 172.21.15.123:0/3379413573 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:19:43.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.532+0000 7f6e9ffff700 1 --2- 172.21.15.123:0/3379413573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ea0101990 0x7f6ea01a07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:19:43.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.532+0000 7f6e9effd700 1 --2- 172.21.15.123:0/3379413573 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ea0100fd0 0x7f6ea0199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:19:43.534 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.532+0000 7f6e9f7fe700 1 -- 172.21.15.123:0/3379413573 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ea0100fd0 msgr2=0x7f6ea0199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:19:43.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.532+0000 7f6e9f7fe700 1 --2- 172.21.15.123:0/3379413573 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ea0100fd0 0x7f6ea0199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:43.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.532+0000 7f6e9f7fe700 1 -- 172.21.15.123:0/3379413573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ea0101990 msgr2=0x7f6ea01a07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:19:43.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.532+0000 7f6e9f7fe700 1 --2- 172.21.15.123:0/3379413573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ea0101990 0x7f6ea01a07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:43.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.532+0000 7f6e9f7fe700 1 -- 172.21.15.123:0/3379413573 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e900095f0 con 0x7f6ea00ffe80 2024-06-02T04:19:43.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.532+0000 7f6e9f7fe700 1 --2- 172.21.15.123:0/3379413573 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ea00ffe80 0x7f6ea0199250 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6e90005740 tx=0x7f6e90005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:19:43.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.532+0000 7f6e9cff9700 1 -- 172.21.15.123:0/3379413573 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9001d070 con 0x7f6ea00ffe80 2024-06-02T04:19:43.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.532+0000 7f6e9cff9700 1 -- 172.21.15.123:0/3379413573 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e90004020 con 0x7f6ea00ffe80 2024-06-02T04:19:43.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.532+0000 7f6ea61fa700 1 -- 172.21.15.123:0/3379413573 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ea01a12d0 con 0x7f6ea00ffe80 2024-06-02T04:19:43.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.532+0000 7f6e9cff9700 1 -- 172.21.15.123:0/3379413573 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e90022c90 con 0x7f6ea00ffe80 2024-06-02T04:19:43.535 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.532+0000 7f6ea61fa700 1 -- 172.21.15.123:0/3379413573 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ea01a16f0 con 0x7f6ea00ffe80 2024-06-02T04:19:43.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.533+0000 7f6ea61fa700 1 -- 172.21.15.123:0/3379413573 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ea0068140 con 0x7f6ea00ffe80 2024-06-02T04:19:43.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.535+0000 7f6e9cff9700 1 -- 172.21.15.123:0/3379413573 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f6e90003b60 con 0x7f6ea00ffe80 2024-06-02T04:19:43.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.536+0000 7f6e9cff9700 1 --2- 172.21.15.123:0/3379413573 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f6e880a1120 0x7f6e880a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:19:43.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.536+0000 7f6e9effd700 1 --2- 172.21.15.123:0/3379413573 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f6e880a1120 0x7f6e880a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:19:43.536 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.536+0000 7f6e9cff9700 1 -- 172.21.15.123:0/3379413573 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f6e900cdf20 con 0x7f6ea00ffe80 2024-06-02T04:19:43.537 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.536+0000 7f6e9effd700 1 --2- 172.21.15.123:0/3379413573 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f6e880a1120 0x7f6e880a35e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6e94009a10 tx=0x7f6e94009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:19:43.539 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.539+0000 7f6e9cff9700 1 -- 172.21.15.123:0/3379413573 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6e90097760 con 0x7f6ea00ffe80 2024-06-02T04:19:43.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.739+0000 7f6ea61fa700 1 -- 172.21.15.123:0/3379413573 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6ea010b890 con 0x7f6ea00ffe80 2024-06-02T04:19:43.739 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.739+0000 7f6e9cff9700 1 -- 172.21.15.123:0/3379413573 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6e900a1030 con 0x7f6ea00ffe80 2024-06-02T04:19:43.739 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-06-02T04:19:43.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.741+0000 7f6ea61fa700 1 -- 172.21.15.123:0/3379413573 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f6e880a1120 msgr2=0x7f6e880a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:19:43.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.741+0000 7f6ea61fa700 1 --2- 172.21.15.123:0/3379413573 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f6e880a1120 0x7f6e880a35e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6e94009a10 tx=0x7f6e94009190 comp rx=0 tx=0).stop 2024-06-02T04:19:43.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.741+0000 7f6ea61fa700 1 -- 172.21.15.123:0/3379413573 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ea00ffe80 msgr2=0x7f6ea0199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:19:43.741 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.741+0000 7f6ea61fa700 1 --2- 172.21.15.123:0/3379413573 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ea00ffe80 0x7f6ea0199250 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6e90005740 tx=0x7f6e90005770 comp rx=0 tx=0).stop 2024-06-02T04:19:43.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.741+0000 7f6ea61fa700 1 -- 172.21.15.123:0/3379413573 shutdown_connections 2024-06-02T04:19:43.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.741+0000 7f6ea61fa700 1 --2- 172.21.15.123:0/3379413573 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f6e880a1120 0x7f6e880a35e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:43.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.741+0000 7f6ea61fa700 1 --2- 172.21.15.123:0/3379413573 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ea0101990 0x7f6ea01a07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:43.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.741+0000 7f6ea61fa700 1 --2- 172.21.15.123:0/3379413573 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f6ea00ffe80 0x7f6ea0199250 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:43.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.741+0000 7f6ea61fa700 1 --2- 172.21.15.123:0/3379413573 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ea0100fd0 0x7f6ea0199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:43.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.741+0000 7f6ea61fa700 1 -- 172.21.15.123:0/3379413573 >> 172.21.15.123:0/3379413573 conn(0x7f6ea00fb430 msgr2=0x7f6ea0069520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:19:43.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.741+0000 7f6ea61fa700 1 -- 172.21.15.123:0/3379413573 shutdown_connections 2024-06-02T04:19:43.742 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.741+0000 7f6ea61fa700 1 -- 172.21.15.123:0/3379413573 wait complete. 2024-06-02T04:19:43.752 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:43 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2162265907' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:19:43.753 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-02T04:19:43.880 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.878+0000 7f3439237700 1 -- 172.21.15.123:0/2436158226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3434101970 msgr2=0x7f3434108290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:19:43.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.878+0000 7f3439237700 1 --2- 172.21.15.123:0/2436158226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3434101970 0x7f3434108290 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f342c00b0a0 tx=0x7f342c00b3b0 comp rx=0 tx=0).stop 2024-06-02T04:19:43.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.878+0000 7f3439237700 1 -- 172.21.15.123:0/2436158226 shutdown_connections 2024-06-02T04:19:43.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.878+0000 7f3439237700 1 --2- 172.21.15.123:0/2436158226 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3434101970 0x7f3434108290 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:43.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.878+0000 7f3439237700 1 --2- 172.21.15.123:0/2436158226 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34340ffe60 0x7f3434100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:43.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.878+0000 7f3439237700 1 --2- 172.21.15.123:0/2436158226 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3434100fb0 0x7f3434101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:43.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.878+0000 7f3439237700 1 -- 172.21.15.123:0/2436158226 >> 172.21.15.123:0/2436158226 conn(0x7f34340fb3f0 msgr2=0x7f34340fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:19:43.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.878+0000 7f3439237700 1 -- 172.21.15.123:0/2436158226 shutdown_connections 2024-06-02T04:19:43.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.878+0000 7f3439237700 1 -- 172.21.15.123:0/2436158226 wait complete. 2024-06-02T04:19:43.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.879+0000 7f3439237700 1 Processor -- start 2024-06-02T04:19:43.881 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.879+0000 7f3439237700 1 -- start start 2024-06-02T04:19:43.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.879+0000 7f3439237700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34340ffe60 0x7f3434195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:19:43.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.879+0000 7f3439237700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3434100fb0 0x7f3434196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:19:43.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.879+0000 7f3439237700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3434101970 0x7f343419d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:19:43.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.879+0000 7f3439237700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343419da20 con 0x7f3434101970 2024-06-02T04:19:43.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.879+0000 7f3439237700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343419db60 con 0x7f34340ffe60 2024-06-02T04:19:43.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.879+0000 7f3439237700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343419dcf0 con 0x7f3434100fb0 2024-06-02T04:19:43.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.879+0000 7f343359e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3434101970 0x7f343419d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:19:43.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.879+0000 7f343359e700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3434101970 0x7f343419d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42632/0 (socket says 172.21.15.123:42632) 2024-06-02T04:19:43.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.879+0000 7f343359e700 1 -- 172.21.15.123:0/260508518 learned_addr learned my addr 172.21.15.123:0/260508518 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:19:43.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.880+0000 7f343259c700 1 --2- 172.21.15.123:0/260508518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3434100fb0 0x7f3434196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:19:43.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.880+0000 7f3432d9d700 1 --2- 172.21.15.123:0/260508518 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34340ffe60 0x7f3434195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:19:43.882 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.880+0000 7f343359e700 1 -- 172.21.15.123:0/260508518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3434100fb0 msgr2=0x7f3434196430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:19:43.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.880+0000 7f343359e700 1 --2- 172.21.15.123:0/260508518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3434100fb0 0x7f3434196430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:43.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.880+0000 7f343359e700 1 -- 172.21.15.123:0/260508518 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34340ffe60 msgr2=0x7f3434195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:19:43.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.880+0000 7f343359e700 1 --2- 172.21.15.123:0/260508518 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34340ffe60 0x7f3434195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:43.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.880+0000 7f343359e700 1 -- 172.21.15.123:0/260508518 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342c009d00 con 0x7f3434101970 2024-06-02T04:19:43.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.880+0000 7f343359e700 1 --2- 172.21.15.123:0/260508518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3434101970 0x7f343419d450 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f342c006070 tx=0x7f342c00bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:19:43.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.880+0000 7f341bfff700 1 -- 172.21.15.123:0/260508518 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c00e040 con 0x7f3434101970 2024-06-02T04:19:43.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.880+0000 7f341bfff700 1 -- 172.21.15.123:0/260508518 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f342c0094b0 con 0x7f3434101970 2024-06-02T04:19:43.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.880+0000 7f3439237700 1 -- 172.21.15.123:0/260508518 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f343419df70 con 0x7f3434101970 2024-06-02T04:19:43.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.880+0000 7f341bfff700 1 -- 172.21.15.123:0/260508518 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c01b6b0 con 0x7f3434101970 2024-06-02T04:19:43.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.880+0000 7f3439237700 1 -- 172.21.15.123:0/260508518 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f343419e390 con 0x7f3434101970 2024-06-02T04:19:43.883 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.881+0000 7f3439237700 1 -- 172.21.15.123:0/260508518 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3434107280 con 0x7f3434101970 2024-06-02T04:19:43.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.883+0000 7f341bfff700 1 -- 172.21.15.123:0/260508518 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f342c01b8d0 con 0x7f3434101970 2024-06-02T04:19:43.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.883+0000 7f341bfff700 1 --2- 172.21.15.123:0/260508518 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f341c0a1120 0x7f341c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:19:43.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.883+0000 7f3432d9d700 1 --2- 172.21.15.123:0/260508518 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f341c0a1120 0x7f341c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:19:43.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.883+0000 7f341bfff700 1 -- 172.21.15.123:0/260508518 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f342c0ce5e0 con 0x7f3434101970 2024-06-02T04:19:43.884 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.884+0000 7f3432d9d700 1 --2- 172.21.15.123:0/260508518 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f341c0a1120 0x7f341c0a35e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3424009c60 tx=0x7f3424009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:19:43.886 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:43.887+0000 7f341bfff700 1 -- 172.21.15.123:0/260508518 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f342c097f40 con 0x7f3434101970 2024-06-02T04:19:44.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:43 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/2162265907' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:19:44.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.085+0000 7f3439237700 1 -- 172.21.15.123:0/260508518 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3434106c60 con 0x7f3434101970 2024-06-02T04:19:44.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.086+0000 7f341bfff700 1 -- 172.21.15.123:0/260508518 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7f342c09b560 con 0x7f3434101970 2024-06-02T04:19:44.086 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-06-02T04:19:44.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:43 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/2162265907' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:19:44.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.088+0000 7f3439237700 1 -- 172.21.15.123:0/260508518 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f341c0a1120 msgr2=0x7f341c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:19:44.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.088+0000 7f3439237700 1 --2- 172.21.15.123:0/260508518 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f341c0a1120 0x7f341c0a35e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3424009c60 tx=0x7f3424009260 comp rx=0 tx=0).stop 2024-06-02T04:19:44.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.088+0000 7f3439237700 1 -- 172.21.15.123:0/260508518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3434101970 msgr2=0x7f343419d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:19:44.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.088+0000 7f3439237700 1 --2- 172.21.15.123:0/260508518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3434101970 0x7f343419d450 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f342c006070 tx=0x7f342c00bd00 comp rx=0 tx=0).stop 2024-06-02T04:19:44.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.088+0000 7f3439237700 1 -- 172.21.15.123:0/260508518 shutdown_connections 2024-06-02T04:19:44.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.088+0000 7f3439237700 1 --2- 172.21.15.123:0/260508518 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3434101970 0x7f343419d450 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:44.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.088+0000 7f3439237700 1 --2- 172.21.15.123:0/260508518 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f341c0a1120 0x7f341c0a35e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:44.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.088+0000 7f3439237700 1 --2- 172.21.15.123:0/260508518 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34340ffe60 0x7f3434195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:44.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.088+0000 7f3439237700 1 --2- 172.21.15.123:0/260508518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3434100fb0 0x7f3434196430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:44.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.088+0000 7f3439237700 1 -- 172.21.15.123:0/260508518 >> 172.21.15.123:0/260508518 conn(0x7f34340fb3f0 msgr2=0x7f34341043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:19:44.089 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.088+0000 7f3439237700 1 -- 172.21.15.123:0/260508518 shutdown_connections 2024-06-02T04:19:44.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.088+0000 7f3439237700 1 -- 172.21.15.123:0/260508518 wait complete. 2024-06-02T04:19:44.101 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-02T04:19:44.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.226+0000 7f8c894db700 1 -- 172.21.15.123:0/3778188803 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c84100fd0 msgr2=0x7f8c84101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:19:44.228 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.226+0000 7f8c894db700 1 --2- 172.21.15.123:0/3778188803 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c84100fd0 0x7f8c84101450 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009990 tx=0x7f8c78009ca0 comp rx=0 tx=0).stop 2024-06-02T04:19:44.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.226+0000 7f8c894db700 1 -- 172.21.15.123:0/3778188803 shutdown_connections 2024-06-02T04:19:44.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.226+0000 7f8c894db700 1 --2- 172.21.15.123:0/3778188803 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c84101990 0x7f8c841082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:44.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.226+0000 7f8c894db700 1 --2- 172.21.15.123:0/3778188803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c840ffe80 0x7f8c841002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:44.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.226+0000 7f8c894db700 1 --2- 172.21.15.123:0/3778188803 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c84100fd0 0x7f8c84101450 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:44.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.226+0000 7f8c894db700 1 -- 172.21.15.123:0/3778188803 >> 172.21.15.123:0/3778188803 conn(0x7f8c840fb3f0 msgr2=0x7f8c840fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:19:44.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.226+0000 7f8c894db700 1 -- 172.21.15.123:0/3778188803 shutdown_connections 2024-06-02T04:19:44.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.226+0000 7f8c894db700 1 -- 172.21.15.123:0/3778188803 wait complete. 2024-06-02T04:19:44.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.227+0000 7f8c894db700 1 Processor -- start 2024-06-02T04:19:44.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.227+0000 7f8c894db700 1 -- start start 2024-06-02T04:19:44.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.227+0000 7f8c894db700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c840ffe80 0x7f8c84069ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:19:44.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.227+0000 7f8c894db700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c84100fd0 0x7f8c8419bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:19:44.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.227+0000 7f8c894db700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c84101990 0x7f8c8419e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:19:44.229 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.227+0000 7f8c894db700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8419ea20 con 0x7f8c84100fd0 2024-06-02T04:19:44.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.227+0000 7f8c894db700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8419eb90 con 0x7f8c840ffe80 2024-06-02T04:19:44.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.227+0000 7f8c894db700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8419ed50 con 0x7f8c84101990 2024-06-02T04:19:44.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.227+0000 7f8c827fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c84100fd0 0x7f8c8419bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:19:44.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.227+0000 7f8c827fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c84100fd0 0x7f8c8419bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:42640/0 (socket says 172.21.15.123:42640) 2024-06-02T04:19:44.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.228+0000 7f8c827fc700 1 -- 172.21.15.123:0/1857211508 learned_addr learned my addr 172.21.15.123:0/1857211508 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:19:44.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.228+0000 7f8c82ffd700 1 --2- 172.21.15.123:0/1857211508 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c840ffe80 0x7f8c84069ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:19:44.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.228+0000 7f8c837fe700 1 --2- 172.21.15.123:0/1857211508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c84101990 0x7f8c8419e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:19:44.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.228+0000 7f8c827fc700 1 -- 172.21.15.123:0/1857211508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c84101990 msgr2=0x7f8c8419e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:19:44.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.228+0000 7f8c827fc700 1 --2- 172.21.15.123:0/1857211508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c84101990 0x7f8c8419e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:44.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.228+0000 7f8c827fc700 1 -- 172.21.15.123:0/1857211508 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c840ffe80 msgr2=0x7f8c84069ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:19:44.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.228+0000 7f8c827fc700 1 --2- 172.21.15.123:0/1857211508 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c840ffe80 0x7f8c84069ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:44.230 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.228+0000 7f8c827fc700 1 -- 172.21.15.123:0/1857211508 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c780095f0 con 0x7f8c84100fd0 2024-06-02T04:19:44.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.228+0000 7f8c837fe700 1 --2- 172.21.15.123:0/1857211508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c84101990 0x7f8c8419e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:19:44.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.228+0000 7f8c827fc700 1 --2- 172.21.15.123:0/1857211508 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c84100fd0 0x7f8c8419bc10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800b5c0 tx=0x7f8c78004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:19:44.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.228+0000 7f8c6bfff700 1 -- 172.21.15.123:0/1857211508 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7801d070 con 0x7f8c84100fd0 2024-06-02T04:19:44.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.228+0000 7f8c6bfff700 1 -- 172.21.15.123:0/1857211508 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c78003f60 con 0x7f8c84100fd0 2024-06-02T04:19:44.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.228+0000 7f8c894db700 1 -- 172.21.15.123:0/1857211508 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c8419ef70 con 0x7f8c84100fd0 2024-06-02T04:19:44.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.228+0000 7f8c6bfff700 1 -- 172.21.15.123:0/1857211508 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c78022d10 con 0x7f8c84100fd0 2024-06-02T04:19:44.231 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.228+0000 7f8c894db700 1 -- 172.21.15.123:0/1857211508 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c8419f330 con 0x7f8c84100fd0 2024-06-02T04:19:44.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.229+0000 7f8c894db700 1 -- 172.21.15.123:0/1857211508 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c84107340 con 0x7f8c84100fd0 2024-06-02T04:19:44.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.230+0000 7f8c6bfff700 1 -- 172.21.15.123:0/1857211508 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f8c780040d0 con 0x7f8c84100fd0 2024-06-02T04:19:44.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.231+0000 7f8c6bfff700 1 --2- 172.21.15.123:0/1857211508 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f8c6c0a1120 0x7f8c6c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:19:44.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.231+0000 7f8c6bfff700 1 -- 172.21.15.123:0/1857211508 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f8c780cdbf0 con 0x7f8c84100fd0 2024-06-02T04:19:44.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.231+0000 7f8c82ffd700 1 --2- 172.21.15.123:0/1857211508 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f8c6c0a1120 0x7f8c6c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:19:44.232 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.231+0000 7f8c82ffd700 1 --2- 172.21.15.123:0/1857211508 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f8c6c0a1120 0x7f8c6c0a35e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8c74005950 tx=0x7f8c7400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:19:44.234 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.234+0000 7f8c6bfff700 1 -- 172.21.15.123:0/1857211508 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8c7805dd60 con 0x7f8c84100fd0 2024-06-02T04:19:44.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.432+0000 7f8c894db700 1 -- 172.21.15.123:0/1857211508 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8c8410b790 con 0x7f8c84100fd0 2024-06-02T04:19:44.432 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.432+0000 7f8c6bfff700 1 -- 172.21.15.123:0/1857211508 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8c7809af60 con 0x7f8c84100fd0 2024-06-02T04:19:44.433 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-06-02T04:19:44.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.435+0000 7f8c894db700 1 -- 172.21.15.123:0/1857211508 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f8c6c0a1120 msgr2=0x7f8c6c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:19:44.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.435+0000 7f8c894db700 1 --2- 172.21.15.123:0/1857211508 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f8c6c0a1120 0x7f8c6c0a35e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8c74005950 tx=0x7f8c7400a300 comp rx=0 tx=0).stop 2024-06-02T04:19:44.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.435+0000 7f8c894db700 1 -- 172.21.15.123:0/1857211508 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c84100fd0 msgr2=0x7f8c8419bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:19:44.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.435+0000 7f8c894db700 1 --2- 172.21.15.123:0/1857211508 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c84100fd0 0x7f8c8419bc10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8c7800b5c0 tx=0x7f8c78004730 comp rx=0 tx=0).stop 2024-06-02T04:19:44.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.435+0000 7f8c894db700 1 -- 172.21.15.123:0/1857211508 shutdown_connections 2024-06-02T04:19:44.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.435+0000 7f8c894db700 1 --2- 172.21.15.123:0/1857211508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c84101990 0x7f8c8419e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:44.435 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.435+0000 7f8c894db700 1 --2- 172.21.15.123:0/1857211508 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f8c6c0a1120 0x7f8c6c0a35e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:44.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.435+0000 7f8c894db700 1 --2- 172.21.15.123:0/1857211508 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c840ffe80 0x7f8c84069ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:44.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.435+0000 7f8c894db700 1 --2- 172.21.15.123:0/1857211508 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f8c84100fd0 0x7f8c8419bc10 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:44.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.435+0000 7f8c894db700 1 -- 172.21.15.123:0/1857211508 >> 172.21.15.123:0/1857211508 conn(0x7f8c840fb3f0 msgr2=0x7f8c84104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:19:44.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.435+0000 7f8c894db700 1 -- 172.21.15.123:0/1857211508 shutdown_connections 2024-06-02T04:19:44.436 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.435+0000 7f8c894db700 1 -- 172.21.15.123:0/1857211508 wait complete. 2024-06-02T04:19:44.447 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-06-02T04:19:44.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.570+0000 7f496d806700 1 -- 172.21.15.123:0/3339652291 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4968102990 msgr2=0x7f49681092b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:19:44.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.570+0000 7f496d806700 1 --2- 172.21.15.123:0/3339652291 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4968102990 0x7f49681092b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f496000b0a0 tx=0x7f496000b3b0 comp rx=0 tx=0).stop 2024-06-02T04:19:44.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.570+0000 7f496d806700 1 -- 172.21.15.123:0/3339652291 shutdown_connections 2024-06-02T04:19:44.570 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.570+0000 7f496d806700 1 --2- 172.21.15.123:0/3339652291 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4968102990 0x7f49681092b0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:44.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.570+0000 7f496d806700 1 --2- 172.21.15.123:0/3339652291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4968100e80 0x7f49681012a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:44.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.570+0000 7f496d806700 1 --2- 172.21.15.123:0/3339652291 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4968101fd0 0x7f4968102450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:44.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.570+0000 7f496d806700 1 -- 172.21.15.123:0/3339652291 >> 172.21.15.123:0/3339652291 conn(0x7f49680fc410 msgr2=0x7f49680fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:19:44.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.570+0000 7f496d806700 1 -- 172.21.15.123:0/3339652291 shutdown_connections 2024-06-02T04:19:44.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.570+0000 7f496d806700 1 -- 172.21.15.123:0/3339652291 wait complete. 2024-06-02T04:19:44.571 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.571+0000 7f496d806700 1 Processor -- start 2024-06-02T04:19:44.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.571+0000 7f496d806700 1 -- start start 2024-06-02T04:19:44.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.571+0000 7f496d806700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4968100e80 0x7f4968196f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:19:44.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.571+0000 7f496d806700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4968101fd0 0x7f49681974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:19:44.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.571+0000 7f496d806700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4968102990 0x7f496819e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:19:44.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.571+0000 7f496d806700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496819ea90 con 0x7f4968102990 2024-06-02T04:19:44.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.571+0000 7f496d806700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496819ebd0 con 0x7f4968100e80 2024-06-02T04:19:44.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.571+0000 7f496d806700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496819ed60 con 0x7f4968101fd0 2024-06-02T04:19:44.573 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.571+0000 7f49677fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4968102990 0x7f496819e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:19:44.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.571+0000 7f49677fe700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4968102990 0x7f496819e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:55420/0 (socket says 172.21.15.123:55420) 2024-06-02T04:19:44.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.571+0000 7f49677fe700 1 -- 172.21.15.123:0/1727398577 learned_addr learned my addr 172.21.15.123:0/1727398577 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:19:44.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.571+0000 7f4966ffd700 1 --2- 172.21.15.123:0/1727398577 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4968100e80 0x7f4968196f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:19:44.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.571+0000 7f49667fc700 1 --2- 172.21.15.123:0/1727398577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4968101fd0 0x7f49681974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:19:44.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.571+0000 7f49677fe700 1 -- 172.21.15.123:0/1727398577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4968101fd0 msgr2=0x7f49681974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:19:44.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.571+0000 7f49677fe700 1 --2- 172.21.15.123:0/1727398577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4968101fd0 0x7f49681974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:44.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.571+0000 7f49677fe700 1 -- 172.21.15.123:0/1727398577 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4968100e80 msgr2=0x7f4968196f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:19:44.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.571+0000 7f49677fe700 1 --2- 172.21.15.123:0/1727398577 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4968100e80 0x7f4968196f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:44.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.571+0000 7f49677fe700 1 -- 172.21.15.123:0/1727398577 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4960009d00 con 0x7f4968102990 2024-06-02T04:19:44.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.572+0000 7f49677fe700 1 --2- 172.21.15.123:0/1727398577 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4968102990 0x7f496819e4c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4960006070 tx=0x7f4960004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:19:44.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.572+0000 7f496c804700 1 -- 172.21.15.123:0/1727398577 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496000e040 con 0x7f4968102990 2024-06-02T04:19:44.574 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.572+0000 7f496c804700 1 -- 172.21.15.123:0/1727398577 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f496001db50 con 0x7f4968102990 2024-06-02T04:19:44.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.572+0000 7f496d806700 1 -- 172.21.15.123:0/1727398577 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f496819efe0 con 0x7f4968102990 2024-06-02T04:19:44.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.572+0000 7f496c804700 1 -- 172.21.15.123:0/1727398577 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496001bbd0 con 0x7f4968102990 2024-06-02T04:19:44.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.572+0000 7f496d806700 1 -- 172.21.15.123:0/1727398577 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496819f400 con 0x7f4968102990 2024-06-02T04:19:44.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.573+0000 7f496d806700 1 -- 172.21.15.123:0/1727398577 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49681082a0 con 0x7f4968102990 2024-06-02T04:19:44.575 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.574+0000 7f496c804700 1 -- 172.21.15.123:0/1727398577 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f496001bd30 con 0x7f4968102990 2024-06-02T04:19:44.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.574+0000 7f496c804700 1 --2- 172.21.15.123:0/1727398577 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f49540a11a0 0x7f49540a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:19:44.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.575+0000 7f4966ffd700 1 --2- 172.21.15.123:0/1727398577 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f49540a11a0 0x7f49540a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:19:44.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.575+0000 7f496c804700 1 -- 172.21.15.123:0/1727398577 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f49600ceae0 con 0x7f4968102990 2024-06-02T04:19:44.576 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.575+0000 7f4966ffd700 1 --2- 172.21.15.123:0/1727398577 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f49540a11a0 0x7f49540a3660 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4958005950 tx=0x7f49580058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:19:44.577 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.578+0000 7f496c804700 1 -- 172.21.15.123:0/1727398577 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4960098320 con 0x7f4968102990 2024-06-02T04:19:44.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:44 smithi123 ceph-mon[42885]: pgmap v722: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 29 MiB/s wr, 2.11k op/s 2024-06-02T04:19:44.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:44 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/3379413573' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:19:44.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:44 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/260508518' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:19:44.823 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:44 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1857211508' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:19:44.834 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.834+0000 7f496d806700 1 -- 172.21.15.123:0/1727398577 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f4968067c10 con 0x7f4968102990 2024-06-02T04:19:44.841 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.842+0000 7f496c804700 1 -- 172.21.15.123:0/1727398577 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) v1 ==== 81+0+733414 (secure 0 0 0) 0x7f496009b940 con 0x7f4968102990 2024-06-02T04:19:44.852 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:19:44.852 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-06-02T04:19:44.852 INFO:teuthology.orchestra.run.smithi123.stdout: "epoch": 18, 2024-06-02T04:19:44.852 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.852 INFO:teuthology.orchestra.run.smithi123.stdout: "active_gid": 14152, 2024-06-02T04:19:44.853 INFO:teuthology.orchestra.run.smithi123.stdout: "active_name": "x", 2024-06-02T04:19:44.853 INFO:teuthology.orchestra.run.smithi123.stdout: "active_addrs": { 2024-06-02T04:19:44.853 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-06-02T04:19:44.853 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:44.853 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-06-02T04:19:44.853 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6800", 2024-06-02T04:19:44.853 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 526143134 2024-06-02T04:19:44.854 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.854 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:44.854 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v1", 2024-06-02T04:19:44.854 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:6801", 2024-06-02T04:19:44.854 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 526143134 2024-06-02T04:19:44.854 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:44.854 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-06-02T04:19:44.854 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.854 INFO:teuthology.orchestra.run.smithi123.stdout: "active_addr": "172.21.15.123:6801/526143134", 2024-06-02T04:19:44.854 INFO:teuthology.orchestra.run.smithi123.stdout: "active_change": "2024-06-02T03:58:06.766352+0000", 2024-06-02T04:19:44.855 INFO:teuthology.orchestra.run.smithi123.stdout: "active_mgr_features": 4540138322906710015, 2024-06-02T04:19:44.855 INFO:teuthology.orchestra.run.smithi123.stdout: "available": true, 2024-06-02T04:19:44.855 INFO:teuthology.orchestra.run.smithi123.stdout: "standbys": [ 2024-06-02T04:19:44.855 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:44.855 INFO:teuthology.orchestra.run.smithi123.stdout: "gid": 24115, 2024-06-02T04:19:44.855 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "z", 2024-06-02T04:19:44.855 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr_features": 4540138322906710015, 2024-06-02T04:19:44.855 INFO:teuthology.orchestra.run.smithi123.stdout: "available_modules": [ 2024-06-02T04:19:44.855 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:44.855 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "alerts", 2024-06-02T04:19:44.855 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:44.855 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:44.856 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:44.856 INFO:teuthology.orchestra.run.smithi123.stdout: "interval": { 2024-06-02T04:19:44.856 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "interval", 2024-06-02T04:19:44.856 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:44.856 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.856 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.856 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "60", 2024-06-02T04:19:44.856 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.856 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.856 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.856 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "How frequently to reexamine health status", 2024-06-02T04:19:44.857 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.857 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.857 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.857 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.857 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:44.857 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:44.857 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.857 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.857 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.857 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:44.857 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.858 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.858 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:44.858 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:44.858 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:44.858 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:44.858 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:44.858 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:44.858 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:44.858 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:44.858 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:44.858 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.859 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.859 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.859 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.859 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:44.859 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:44.859 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:44.859 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.859 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.859 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:44.859 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.860 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.860 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.860 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:44.860 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.860 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.860 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.860 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.860 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:44.860 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:44.860 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.861 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.861 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.861 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:44.861 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.861 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.861 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:44.861 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:44.861 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:44.861 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:44.861 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:44.862 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:44.862 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:44.862 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:44.862 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:44.862 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.862 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.862 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.862 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.862 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:44.863 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:44.863 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:44.863 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.863 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.863 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:44.863 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.863 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.863 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.863 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:44.863 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.863 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.864 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.864 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.864 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_destination": { 2024-06-02T04:19:44.864 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_destination", 2024-06-02T04:19:44.864 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.864 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.864 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.864 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:44.864 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.864 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.864 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.865 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Email address to send alerts to", 2024-06-02T04:19:44.865 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.865 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.865 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.865 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.865 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_from_name": { 2024-06-02T04:19:44.865 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_from_name", 2024-06-02T04:19:44.865 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.865 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.865 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.865 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "Ceph", 2024-06-02T04:19:44.866 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.866 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.866 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.866 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Email From: name", 2024-06-02T04:19:44.866 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.866 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.866 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.866 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.866 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_host": { 2024-06-02T04:19:44.866 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_host", 2024-06-02T04:19:44.866 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.867 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.867 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.867 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:44.867 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.867 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.867 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.867 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "SMTP server", 2024-06-02T04:19:44.867 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.867 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.867 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.867 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.868 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_password": { 2024-06-02T04:19:44.868 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_password", 2024-06-02T04:19:44.868 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.868 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.868 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.868 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:44.868 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.868 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.868 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.868 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Password to authenticate with", 2024-06-02T04:19:44.868 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.869 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.869 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.869 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.869 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_port": { 2024-06-02T04:19:44.869 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_port", 2024-06-02T04:19:44.869 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:44.869 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.869 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.869 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "465", 2024-06-02T04:19:44.869 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.869 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.869 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.870 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "SMTP port", 2024-06-02T04:19:44.870 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.870 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.870 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.870 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.870 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_sender": { 2024-06-02T04:19:44.870 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_sender", 2024-06-02T04:19:44.870 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.870 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.870 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.871 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:44.871 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.871 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.871 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.871 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "SMTP envelope sender", 2024-06-02T04:19:44.871 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.871 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.871 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.871 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.872 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_ssl": { 2024-06-02T04:19:44.872 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_ssl", 2024-06-02T04:19:44.872 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:44.872 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.872 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.872 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:44.872 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.872 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.872 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.872 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Use SSL to connect to SMTP server", 2024-06-02T04:19:44.872 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.873 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.873 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.873 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.873 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_user": { 2024-06-02T04:19:44.873 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_user", 2024-06-02T04:19:44.873 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.873 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.873 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.873 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:44.873 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.873 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.874 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.874 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "User to authenticate as", 2024-06-02T04:19:44.874 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.874 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.874 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.874 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:44.874 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:44.874 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.874 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:44.874 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "balancer", 2024-06-02T04:19:44.875 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:44.875 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:44.875 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:44.875 INFO:teuthology.orchestra.run.smithi123.stdout: "active": { 2024-06-02T04:19:44.875 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "active", 2024-06-02T04:19:44.875 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:44.875 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.875 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.875 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:44.875 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.875 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.875 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.876 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "automatically balance PGs across cluster", 2024-06-02T04:19:44.876 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.876 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.876 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.876 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.876 INFO:teuthology.orchestra.run.smithi123.stdout: "begin_time": { 2024-06-02T04:19:44.876 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "begin_time", 2024-06-02T04:19:44.876 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.876 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.876 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.876 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0000", 2024-06-02T04:19:44.877 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.877 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.877 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.877 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "beginning time of day to automatically balance", 2024-06-02T04:19:44.877 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-02T04:19:44.877 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.877 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.877 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.877 INFO:teuthology.orchestra.run.smithi123.stdout: "begin_weekday": { 2024-06-02T04:19:44.877 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "begin_weekday", 2024-06-02T04:19:44.878 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "uint", 2024-06-02T04:19:44.878 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.878 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.878 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0", 2024-06-02T04:19:44.878 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "0", 2024-06-02T04:19:44.878 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "6", 2024-06-02T04:19:44.878 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.878 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-06-02T04:19:44.878 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-02T04:19:44.878 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.879 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.879 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.879 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_compat_max_iterations": { 2024-06-02T04:19:44.879 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "crush_compat_max_iterations", 2024-06-02T04:19:44.879 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "uint", 2024-06-02T04:19:44.879 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.879 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.879 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "25", 2024-06-02T04:19:44.879 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "1", 2024-06-02T04:19:44.879 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "250", 2024-06-02T04:19:44.879 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.880 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-06-02T04:19:44.880 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.880 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.880 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.880 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.880 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_compat_metrics": { 2024-06-02T04:19:44.880 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "crush_compat_metrics", 2024-06-02T04:19:44.880 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.880 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.880 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.881 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "pgs,objects,bytes", 2024-06-02T04:19:44.881 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.881 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.881 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.881 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-06-02T04:19:44.881 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-06-02T04:19:44.881 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.881 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.881 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.882 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_compat_step": { 2024-06-02T04:19:44.882 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "crush_compat_step", 2024-06-02T04:19:44.882 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-06-02T04:19:44.882 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.882 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.882 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0.5", 2024-06-02T04:19:44.882 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "0.001", 2024-06-02T04:19:44.882 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "0.999", 2024-06-02T04:19:44.882 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.883 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "aggressiveness of optimization", 2024-06-02T04:19:44.883 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-06-02T04:19:44.883 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.883 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.883 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.883 INFO:teuthology.orchestra.run.smithi123.stdout: "end_time": { 2024-06-02T04:19:44.883 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "end_time", 2024-06-02T04:19:44.883 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.883 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.884 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.884 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "2359", 2024-06-02T04:19:44.884 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.884 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.884 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.884 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "ending time of day to automatically balance", 2024-06-02T04:19:44.884 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-02T04:19:44.884 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.884 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.885 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.885 INFO:teuthology.orchestra.run.smithi123.stdout: "end_weekday": { 2024-06-02T04:19:44.885 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "end_weekday", 2024-06-02T04:19:44.885 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "uint", 2024-06-02T04:19:44.885 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.885 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.885 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0", 2024-06-02T04:19:44.885 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "0", 2024-06-02T04:19:44.885 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "6", 2024-06-02T04:19:44.886 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.886 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-06-02T04:19:44.886 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-02T04:19:44.886 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.886 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.886 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.886 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:44.886 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:44.887 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.887 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.887 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.887 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:44.887 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.887 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.887 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:44.887 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:44.887 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:44.887 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:44.887 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:44.888 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:44.888 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:44.888 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:44.888 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:44.888 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.888 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.888 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.888 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.888 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:44.888 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:44.888 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:44.889 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.889 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.889 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:44.889 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.889 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.889 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.889 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:44.889 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.889 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.890 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.890 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.890 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:44.890 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:44.890 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.890 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.890 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.890 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:44.890 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.890 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.890 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:44.891 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:44.891 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:44.891 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:44.891 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:44.891 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:44.891 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:44.891 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:44.891 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:44.891 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.891 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.891 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.892 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.892 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:44.892 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:44.892 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:44.892 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.892 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.892 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:44.892 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.892 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.892 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.892 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:44.893 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.893 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.893 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.893 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.893 INFO:teuthology.orchestra.run.smithi123.stdout: "min_score": { 2024-06-02T04:19:44.893 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "min_score", 2024-06-02T04:19:44.893 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-06-02T04:19:44.893 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.893 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.893 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0", 2024-06-02T04:19:44.893 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.894 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.894 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.894 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-06-02T04:19:44.894 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.894 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.894 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.894 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.894 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": { 2024-06-02T04:19:44.894 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mode", 2024-06-02T04:19:44.894 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.894 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.895 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.895 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "upmap", 2024-06-02T04:19:44.895 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.895 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.895 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:44.895 INFO:teuthology.orchestra.run.smithi123.stdout: "crush-compat", 2024-06-02T04:19:44.895 INFO:teuthology.orchestra.run.smithi123.stdout: "none", 2024-06-02T04:19:44.895 INFO:teuthology.orchestra.run.smithi123.stdout: "upmap" 2024-06-02T04:19:44.895 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:44.895 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Balancer mode", 2024-06-02T04:19:44.896 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.896 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.896 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.896 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.896 INFO:teuthology.orchestra.run.smithi123.stdout: "pool_ids": { 2024-06-02T04:19:44.896 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "pool_ids", 2024-06-02T04:19:44.896 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.896 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.896 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.896 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:44.896 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.897 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.897 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.897 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-06-02T04:19:44.897 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.897 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.897 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.897 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.897 INFO:teuthology.orchestra.run.smithi123.stdout: "sleep_interval": { 2024-06-02T04:19:44.897 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "sleep_interval", 2024-06-02T04:19:44.897 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:44.897 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.897 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.898 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "60", 2024-06-02T04:19:44.898 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.898 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.898 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.898 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-06-02T04:19:44.898 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.898 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.898 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.898 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.898 INFO:teuthology.orchestra.run.smithi123.stdout: "upmap_max_deviation": { 2024-06-02T04:19:44.899 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "upmap_max_deviation", 2024-06-02T04:19:44.899 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:44.899 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.899 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.899 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "5", 2024-06-02T04:19:44.899 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "1", 2024-06-02T04:19:44.899 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.899 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.899 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "deviation below which no optimization is attempted", 2024-06-02T04:19:44.899 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-06-02T04:19:44.900 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.900 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.900 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.900 INFO:teuthology.orchestra.run.smithi123.stdout: "upmap_max_optimizations": { 2024-06-02T04:19:44.900 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "upmap_max_optimizations", 2024-06-02T04:19:44.900 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "uint", 2024-06-02T04:19:44.900 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.900 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.900 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-06-02T04:19:44.900 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.900 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.900 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.901 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-06-02T04:19:44.901 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.901 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.901 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.901 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:44.901 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:44.901 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.901 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:44.901 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "cephadm", 2024-06-02T04:19:44.901 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:44.901 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:44.902 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:44.902 INFO:teuthology.orchestra.run.smithi123.stdout: "agent_down_multiplier": { 2024-06-02T04:19:44.902 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "agent_down_multiplier", 2024-06-02T04:19:44.902 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-06-02T04:19:44.902 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.902 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.902 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "3.0", 2024-06-02T04:19:44.902 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.902 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.902 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.902 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-06-02T04:19:44.903 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.903 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.903 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.903 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.903 INFO:teuthology.orchestra.run.smithi123.stdout: "agent_refresh_rate": { 2024-06-02T04:19:44.903 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "agent_refresh_rate", 2024-06-02T04:19:44.903 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:44.903 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.903 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.903 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "20", 2024-06-02T04:19:44.903 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.904 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.904 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.904 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-06-02T04:19:44.904 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.904 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.904 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.904 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.904 INFO:teuthology.orchestra.run.smithi123.stdout: "agent_starting_port": { 2024-06-02T04:19:44.904 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "agent_starting_port", 2024-06-02T04:19:44.904 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:44.904 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.904 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.905 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "4721", 2024-06-02T04:19:44.905 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.905 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.905 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.905 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-06-02T04:19:44.905 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.905 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.905 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.905 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.905 INFO:teuthology.orchestra.run.smithi123.stdout: "allow_ptrace": { 2024-06-02T04:19:44.906 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "allow_ptrace", 2024-06-02T04:19:44.906 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:44.906 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.906 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.906 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:44.906 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.906 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.906 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.906 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-06-02T04:19:44.906 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-06-02T04:19:44.906 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.907 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.907 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.907 INFO:teuthology.orchestra.run.smithi123.stdout: "autotune_interval": { 2024-06-02T04:19:44.907 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "autotune_interval", 2024-06-02T04:19:44.907 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:44.907 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.907 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.907 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "600", 2024-06-02T04:19:44.907 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.907 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.908 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.908 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how frequently to autotune daemon memory", 2024-06-02T04:19:44.908 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.908 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.908 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.908 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.908 INFO:teuthology.orchestra.run.smithi123.stdout: "autotune_memory_target_ratio": { 2024-06-02T04:19:44.908 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "autotune_memory_target_ratio", 2024-06-02T04:19:44.908 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-06-02T04:19:44.908 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.908 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.909 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0.7", 2024-06-02T04:19:44.909 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.909 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.909 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.909 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-06-02T04:19:44.909 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.909 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.909 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.909 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.909 INFO:teuthology.orchestra.run.smithi123.stdout: "cgroups_split": { 2024-06-02T04:19:44.909 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "cgroups_split", 2024-06-02T04:19:44.910 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:44.910 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.910 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.910 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:44.910 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.910 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.910 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.910 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-06-02T04:19:44.910 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.910 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.910 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.911 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.911 INFO:teuthology.orchestra.run.smithi123.stdout: "config_checks_enabled": { 2024-06-02T04:19:44.911 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "config_checks_enabled", 2024-06-02T04:19:44.911 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:44.911 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.911 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.911 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:44.911 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.911 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.911 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.911 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-06-02T04:19:44.912 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.912 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.912 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.912 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.912 INFO:teuthology.orchestra.run.smithi123.stdout: "config_dashboard": { 2024-06-02T04:19:44.912 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "config_dashboard", 2024-06-02T04:19:44.912 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:44.912 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.912 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.912 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:44.912 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.913 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.913 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.913 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-06-02T04:19:44.913 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.913 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.913 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.913 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.913 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_alertmanager": { 2024-06-02T04:19:44.913 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_alertmanager", 2024-06-02T04:19:44.913 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.914 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.914 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.914 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-06-02T04:19:44.914 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.914 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.914 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.914 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Prometheus container image", 2024-06-02T04:19:44.914 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.914 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.914 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.915 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.915 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_base": { 2024-06-02T04:19:44.915 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_base", 2024-06-02T04:19:44.915 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.915 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.915 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.915 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/ceph/ceph", 2024-06-02T04:19:44.915 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.915 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.915 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.915 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Container image name, without the tag", 2024-06-02T04:19:44.916 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.916 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.916 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.916 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.916 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_elasticsearch": { 2024-06-02T04:19:44.916 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_elasticsearch", 2024-06-02T04:19:44.916 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.916 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.916 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.916 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-06-02T04:19:44.916 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.916 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.917 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.917 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "elasticsearch container image", 2024-06-02T04:19:44.917 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.917 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.917 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.917 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.917 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_grafana": { 2024-06-02T04:19:44.917 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_grafana", 2024-06-02T04:19:44.917 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.917 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.917 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.917 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-06-02T04:19:44.918 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.918 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.918 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.918 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Prometheus container image", 2024-06-02T04:19:44.918 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.918 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.918 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.918 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.918 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_haproxy": { 2024-06-02T04:19:44.918 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_haproxy", 2024-06-02T04:19:44.918 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.919 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.919 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.919 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-06-02T04:19:44.919 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.919 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.919 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.919 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "HAproxy container image", 2024-06-02T04:19:44.919 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.919 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.919 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.919 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.920 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_jaeger_agent": { 2024-06-02T04:19:44.920 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_jaeger_agent", 2024-06-02T04:19:44.920 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.920 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.920 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.920 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-06-02T04:19:44.920 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.920 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.920 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.920 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Jaeger agent container image", 2024-06-02T04:19:44.920 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.921 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.921 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.921 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.921 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_jaeger_collector": { 2024-06-02T04:19:44.921 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_jaeger_collector", 2024-06-02T04:19:44.921 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.921 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.921 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.921 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-06-02T04:19:44.921 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.921 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.922 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.922 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Jaeger collector container image", 2024-06-02T04:19:44.922 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.922 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.922 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.922 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.922 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_jaeger_query": { 2024-06-02T04:19:44.922 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_jaeger_query", 2024-06-02T04:19:44.922 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.922 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.922 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.923 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-06-02T04:19:44.923 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.923 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.923 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.923 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Jaeger query container image", 2024-06-02T04:19:44.923 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.923 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.923 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.923 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.923 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_keepalived": { 2024-06-02T04:19:44.923 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_keepalived", 2024-06-02T04:19:44.923 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.924 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.924 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.924 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-06-02T04:19:44.924 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.924 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.924 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.924 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Keepalived container image", 2024-06-02T04:19:44.924 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.924 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.924 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.924 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.925 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_loki": { 2024-06-02T04:19:44.925 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_loki", 2024-06-02T04:19:44.925 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.925 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.925 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.925 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-06-02T04:19:44.925 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.925 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.925 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.925 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Loki container image", 2024-06-02T04:19:44.925 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.925 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.926 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.926 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.926 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_node_exporter": { 2024-06-02T04:19:44.926 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_node_exporter", 2024-06-02T04:19:44.926 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.926 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.926 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.926 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-06-02T04:19:44.926 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.926 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.927 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.927 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Prometheus container image", 2024-06-02T04:19:44.927 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.927 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.927 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.927 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.927 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_nvmeof": { 2024-06-02T04:19:44.927 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_nvmeof", 2024-06-02T04:19:44.927 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.927 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.927 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.927 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-06-02T04:19:44.928 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.928 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.928 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.928 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Nvme-of container image", 2024-06-02T04:19:44.928 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.928 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.928 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.928 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.928 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_prometheus": { 2024-06-02T04:19:44.928 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_prometheus", 2024-06-02T04:19:44.928 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.929 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.929 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.929 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-06-02T04:19:44.929 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.929 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.929 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.929 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Prometheus container image", 2024-06-02T04:19:44.929 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.929 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.929 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.929 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.930 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_promtail": { 2024-06-02T04:19:44.930 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_promtail", 2024-06-02T04:19:44.930 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.930 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.930 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.930 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-06-02T04:19:44.930 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.930 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.930 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.930 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Promtail container image", 2024-06-02T04:19:44.930 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.931 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.931 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.931 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.931 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_snmp_gateway": { 2024-06-02T04:19:44.931 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_snmp_gateway", 2024-06-02T04:19:44.931 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.931 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.931 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.931 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-06-02T04:19:44.931 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.931 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.931 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.932 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "SNMP Gateway container image", 2024-06-02T04:19:44.932 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.932 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.932 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.932 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.932 INFO:teuthology.orchestra.run.smithi123.stdout: "container_init": { 2024-06-02T04:19:44.932 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_init", 2024-06-02T04:19:44.932 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:44.932 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.932 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.932 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:44.933 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.933 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.933 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.933 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Run podman/docker with `--init`", 2024-06-02T04:19:44.933 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.933 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.933 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.933 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.933 INFO:teuthology.orchestra.run.smithi123.stdout: "daemon_cache_timeout": { 2024-06-02T04:19:44.933 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "daemon_cache_timeout", 2024-06-02T04:19:44.933 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:44.934 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.934 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.934 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "600", 2024-06-02T04:19:44.934 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.934 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.934 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.934 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-06-02T04:19:44.934 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.934 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.934 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.934 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.934 INFO:teuthology.orchestra.run.smithi123.stdout: "default_cephadm_command_timeout": { 2024-06-02T04:19:44.935 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "default_cephadm_command_timeout", 2024-06-02T04:19:44.935 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:44.935 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.935 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.935 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "900", 2024-06-02T04:19:44.935 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.935 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.935 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.935 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-06-02T04:19:44.935 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.936 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.936 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.936 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.936 INFO:teuthology.orchestra.run.smithi123.stdout: "default_registry": { 2024-06-02T04:19:44.936 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "default_registry", 2024-06-02T04:19:44.936 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.936 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.936 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.936 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "docker.io", 2024-06-02T04:19:44.936 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.937 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.937 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.937 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-06-02T04:19:44.937 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.937 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.937 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.937 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.937 INFO:teuthology.orchestra.run.smithi123.stdout: "device_cache_timeout": { 2024-06-02T04:19:44.937 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "device_cache_timeout", 2024-06-02T04:19:44.937 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:44.938 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.938 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.938 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "1800", 2024-06-02T04:19:44.938 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.938 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.938 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.938 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "seconds to cache device inventory", 2024-06-02T04:19:44.938 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.938 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.938 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.938 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.939 INFO:teuthology.orchestra.run.smithi123.stdout: "device_enhanced_scan": { 2024-06-02T04:19:44.939 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "device_enhanced_scan", 2024-06-02T04:19:44.939 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:44.939 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.939 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.939 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:44.939 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.939 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.939 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.939 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Use libstoragemgmt during device scans", 2024-06-02T04:19:44.939 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.940 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.940 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.940 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.940 INFO:teuthology.orchestra.run.smithi123.stdout: "facts_cache_timeout": { 2024-06-02T04:19:44.940 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "facts_cache_timeout", 2024-06-02T04:19:44.940 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:44.940 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.940 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.940 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "60", 2024-06-02T04:19:44.940 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.940 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.941 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.941 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "seconds to cache host facts data", 2024-06-02T04:19:44.941 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.941 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.941 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.941 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.941 INFO:teuthology.orchestra.run.smithi123.stdout: "host_check_interval": { 2024-06-02T04:19:44.941 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "host_check_interval", 2024-06-02T04:19:44.941 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:44.941 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.942 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.942 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "600", 2024-06-02T04:19:44.942 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.942 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.942 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.942 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how frequently to perform a host check", 2024-06-02T04:19:44.942 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.942 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.942 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.942 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.943 INFO:teuthology.orchestra.run.smithi123.stdout: "hw_monitoring": { 2024-06-02T04:19:44.943 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "hw_monitoring", 2024-06-02T04:19:44.943 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:44.943 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.943 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.943 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:44.943 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.943 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.943 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.943 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-06-02T04:19:44.943 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.944 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.944 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.944 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.944 INFO:teuthology.orchestra.run.smithi123.stdout: "inventory_list_all": { 2024-06-02T04:19:44.944 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "inventory_list_all", 2024-06-02T04:19:44.944 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:44.944 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.944 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.944 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:44.944 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.945 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.945 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.945 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-06-02T04:19:44.945 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.945 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.945 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.945 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.945 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:44.945 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:44.945 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.945 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.945 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.946 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:44.946 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.946 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.946 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:44.946 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:44.946 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:44.946 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:44.946 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:44.946 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:44.946 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:44.947 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:44.947 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:44.947 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.947 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.947 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.947 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.947 INFO:teuthology.orchestra.run.smithi123.stdout: "log_refresh_metadata": { 2024-06-02T04:19:44.947 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_refresh_metadata", 2024-06-02T04:19:44.947 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:44.947 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.948 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.948 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:44.948 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.948 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.948 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.948 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-06-02T04:19:44.948 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.948 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.948 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.948 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.949 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:44.949 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:44.949 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:44.949 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.949 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.949 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:44.949 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.949 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.949 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.949 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-06-02T04:19:44.949 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.950 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.950 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.950 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.950 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:44.950 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:44.950 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.950 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.950 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.950 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:44.951 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.951 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.954 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:44.954 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:44.954 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:44.955 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:44.955 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:44.955 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:44.955 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:44.955 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:44.955 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:44.955 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.955 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.955 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.955 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.955 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:44.955 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:44.956 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:44.956 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.956 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.956 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:44.956 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.956 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.956 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.956 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:44.956 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.956 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.957 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.957 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.957 INFO:teuthology.orchestra.run.smithi123.stdout: "manage_etc_ceph_ceph_conf": { 2024-06-02T04:19:44.957 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-06-02T04:19:44.957 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:44.957 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.957 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.957 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:44.957 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.957 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.957 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.958 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-06-02T04:19:44.958 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.958 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.958 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.958 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.958 INFO:teuthology.orchestra.run.smithi123.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-06-02T04:19:44.958 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-06-02T04:19:44.958 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.958 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.958 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.958 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "*", 2024-06-02T04:19:44.959 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.959 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.959 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.959 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-06-02T04:19:44.959 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.959 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.959 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.959 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.959 INFO:teuthology.orchestra.run.smithi123.stdout: "max_count_per_host": { 2024-06-02T04:19:44.959 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "max_count_per_host", 2024-06-02T04:19:44.959 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:44.960 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.960 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.960 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-06-02T04:19:44.960 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.960 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.960 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.960 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "max number of daemons per service per host", 2024-06-02T04:19:44.960 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.960 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.960 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.960 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.960 INFO:teuthology.orchestra.run.smithi123.stdout: "max_osd_draining_count": { 2024-06-02T04:19:44.961 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "max_osd_draining_count", 2024-06-02T04:19:44.961 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:44.961 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.961 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.961 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-06-02T04:19:44.961 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.961 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.961 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.961 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-06-02T04:19:44.961 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.961 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.962 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.962 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.962 INFO:teuthology.orchestra.run.smithi123.stdout: "migration_current": { 2024-06-02T04:19:44.962 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "migration_current", 2024-06-02T04:19:44.962 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:44.962 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.962 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.962 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:44.962 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.962 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.962 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.963 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "internal - do not modify", 2024-06-02T04:19:44.963 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.963 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.963 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.963 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.963 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": { 2024-06-02T04:19:44.963 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mode", 2024-06-02T04:19:44.963 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.963 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.963 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.963 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "root", 2024-06-02T04:19:44.963 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.964 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.964 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:44.964 INFO:teuthology.orchestra.run.smithi123.stdout: "cephadm-package", 2024-06-02T04:19:44.964 INFO:teuthology.orchestra.run.smithi123.stdout: "root" 2024-06-02T04:19:44.964 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:44.964 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "mode for remote execution of cephadm", 2024-06-02T04:19:44.964 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.964 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.964 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.964 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.964 INFO:teuthology.orchestra.run.smithi123.stdout: "oob_default_addr": { 2024-06-02T04:19:44.965 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "oob_default_addr", 2024-06-02T04:19:44.965 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.965 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.965 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.965 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "169.254.1.1", 2024-06-02T04:19:44.965 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.965 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.965 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.965 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Default address for RedFish API (oob management).", 2024-06-02T04:19:44.965 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.965 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.965 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.966 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.966 INFO:teuthology.orchestra.run.smithi123.stdout: "prometheus_alerts_path": { 2024-06-02T04:19:44.966 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "prometheus_alerts_path", 2024-06-02T04:19:44.966 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.966 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.966 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.966 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-06-02T04:19:44.966 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.966 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.966 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.966 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-06-02T04:19:44.967 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.967 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.967 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.967 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.967 INFO:teuthology.orchestra.run.smithi123.stdout: "registry_insecure": { 2024-06-02T04:19:44.967 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "registry_insecure", 2024-06-02T04:19:44.967 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:44.967 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.967 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.967 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:44.967 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.968 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.968 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.968 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-06-02T04:19:44.968 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.968 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.968 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.968 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.968 INFO:teuthology.orchestra.run.smithi123.stdout: "registry_password": { 2024-06-02T04:19:44.968 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "registry_password", 2024-06-02T04:19:44.968 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.968 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.969 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.969 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:44.969 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.969 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.969 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.969 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-06-02T04:19:44.969 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.969 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.969 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.969 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.969 INFO:teuthology.orchestra.run.smithi123.stdout: "registry_url": { 2024-06-02T04:19:44.970 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "registry_url", 2024-06-02T04:19:44.970 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.970 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.970 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.970 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:44.970 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.970 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.970 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.970 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-06-02T04:19:44.970 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.970 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.971 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.971 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.971 INFO:teuthology.orchestra.run.smithi123.stdout: "registry_username": { 2024-06-02T04:19:44.971 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "registry_username", 2024-06-02T04:19:44.971 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.971 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.971 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.971 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:44.971 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.971 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.972 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.972 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-06-02T04:19:44.972 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.972 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.972 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.972 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.972 INFO:teuthology.orchestra.run.smithi123.stdout: "secure_monitoring_stack": { 2024-06-02T04:19:44.972 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "secure_monitoring_stack", 2024-06-02T04:19:44.972 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:44.972 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.972 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.972 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:44.973 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.973 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.973 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.973 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-06-02T04:19:44.973 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.973 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.973 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.973 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.973 INFO:teuthology.orchestra.run.smithi123.stdout: "service_discovery_port": { 2024-06-02T04:19:44.973 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "service_discovery_port", 2024-06-02T04:19:44.973 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:44.974 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.974 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.974 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "8765", 2024-06-02T04:19:44.974 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.974 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.974 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.974 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "cephadm service discovery port", 2024-06-02T04:19:44.974 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.974 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.974 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.975 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.975 INFO:teuthology.orchestra.run.smithi123.stdout: "ssh_config_file": { 2024-06-02T04:19:44.975 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ssh_config_file", 2024-06-02T04:19:44.975 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.975 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.975 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.975 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:44.975 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.975 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.975 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.975 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-06-02T04:19:44.976 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.976 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.976 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.976 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.976 INFO:teuthology.orchestra.run.smithi123.stdout: "use_agent": { 2024-06-02T04:19:44.976 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "use_agent", 2024-06-02T04:19:44.976 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:44.976 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.976 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.976 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:44.976 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.977 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.977 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.977 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-06-02T04:19:44.977 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.977 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.977 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.977 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.977 INFO:teuthology.orchestra.run.smithi123.stdout: "use_repo_digest": { 2024-06-02T04:19:44.977 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "use_repo_digest", 2024-06-02T04:19:44.977 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:44.977 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.977 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.978 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:44.978 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.978 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.978 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.978 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-06-02T04:19:44.978 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.978 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.978 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.978 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.978 INFO:teuthology.orchestra.run.smithi123.stdout: "warn_on_failed_host_check": { 2024-06-02T04:19:44.978 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "warn_on_failed_host_check", 2024-06-02T04:19:44.979 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:44.979 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.979 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.979 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:44.979 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.979 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.979 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.979 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "raise a health warning if the host check fails", 2024-06-02T04:19:44.979 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.979 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.979 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.980 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.980 INFO:teuthology.orchestra.run.smithi123.stdout: "warn_on_stray_daemons": { 2024-06-02T04:19:44.980 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "warn_on_stray_daemons", 2024-06-02T04:19:44.980 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:44.980 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.980 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.980 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:44.980 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.980 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.980 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.981 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-06-02T04:19:44.981 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.981 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.981 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.981 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.981 INFO:teuthology.orchestra.run.smithi123.stdout: "warn_on_stray_hosts": { 2024-06-02T04:19:44.981 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "warn_on_stray_hosts", 2024-06-02T04:19:44.981 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:44.981 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.981 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.981 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:44.982 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.982 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.982 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.982 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-06-02T04:19:44.982 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.982 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.982 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.982 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:44.982 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:44.982 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.982 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:44.983 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "crash", 2024-06-02T04:19:44.983 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:44.983 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:44.983 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:44.983 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:44.983 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:44.983 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.983 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.983 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.983 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:44.983 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.984 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.984 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:44.984 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:44.984 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:44.984 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:44.984 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:44.984 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:44.984 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:44.984 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:44.984 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:44.984 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.984 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.985 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.985 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.985 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:44.985 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:44.985 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:44.985 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.985 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.985 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:44.985 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.985 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.985 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.986 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:44.986 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.986 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.986 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.986 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.986 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:44.986 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:44.986 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.986 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.986 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.986 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:44.987 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.987 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.987 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:44.987 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:44.987 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:44.987 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:44.987 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:44.987 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:44.987 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:44.987 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:44.987 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:44.987 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.988 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.988 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.988 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.988 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:44.988 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:44.988 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:44.988 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.988 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.988 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:44.988 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.989 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.989 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.989 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:44.989 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.989 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.989 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.989 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.989 INFO:teuthology.orchestra.run.smithi123.stdout: "retain_interval": { 2024-06-02T04:19:44.989 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "retain_interval", 2024-06-02T04:19:44.989 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:44.990 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.990 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.990 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "31536000", 2024-06-02T04:19:44.990 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.990 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.990 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.990 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how long to retain crashes before pruning them", 2024-06-02T04:19:44.990 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.990 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.990 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.990 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.990 INFO:teuthology.orchestra.run.smithi123.stdout: "warn_recent_interval": { 2024-06-02T04:19:44.991 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "warn_recent_interval", 2024-06-02T04:19:44.991 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:44.991 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.991 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:44.991 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "1209600", 2024-06-02T04:19:44.991 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.991 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.991 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.991 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "time interval in which to warn about recent crashes", 2024-06-02T04:19:44.991 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.992 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.992 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.992 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:44.992 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:44.992 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.992 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:44.992 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "dashboard", 2024-06-02T04:19:44.992 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:44.992 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:44.992 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:44.992 INFO:teuthology.orchestra.run.smithi123.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-06-02T04:19:44.992 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-06-02T04:19:44.993 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:44.993 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.993 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.993 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-06-02T04:19:44.993 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.993 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.993 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.993 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:44.993 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.993 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.994 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.994 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.994 INFO:teuthology.orchestra.run.smithi123.stdout: "ALERTMANAGER_API_HOST": { 2024-06-02T04:19:44.994 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ALERTMANAGER_API_HOST", 2024-06-02T04:19:44.994 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:44.994 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.994 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.994 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:44.994 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.994 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.994 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.995 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:44.995 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.995 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.995 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.995 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.995 INFO:teuthology.orchestra.run.smithi123.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-06-02T04:19:44.995 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-06-02T04:19:44.995 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:44.995 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.995 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.995 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:44.995 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.996 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.996 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.996 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:44.996 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.996 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.996 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.996 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.996 INFO:teuthology.orchestra.run.smithi123.stdout: "AUDIT_API_ENABLED": { 2024-06-02T04:19:44.996 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "AUDIT_API_ENABLED", 2024-06-02T04:19:44.996 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:44.996 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.997 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.997 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:44.997 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.997 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.997 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.997 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:44.997 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.997 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.997 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.997 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.997 INFO:teuthology.orchestra.run.smithi123.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-06-02T04:19:44.997 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-06-02T04:19:44.998 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:44.998 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.998 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.998 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:44.998 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.998 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:44.998 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:44.998 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:44.998 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:44.998 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:44.998 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:44.998 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:44.999 INFO:teuthology.orchestra.run.smithi123.stdout: "ENABLE_BROWSABLE_API": { 2024-06-02T04:19:44.999 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ENABLE_BROWSABLE_API", 2024-06-02T04:19:44.999 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:44.999 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:44.999 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:44.999 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:44.999 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:44.999 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.000 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.000 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.000 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.000 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.000 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.000 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.000 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-06-02T04:19:45.000 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-06-02T04:19:45.000 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.000 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.000 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.001 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.001 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.001 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.001 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.001 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.001 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.001 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.001 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.001 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.001 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-06-02T04:19:45.001 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-06-02T04:19:45.001 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.002 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.002 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.002 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.002 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.002 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.002 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.002 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.002 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.002 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.002 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.003 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.003 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-06-02T04:19:45.003 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-06-02T04:19:45.003 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.003 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.003 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.003 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.003 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.003 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.003 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.003 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.004 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.004 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.004 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.004 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.004 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-06-02T04:19:45.004 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-06-02T04:19:45.004 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.004 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.004 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.004 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.004 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.005 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.005 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.005 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.005 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.005 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.005 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.005 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.005 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_NFS": { 2024-06-02T04:19:45.005 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-06-02T04:19:45.005 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.005 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.005 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.006 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.006 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.006 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.006 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.006 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.006 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.006 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.006 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.006 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.006 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_RBD": { 2024-06-02T04:19:45.006 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-06-02T04:19:45.007 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.007 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.007 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.007 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.007 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.007 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.007 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.007 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.007 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.007 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.007 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.008 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.008 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_RGW": { 2024-06-02T04:19:45.008 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-06-02T04:19:45.008 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.008 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.008 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.008 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.008 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.008 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.008 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.009 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.009 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.009 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.009 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.009 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.009 INFO:teuthology.orchestra.run.smithi123.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-06-02T04:19:45.009 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-06-02T04:19:45.009 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.009 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.009 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.009 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.010 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.010 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.010 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.010 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.010 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.010 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.010 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.010 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.010 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_API_PASSWORD": { 2024-06-02T04:19:45.010 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_API_PASSWORD", 2024-06-02T04:19:45.011 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.011 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.011 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.011 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "admin", 2024-06-02T04:19:45.011 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.011 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.011 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.011 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.011 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.011 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.011 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.012 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.012 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-06-02T04:19:45.012 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-06-02T04:19:45.012 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.012 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.012 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.012 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.012 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.012 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.012 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.012 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.013 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.013 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.013 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.013 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.013 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_API_URL": { 2024-06-02T04:19:45.013 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_API_URL", 2024-06-02T04:19:45.013 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.013 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.013 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.013 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.013 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.013 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.014 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.014 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.014 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.014 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.014 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.014 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.014 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_API_USERNAME": { 2024-06-02T04:19:45.014 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_API_USERNAME", 2024-06-02T04:19:45.014 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.014 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.014 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.015 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "admin", 2024-06-02T04:19:45.015 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.015 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.015 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.015 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.015 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.015 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.015 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.015 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.015 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-06-02T04:19:45.015 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-06-02T04:19:45.016 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.016 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.016 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.016 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.016 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.016 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.016 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.016 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.016 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.016 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.016 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.017 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.017 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-06-02T04:19:45.017 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-06-02T04:19:45.017 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.017 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.017 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.017 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.017 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.017 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.017 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.017 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.017 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.018 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.018 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.018 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.018 INFO:teuthology.orchestra.run.smithi123.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-06-02T04:19:45.018 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-06-02T04:19:45.018 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.018 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.018 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.018 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.018 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.018 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.019 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.019 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.019 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.019 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.019 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.019 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.019 INFO:teuthology.orchestra.run.smithi123.stdout: "ISSUE_TRACKER_API_KEY": { 2024-06-02T04:19:45.019 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-06-02T04:19:45.019 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.020 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.020 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.020 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.020 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.020 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.020 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.020 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.020 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.020 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.020 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.020 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.020 INFO:teuthology.orchestra.run.smithi123.stdout: "PROMETHEUS_API_HOST": { 2024-06-02T04:19:45.021 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PROMETHEUS_API_HOST", 2024-06-02T04:19:45.021 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.021 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.021 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.021 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.021 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.021 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.021 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.021 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.021 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.022 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.022 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.022 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.022 INFO:teuthology.orchestra.run.smithi123.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-06-02T04:19:45.022 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-06-02T04:19:45.022 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.022 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.022 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.022 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.022 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.023 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.023 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.023 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.023 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.023 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.023 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.023 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.023 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-06-02T04:19:45.023 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-06-02T04:19:45.023 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.023 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.024 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.024 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.024 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.024 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.024 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.024 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.024 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.024 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.024 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.024 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.025 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-06-02T04:19:45.025 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-06-02T04:19:45.025 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.025 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.025 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.025 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.025 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.025 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.025 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.025 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.025 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.026 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.026 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.026 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.026 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-06-02T04:19:45.026 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-06-02T04:19:45.026 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.026 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.026 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.026 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.026 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.027 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.027 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.027 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.027 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.027 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.027 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.027 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.027 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-06-02T04:19:45.027 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-06-02T04:19:45.027 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.028 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.028 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.028 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.028 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.028 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.028 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.028 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.028 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.028 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.028 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.029 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.029 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-06-02T04:19:45.029 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-06-02T04:19:45.029 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.029 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.029 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.029 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.029 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.029 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.029 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.029 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.030 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.030 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.030 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.030 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.030 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-06-02T04:19:45.030 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-06-02T04:19:45.030 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.030 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.030 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.030 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.030 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.031 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.031 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.031 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.031 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.031 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.031 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.031 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.031 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-06-02T04:19:45.031 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-06-02T04:19:45.031 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.031 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.032 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.032 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.032 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.032 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.032 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.032 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.032 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.032 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.032 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.032 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.032 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_ENABLED": { 2024-06-02T04:19:45.032 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_ENABLED", 2024-06-02T04:19:45.033 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.033 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.033 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.033 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.033 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.033 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.033 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.033 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.033 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.033 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.033 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.034 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.034 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-06-02T04:19:45.034 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-06-02T04:19:45.034 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.034 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.034 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.034 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-06-02T04:19:45.034 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.034 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.034 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.034 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.035 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.035 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.035 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.035 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.035 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-06-02T04:19:45.035 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-06-02T04:19:45.035 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.035 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.035 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.035 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-06-02T04:19:45.035 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.036 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.036 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.036 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.036 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.036 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.036 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.036 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.036 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-06-02T04:19:45.036 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-06-02T04:19:45.036 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.036 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.036 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.037 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "8", 2024-06-02T04:19:45.037 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.037 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.037 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.037 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.037 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.037 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.037 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.037 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.037 INFO:teuthology.orchestra.run.smithi123.stdout: "REST_REQUESTS_TIMEOUT": { 2024-06-02T04:19:45.037 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-06-02T04:19:45.038 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.038 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.038 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.038 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "45", 2024-06-02T04:19:45.038 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.038 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.038 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.038 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.038 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.038 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.039 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.039 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.039 INFO:teuthology.orchestra.run.smithi123.stdout: "RGW_API_ACCESS_KEY": { 2024-06-02T04:19:45.039 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RGW_API_ACCESS_KEY", 2024-06-02T04:19:45.039 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.039 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.039 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.039 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.039 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.039 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.039 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.040 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.040 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.040 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.040 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.040 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.040 INFO:teuthology.orchestra.run.smithi123.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-06-02T04:19:45.040 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-06-02T04:19:45.040 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.040 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.040 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.040 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "admin", 2024-06-02T04:19:45.041 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.041 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.041 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.041 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.041 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.041 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.041 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.041 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.041 INFO:teuthology.orchestra.run.smithi123.stdout: "RGW_API_SECRET_KEY": { 2024-06-02T04:19:45.041 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RGW_API_SECRET_KEY", 2024-06-02T04:19:45.042 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.042 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.042 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.042 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.042 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.042 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.042 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.043 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.043 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.043 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.043 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.043 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.043 INFO:teuthology.orchestra.run.smithi123.stdout: "RGW_API_SSL_VERIFY": { 2024-06-02T04:19:45.043 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RGW_API_SSL_VERIFY", 2024-06-02T04:19:45.043 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.044 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.044 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.044 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.044 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.044 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.044 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.044 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.044 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.044 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.045 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.045 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.045 INFO:teuthology.orchestra.run.smithi123.stdout: "UNSAFE_TLS_v1_2": { 2024-06-02T04:19:45.045 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "UNSAFE_TLS_v1_2", 2024-06-02T04:19:45.045 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.045 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.045 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.045 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.045 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.046 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.046 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.046 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.046 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.046 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.046 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.046 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.046 INFO:teuthology.orchestra.run.smithi123.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-06-02T04:19:45.046 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-06-02T04:19:45.047 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.047 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.047 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.047 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0", 2024-06-02T04:19:45.047 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.047 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.047 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.047 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.048 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.048 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.048 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.048 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.048 INFO:teuthology.orchestra.run.smithi123.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-06-02T04:19:45.048 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-06-02T04:19:45.048 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.048 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.048 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.048 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-06-02T04:19:45.049 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.049 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.049 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.049 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.049 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.049 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.049 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.049 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.049 INFO:teuthology.orchestra.run.smithi123.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-06-02T04:19:45.050 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-06-02T04:19:45.050 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.050 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.050 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.050 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "5", 2024-06-02T04:19:45.050 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.050 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.050 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.050 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.051 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.051 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.051 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.051 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.051 INFO:teuthology.orchestra.run.smithi123.stdout: "cross_origin_url": { 2024-06-02T04:19:45.051 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "cross_origin_url", 2024-06-02T04:19:45.051 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.051 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.051 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.052 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.052 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.052 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.052 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.052 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.052 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.052 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.052 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.053 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.053 INFO:teuthology.orchestra.run.smithi123.stdout: "crt_file": { 2024-06-02T04:19:45.053 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "crt_file", 2024-06-02T04:19:45.053 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.053 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.053 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.053 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.053 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.053 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.054 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.054 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.054 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.054 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.054 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.054 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.054 INFO:teuthology.orchestra.run.smithi123.stdout: "debug": { 2024-06-02T04:19:45.054 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "debug", 2024-06-02T04:19:45.055 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.055 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.055 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.055 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.055 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.055 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.055 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.055 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Enable/disable debug options", 2024-06-02T04:19:45.055 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.056 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.056 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.056 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.056 INFO:teuthology.orchestra.run.smithi123.stdout: "jwt_token_ttl": { 2024-06-02T04:19:45.056 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "jwt_token_ttl", 2024-06-02T04:19:45.056 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.056 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.056 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.057 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "28800", 2024-06-02T04:19:45.057 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.057 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.057 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.057 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.057 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.057 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.057 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.058 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.058 INFO:teuthology.orchestra.run.smithi123.stdout: "key_file": { 2024-06-02T04:19:45.058 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "key_file", 2024-06-02T04:19:45.058 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.058 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.058 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.058 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.059 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.059 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.059 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.059 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.059 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.059 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.059 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.059 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.060 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.060 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.060 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.060 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.060 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.060 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.060 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.061 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.061 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.061 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.061 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.061 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.062 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.062 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.062 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.062 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.062 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.062 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.062 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.062 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.062 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.063 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.063 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.063 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.063 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.063 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.063 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.063 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.063 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.063 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.064 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.064 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.064 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.064 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.064 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.064 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.064 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.064 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.064 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.065 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.065 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.065 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.065 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.065 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.065 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.065 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.065 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.065 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.065 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.066 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.066 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.066 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.066 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.066 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.066 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.066 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.066 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.066 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.066 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.066 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.067 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.067 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.067 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.067 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.067 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.067 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.067 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.067 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.067 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.068 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.068 INFO:teuthology.orchestra.run.smithi123.stdout: "motd": { 2024-06-02T04:19:45.068 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "motd", 2024-06-02T04:19:45.068 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.068 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.068 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.068 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.068 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.068 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.068 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.069 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "The message of the day", 2024-06-02T04:19:45.069 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.069 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.069 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.069 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.069 INFO:teuthology.orchestra.run.smithi123.stdout: "redirect_resolve_ip_addr": { 2024-06-02T04:19:45.069 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "redirect_resolve_ip_addr", 2024-06-02T04:19:45.069 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.069 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.070 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.070 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.070 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.070 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.070 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.070 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.070 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.070 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.070 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.070 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.070 INFO:teuthology.orchestra.run.smithi123.stdout: "server_addr": { 2024-06-02T04:19:45.071 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_addr", 2024-06-02T04:19:45.071 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.071 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.071 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.071 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "::", 2024-06-02T04:19:45.071 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.071 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.071 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.071 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.071 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.071 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.072 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.072 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.072 INFO:teuthology.orchestra.run.smithi123.stdout: "server_port": { 2024-06-02T04:19:45.072 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_port", 2024-06-02T04:19:45.072 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.072 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.072 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.072 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "8080", 2024-06-02T04:19:45.072 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.072 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.072 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.072 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.073 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.073 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.073 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.073 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.073 INFO:teuthology.orchestra.run.smithi123.stdout: "ssl": { 2024-06-02T04:19:45.073 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ssl", 2024-06-02T04:19:45.073 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.073 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.073 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.073 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.073 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.074 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.074 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.074 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.074 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.074 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.074 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.074 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.074 INFO:teuthology.orchestra.run.smithi123.stdout: "ssl_server_port": { 2024-06-02T04:19:45.074 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ssl_server_port", 2024-06-02T04:19:45.074 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.075 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.075 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.075 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "8443", 2024-06-02T04:19:45.075 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.075 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.075 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.075 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.075 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.075 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.075 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.075 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.076 INFO:teuthology.orchestra.run.smithi123.stdout: "standby_behaviour": { 2024-06-02T04:19:45.076 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "standby_behaviour", 2024-06-02T04:19:45.076 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.076 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.076 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.076 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "redirect", 2024-06-02T04:19:45.076 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.076 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.076 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.076 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.076 INFO:teuthology.orchestra.run.smithi123.stdout: "redirect" 2024-06-02T04:19:45.077 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.077 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.077 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.077 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.077 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.077 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.077 INFO:teuthology.orchestra.run.smithi123.stdout: "standby_error_status_code": { 2024-06-02T04:19:45.077 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "standby_error_status_code", 2024-06-02T04:19:45.077 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.077 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.077 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.077 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "500", 2024-06-02T04:19:45.078 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "400", 2024-06-02T04:19:45.078 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "599", 2024-06-02T04:19:45.078 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.078 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.078 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.078 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.078 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.078 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.078 INFO:teuthology.orchestra.run.smithi123.stdout: "url_prefix": { 2024-06-02T04:19:45.078 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "url_prefix", 2024-06-02T04:19:45.078 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.079 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.079 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.079 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.079 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.079 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.079 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.079 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.079 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.079 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.079 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.080 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.080 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.080 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.080 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.080 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "devicehealth", 2024-06-02T04:19:45.080 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.080 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.080 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.080 INFO:teuthology.orchestra.run.smithi123.stdout: "enable_monitoring": { 2024-06-02T04:19:45.080 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "enable_monitoring", 2024-06-02T04:19:45.080 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.081 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.081 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.081 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.081 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.081 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.081 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.081 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "monitor device health metrics", 2024-06-02T04:19:45.081 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.081 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.081 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.081 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.082 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.082 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.082 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.082 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.082 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.082 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.082 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.082 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.082 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.082 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.082 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.083 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.083 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.083 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.083 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.083 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.083 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.083 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.083 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.083 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.083 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.083 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.084 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.084 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.084 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.084 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.084 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.084 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.084 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.084 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.084 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.084 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.084 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.084 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.085 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.085 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.085 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.085 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.085 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.085 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.085 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.085 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.085 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.085 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.085 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.086 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.086 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.086 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.086 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.086 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.086 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.086 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.086 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.086 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.086 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.086 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.087 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.087 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.087 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.087 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.087 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.087 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.087 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.087 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.087 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.087 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.087 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.087 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.088 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.088 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.088 INFO:teuthology.orchestra.run.smithi123.stdout: "mark_out_threshold": { 2024-06-02T04:19:45.088 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mark_out_threshold", 2024-06-02T04:19:45.088 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:45.088 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.088 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.088 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "2419200", 2024-06-02T04:19:45.088 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.088 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.088 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.088 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-06-02T04:19:45.089 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.089 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.089 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.089 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.089 INFO:teuthology.orchestra.run.smithi123.stdout: "pool_name": { 2024-06-02T04:19:45.089 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "pool_name", 2024-06-02T04:19:45.089 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.089 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.089 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.089 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "device_health_metrics", 2024-06-02T04:19:45.089 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.090 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.090 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.090 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "name of pool in which to store device health metrics", 2024-06-02T04:19:45.090 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.090 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.090 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.090 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.090 INFO:teuthology.orchestra.run.smithi123.stdout: "retention_period": { 2024-06-02T04:19:45.090 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "retention_period", 2024-06-02T04:19:45.090 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:45.090 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.090 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.091 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "15552000", 2024-06-02T04:19:45.091 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.091 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.091 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.091 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how long to retain device health metrics", 2024-06-02T04:19:45.091 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.091 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.091 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.091 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.091 INFO:teuthology.orchestra.run.smithi123.stdout: "scrape_frequency": { 2024-06-02T04:19:45.091 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "scrape_frequency", 2024-06-02T04:19:45.092 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:45.092 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.092 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.092 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "86400", 2024-06-02T04:19:45.092 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.092 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.092 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.092 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how frequently to scrape device health metrics", 2024-06-02T04:19:45.092 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.092 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.092 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.092 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.093 INFO:teuthology.orchestra.run.smithi123.stdout: "self_heal": { 2024-06-02T04:19:45.093 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "self_heal", 2024-06-02T04:19:45.093 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.093 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.093 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.093 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.093 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.093 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.093 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.093 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-06-02T04:19:45.093 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.094 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.094 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.094 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.094 INFO:teuthology.orchestra.run.smithi123.stdout: "sleep_interval": { 2024-06-02T04:19:45.094 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "sleep_interval", 2024-06-02T04:19:45.094 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:45.094 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.094 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.094 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "600", 2024-06-02T04:19:45.094 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.094 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.095 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.095 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how frequently to wake up and check device health", 2024-06-02T04:19:45.095 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.095 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.095 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.095 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.095 INFO:teuthology.orchestra.run.smithi123.stdout: "warn_threshold": { 2024-06-02T04:19:45.095 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "warn_threshold", 2024-06-02T04:19:45.095 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:45.095 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.096 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.096 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "7257600", 2024-06-02T04:19:45.096 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.096 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.096 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.096 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-06-02T04:19:45.096 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.096 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.096 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.096 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.096 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.096 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.097 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.097 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "diskprediction_local", 2024-06-02T04:19:45.097 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.097 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.097 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.097 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.097 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.097 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.097 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.097 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.097 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.098 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.098 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.098 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.098 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.098 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.098 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.098 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.098 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.098 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.098 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.098 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.099 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.099 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.099 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.099 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.099 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.099 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.099 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.099 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.099 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.099 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.099 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.100 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.100 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.100 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.100 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.100 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.100 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.100 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.100 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.100 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.100 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.100 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.101 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.101 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.101 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.101 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.101 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.101 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.101 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.101 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.101 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.101 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.102 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.102 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.102 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.102 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.102 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.102 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.102 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.102 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.102 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.102 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.102 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.103 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.103 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.103 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.103 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.103 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.103 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.103 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.103 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.103 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.103 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.104 INFO:teuthology.orchestra.run.smithi123.stdout: "predict_interval": { 2024-06-02T04:19:45.104 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "predict_interval", 2024-06-02T04:19:45.104 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.104 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.104 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.104 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "86400", 2024-06-02T04:19:45.104 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.104 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.104 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.104 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.104 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.105 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.105 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.105 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.105 INFO:teuthology.orchestra.run.smithi123.stdout: "predictor_model": { 2024-06-02T04:19:45.105 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "predictor_model", 2024-06-02T04:19:45.105 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.105 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.105 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.105 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "prophetstor", 2024-06-02T04:19:45.105 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.105 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.106 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.106 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.106 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.106 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.106 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.106 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.106 INFO:teuthology.orchestra.run.smithi123.stdout: "sleep_interval": { 2024-06-02T04:19:45.106 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "sleep_interval", 2024-06-02T04:19:45.106 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.106 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.106 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.107 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "600", 2024-06-02T04:19:45.107 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.107 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.107 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.107 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.107 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.107 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.107 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.107 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.107 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.107 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.107 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.108 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "influx", 2024-06-02T04:19:45.108 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": false, 2024-06-02T04:19:45.108 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "influxdb python module not found", 2024-06-02T04:19:45.108 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.108 INFO:teuthology.orchestra.run.smithi123.stdout: "batch_size": { 2024-06-02T04:19:45.108 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "batch_size", 2024-06-02T04:19:45.108 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.108 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.108 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.108 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "5000", 2024-06-02T04:19:45.108 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.108 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.109 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.109 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-06-02T04:19:45.109 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.109 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.109 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.109 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.109 INFO:teuthology.orchestra.run.smithi123.stdout: "database": { 2024-06-02T04:19:45.109 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "database", 2024-06-02T04:19:45.109 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.109 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.109 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.110 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "ceph", 2024-06-02T04:19:45.110 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.110 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.110 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.110 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-06-02T04:19:45.110 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.110 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.110 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.110 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.110 INFO:teuthology.orchestra.run.smithi123.stdout: "hostname": { 2024-06-02T04:19:45.110 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "hostname", 2024-06-02T04:19:45.110 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.111 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.111 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.111 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.111 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.111 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.111 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.111 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "InfluxDB server hostname", 2024-06-02T04:19:45.111 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.111 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.111 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.111 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.112 INFO:teuthology.orchestra.run.smithi123.stdout: "interval": { 2024-06-02T04:19:45.112 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "interval", 2024-06-02T04:19:45.112 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:45.112 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.112 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.112 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "30", 2024-06-02T04:19:45.112 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "5", 2024-06-02T04:19:45.112 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.112 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.112 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-06-02T04:19:45.113 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.113 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.113 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.113 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.113 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.113 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.113 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.113 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.113 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.113 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.113 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.114 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.114 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.114 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.114 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.114 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.114 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.114 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.114 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.114 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.114 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.114 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.115 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.115 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.115 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.115 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.115 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.115 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.115 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.115 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.115 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.115 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.115 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.115 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.116 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.116 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.116 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.116 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.116 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.116 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.116 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.116 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.116 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.116 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.116 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.117 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.117 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.117 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.117 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.117 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.117 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.117 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.117 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.117 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.117 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.117 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.117 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.118 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.118 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.118 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.118 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.118 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.118 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.118 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.118 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.118 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.118 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.118 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.119 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.119 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.119 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.119 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.119 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.119 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.119 INFO:teuthology.orchestra.run.smithi123.stdout: "password": { 2024-06-02T04:19:45.119 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "password", 2024-06-02T04:19:45.119 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.119 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.119 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.120 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.120 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.120 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.120 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.120 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "password of InfluxDB server user", 2024-06-02T04:19:45.120 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.120 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.120 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.120 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.120 INFO:teuthology.orchestra.run.smithi123.stdout: "port": { 2024-06-02T04:19:45.120 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "port", 2024-06-02T04:19:45.120 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.121 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.121 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.121 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "8086", 2024-06-02T04:19:45.121 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.121 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.121 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.121 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "InfluxDB server port", 2024-06-02T04:19:45.121 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.121 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.121 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.121 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.122 INFO:teuthology.orchestra.run.smithi123.stdout: "ssl": { 2024-06-02T04:19:45.122 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ssl", 2024-06-02T04:19:45.122 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.122 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.122 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.122 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "false", 2024-06-02T04:19:45.122 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.122 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.122 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.122 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-06-02T04:19:45.122 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.122 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.123 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.123 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.123 INFO:teuthology.orchestra.run.smithi123.stdout: "threads": { 2024-06-02T04:19:45.123 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "threads", 2024-06-02T04:19:45.123 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.123 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.123 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.123 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "5", 2024-06-02T04:19:45.123 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "1", 2024-06-02T04:19:45.123 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "32", 2024-06-02T04:19:45.123 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.123 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-06-02T04:19:45.124 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.124 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.124 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.124 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.124 INFO:teuthology.orchestra.run.smithi123.stdout: "username": { 2024-06-02T04:19:45.124 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "username", 2024-06-02T04:19:45.124 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.124 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.124 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.124 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.124 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.125 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.125 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.125 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "username of InfluxDB server user", 2024-06-02T04:19:45.125 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.125 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.125 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.125 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.125 INFO:teuthology.orchestra.run.smithi123.stdout: "verify_ssl": { 2024-06-02T04:19:45.125 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "verify_ssl", 2024-06-02T04:19:45.125 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.125 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.125 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.126 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "true", 2024-06-02T04:19:45.126 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.126 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.126 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.126 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-06-02T04:19:45.126 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.126 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.126 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.126 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.126 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.126 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.126 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.127 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "insights", 2024-06-02T04:19:45.127 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.127 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.127 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.127 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.127 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.127 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.127 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.127 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.127 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.127 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.128 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.128 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.128 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.128 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.128 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.128 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.128 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.128 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.128 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.128 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.128 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.128 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.129 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.129 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.129 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.129 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.129 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.129 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.129 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.129 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.129 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.130 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.130 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.130 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.130 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.130 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.130 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.130 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.130 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.130 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.130 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.130 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.131 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.131 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.131 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.131 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.131 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.131 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.131 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.131 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.131 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.131 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.131 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.131 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.132 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.132 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.132 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.132 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.132 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.132 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.132 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.132 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.132 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.132 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.132 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.133 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.133 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.133 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.133 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.133 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.133 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.133 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.133 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.133 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.133 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.133 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.134 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "iostat", 2024-06-02T04:19:45.134 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.134 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.134 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.134 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.134 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.134 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.134 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.134 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.134 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.134 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.134 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.135 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.135 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.135 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.135 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.135 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.135 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.135 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.135 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.135 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.135 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.135 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.136 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.136 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.136 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.136 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.136 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.136 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.136 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.136 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.136 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.136 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.136 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.137 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.137 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.137 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.137 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.137 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.137 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.137 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.137 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.137 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.137 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.137 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.137 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.138 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.138 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.138 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.138 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.138 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.138 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.138 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.138 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.138 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.138 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.138 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.139 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.139 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.139 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.139 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.139 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.139 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.139 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.139 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.139 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.139 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.139 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.140 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.140 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.140 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.140 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.140 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.140 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.140 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.140 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.140 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.140 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "k8sevents", 2024-06-02T04:19:45.140 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.140 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.141 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.141 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_event_retention_days": { 2024-06-02T04:19:45.141 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ceph_event_retention_days", 2024-06-02T04:19:45.141 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.141 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.141 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.141 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "7", 2024-06-02T04:19:45.141 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.141 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.141 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.141 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Days to hold ceph event information within local cache", 2024-06-02T04:19:45.142 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.142 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.142 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.142 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.142 INFO:teuthology.orchestra.run.smithi123.stdout: "config_check_secs": { 2024-06-02T04:19:45.142 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "config_check_secs", 2024-06-02T04:19:45.142 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.142 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.142 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.142 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-06-02T04:19:45.142 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "10", 2024-06-02T04:19:45.143 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.143 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.143 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-06-02T04:19:45.143 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.143 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.143 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.143 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.143 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.143 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.143 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.143 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.144 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.144 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.144 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.144 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.144 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.144 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.144 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.144 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.144 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.144 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.144 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.144 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.145 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.145 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.145 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.145 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.145 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.145 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.145 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.145 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.145 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.145 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.145 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.146 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.146 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.146 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.146 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.146 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.146 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.146 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.146 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.147 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.147 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.147 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.147 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.147 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.147 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.147 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.147 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.147 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.148 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.148 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.148 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.148 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.148 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.148 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.148 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.148 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.148 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.148 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.148 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.149 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.149 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.149 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.149 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.149 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.149 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.149 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.149 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.149 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.149 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.150 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.150 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.150 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.150 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.150 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.150 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.150 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.150 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.150 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "localpool", 2024-06-02T04:19:45.151 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.151 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.151 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.151 INFO:teuthology.orchestra.run.smithi123.stdout: "failure_domain": { 2024-06-02T04:19:45.151 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "failure_domain", 2024-06-02T04:19:45.151 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.151 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.151 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.151 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "host", 2024-06-02T04:19:45.151 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.152 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.152 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.152 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "failure domain for any created local pool", 2024-06-02T04:19:45.152 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-06-02T04:19:45.152 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.152 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.152 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.152 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.152 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.152 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.152 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.153 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.153 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.153 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.153 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.153 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.153 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.153 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.153 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.153 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.153 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.153 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.154 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.154 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.154 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.154 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.154 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.154 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.154 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.154 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.154 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.154 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.155 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.155 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.155 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.155 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.155 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.155 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.155 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.155 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.155 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.155 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.156 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.156 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.156 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.156 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.156 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.156 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.156 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.156 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.156 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.156 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.156 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.156 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.157 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.157 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.157 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.157 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.157 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.157 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.157 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.157 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.157 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.157 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.157 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.158 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.158 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.158 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.158 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.158 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.158 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.158 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.158 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.158 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.158 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.158 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.159 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.159 INFO:teuthology.orchestra.run.smithi123.stdout: "min_size": { 2024-06-02T04:19:45.159 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "min_size", 2024-06-02T04:19:45.159 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.159 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.159 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.159 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.159 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.159 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.159 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.159 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "default min_size for any created local pool", 2024-06-02T04:19:45.160 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-06-02T04:19:45.160 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.160 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.160 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.160 INFO:teuthology.orchestra.run.smithi123.stdout: "num_rep": { 2024-06-02T04:19:45.160 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "num_rep", 2024-06-02T04:19:45.160 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.160 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.160 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.160 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "3", 2024-06-02T04:19:45.160 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.160 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.161 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.161 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "default replica count for any created local pool", 2024-06-02T04:19:45.161 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.161 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.161 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.161 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.161 INFO:teuthology.orchestra.run.smithi123.stdout: "pg_num": { 2024-06-02T04:19:45.161 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "pg_num", 2024-06-02T04:19:45.161 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.161 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.161 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.162 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "128", 2024-06-02T04:19:45.162 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.162 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.162 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.162 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "default pg_num for any created local pool", 2024-06-02T04:19:45.162 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.162 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.162 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.162 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.162 INFO:teuthology.orchestra.run.smithi123.stdout: "prefix": { 2024-06-02T04:19:45.162 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "prefix", 2024-06-02T04:19:45.163 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.163 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.163 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.163 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.163 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.163 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.163 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.163 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "name prefix for any created local pool", 2024-06-02T04:19:45.163 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.163 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.163 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.163 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.164 INFO:teuthology.orchestra.run.smithi123.stdout: "subtree": { 2024-06-02T04:19:45.164 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "subtree", 2024-06-02T04:19:45.164 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.164 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.164 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.164 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "rack", 2024-06-02T04:19:45.164 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.164 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.164 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.164 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "CRUSH level for which to create a local pool", 2024-06-02T04:19:45.165 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-06-02T04:19:45.165 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.165 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.165 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.165 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.165 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.165 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.165 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mds_autoscaler", 2024-06-02T04:19:45.165 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.165 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.165 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.165 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.166 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.166 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.166 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.166 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.166 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.166 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.166 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.166 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.166 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.166 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.166 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.167 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.167 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.167 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.167 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.167 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.167 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.167 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.167 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.167 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.167 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.167 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.167 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.168 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.168 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.168 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.168 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.168 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.168 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.168 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.168 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.168 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.169 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.169 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.169 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.169 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.169 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.169 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.169 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.169 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.170 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.170 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.170 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.170 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.170 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.170 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.170 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.170 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.170 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.170 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.170 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.171 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.171 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.171 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.171 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.171 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.171 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.171 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.171 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.171 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.171 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.171 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.171 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.172 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.172 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.172 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.172 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.172 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.172 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.172 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.172 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.172 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.172 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mirroring", 2024-06-02T04:19:45.172 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.173 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.173 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.173 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.173 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.173 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.173 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.173 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.173 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.173 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.173 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.173 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.173 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.174 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.174 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.174 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.174 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.174 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.174 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.174 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.174 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.174 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.174 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.175 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.175 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.175 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.175 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.175 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.175 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.175 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.175 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.175 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.175 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.176 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.176 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.176 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.176 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.176 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.176 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.176 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.177 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.177 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.177 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.177 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.177 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.177 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.177 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.177 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.178 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.178 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.178 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.178 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.178 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.178 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.178 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.178 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.178 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.179 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.179 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.179 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.179 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.179 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.179 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.179 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.179 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.179 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.180 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.180 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.180 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.180 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.180 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.180 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.180 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.180 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.180 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.180 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.180 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "nfs", 2024-06-02T04:19:45.180 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.181 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.181 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.181 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.181 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.181 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.181 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.181 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.181 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.181 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.181 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.181 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.182 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.182 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.182 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.182 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.182 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.182 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.182 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.182 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.182 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.182 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.183 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.183 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.183 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.183 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.183 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.183 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.183 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.183 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.183 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.183 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.184 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.184 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.184 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.184 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.184 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.184 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.184 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.184 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.184 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.184 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.184 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.185 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.185 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.185 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.185 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.185 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.185 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.185 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.185 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.185 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.185 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.186 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.186 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.186 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.186 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.186 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.186 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.186 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.186 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.186 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.186 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.187 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.187 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.187 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.187 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.187 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.187 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.187 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.187 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.187 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.188 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.188 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.188 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.188 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.188 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "orchestrator", 2024-06-02T04:19:45.188 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.188 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.188 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.188 INFO:teuthology.orchestra.run.smithi123.stdout: "fail_fs": { 2024-06-02T04:19:45.188 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "fail_fs", 2024-06-02T04:19:45.189 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.189 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.189 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.189 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.189 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.189 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.189 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.189 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-06-02T04:19:45.189 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.189 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.189 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.190 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.190 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.190 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.190 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.190 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.190 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.190 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.190 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.190 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.190 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.190 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.191 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.191 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.191 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.191 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.191 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.191 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.191 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.191 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.191 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.191 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.191 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.192 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.192 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.192 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.192 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.192 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.192 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.192 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.192 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.192 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.192 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.192 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.193 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.193 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.193 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.193 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.193 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.193 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.193 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.193 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.193 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.193 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.193 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.194 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.194 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.194 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.194 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.194 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.194 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.194 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.194 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.195 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.195 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.195 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.195 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.195 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.195 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.195 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.195 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.195 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.195 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.195 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.195 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.196 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.196 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.196 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.196 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.196 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.196 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.196 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.196 INFO:teuthology.orchestra.run.smithi123.stdout: "orchestrator": { 2024-06-02T04:19:45.196 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "orchestrator", 2024-06-02T04:19:45.196 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.196 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.196 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.197 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.197 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.197 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.197 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.197 INFO:teuthology.orchestra.run.smithi123.stdout: "cephadm", 2024-06-02T04:19:45.197 INFO:teuthology.orchestra.run.smithi123.stdout: "rook", 2024-06-02T04:19:45.197 INFO:teuthology.orchestra.run.smithi123.stdout: "test_orchestrator" 2024-06-02T04:19:45.197 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.197 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Orchestrator backend", 2024-06-02T04:19:45.197 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.197 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.198 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.198 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.198 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.198 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.198 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.198 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "osd_perf_query", 2024-06-02T04:19:45.198 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.198 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.198 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.198 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.198 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.199 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.199 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.199 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.199 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.199 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.199 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.199 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.199 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.199 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.199 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.199 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.200 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.200 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.200 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.200 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.200 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.200 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.200 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.200 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.200 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.200 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.200 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.200 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.201 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.201 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.201 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.201 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.201 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.201 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.201 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.201 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.201 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.201 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.202 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.202 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.202 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.202 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.202 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.202 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.202 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.202 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.202 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.202 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.202 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.203 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.203 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.203 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.203 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.203 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.203 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.203 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.203 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.203 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.203 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.203 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.204 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.204 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.204 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.204 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.204 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.204 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.204 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.204 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.204 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.204 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.204 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.204 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.205 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.205 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.205 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.205 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.205 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "osd_support", 2024-06-02T04:19:45.205 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.205 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.205 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.205 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.205 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.205 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.205 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.206 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.206 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.206 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.206 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.206 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.206 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.206 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.206 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.206 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.206 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.206 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.207 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.207 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.207 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.207 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.207 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.207 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.207 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.207 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.207 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.207 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.207 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.208 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.208 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.208 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.208 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.208 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.208 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.208 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.208 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.208 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.208 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.208 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.209 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.209 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.209 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.209 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.209 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.209 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.209 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.209 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.209 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.209 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.209 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.209 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.210 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.210 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.210 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.210 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.210 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.210 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.210 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.210 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.210 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.210 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.210 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.211 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.211 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.211 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.211 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.211 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.211 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.211 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.211 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.211 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.212 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.212 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.212 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.212 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.212 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "pg_autoscaler", 2024-06-02T04:19:45.212 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.212 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.212 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.212 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.212 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.212 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.213 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.213 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.213 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.213 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.213 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.213 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.213 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.213 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.213 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.213 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.213 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.214 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.214 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.214 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.214 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.214 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.214 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.214 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.214 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.214 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.214 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.214 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.215 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.215 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.215 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.215 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.215 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.215 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.215 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.215 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.215 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.215 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.215 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.215 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.216 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.216 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.216 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.216 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.216 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.216 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.216 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.216 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.216 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.216 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.216 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.217 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.217 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.217 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.217 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.217 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.217 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.217 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.217 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.217 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.217 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.217 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.217 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.218 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.218 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.218 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.218 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.218 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.218 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.218 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.218 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.218 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.218 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.218 INFO:teuthology.orchestra.run.smithi123.stdout: "sleep_interval": { 2024-06-02T04:19:45.219 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "sleep_interval", 2024-06-02T04:19:45.219 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:45.219 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.219 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.219 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "60", 2024-06-02T04:19:45.219 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.219 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.219 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.219 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.220 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.220 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.220 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.220 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.220 INFO:teuthology.orchestra.run.smithi123.stdout: "threshold": { 2024-06-02T04:19:45.220 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "threshold", 2024-06-02T04:19:45.220 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-06-02T04:19:45.220 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.220 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.220 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "3.0", 2024-06-02T04:19:45.220 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "1.0", 2024-06-02T04:19:45.221 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.221 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.221 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "scaling threshold", 2024-06-02T04:19:45.221 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-06-02T04:19:45.221 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.221 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.221 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.221 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.221 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.221 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.221 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "progress", 2024-06-02T04:19:45.221 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.222 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.222 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.222 INFO:teuthology.orchestra.run.smithi123.stdout: "allow_pg_recovery_event": { 2024-06-02T04:19:45.222 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "allow_pg_recovery_event", 2024-06-02T04:19:45.222 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.222 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.222 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.222 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.222 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.222 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.223 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.223 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "allow the module to show pg recovery progress", 2024-06-02T04:19:45.223 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.223 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.223 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.223 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.223 INFO:teuthology.orchestra.run.smithi123.stdout: "enabled": { 2024-06-02T04:19:45.223 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "enabled", 2024-06-02T04:19:45.223 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.223 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.223 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.223 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.224 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.224 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.224 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.224 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.224 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.224 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.224 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.224 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.224 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.224 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.224 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.225 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.225 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.225 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.225 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.225 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.225 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.225 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.225 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.225 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.225 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.225 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.226 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.226 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.226 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.226 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.226 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.226 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.226 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.226 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.226 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.226 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.227 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.227 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.227 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.227 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.227 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.227 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.227 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.227 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.227 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.227 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.227 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.227 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.228 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.228 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.228 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.228 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.228 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.228 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.228 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.228 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.228 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.228 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.228 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.229 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.229 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.229 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.229 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.229 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.229 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.229 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.229 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.229 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.229 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.229 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.229 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.230 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.230 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.230 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.230 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.230 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.230 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.230 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.230 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.230 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.230 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.230 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.231 INFO:teuthology.orchestra.run.smithi123.stdout: "max_completed_events": { 2024-06-02T04:19:45.231 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "max_completed_events", 2024-06-02T04:19:45.231 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.231 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.231 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.231 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "50", 2024-06-02T04:19:45.231 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.231 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.231 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.231 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "number of past completed events to remember", 2024-06-02T04:19:45.231 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.231 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.232 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.232 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.232 INFO:teuthology.orchestra.run.smithi123.stdout: "sleep_interval": { 2024-06-02T04:19:45.232 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "sleep_interval", 2024-06-02T04:19:45.232 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:45.232 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.232 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.232 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "5", 2024-06-02T04:19:45.232 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.232 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.233 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.233 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how long the module is going to sleep", 2024-06-02T04:19:45.233 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.233 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.233 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.233 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.233 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.233 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.233 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.233 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "prometheus", 2024-06-02T04:19:45.233 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.234 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.234 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.234 INFO:teuthology.orchestra.run.smithi123.stdout: "cache": { 2024-06-02T04:19:45.234 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "cache", 2024-06-02T04:19:45.234 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.234 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.234 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.234 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.234 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.234 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.235 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.235 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.235 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.235 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.235 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.235 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.235 INFO:teuthology.orchestra.run.smithi123.stdout: "exclude_perf_counters": { 2024-06-02T04:19:45.235 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "exclude_perf_counters", 2024-06-02T04:19:45.235 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.235 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.235 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.236 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.236 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.236 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.236 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.236 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-06-02T04:19:45.236 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-06-02T04:19:45.236 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.236 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.236 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.236 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.237 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.237 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.237 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.237 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.237 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.237 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.237 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.237 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.237 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.237 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.237 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.238 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.238 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.238 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.238 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.238 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.238 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.238 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.238 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.238 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.238 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.238 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.239 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.239 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.239 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.239 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.239 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.239 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.239 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.239 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.239 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.239 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.239 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.240 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.240 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.240 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.240 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.240 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.240 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.240 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.240 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.240 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.240 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.240 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.240 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.241 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.241 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.241 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.241 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.241 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.241 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.241 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.241 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.241 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.241 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.241 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.242 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.242 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.242 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.242 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.242 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.242 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.242 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.242 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.242 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.242 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.242 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.243 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.243 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.243 INFO:teuthology.orchestra.run.smithi123.stdout: "rbd_stats_pools": { 2024-06-02T04:19:45.243 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rbd_stats_pools", 2024-06-02T04:19:45.243 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.243 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.243 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.243 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.243 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.243 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.243 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.243 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.244 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.244 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.244 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.244 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.244 INFO:teuthology.orchestra.run.smithi123.stdout: "rbd_stats_pools_refresh_interval": { 2024-06-02T04:19:45.244 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-06-02T04:19:45.244 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.244 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.244 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.244 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "300", 2024-06-02T04:19:45.244 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.245 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.245 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.245 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.245 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.245 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.245 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.245 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.245 INFO:teuthology.orchestra.run.smithi123.stdout: "scrape_interval": { 2024-06-02T04:19:45.245 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "scrape_interval", 2024-06-02T04:19:45.245 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-06-02T04:19:45.245 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.246 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.246 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "15.0", 2024-06-02T04:19:45.246 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.246 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.246 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.246 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.246 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.246 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.246 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.246 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.246 INFO:teuthology.orchestra.run.smithi123.stdout: "server_addr": { 2024-06-02T04:19:45.246 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_addr", 2024-06-02T04:19:45.247 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.247 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.247 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.247 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "::", 2024-06-02T04:19:45.247 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.247 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.247 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.247 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-06-02T04:19:45.247 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.247 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.247 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.248 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.248 INFO:teuthology.orchestra.run.smithi123.stdout: "server_port": { 2024-06-02T04:19:45.248 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_port", 2024-06-02T04:19:45.248 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.248 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.248 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.248 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "9283", 2024-06-02T04:19:45.248 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.248 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.248 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.248 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-06-02T04:19:45.248 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.249 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.249 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.249 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.249 INFO:teuthology.orchestra.run.smithi123.stdout: "stale_cache_strategy": { 2024-06-02T04:19:45.249 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "stale_cache_strategy", 2024-06-02T04:19:45.249 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.249 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.249 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.249 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "log", 2024-06-02T04:19:45.249 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.249 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.250 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.250 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.250 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.250 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.250 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.250 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.250 INFO:teuthology.orchestra.run.smithi123.stdout: "standby_behaviour": { 2024-06-02T04:19:45.250 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "standby_behaviour", 2024-06-02T04:19:45.250 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.250 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.250 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.251 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "default", 2024-06-02T04:19:45.251 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.251 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.251 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.251 INFO:teuthology.orchestra.run.smithi123.stdout: "default", 2024-06-02T04:19:45.251 INFO:teuthology.orchestra.run.smithi123.stdout: "error" 2024-06-02T04:19:45.251 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.251 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.251 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.251 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.251 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.251 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.252 INFO:teuthology.orchestra.run.smithi123.stdout: "standby_error_status_code": { 2024-06-02T04:19:45.252 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "standby_error_status_code", 2024-06-02T04:19:45.252 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.252 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.252 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.252 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "500", 2024-06-02T04:19:45.252 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "400", 2024-06-02T04:19:45.252 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "599", 2024-06-02T04:19:45.252 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.252 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.253 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.253 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.253 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.253 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.253 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.253 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.253 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.253 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rbd_support", 2024-06-02T04:19:45.253 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.253 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.253 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.254 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.254 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.254 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.254 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.254 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.254 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.254 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.254 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.254 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.254 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.254 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.255 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.255 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.255 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.255 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.255 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.255 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.255 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.255 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.255 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.255 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.255 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.255 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.256 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.256 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.256 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.256 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.256 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.256 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.256 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.256 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.256 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.256 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.256 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.256 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.257 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.257 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.257 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.257 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.257 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.257 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.257 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.257 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.257 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.257 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.257 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.258 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.258 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.258 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.258 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.258 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.258 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.258 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.258 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.258 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.258 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.258 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.259 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.259 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.259 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.259 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.259 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.259 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.259 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.259 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.259 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.259 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.259 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.260 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.260 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.260 INFO:teuthology.orchestra.run.smithi123.stdout: "max_concurrent_snap_create": { 2024-06-02T04:19:45.260 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "max_concurrent_snap_create", 2024-06-02T04:19:45.260 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.260 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.260 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.260 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-06-02T04:19:45.260 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.260 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.260 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.261 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.261 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.261 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.261 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.261 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.261 INFO:teuthology.orchestra.run.smithi123.stdout: "mirror_snapshot_schedule": { 2024-06-02T04:19:45.261 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mirror_snapshot_schedule", 2024-06-02T04:19:45.261 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.261 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.261 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.261 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.261 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.262 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.262 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.262 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.262 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.262 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.262 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.262 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.262 INFO:teuthology.orchestra.run.smithi123.stdout: "trash_purge_schedule": { 2024-06-02T04:19:45.262 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "trash_purge_schedule", 2024-06-02T04:19:45.262 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.262 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.263 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.263 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.263 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.263 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.263 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.263 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.263 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.263 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.263 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.263 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.263 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.264 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.264 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.264 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "restful", 2024-06-02T04:19:45.264 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.264 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.264 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.264 INFO:teuthology.orchestra.run.smithi123.stdout: "enable_auth": { 2024-06-02T04:19:45.264 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "enable_auth", 2024-06-02T04:19:45.264 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.264 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.264 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.264 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.265 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.265 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.265 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.265 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.265 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.265 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.265 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.265 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.265 INFO:teuthology.orchestra.run.smithi123.stdout: "key_file": { 2024-06-02T04:19:45.265 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "key_file", 2024-06-02T04:19:45.265 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.266 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.266 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.266 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.266 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.266 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.266 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.266 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.266 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.266 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.266 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.266 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.267 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.267 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.267 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.267 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.267 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.267 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.267 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.267 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.267 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.267 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.267 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.267 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.268 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.268 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.268 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.268 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.268 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.268 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.268 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.268 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.268 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.268 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.268 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.269 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.269 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.269 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.269 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.269 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.269 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.269 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.269 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.269 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.269 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.269 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.269 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.270 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.270 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.270 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.270 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.270 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.270 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.270 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.270 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.271 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.271 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.271 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.271 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.271 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.271 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.271 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.271 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.271 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.271 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.271 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.272 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.272 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.272 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.272 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.272 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.272 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.272 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.272 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.272 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.272 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.272 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.273 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.273 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.273 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.273 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.273 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.273 INFO:teuthology.orchestra.run.smithi123.stdout: "server_addr": { 2024-06-02T04:19:45.273 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_addr", 2024-06-02T04:19:45.273 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.273 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.273 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.273 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.274 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.274 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.274 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.274 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.274 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.274 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.274 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.274 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.274 INFO:teuthology.orchestra.run.smithi123.stdout: "server_port": { 2024-06-02T04:19:45.274 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_port", 2024-06-02T04:19:45.274 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.275 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.275 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.275 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.275 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.275 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.275 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.275 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.275 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.275 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.275 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.275 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.276 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.276 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.276 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.276 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rgw", 2024-06-02T04:19:45.276 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.276 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.276 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.276 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.276 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.276 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.276 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.276 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.277 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.277 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.277 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.277 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.277 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.277 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.277 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.277 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.277 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.277 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.277 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.278 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.278 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.278 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.278 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.278 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.278 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.278 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.278 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.278 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.278 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.278 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.279 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.279 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.279 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.279 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.279 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.279 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.279 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.279 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.279 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.279 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.279 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.280 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.280 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.280 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.280 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.280 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.280 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.280 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.280 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.280 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.280 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.280 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.280 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.281 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.281 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.281 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.281 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.281 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.281 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.281 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.281 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.281 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.281 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.281 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.282 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.282 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.282 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.282 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.282 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.282 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.282 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.282 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.282 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.282 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.282 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.283 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.283 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rook", 2024-06-02T04:19:45.283 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.283 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.283 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.283 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.283 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.283 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.283 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.283 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.283 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.283 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.284 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.284 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.284 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.284 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.284 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.284 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.284 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.284 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.284 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.284 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.284 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.284 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.285 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.285 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.285 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.285 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.285 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.285 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.285 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.285 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.285 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.285 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.286 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.286 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.286 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.286 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.286 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.286 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.286 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.286 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.286 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.286 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.286 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.287 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.287 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.287 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.287 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.287 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.287 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.287 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.287 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.287 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.287 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.287 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.287 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.288 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.288 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.288 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.288 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.288 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.288 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.288 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.288 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.288 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.289 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.289 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.289 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.289 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.289 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.289 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.289 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.289 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.289 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.289 INFO:teuthology.orchestra.run.smithi123.stdout: "storage_class": { 2024-06-02T04:19:45.290 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "storage_class", 2024-06-02T04:19:45.290 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.290 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.290 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.290 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "local", 2024-06-02T04:19:45.290 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.290 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.290 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.290 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-06-02T04:19:45.291 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.291 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.291 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.291 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.291 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.291 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.291 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.291 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "selftest", 2024-06-02T04:19:45.291 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.291 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.291 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.292 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.292 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.292 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.292 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.292 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.292 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.292 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.292 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.292 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.292 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.292 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.293 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.293 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.293 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.293 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.293 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.293 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.293 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.293 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.293 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.293 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.293 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.294 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.294 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.294 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.294 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.294 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.294 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.294 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.294 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.294 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.294 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.294 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.295 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.295 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.295 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.295 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.295 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.295 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.295 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.295 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.295 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.295 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.295 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.296 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.296 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.296 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.296 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.296 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.296 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.296 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.296 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.296 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.296 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.296 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.297 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.297 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.297 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.297 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.297 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.297 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.297 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.297 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.297 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.297 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.297 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.298 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.298 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.298 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.298 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.298 INFO:teuthology.orchestra.run.smithi123.stdout: "roption1": { 2024-06-02T04:19:45.298 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "roption1", 2024-06-02T04:19:45.298 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.298 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.298 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.298 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.298 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.299 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.299 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.299 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.299 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.299 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.299 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.299 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.299 INFO:teuthology.orchestra.run.smithi123.stdout: "roption2": { 2024-06-02T04:19:45.299 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "roption2", 2024-06-02T04:19:45.299 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.299 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.300 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.300 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "xyz", 2024-06-02T04:19:45.300 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.300 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.300 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.300 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.300 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.300 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.300 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.300 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.300 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption1": { 2024-06-02T04:19:45.301 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption1", 2024-06-02T04:19:45.301 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.301 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.301 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.301 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.301 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.301 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.301 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.301 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.301 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.301 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.302 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.302 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.302 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption2": { 2024-06-02T04:19:45.302 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption2", 2024-06-02T04:19:45.302 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.302 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.302 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.302 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.302 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.302 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.302 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.303 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.303 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.303 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.303 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.303 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.303 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption3": { 2024-06-02T04:19:45.303 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption3", 2024-06-02T04:19:45.303 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-06-02T04:19:45.303 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.303 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.303 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.304 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.304 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.304 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.304 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.304 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.304 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.304 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.304 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.304 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption4": { 2024-06-02T04:19:45.304 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption4", 2024-06-02T04:19:45.304 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.304 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.305 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.305 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.305 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.305 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.305 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.305 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.305 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.305 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.305 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.305 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.305 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption5": { 2024-06-02T04:19:45.306 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption5", 2024-06-02T04:19:45.306 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.306 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.306 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.306 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.306 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.306 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.306 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.306 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.306 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.307 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.307 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.307 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.307 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption6": { 2024-06-02T04:19:45.307 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption6", 2024-06-02T04:19:45.307 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.307 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.307 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.307 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.307 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.307 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.308 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.308 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.308 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.308 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.308 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.308 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.308 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption7": { 2024-06-02T04:19:45.308 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption7", 2024-06-02T04:19:45.308 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.308 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.308 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.309 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.309 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "1", 2024-06-02T04:19:45.309 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "42", 2024-06-02T04:19:45.309 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.309 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.309 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.309 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.309 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.309 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.309 INFO:teuthology.orchestra.run.smithi123.stdout: "testkey": { 2024-06-02T04:19:45.309 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "testkey", 2024-06-02T04:19:45.310 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.310 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.310 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.310 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.310 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.310 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.310 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.310 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.310 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.311 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.311 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.311 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.311 INFO:teuthology.orchestra.run.smithi123.stdout: "testlkey": { 2024-06-02T04:19:45.311 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "testlkey", 2024-06-02T04:19:45.311 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.311 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.311 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.311 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.311 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.311 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.312 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.312 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.312 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.312 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.312 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.312 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.312 INFO:teuthology.orchestra.run.smithi123.stdout: "testnewline": { 2024-06-02T04:19:45.312 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "testnewline", 2024-06-02T04:19:45.312 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.312 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.313 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.313 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.313 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.313 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.313 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.313 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.313 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.313 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.313 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.313 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.313 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.313 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.314 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.314 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "snap_schedule", 2024-06-02T04:19:45.314 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.314 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.314 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.314 INFO:teuthology.orchestra.run.smithi123.stdout: "allow_m_granularity": { 2024-06-02T04:19:45.314 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "allow_m_granularity", 2024-06-02T04:19:45.314 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.314 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.314 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.315 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.315 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.315 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.315 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.315 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "allow minute scheduled snapshots", 2024-06-02T04:19:45.315 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.315 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.315 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.315 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.315 INFO:teuthology.orchestra.run.smithi123.stdout: "dump_on_update": { 2024-06-02T04:19:45.316 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "dump_on_update", 2024-06-02T04:19:45.316 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.316 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.316 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.316 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.316 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.316 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.316 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.316 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "dump database to debug log on update", 2024-06-02T04:19:45.316 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.316 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.317 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.317 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.317 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.317 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.317 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.317 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.317 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.317 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.317 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.317 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.318 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.318 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.318 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.318 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.318 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.318 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.318 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.318 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.318 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.318 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.318 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.319 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.319 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.319 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.319 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.319 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.319 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.319 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.319 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.319 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.319 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.319 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.320 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.320 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.320 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.320 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.320 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.320 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.320 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.320 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.320 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.320 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.320 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.321 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.321 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.321 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.321 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.321 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.321 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.321 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.321 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.321 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.321 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.322 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.322 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.322 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.322 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.322 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.322 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.322 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.322 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.322 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.322 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.322 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.323 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.323 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.323 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.323 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.323 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.323 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.323 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.323 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.323 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.323 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.323 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.324 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "stats", 2024-06-02T04:19:45.324 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.324 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.324 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.324 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.324 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.324 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.324 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.324 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.325 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.325 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.325 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.325 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.325 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.325 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.325 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.325 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.325 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.325 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.325 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.325 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.326 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.326 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.326 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.326 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.326 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.326 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.326 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.326 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.326 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.326 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.327 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.327 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.327 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.327 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.327 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.327 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.327 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.327 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.327 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.327 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.327 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.328 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.328 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.328 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.328 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.328 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.328 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.328 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.328 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.328 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.328 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.328 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.328 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.329 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.329 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.329 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.329 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.329 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.329 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.329 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.329 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.329 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.329 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.329 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.330 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.330 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.330 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.330 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.330 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.330 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.330 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.330 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.330 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.330 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.330 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.331 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.331 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "status", 2024-06-02T04:19:45.331 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.331 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.331 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.331 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.331 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.331 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.331 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.331 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.331 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.332 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.332 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.332 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.332 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.332 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.332 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.332 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.332 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.332 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.332 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.332 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.333 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.333 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.333 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.333 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.333 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.333 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.333 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.333 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.333 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.333 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.333 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.334 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.334 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.334 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.334 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.334 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.334 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.334 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.334 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.334 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.334 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.335 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.335 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.335 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.335 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.335 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.335 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.335 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.335 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.335 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.335 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.335 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.335 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.336 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.336 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.336 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.336 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.336 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.336 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.336 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.336 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.336 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.336 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.336 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.336 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.337 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.337 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.337 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.337 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.337 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.337 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.337 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.337 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.337 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.337 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.337 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.338 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "telegraf", 2024-06-02T04:19:45.338 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.338 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.338 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.338 INFO:teuthology.orchestra.run.smithi123.stdout: "address": { 2024-06-02T04:19:45.338 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "address", 2024-06-02T04:19:45.338 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.338 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.338 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.338 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-06-02T04:19:45.338 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.339 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.339 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.339 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.339 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.339 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.339 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.339 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.339 INFO:teuthology.orchestra.run.smithi123.stdout: "interval": { 2024-06-02T04:19:45.339 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "interval", 2024-06-02T04:19:45.339 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:45.339 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.339 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.340 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "15", 2024-06-02T04:19:45.340 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.340 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.340 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.340 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.340 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.340 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.340 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.340 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.340 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.340 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.340 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.341 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.341 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.341 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.341 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.341 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.341 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.341 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.341 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.341 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.341 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.341 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.342 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.342 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.342 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.342 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.342 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.342 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.342 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.342 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.342 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.342 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.343 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.343 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.343 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.343 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.343 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.343 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.343 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.343 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.343 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.343 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.343 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.344 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.344 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.344 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.344 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.344 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.344 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.344 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.344 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.344 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.344 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.344 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.344 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.345 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.345 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.345 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.345 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.345 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.345 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.345 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.345 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.345 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.345 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.345 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.345 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.346 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.346 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.346 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.346 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.346 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.346 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.346 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.346 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.346 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.346 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.346 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.347 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.347 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.347 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.347 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "telemetry", 2024-06-02T04:19:45.347 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.347 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.347 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.347 INFO:teuthology.orchestra.run.smithi123.stdout: "channel_basic": { 2024-06-02T04:19:45.347 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "channel_basic", 2024-06-02T04:19:45.347 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.347 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.348 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.348 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.348 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.348 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.348 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.348 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Share basic cluster information (size, version)", 2024-06-02T04:19:45.348 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.348 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.348 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.348 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.348 INFO:teuthology.orchestra.run.smithi123.stdout: "channel_crash": { 2024-06-02T04:19:45.348 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "channel_crash", 2024-06-02T04:19:45.349 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.349 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.349 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.349 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.349 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.349 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.349 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.349 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-06-02T04:19:45.349 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.349 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.349 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.350 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.350 INFO:teuthology.orchestra.run.smithi123.stdout: "channel_device": { 2024-06-02T04:19:45.350 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "channel_device", 2024-06-02T04:19:45.350 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.350 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.350 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.350 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.350 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.350 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.350 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.351 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-06-02T04:19:45.351 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.351 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.351 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.351 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.351 INFO:teuthology.orchestra.run.smithi123.stdout: "channel_ident": { 2024-06-02T04:19:45.351 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "channel_ident", 2024-06-02T04:19:45.351 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.351 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.351 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.351 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.352 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.352 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.352 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.352 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-06-02T04:19:45.352 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.352 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.352 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.352 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.352 INFO:teuthology.orchestra.run.smithi123.stdout: "channel_perf": { 2024-06-02T04:19:45.352 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "channel_perf", 2024-06-02T04:19:45.352 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.352 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.353 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.353 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.353 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.353 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.353 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.353 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Share various performance metrics of a cluster", 2024-06-02T04:19:45.353 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.353 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.353 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.353 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.353 INFO:teuthology.orchestra.run.smithi123.stdout: "contact": { 2024-06-02T04:19:45.353 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "contact", 2024-06-02T04:19:45.354 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.354 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.354 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.354 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.354 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.354 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.354 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.354 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.354 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.354 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.354 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.355 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.355 INFO:teuthology.orchestra.run.smithi123.stdout: "description": { 2024-06-02T04:19:45.355 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "description", 2024-06-02T04:19:45.355 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.355 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.355 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.355 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.355 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.355 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.355 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.355 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.355 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.356 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.356 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.356 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.356 INFO:teuthology.orchestra.run.smithi123.stdout: "device_url": { 2024-06-02T04:19:45.356 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "device_url", 2024-06-02T04:19:45.356 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.356 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.356 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.356 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-06-02T04:19:45.356 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.356 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.356 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.357 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.357 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.357 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.357 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.357 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.357 INFO:teuthology.orchestra.run.smithi123.stdout: "enabled": { 2024-06-02T04:19:45.357 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "enabled", 2024-06-02T04:19:45.357 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.357 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.357 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.357 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.358 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.358 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.358 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.358 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.358 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.358 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.358 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.358 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.358 INFO:teuthology.orchestra.run.smithi123.stdout: "interval": { 2024-06-02T04:19:45.358 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "interval", 2024-06-02T04:19:45.359 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.359 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.359 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.359 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "24", 2024-06-02T04:19:45.359 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "8", 2024-06-02T04:19:45.359 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.359 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.359 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.359 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.359 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.359 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.360 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.360 INFO:teuthology.orchestra.run.smithi123.stdout: "last_opt_revision": { 2024-06-02T04:19:45.360 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "last_opt_revision", 2024-06-02T04:19:45.360 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.360 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.360 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.360 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "1", 2024-06-02T04:19:45.360 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.360 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.360 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.360 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.361 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.361 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.361 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.361 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.361 INFO:teuthology.orchestra.run.smithi123.stdout: "leaderboard": { 2024-06-02T04:19:45.361 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "leaderboard", 2024-06-02T04:19:45.361 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.361 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.361 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.361 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.361 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.361 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.362 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.362 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.362 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.362 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.362 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.362 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.362 INFO:teuthology.orchestra.run.smithi123.stdout: "leaderboard_description": { 2024-06-02T04:19:45.362 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "leaderboard_description", 2024-06-02T04:19:45.362 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.362 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.362 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.363 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.363 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.366 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.366 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.366 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.366 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.366 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.366 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.366 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.366 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.366 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.366 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.367 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.367 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.367 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.367 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.367 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.367 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.367 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.367 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.367 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.367 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.367 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.368 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.368 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.368 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.368 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.368 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.368 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.368 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.368 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.368 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.368 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.368 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.368 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.369 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.369 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.369 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.369 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.369 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.369 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.369 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.369 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.369 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.369 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.369 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.370 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.370 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.370 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.370 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.370 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.370 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.370 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.370 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.370 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.370 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.370 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.371 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.371 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.371 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.371 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.371 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.371 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.371 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.371 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.371 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.371 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.371 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.371 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.372 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.372 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.372 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.372 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.372 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.372 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.372 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.372 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.372 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.372 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.372 INFO:teuthology.orchestra.run.smithi123.stdout: "organization": { 2024-06-02T04:19:45.373 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "organization", 2024-06-02T04:19:45.373 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.373 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.373 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.373 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.373 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.373 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.373 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.373 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.373 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.373 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.374 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.374 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.374 INFO:teuthology.orchestra.run.smithi123.stdout: "proxy": { 2024-06-02T04:19:45.374 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "proxy", 2024-06-02T04:19:45.374 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.374 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.374 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.374 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.374 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.374 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.375 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.375 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.375 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.375 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.375 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.375 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.375 INFO:teuthology.orchestra.run.smithi123.stdout: "url": { 2024-06-02T04:19:45.375 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "url", 2024-06-02T04:19:45.375 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.375 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.375 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.376 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-06-02T04:19:45.376 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.376 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.376 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.376 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.376 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.376 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.376 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.376 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.376 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.376 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.377 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.377 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "test_orchestrator", 2024-06-02T04:19:45.377 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.377 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.377 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.377 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.377 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.377 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.377 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.377 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.377 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.378 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.378 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.378 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.378 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.378 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.378 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.378 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.378 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.378 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.378 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.378 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.379 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.379 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.379 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.379 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.379 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.379 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.379 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.379 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.379 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.379 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.380 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.380 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.380 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.380 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.380 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.380 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.380 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.380 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.380 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.380 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.381 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.381 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.381 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.381 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.381 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.381 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.381 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.381 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.381 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.381 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.381 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.382 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.382 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.382 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.382 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.382 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.382 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.382 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.382 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.382 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.382 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.383 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.383 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.383 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.383 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.383 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.383 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.383 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.383 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.383 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.383 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.383 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.384 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.384 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.384 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.384 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.384 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "volumes", 2024-06-02T04:19:45.384 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.384 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.384 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.384 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.384 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.384 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.384 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.385 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.385 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.385 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.385 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.385 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.385 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.385 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.385 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.385 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.385 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.385 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.386 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.386 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.386 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.386 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.386 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.386 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.386 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.386 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.386 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.386 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.387 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.387 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.387 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.387 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.387 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.387 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.387 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.387 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.387 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.387 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.387 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.388 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.388 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.388 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.388 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.388 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.388 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.388 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.388 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.388 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.388 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.388 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.388 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.389 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.389 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.389 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.389 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.389 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.389 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.389 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.389 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.389 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.390 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.390 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.390 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.390 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.390 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.390 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.390 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.390 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.390 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.390 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.390 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.391 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.391 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.391 INFO:teuthology.orchestra.run.smithi123.stdout: "max_concurrent_clones": { 2024-06-02T04:19:45.391 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "max_concurrent_clones", 2024-06-02T04:19:45.391 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.391 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.391 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.391 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "4", 2024-06-02T04:19:45.391 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.391 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.391 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.392 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Number of asynchronous cloner threads", 2024-06-02T04:19:45.392 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.392 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.392 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.392 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.392 INFO:teuthology.orchestra.run.smithi123.stdout: "snapshot_clone_delay": { 2024-06-02T04:19:45.392 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "snapshot_clone_delay", 2024-06-02T04:19:45.392 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.392 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.392 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.393 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0", 2024-06-02T04:19:45.393 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.393 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.393 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.393 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-06-02T04:19:45.393 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.393 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.393 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.393 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.393 INFO:teuthology.orchestra.run.smithi123.stdout: "snapshot_clone_no_wait": { 2024-06-02T04:19:45.393 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "snapshot_clone_no_wait", 2024-06-02T04:19:45.393 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.394 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.394 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.394 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.394 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.394 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.394 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.394 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-06-02T04:19:45.394 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.394 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.394 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.395 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.395 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.395 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.395 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.395 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "zabbix", 2024-06-02T04:19:45.395 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.395 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.395 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.395 INFO:teuthology.orchestra.run.smithi123.stdout: "discovery_interval": { 2024-06-02T04:19:45.395 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "discovery_interval", 2024-06-02T04:19:45.395 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "uint", 2024-06-02T04:19:45.396 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.396 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.396 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "100", 2024-06-02T04:19:45.396 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.396 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.396 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.396 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.396 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.396 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.396 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.397 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.397 INFO:teuthology.orchestra.run.smithi123.stdout: "identifier": { 2024-06-02T04:19:45.397 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "identifier", 2024-06-02T04:19:45.397 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.397 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.397 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.397 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.397 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.397 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.397 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.398 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.398 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.398 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.398 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.398 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.398 INFO:teuthology.orchestra.run.smithi123.stdout: "interval": { 2024-06-02T04:19:45.398 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "interval", 2024-06-02T04:19:45.398 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:45.398 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.398 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.398 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "60", 2024-06-02T04:19:45.399 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.399 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.399 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.399 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.399 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.399 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.399 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.399 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.399 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.399 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.399 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.400 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.400 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.400 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.400 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.400 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.400 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.400 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.400 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.400 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.400 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.400 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.401 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.401 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.401 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.401 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.401 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.401 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.401 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.401 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.401 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.401 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.402 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.402 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.402 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.402 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.402 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.402 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.402 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.402 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.402 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.402 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.402 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.403 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.403 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.403 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.403 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.403 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.403 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.403 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.403 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.403 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.403 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.403 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.404 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.404 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.404 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.404 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.404 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.404 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.404 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.404 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.404 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.404 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.404 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.405 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.405 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.405 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.405 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.405 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.405 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.405 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.405 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.405 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.405 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.405 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.406 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.406 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.406 INFO:teuthology.orchestra.run.smithi123.stdout: "zabbix_host": { 2024-06-02T04:19:45.406 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "zabbix_host", 2024-06-02T04:19:45.406 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.406 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.406 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.406 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.406 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.406 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.407 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.407 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.407 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.407 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.407 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.407 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.407 INFO:teuthology.orchestra.run.smithi123.stdout: "zabbix_port": { 2024-06-02T04:19:45.407 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "zabbix_port", 2024-06-02T04:19:45.407 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.407 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.407 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.407 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10051", 2024-06-02T04:19:45.408 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.408 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.408 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.408 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.408 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.408 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.408 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.408 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.408 INFO:teuthology.orchestra.run.smithi123.stdout: "zabbix_sender": { 2024-06-02T04:19:45.408 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "zabbix_sender", 2024-06-02T04:19:45.408 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.409 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.409 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.409 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-06-02T04:19:45.409 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.409 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.409 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.409 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.409 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.409 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.409 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.410 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.410 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.410 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.410 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-06-02T04:19:45.410 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.410 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.410 INFO:teuthology.orchestra.run.smithi123.stdout: "gid": 24121, 2024-06-02T04:19:45.410 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "y", 2024-06-02T04:19:45.410 INFO:teuthology.orchestra.run.smithi123.stdout: "mgr_features": 4540138322906710015, 2024-06-02T04:19:45.410 INFO:teuthology.orchestra.run.smithi123.stdout: "available_modules": [ 2024-06-02T04:19:45.410 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.411 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "alerts", 2024-06-02T04:19:45.411 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.411 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.411 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.411 INFO:teuthology.orchestra.run.smithi123.stdout: "interval": { 2024-06-02T04:19:45.411 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "interval", 2024-06-02T04:19:45.411 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:45.411 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.411 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.411 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "60", 2024-06-02T04:19:45.411 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.412 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.412 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.412 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "How frequently to reexamine health status", 2024-06-02T04:19:45.412 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.412 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.412 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.412 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.412 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.412 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.412 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.412 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.413 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.413 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.413 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.413 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.413 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.413 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.413 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.413 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.413 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.413 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.413 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.414 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.414 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.414 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.414 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.414 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.414 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.414 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.414 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.414 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.414 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.414 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.415 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.415 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.415 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.415 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.415 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.415 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.415 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.415 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.415 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.415 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.416 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.416 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.416 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.416 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.416 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.416 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.416 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.416 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.416 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.416 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.416 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.417 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.417 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.417 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.417 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.417 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.417 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.417 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.417 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.417 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.417 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.417 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.418 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.418 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.418 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.418 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.418 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.418 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.418 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.418 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.418 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.418 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.418 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.419 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.419 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_destination": { 2024-06-02T04:19:45.419 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_destination", 2024-06-02T04:19:45.419 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.419 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.419 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.419 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.419 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.419 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.419 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.420 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Email address to send alerts to", 2024-06-02T04:19:45.420 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.420 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.420 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.420 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.420 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_from_name": { 2024-06-02T04:19:45.420 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_from_name", 2024-06-02T04:19:45.420 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.420 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.420 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.420 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "Ceph", 2024-06-02T04:19:45.420 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.421 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.421 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.421 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Email From: name", 2024-06-02T04:19:45.421 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.421 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.421 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.421 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.421 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_host": { 2024-06-02T04:19:45.421 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_host", 2024-06-02T04:19:45.421 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.421 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.422 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.422 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.422 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.422 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.422 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.422 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "SMTP server", 2024-06-02T04:19:45.422 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.422 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.422 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.422 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.423 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_password": { 2024-06-02T04:19:45.423 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_password", 2024-06-02T04:19:45.423 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.423 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.423 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.423 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.423 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.423 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.423 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.423 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Password to authenticate with", 2024-06-02T04:19:45.423 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.424 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.424 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.424 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.424 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_port": { 2024-06-02T04:19:45.424 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_port", 2024-06-02T04:19:45.424 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.424 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.424 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.424 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "465", 2024-06-02T04:19:45.424 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.424 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.425 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.425 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "SMTP port", 2024-06-02T04:19:45.425 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.425 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.425 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.425 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.425 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_sender": { 2024-06-02T04:19:45.425 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_sender", 2024-06-02T04:19:45.425 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.425 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.425 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.426 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.426 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.426 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.426 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.426 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "SMTP envelope sender", 2024-06-02T04:19:45.426 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.426 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.426 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.426 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.426 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_ssl": { 2024-06-02T04:19:45.427 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_ssl", 2024-06-02T04:19:45.427 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.427 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.427 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.427 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.427 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.427 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.427 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.427 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Use SSL to connect to SMTP server", 2024-06-02T04:19:45.427 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.427 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.427 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.428 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.428 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_user": { 2024-06-02T04:19:45.428 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_user", 2024-06-02T04:19:45.428 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.428 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.428 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.428 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.428 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.428 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.428 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.429 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "User to authenticate as", 2024-06-02T04:19:45.429 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.429 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.429 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.429 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.429 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.429 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.429 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.429 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "balancer", 2024-06-02T04:19:45.429 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.429 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.429 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.430 INFO:teuthology.orchestra.run.smithi123.stdout: "active": { 2024-06-02T04:19:45.430 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "active", 2024-06-02T04:19:45.430 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.430 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.430 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.430 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.430 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.430 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.430 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.430 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "automatically balance PGs across cluster", 2024-06-02T04:19:45.430 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.431 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.431 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.431 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.431 INFO:teuthology.orchestra.run.smithi123.stdout: "begin_time": { 2024-06-02T04:19:45.431 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "begin_time", 2024-06-02T04:19:45.431 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.431 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.431 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.431 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0000", 2024-06-02T04:19:45.431 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.431 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.431 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.432 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "beginning time of day to automatically balance", 2024-06-02T04:19:45.432 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-02T04:19:45.432 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.432 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.432 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.432 INFO:teuthology.orchestra.run.smithi123.stdout: "begin_weekday": { 2024-06-02T04:19:45.432 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "begin_weekday", 2024-06-02T04:19:45.432 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "uint", 2024-06-02T04:19:45.432 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.432 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.433 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0", 2024-06-02T04:19:45.433 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "0", 2024-06-02T04:19:45.433 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "6", 2024-06-02T04:19:45.433 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.433 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-06-02T04:19:45.433 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-02T04:19:45.433 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.433 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.433 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.433 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_compat_max_iterations": { 2024-06-02T04:19:45.433 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "crush_compat_max_iterations", 2024-06-02T04:19:45.433 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "uint", 2024-06-02T04:19:45.434 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.434 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.434 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "25", 2024-06-02T04:19:45.434 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "1", 2024-06-02T04:19:45.434 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "250", 2024-06-02T04:19:45.434 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.434 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-06-02T04:19:45.434 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.434 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.434 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.434 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.435 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_compat_metrics": { 2024-06-02T04:19:45.435 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "crush_compat_metrics", 2024-06-02T04:19:45.435 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.435 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.435 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.435 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "pgs,objects,bytes", 2024-06-02T04:19:45.435 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.435 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.435 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.435 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-06-02T04:19:45.435 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-06-02T04:19:45.436 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.436 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.436 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.436 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_compat_step": { 2024-06-02T04:19:45.436 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "crush_compat_step", 2024-06-02T04:19:45.436 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-06-02T04:19:45.436 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.436 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.436 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0.5", 2024-06-02T04:19:45.436 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "0.001", 2024-06-02T04:19:45.436 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "0.999", 2024-06-02T04:19:45.437 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.437 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "aggressiveness of optimization", 2024-06-02T04:19:45.437 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-06-02T04:19:45.437 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.437 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.437 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.437 INFO:teuthology.orchestra.run.smithi123.stdout: "end_time": { 2024-06-02T04:19:45.437 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "end_time", 2024-06-02T04:19:45.437 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.437 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.437 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.438 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "2359", 2024-06-02T04:19:45.438 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.438 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.438 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.438 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "ending time of day to automatically balance", 2024-06-02T04:19:45.438 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-02T04:19:45.438 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.438 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.438 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.438 INFO:teuthology.orchestra.run.smithi123.stdout: "end_weekday": { 2024-06-02T04:19:45.438 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "end_weekday", 2024-06-02T04:19:45.439 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "uint", 2024-06-02T04:19:45.439 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.439 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.439 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0", 2024-06-02T04:19:45.439 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "0", 2024-06-02T04:19:45.439 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "6", 2024-06-02T04:19:45.439 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.439 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-06-02T04:19:45.439 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-02T04:19:45.439 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.439 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.440 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.440 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.440 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.440 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.440 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.440 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.440 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.440 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.440 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.440 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.440 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.441 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.441 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.441 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.441 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.441 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.441 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.441 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.441 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.441 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.441 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.441 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.442 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.442 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.442 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.442 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.442 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.442 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.442 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.442 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.442 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.442 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.442 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.442 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.443 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.443 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.443 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.443 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.443 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.443 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.443 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.443 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.443 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.443 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.443 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.444 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.444 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.444 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.444 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.444 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.444 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.444 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.444 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.444 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.444 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.444 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.445 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.445 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.445 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.445 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.445 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.445 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.445 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.445 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.445 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.445 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.445 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.445 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.446 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.446 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.446 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.446 INFO:teuthology.orchestra.run.smithi123.stdout: "min_score": { 2024-06-02T04:19:45.446 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "min_score", 2024-06-02T04:19:45.446 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-06-02T04:19:45.446 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.446 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.446 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0", 2024-06-02T04:19:45.446 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.446 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.447 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.447 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-06-02T04:19:45.447 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.447 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.447 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.447 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.447 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": { 2024-06-02T04:19:45.447 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mode", 2024-06-02T04:19:45.447 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.447 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.447 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.448 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "upmap", 2024-06-02T04:19:45.448 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.448 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.448 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.448 INFO:teuthology.orchestra.run.smithi123.stdout: "crush-compat", 2024-06-02T04:19:45.448 INFO:teuthology.orchestra.run.smithi123.stdout: "none", 2024-06-02T04:19:45.448 INFO:teuthology.orchestra.run.smithi123.stdout: "upmap" 2024-06-02T04:19:45.448 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.448 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Balancer mode", 2024-06-02T04:19:45.448 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.449 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.449 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.449 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.449 INFO:teuthology.orchestra.run.smithi123.stdout: "pool_ids": { 2024-06-02T04:19:45.449 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "pool_ids", 2024-06-02T04:19:45.449 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.449 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.449 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.449 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.449 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.449 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.449 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.450 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-06-02T04:19:45.450 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.450 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.450 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.450 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.450 INFO:teuthology.orchestra.run.smithi123.stdout: "sleep_interval": { 2024-06-02T04:19:45.450 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "sleep_interval", 2024-06-02T04:19:45.450 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:45.450 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.450 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.451 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "60", 2024-06-02T04:19:45.451 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.451 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.451 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.451 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-06-02T04:19:45.451 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.451 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.451 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.451 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.451 INFO:teuthology.orchestra.run.smithi123.stdout: "upmap_max_deviation": { 2024-06-02T04:19:45.452 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "upmap_max_deviation", 2024-06-02T04:19:45.452 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.452 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.452 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.452 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "5", 2024-06-02T04:19:45.452 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "1", 2024-06-02T04:19:45.452 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.452 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.452 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "deviation below which no optimization is attempted", 2024-06-02T04:19:45.452 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-06-02T04:19:45.452 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.453 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.453 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.453 INFO:teuthology.orchestra.run.smithi123.stdout: "upmap_max_optimizations": { 2024-06-02T04:19:45.453 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "upmap_max_optimizations", 2024-06-02T04:19:45.453 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "uint", 2024-06-02T04:19:45.453 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.453 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.453 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-06-02T04:19:45.453 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.453 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.453 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.454 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-06-02T04:19:45.454 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.454 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.454 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.454 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.454 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.454 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.454 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.454 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "cephadm", 2024-06-02T04:19:45.454 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.455 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.455 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.455 INFO:teuthology.orchestra.run.smithi123.stdout: "agent_down_multiplier": { 2024-06-02T04:19:45.455 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "agent_down_multiplier", 2024-06-02T04:19:45.455 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-06-02T04:19:45.455 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.455 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.455 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "3.0", 2024-06-02T04:19:45.455 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.455 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.456 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.456 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-06-02T04:19:45.456 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.456 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.456 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.456 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.456 INFO:teuthology.orchestra.run.smithi123.stdout: "agent_refresh_rate": { 2024-06-02T04:19:45.456 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "agent_refresh_rate", 2024-06-02T04:19:45.456 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:45.456 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.457 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.457 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "20", 2024-06-02T04:19:45.457 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.457 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.457 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.457 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-06-02T04:19:45.457 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.457 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.457 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.457 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.458 INFO:teuthology.orchestra.run.smithi123.stdout: "agent_starting_port": { 2024-06-02T04:19:45.458 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "agent_starting_port", 2024-06-02T04:19:45.458 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.458 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.458 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.458 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "4721", 2024-06-02T04:19:45.458 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.458 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.458 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.458 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-06-02T04:19:45.459 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.459 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.459 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.459 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.459 INFO:teuthology.orchestra.run.smithi123.stdout: "allow_ptrace": { 2024-06-02T04:19:45.459 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "allow_ptrace", 2024-06-02T04:19:45.459 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.459 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.459 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.459 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.459 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.459 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.460 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.460 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-06-02T04:19:45.460 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-06-02T04:19:45.460 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.460 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.460 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.460 INFO:teuthology.orchestra.run.smithi123.stdout: "autotune_interval": { 2024-06-02T04:19:45.460 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "autotune_interval", 2024-06-02T04:19:45.460 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:45.460 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.461 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.461 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "600", 2024-06-02T04:19:45.461 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.461 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.461 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.461 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how frequently to autotune daemon memory", 2024-06-02T04:19:45.461 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.461 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.461 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.461 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.461 INFO:teuthology.orchestra.run.smithi123.stdout: "autotune_memory_target_ratio": { 2024-06-02T04:19:45.461 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "autotune_memory_target_ratio", 2024-06-02T04:19:45.462 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-06-02T04:19:45.462 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.462 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.462 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0.7", 2024-06-02T04:19:45.462 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.462 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.462 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.462 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-06-02T04:19:45.462 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.462 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.463 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.463 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.463 INFO:teuthology.orchestra.run.smithi123.stdout: "cgroups_split": { 2024-06-02T04:19:45.463 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "cgroups_split", 2024-06-02T04:19:45.463 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.463 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.463 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.463 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.463 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.463 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.464 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.464 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-06-02T04:19:45.464 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.464 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.464 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.464 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.464 INFO:teuthology.orchestra.run.smithi123.stdout: "config_checks_enabled": { 2024-06-02T04:19:45.464 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "config_checks_enabled", 2024-06-02T04:19:45.464 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.465 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.465 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.465 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.465 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.465 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.465 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.465 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-06-02T04:19:45.465 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.465 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.465 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.465 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.466 INFO:teuthology.orchestra.run.smithi123.stdout: "config_dashboard": { 2024-06-02T04:19:45.466 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "config_dashboard", 2024-06-02T04:19:45.466 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.466 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.466 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.466 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.466 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.466 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.466 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.466 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-06-02T04:19:45.467 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.467 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.467 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.467 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.467 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_alertmanager": { 2024-06-02T04:19:45.467 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_alertmanager", 2024-06-02T04:19:45.467 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.467 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.467 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.467 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-06-02T04:19:45.468 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.468 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.468 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.468 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Prometheus container image", 2024-06-02T04:19:45.468 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.468 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.468 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.468 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.468 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_base": { 2024-06-02T04:19:45.468 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_base", 2024-06-02T04:19:45.469 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.469 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.469 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.469 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/ceph/ceph", 2024-06-02T04:19:45.469 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.469 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.469 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.469 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Container image name, without the tag", 2024-06-02T04:19:45.469 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.469 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.470 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.470 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.470 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_elasticsearch": { 2024-06-02T04:19:45.470 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_elasticsearch", 2024-06-02T04:19:45.470 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.470 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.470 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.470 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-06-02T04:19:45.470 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.470 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.471 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.471 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "elasticsearch container image", 2024-06-02T04:19:45.471 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.471 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.471 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.471 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.471 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_grafana": { 2024-06-02T04:19:45.471 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_grafana", 2024-06-02T04:19:45.471 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.471 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.471 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.472 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-06-02T04:19:45.472 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.472 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.472 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.472 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Prometheus container image", 2024-06-02T04:19:45.472 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.472 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.472 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.472 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.472 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_haproxy": { 2024-06-02T04:19:45.472 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_haproxy", 2024-06-02T04:19:45.473 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.473 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.473 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.473 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-06-02T04:19:45.473 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.473 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.473 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.473 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "HAproxy container image", 2024-06-02T04:19:45.473 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.473 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.473 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.474 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.474 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_jaeger_agent": { 2024-06-02T04:19:45.474 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_jaeger_agent", 2024-06-02T04:19:45.474 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.474 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.474 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.474 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-06-02T04:19:45.474 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.474 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.474 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.474 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Jaeger agent container image", 2024-06-02T04:19:45.475 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.475 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.475 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.475 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.475 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_jaeger_collector": { 2024-06-02T04:19:45.475 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_jaeger_collector", 2024-06-02T04:19:45.475 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.475 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.475 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.475 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-06-02T04:19:45.475 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.476 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.476 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.476 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Jaeger collector container image", 2024-06-02T04:19:45.476 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.476 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.476 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.476 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.476 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_jaeger_query": { 2024-06-02T04:19:45.476 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_jaeger_query", 2024-06-02T04:19:45.476 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.476 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.477 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.477 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-06-02T04:19:45.477 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.477 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.477 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.477 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Jaeger query container image", 2024-06-02T04:19:45.477 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.477 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.477 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.477 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.477 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_keepalived": { 2024-06-02T04:19:45.477 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_keepalived", 2024-06-02T04:19:45.478 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.478 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.478 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.478 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-06-02T04:19:45.478 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.478 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.478 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.478 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Keepalived container image", 2024-06-02T04:19:45.478 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.478 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.478 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.479 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.479 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_loki": { 2024-06-02T04:19:45.479 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_loki", 2024-06-02T04:19:45.479 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.479 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.479 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.479 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-06-02T04:19:45.479 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.479 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.479 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.479 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Loki container image", 2024-06-02T04:19:45.480 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.480 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.480 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.480 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.480 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_node_exporter": { 2024-06-02T04:19:45.480 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_node_exporter", 2024-06-02T04:19:45.480 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.480 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.480 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.480 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-06-02T04:19:45.481 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.481 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.481 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.481 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Prometheus container image", 2024-06-02T04:19:45.481 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.481 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.481 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.481 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.481 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_nvmeof": { 2024-06-02T04:19:45.481 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_nvmeof", 2024-06-02T04:19:45.481 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.482 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.482 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.482 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-06-02T04:19:45.482 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.482 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.482 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.482 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Nvme-of container image", 2024-06-02T04:19:45.482 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.482 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.482 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.483 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.483 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_prometheus": { 2024-06-02T04:19:45.483 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_prometheus", 2024-06-02T04:19:45.483 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.483 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.483 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.483 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-06-02T04:19:45.483 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.483 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.483 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.483 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Prometheus container image", 2024-06-02T04:19:45.484 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.484 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.484 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.484 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.484 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_promtail": { 2024-06-02T04:19:45.484 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_promtail", 2024-06-02T04:19:45.484 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.484 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.484 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.484 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-06-02T04:19:45.484 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.484 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.485 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.485 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Promtail container image", 2024-06-02T04:19:45.485 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.485 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.485 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.485 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.485 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_snmp_gateway": { 2024-06-02T04:19:45.485 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_snmp_gateway", 2024-06-02T04:19:45.485 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.485 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.485 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.486 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-06-02T04:19:45.486 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.486 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.486 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.486 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "SNMP Gateway container image", 2024-06-02T04:19:45.486 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.486 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.486 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.486 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.486 INFO:teuthology.orchestra.run.smithi123.stdout: "container_init": { 2024-06-02T04:19:45.487 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_init", 2024-06-02T04:19:45.487 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.487 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.487 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.487 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.487 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.487 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.487 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.487 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Run podman/docker with `--init`", 2024-06-02T04:19:45.487 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.487 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.488 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.488 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.488 INFO:teuthology.orchestra.run.smithi123.stdout: "daemon_cache_timeout": { 2024-06-02T04:19:45.488 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "daemon_cache_timeout", 2024-06-02T04:19:45.488 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:45.488 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.488 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.488 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "600", 2024-06-02T04:19:45.488 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.488 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.488 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.489 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-06-02T04:19:45.489 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.489 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.489 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.489 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.489 INFO:teuthology.orchestra.run.smithi123.stdout: "default_cephadm_command_timeout": { 2024-06-02T04:19:45.489 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "default_cephadm_command_timeout", 2024-06-02T04:19:45.489 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.489 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.489 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.489 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "900", 2024-06-02T04:19:45.490 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.490 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.490 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.490 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-06-02T04:19:45.490 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.490 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.490 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.490 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.490 INFO:teuthology.orchestra.run.smithi123.stdout: "default_registry": { 2024-06-02T04:19:45.490 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "default_registry", 2024-06-02T04:19:45.491 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.491 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.491 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.491 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "docker.io", 2024-06-02T04:19:45.491 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.491 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.491 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.491 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-06-02T04:19:45.491 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.491 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.491 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.491 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.492 INFO:teuthology.orchestra.run.smithi123.stdout: "device_cache_timeout": { 2024-06-02T04:19:45.492 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "device_cache_timeout", 2024-06-02T04:19:45.492 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:45.492 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.492 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.492 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "1800", 2024-06-02T04:19:45.492 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.492 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.492 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.492 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "seconds to cache device inventory", 2024-06-02T04:19:45.492 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.493 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.493 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.493 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.493 INFO:teuthology.orchestra.run.smithi123.stdout: "device_enhanced_scan": { 2024-06-02T04:19:45.493 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "device_enhanced_scan", 2024-06-02T04:19:45.493 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.493 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.493 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.493 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.493 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.493 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.493 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.494 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Use libstoragemgmt during device scans", 2024-06-02T04:19:45.494 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.494 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.494 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.494 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.494 INFO:teuthology.orchestra.run.smithi123.stdout: "facts_cache_timeout": { 2024-06-02T04:19:45.494 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "facts_cache_timeout", 2024-06-02T04:19:45.494 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:45.494 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.494 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.494 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "60", 2024-06-02T04:19:45.495 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.495 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.495 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.495 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "seconds to cache host facts data", 2024-06-02T04:19:45.495 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.495 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.495 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.495 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.495 INFO:teuthology.orchestra.run.smithi123.stdout: "host_check_interval": { 2024-06-02T04:19:45.495 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "host_check_interval", 2024-06-02T04:19:45.496 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:45.496 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.496 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.496 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "600", 2024-06-02T04:19:45.496 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.496 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.496 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.496 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how frequently to perform a host check", 2024-06-02T04:19:45.496 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.496 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.496 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.497 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.497 INFO:teuthology.orchestra.run.smithi123.stdout: "hw_monitoring": { 2024-06-02T04:19:45.497 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "hw_monitoring", 2024-06-02T04:19:45.497 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.497 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.497 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.497 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.497 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.497 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.497 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.498 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-06-02T04:19:45.498 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.498 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.498 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.498 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.498 INFO:teuthology.orchestra.run.smithi123.stdout: "inventory_list_all": { 2024-06-02T04:19:45.498 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "inventory_list_all", 2024-06-02T04:19:45.498 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.498 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.498 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.499 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.499 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.499 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.499 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.499 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-06-02T04:19:45.499 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.499 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.499 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.499 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.499 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.499 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.500 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.500 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.500 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.500 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.500 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.500 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.500 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.500 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.500 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.501 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.501 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.501 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.501 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.501 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.501 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.501 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.501 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.501 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.501 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.501 INFO:teuthology.orchestra.run.smithi123.stdout: "log_refresh_metadata": { 2024-06-02T04:19:45.502 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_refresh_metadata", 2024-06-02T04:19:45.502 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.502 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.502 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.502 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.502 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.502 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.502 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.502 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-06-02T04:19:45.502 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.503 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.503 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.503 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.503 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.503 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.503 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.503 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.503 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.503 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.503 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.504 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.504 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.504 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-06-02T04:19:45.504 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.504 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.504 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.504 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.504 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.504 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.504 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.505 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.505 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.505 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.505 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.505 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.505 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.505 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.505 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.505 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.505 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.505 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.506 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.506 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.506 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.506 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.506 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.506 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.506 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.506 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.506 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.506 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.507 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.507 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.507 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.507 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.507 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.507 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.507 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.507 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.507 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.507 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.507 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.507 INFO:teuthology.orchestra.run.smithi123.stdout: "manage_etc_ceph_ceph_conf": { 2024-06-02T04:19:45.508 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-06-02T04:19:45.508 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.508 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.508 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.508 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.508 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.508 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.508 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.508 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-06-02T04:19:45.508 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.509 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.509 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.509 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.509 INFO:teuthology.orchestra.run.smithi123.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-06-02T04:19:45.509 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-06-02T04:19:45.509 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.509 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.509 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.509 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "*", 2024-06-02T04:19:45.510 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.510 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.510 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.510 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-06-02T04:19:45.510 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.510 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.510 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.510 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.510 INFO:teuthology.orchestra.run.smithi123.stdout: "max_count_per_host": { 2024-06-02T04:19:45.510 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "max_count_per_host", 2024-06-02T04:19:45.511 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.511 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.511 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.511 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-06-02T04:19:45.511 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.511 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.511 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.511 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "max number of daemons per service per host", 2024-06-02T04:19:45.511 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.511 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.512 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.512 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.512 INFO:teuthology.orchestra.run.smithi123.stdout: "max_osd_draining_count": { 2024-06-02T04:19:45.512 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "max_osd_draining_count", 2024-06-02T04:19:45.512 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.512 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.512 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.512 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-06-02T04:19:45.512 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.512 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.512 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.513 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-06-02T04:19:45.513 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.513 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.513 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.513 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.513 INFO:teuthology.orchestra.run.smithi123.stdout: "migration_current": { 2024-06-02T04:19:45.513 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "migration_current", 2024-06-02T04:19:45.513 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.513 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.513 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.514 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.514 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.514 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.514 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.514 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "internal - do not modify", 2024-06-02T04:19:45.514 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.514 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.514 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.514 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.514 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": { 2024-06-02T04:19:45.514 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mode", 2024-06-02T04:19:45.515 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.515 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.515 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.515 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "root", 2024-06-02T04:19:45.515 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.515 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.515 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.515 INFO:teuthology.orchestra.run.smithi123.stdout: "cephadm-package", 2024-06-02T04:19:45.515 INFO:teuthology.orchestra.run.smithi123.stdout: "root" 2024-06-02T04:19:45.515 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.515 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "mode for remote execution of cephadm", 2024-06-02T04:19:45.516 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.516 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.516 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.516 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.516 INFO:teuthology.orchestra.run.smithi123.stdout: "oob_default_addr": { 2024-06-02T04:19:45.516 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "oob_default_addr", 2024-06-02T04:19:45.516 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.516 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.516 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.516 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "169.254.1.1", 2024-06-02T04:19:45.516 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.517 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.517 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.517 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Default address for RedFish API (oob management).", 2024-06-02T04:19:45.517 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.517 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.517 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.517 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.517 INFO:teuthology.orchestra.run.smithi123.stdout: "prometheus_alerts_path": { 2024-06-02T04:19:45.517 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "prometheus_alerts_path", 2024-06-02T04:19:45.517 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.517 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.518 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.518 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-06-02T04:19:45.518 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.518 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.518 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.518 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-06-02T04:19:45.518 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.518 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.518 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.518 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.519 INFO:teuthology.orchestra.run.smithi123.stdout: "registry_insecure": { 2024-06-02T04:19:45.519 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "registry_insecure", 2024-06-02T04:19:45.519 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.519 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.519 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.519 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.519 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.519 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.519 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.519 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-06-02T04:19:45.520 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.520 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.520 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.520 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.520 INFO:teuthology.orchestra.run.smithi123.stdout: "registry_password": { 2024-06-02T04:19:45.520 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "registry_password", 2024-06-02T04:19:45.520 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.520 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.520 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.520 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.520 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.520 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.521 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.521 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-06-02T04:19:45.521 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.521 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.521 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.521 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.521 INFO:teuthology.orchestra.run.smithi123.stdout: "registry_url": { 2024-06-02T04:19:45.521 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "registry_url", 2024-06-02T04:19:45.521 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.521 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.521 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.522 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.522 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.522 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.522 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.522 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-06-02T04:19:45.522 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.522 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.522 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.522 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.522 INFO:teuthology.orchestra.run.smithi123.stdout: "registry_username": { 2024-06-02T04:19:45.522 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "registry_username", 2024-06-02T04:19:45.523 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.523 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.523 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.523 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.523 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.523 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.523 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.523 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-06-02T04:19:45.523 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.523 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.523 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.524 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.524 INFO:teuthology.orchestra.run.smithi123.stdout: "secure_monitoring_stack": { 2024-06-02T04:19:45.524 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "secure_monitoring_stack", 2024-06-02T04:19:45.524 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.524 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.524 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.524 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.524 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.524 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.524 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.524 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-06-02T04:19:45.525 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.525 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.525 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.525 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.525 INFO:teuthology.orchestra.run.smithi123.stdout: "service_discovery_port": { 2024-06-02T04:19:45.525 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "service_discovery_port", 2024-06-02T04:19:45.525 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.525 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.525 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.525 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "8765", 2024-06-02T04:19:45.525 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.525 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.526 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.526 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "cephadm service discovery port", 2024-06-02T04:19:45.526 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.526 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.526 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.526 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.526 INFO:teuthology.orchestra.run.smithi123.stdout: "ssh_config_file": { 2024-06-02T04:19:45.526 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ssh_config_file", 2024-06-02T04:19:45.526 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.526 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.527 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.527 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.527 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.527 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.527 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.527 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-06-02T04:19:45.527 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.527 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.527 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.527 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.527 INFO:teuthology.orchestra.run.smithi123.stdout: "use_agent": { 2024-06-02T04:19:45.528 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "use_agent", 2024-06-02T04:19:45.528 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.528 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.528 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.528 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.528 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.528 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.528 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.528 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-06-02T04:19:45.528 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.528 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.529 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.529 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.529 INFO:teuthology.orchestra.run.smithi123.stdout: "use_repo_digest": { 2024-06-02T04:19:45.529 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "use_repo_digest", 2024-06-02T04:19:45.529 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.529 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.529 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.529 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.529 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.529 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.529 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.530 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-06-02T04:19:45.530 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.530 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.530 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.530 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.530 INFO:teuthology.orchestra.run.smithi123.stdout: "warn_on_failed_host_check": { 2024-06-02T04:19:45.530 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "warn_on_failed_host_check", 2024-06-02T04:19:45.530 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.530 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.530 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.530 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.531 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.531 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.531 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.531 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "raise a health warning if the host check fails", 2024-06-02T04:19:45.531 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.531 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.531 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.531 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.531 INFO:teuthology.orchestra.run.smithi123.stdout: "warn_on_stray_daemons": { 2024-06-02T04:19:45.531 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "warn_on_stray_daemons", 2024-06-02T04:19:45.531 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.531 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.532 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.532 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.532 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.532 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.532 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.532 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-06-02T04:19:45.532 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.532 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.532 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.532 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.532 INFO:teuthology.orchestra.run.smithi123.stdout: "warn_on_stray_hosts": { 2024-06-02T04:19:45.533 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "warn_on_stray_hosts", 2024-06-02T04:19:45.533 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.533 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.533 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.533 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.533 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.533 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.533 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.533 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-06-02T04:19:45.533 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.533 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.534 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.534 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.534 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.534 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.534 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.534 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "crash", 2024-06-02T04:19:45.534 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.534 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.534 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.534 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.534 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.535 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.535 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.535 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.535 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.535 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.535 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.535 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.535 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.535 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.535 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.535 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.535 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.536 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.536 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.536 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.536 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.536 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.536 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.536 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.536 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.536 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.536 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.536 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.537 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.537 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.537 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.537 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.537 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.537 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.537 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.537 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.537 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.537 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.537 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.538 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.538 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.538 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.538 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.538 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.538 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.538 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.538 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.538 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.538 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.538 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.539 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.539 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.539 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.539 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.539 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.539 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.539 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.539 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.539 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.539 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.539 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.540 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.540 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.540 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.540 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.540 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.540 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.540 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.540 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.540 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.540 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.540 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.541 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.541 INFO:teuthology.orchestra.run.smithi123.stdout: "retain_interval": { 2024-06-02T04:19:45.541 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "retain_interval", 2024-06-02T04:19:45.541 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:45.541 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.541 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.541 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "31536000", 2024-06-02T04:19:45.541 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.541 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.541 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.542 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how long to retain crashes before pruning them", 2024-06-02T04:19:45.542 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.542 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.542 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.542 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.542 INFO:teuthology.orchestra.run.smithi123.stdout: "warn_recent_interval": { 2024-06-02T04:19:45.542 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "warn_recent_interval", 2024-06-02T04:19:45.542 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:45.542 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.542 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.542 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "1209600", 2024-06-02T04:19:45.543 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.543 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.543 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.543 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "time interval in which to warn about recent crashes", 2024-06-02T04:19:45.543 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.543 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.543 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.543 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.543 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.543 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.543 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.544 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "dashboard", 2024-06-02T04:19:45.544 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.544 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.544 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.544 INFO:teuthology.orchestra.run.smithi123.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-06-02T04:19:45.544 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-06-02T04:19:45.544 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.544 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.544 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.544 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-06-02T04:19:45.544 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.545 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.545 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.545 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.545 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.545 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.545 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.545 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.545 INFO:teuthology.orchestra.run.smithi123.stdout: "ALERTMANAGER_API_HOST": { 2024-06-02T04:19:45.545 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ALERTMANAGER_API_HOST", 2024-06-02T04:19:45.545 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.546 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.546 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.546 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.546 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.546 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.546 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.546 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.546 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.546 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.546 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.547 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.547 INFO:teuthology.orchestra.run.smithi123.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-06-02T04:19:45.547 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-06-02T04:19:45.547 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.547 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.547 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.547 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.547 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.547 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.547 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.547 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.548 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.548 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.548 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.548 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.548 INFO:teuthology.orchestra.run.smithi123.stdout: "AUDIT_API_ENABLED": { 2024-06-02T04:19:45.548 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "AUDIT_API_ENABLED", 2024-06-02T04:19:45.548 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.548 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.548 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.548 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.549 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.549 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.549 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.549 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.549 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.549 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.549 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.549 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.549 INFO:teuthology.orchestra.run.smithi123.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-06-02T04:19:45.550 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-06-02T04:19:45.550 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.550 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.550 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.550 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.550 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.550 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.550 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.550 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.550 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.551 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.551 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.551 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.551 INFO:teuthology.orchestra.run.smithi123.stdout: "ENABLE_BROWSABLE_API": { 2024-06-02T04:19:45.551 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ENABLE_BROWSABLE_API", 2024-06-02T04:19:45.551 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.551 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.551 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.551 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.551 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.552 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.552 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.552 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.552 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.552 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.552 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.552 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.552 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-06-02T04:19:45.552 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-06-02T04:19:45.553 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.553 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.553 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.553 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.553 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.553 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.553 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.553 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.553 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.553 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.554 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.554 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.554 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-06-02T04:19:45.554 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-06-02T04:19:45.554 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.554 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.554 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.554 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.554 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.554 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.555 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.555 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.555 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.555 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.555 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.555 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.555 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-06-02T04:19:45.555 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-06-02T04:19:45.555 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.555 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.555 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.556 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.556 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.556 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.556 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.556 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.556 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.556 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.556 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.556 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.556 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-06-02T04:19:45.556 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-06-02T04:19:45.557 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.557 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.557 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.557 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.557 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.557 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.557 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.557 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.557 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.557 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.557 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.557 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.558 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_NFS": { 2024-06-02T04:19:45.558 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-06-02T04:19:45.558 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.558 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.558 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.558 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.558 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.558 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.558 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.559 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.559 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.559 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.559 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.559 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.559 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_RBD": { 2024-06-02T04:19:45.559 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-06-02T04:19:45.559 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.559 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.559 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.559 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.560 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.560 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.560 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.560 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.560 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.560 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.560 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.560 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.560 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_RGW": { 2024-06-02T04:19:45.560 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-06-02T04:19:45.560 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.561 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.561 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.561 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.561 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.561 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.561 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.561 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.561 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.561 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.561 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.561 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.562 INFO:teuthology.orchestra.run.smithi123.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-06-02T04:19:45.562 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-06-02T04:19:45.562 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.562 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.562 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.562 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.562 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.562 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.562 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.562 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.562 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.563 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.563 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.563 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.563 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_API_PASSWORD": { 2024-06-02T04:19:45.563 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_API_PASSWORD", 2024-06-02T04:19:45.563 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.563 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.563 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.563 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "admin", 2024-06-02T04:19:45.563 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.564 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.564 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.564 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.564 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.564 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.564 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.564 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.564 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-06-02T04:19:45.564 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-06-02T04:19:45.564 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.564 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.565 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.565 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.565 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.565 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.565 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.565 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.565 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.565 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.565 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.565 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.565 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_API_URL": { 2024-06-02T04:19:45.566 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_API_URL", 2024-06-02T04:19:45.566 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.566 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.566 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.566 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.566 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.566 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.566 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.566 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.566 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.567 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.567 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.567 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.567 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_API_USERNAME": { 2024-06-02T04:19:45.567 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_API_USERNAME", 2024-06-02T04:19:45.569 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.569 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.570 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.570 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "admin", 2024-06-02T04:19:45.570 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.570 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.570 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.570 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.570 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.570 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.570 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.570 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.570 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-06-02T04:19:45.571 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-06-02T04:19:45.571 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.571 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.571 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.571 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.571 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.571 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.571 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.571 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.571 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.572 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.572 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.572 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.572 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-06-02T04:19:45.572 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-06-02T04:19:45.572 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.572 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.572 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.572 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.572 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.572 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.573 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.573 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.573 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.573 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.573 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.573 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.573 INFO:teuthology.orchestra.run.smithi123.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-06-02T04:19:45.573 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-06-02T04:19:45.573 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.573 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.574 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.574 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.574 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.574 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.574 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.574 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.574 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.574 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.574 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.574 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.574 INFO:teuthology.orchestra.run.smithi123.stdout: "ISSUE_TRACKER_API_KEY": { 2024-06-02T04:19:45.575 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-06-02T04:19:45.575 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.575 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.575 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.575 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.575 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.575 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.575 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.575 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.575 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.575 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.576 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.576 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.576 INFO:teuthology.orchestra.run.smithi123.stdout: "PROMETHEUS_API_HOST": { 2024-06-02T04:19:45.576 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PROMETHEUS_API_HOST", 2024-06-02T04:19:45.576 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.576 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.576 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.576 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.576 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.576 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.576 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.577 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.577 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.577 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.577 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.577 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.577 INFO:teuthology.orchestra.run.smithi123.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-06-02T04:19:45.577 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-06-02T04:19:45.577 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.577 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.577 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.577 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.578 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.578 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.578 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.578 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.578 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.578 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.578 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.578 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.578 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-06-02T04:19:45.578 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-06-02T04:19:45.578 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.579 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.579 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.579 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.579 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.579 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.579 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.579 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.579 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.579 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.579 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.579 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.579 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-06-02T04:19:45.580 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-06-02T04:19:45.580 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.580 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.580 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.580 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.580 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.580 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.580 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.580 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.580 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.580 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.581 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.581 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.581 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-06-02T04:19:45.581 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-06-02T04:19:45.581 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.581 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.581 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.581 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.581 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.581 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.581 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.582 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.582 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.582 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.582 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.582 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.582 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-06-02T04:19:45.582 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-06-02T04:19:45.582 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.582 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.583 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.583 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.583 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.583 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.583 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.583 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.583 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.583 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.583 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.583 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.584 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-06-02T04:19:45.584 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-06-02T04:19:45.584 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.584 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.584 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.584 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.584 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.584 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.584 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.584 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.585 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.585 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.585 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.585 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.585 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-06-02T04:19:45.585 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-06-02T04:19:45.585 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.585 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.585 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.585 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.586 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.586 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.586 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.586 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.586 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.586 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.586 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.586 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.586 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-06-02T04:19:45.586 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-06-02T04:19:45.587 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.587 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.587 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.587 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.587 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.587 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.587 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.587 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.587 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.587 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.588 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.588 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.588 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_ENABLED": { 2024-06-02T04:19:45.588 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_ENABLED", 2024-06-02T04:19:45.588 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.588 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.588 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.588 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.588 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.588 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.589 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.589 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.589 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.589 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.589 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.589 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.589 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-06-02T04:19:45.589 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-06-02T04:19:45.589 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.589 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.589 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.590 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-06-02T04:19:45.590 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.590 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.590 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.590 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.590 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.590 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.590 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.590 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.590 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-06-02T04:19:45.590 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-06-02T04:19:45.591 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.591 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.591 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.591 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-06-02T04:19:45.591 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.591 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.591 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.591 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.591 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.591 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.591 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.592 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.592 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-06-02T04:19:45.592 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-06-02T04:19:45.592 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.592 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.592 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.592 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "8", 2024-06-02T04:19:45.592 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.592 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.592 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.592 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.593 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.593 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.593 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.593 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.593 INFO:teuthology.orchestra.run.smithi123.stdout: "REST_REQUESTS_TIMEOUT": { 2024-06-02T04:19:45.593 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-06-02T04:19:45.593 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.593 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.593 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.593 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "45", 2024-06-02T04:19:45.593 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.593 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.594 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.594 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.594 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.594 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.594 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.594 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.594 INFO:teuthology.orchestra.run.smithi123.stdout: "RGW_API_ACCESS_KEY": { 2024-06-02T04:19:45.594 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RGW_API_ACCESS_KEY", 2024-06-02T04:19:45.594 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.594 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.595 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.595 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.595 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.595 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.595 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.595 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.595 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.595 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.595 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.595 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.595 INFO:teuthology.orchestra.run.smithi123.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-06-02T04:19:45.596 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-06-02T04:19:45.596 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.596 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.596 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.596 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "admin", 2024-06-02T04:19:45.596 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.596 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.596 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.596 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.596 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.596 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.597 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.597 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.597 INFO:teuthology.orchestra.run.smithi123.stdout: "RGW_API_SECRET_KEY": { 2024-06-02T04:19:45.597 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RGW_API_SECRET_KEY", 2024-06-02T04:19:45.597 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.597 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.597 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.597 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.597 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.597 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.597 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.598 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.598 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.598 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.598 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.598 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.598 INFO:teuthology.orchestra.run.smithi123.stdout: "RGW_API_SSL_VERIFY": { 2024-06-02T04:19:45.598 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RGW_API_SSL_VERIFY", 2024-06-02T04:19:45.598 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.598 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.598 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.599 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.599 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.599 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.599 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.599 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.599 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.599 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.599 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.599 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.599 INFO:teuthology.orchestra.run.smithi123.stdout: "UNSAFE_TLS_v1_2": { 2024-06-02T04:19:45.599 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "UNSAFE_TLS_v1_2", 2024-06-02T04:19:45.600 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.600 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.600 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.600 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.600 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.600 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.600 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.600 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.600 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.601 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.601 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.601 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.601 INFO:teuthology.orchestra.run.smithi123.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-06-02T04:19:45.601 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-06-02T04:19:45.601 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.601 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.601 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.601 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0", 2024-06-02T04:19:45.601 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.602 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.602 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.602 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.602 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.602 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.602 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.602 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.602 INFO:teuthology.orchestra.run.smithi123.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-06-02T04:19:45.602 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-06-02T04:19:45.602 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.602 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.603 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.603 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-06-02T04:19:45.603 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.603 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.603 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.603 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.603 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.603 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.603 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.603 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.603 INFO:teuthology.orchestra.run.smithi123.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-06-02T04:19:45.603 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-06-02T04:19:45.604 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.604 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.604 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.604 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "5", 2024-06-02T04:19:45.604 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.604 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.604 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.604 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.604 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.604 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.604 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.605 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.605 INFO:teuthology.orchestra.run.smithi123.stdout: "cross_origin_url": { 2024-06-02T04:19:45.605 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "cross_origin_url", 2024-06-02T04:19:45.605 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.605 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.605 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.605 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.605 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.605 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.605 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.605 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.606 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.606 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.606 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.606 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.606 INFO:teuthology.orchestra.run.smithi123.stdout: "crt_file": { 2024-06-02T04:19:45.606 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "crt_file", 2024-06-02T04:19:45.606 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.606 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.606 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.606 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.606 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.607 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.607 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.607 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.607 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.607 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.607 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.607 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.607 INFO:teuthology.orchestra.run.smithi123.stdout: "debug": { 2024-06-02T04:19:45.607 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "debug", 2024-06-02T04:19:45.607 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.607 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.608 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.608 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.608 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.608 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.608 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.608 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Enable/disable debug options", 2024-06-02T04:19:45.608 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.608 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.608 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.608 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.609 INFO:teuthology.orchestra.run.smithi123.stdout: "jwt_token_ttl": { 2024-06-02T04:19:45.609 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "jwt_token_ttl", 2024-06-02T04:19:45.609 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.609 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.609 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.609 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "28800", 2024-06-02T04:19:45.609 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.609 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.609 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.609 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.609 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.609 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.610 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.610 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.610 INFO:teuthology.orchestra.run.smithi123.stdout: "key_file": { 2024-06-02T04:19:45.610 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "key_file", 2024-06-02T04:19:45.610 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.610 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.610 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.610 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.610 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.610 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.611 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.611 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.611 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.611 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.611 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.611 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.611 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.611 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.611 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.611 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.611 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.612 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.612 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.612 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.612 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.612 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.612 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.612 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.612 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.612 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.612 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.613 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.613 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.613 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.613 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.613 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.613 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.613 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.613 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.613 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.613 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.613 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.613 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.614 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.614 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.614 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.614 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.614 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.614 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.614 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.614 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.614 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.614 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.615 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.615 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.615 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.615 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.615 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.615 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.615 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.615 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.615 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.615 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.616 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.616 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.616 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.616 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.616 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.616 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.616 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.616 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.616 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.616 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.616 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.617 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.617 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.617 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.617 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.617 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.617 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.617 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.617 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.617 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.617 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.618 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.618 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.618 INFO:teuthology.orchestra.run.smithi123.stdout: "motd": { 2024-06-02T04:19:45.618 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "motd", 2024-06-02T04:19:45.618 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.618 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.618 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.618 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.618 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.618 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.618 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.619 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "The message of the day", 2024-06-02T04:19:45.619 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.619 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.619 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.619 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.619 INFO:teuthology.orchestra.run.smithi123.stdout: "redirect_resolve_ip_addr": { 2024-06-02T04:19:45.619 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "redirect_resolve_ip_addr", 2024-06-02T04:19:45.619 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.619 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.619 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.619 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.620 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.620 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.620 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.620 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.620 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.620 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.620 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.620 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.620 INFO:teuthology.orchestra.run.smithi123.stdout: "server_addr": { 2024-06-02T04:19:45.620 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_addr", 2024-06-02T04:19:45.620 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.621 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.621 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.621 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "::", 2024-06-02T04:19:45.621 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.621 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.621 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.621 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.621 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.621 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.621 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.621 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.622 INFO:teuthology.orchestra.run.smithi123.stdout: "server_port": { 2024-06-02T04:19:45.622 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_port", 2024-06-02T04:19:45.622 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.622 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.622 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.622 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "8080", 2024-06-02T04:19:45.622 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.622 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.622 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.622 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.623 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.623 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.623 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.623 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.623 INFO:teuthology.orchestra.run.smithi123.stdout: "ssl": { 2024-06-02T04:19:45.623 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ssl", 2024-06-02T04:19:45.623 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.623 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.623 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.623 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.623 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.624 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.624 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.624 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.624 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.624 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.624 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.624 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.624 INFO:teuthology.orchestra.run.smithi123.stdout: "ssl_server_port": { 2024-06-02T04:19:45.624 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ssl_server_port", 2024-06-02T04:19:45.624 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.624 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.625 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.625 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "8443", 2024-06-02T04:19:45.625 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.625 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.625 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.625 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.625 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.625 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.625 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.625 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.625 INFO:teuthology.orchestra.run.smithi123.stdout: "standby_behaviour": { 2024-06-02T04:19:45.626 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "standby_behaviour", 2024-06-02T04:19:45.626 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.626 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.626 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.626 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "redirect", 2024-06-02T04:19:45.626 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.626 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.626 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.626 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.626 INFO:teuthology.orchestra.run.smithi123.stdout: "redirect" 2024-06-02T04:19:45.626 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.627 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.627 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.627 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.627 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.627 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.627 INFO:teuthology.orchestra.run.smithi123.stdout: "standby_error_status_code": { 2024-06-02T04:19:45.627 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "standby_error_status_code", 2024-06-02T04:19:45.627 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.627 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.627 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.627 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "500", 2024-06-02T04:19:45.627 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "400", 2024-06-02T04:19:45.628 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "599", 2024-06-02T04:19:45.628 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.628 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.628 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.628 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.628 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.628 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.628 INFO:teuthology.orchestra.run.smithi123.stdout: "url_prefix": { 2024-06-02T04:19:45.628 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "url_prefix", 2024-06-02T04:19:45.628 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.628 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.629 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.629 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.629 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.629 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.629 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.629 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.629 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.629 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.629 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.629 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.629 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.629 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.630 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.630 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "devicehealth", 2024-06-02T04:19:45.630 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.630 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.630 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.630 INFO:teuthology.orchestra.run.smithi123.stdout: "enable_monitoring": { 2024-06-02T04:19:45.630 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "enable_monitoring", 2024-06-02T04:19:45.630 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.630 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.630 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.630 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.631 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.631 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.631 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.631 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "monitor device health metrics", 2024-06-02T04:19:45.631 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.631 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.631 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.631 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.631 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.631 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.631 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.632 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.632 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.632 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.632 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.632 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.632 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.632 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.632 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.632 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.632 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.632 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.632 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.633 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.633 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.633 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.633 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.633 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.633 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.633 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.633 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.633 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.633 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.633 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.634 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.634 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.634 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.634 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.634 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.634 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.634 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.634 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.634 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.634 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.634 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.635 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.635 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.635 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.635 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.635 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.635 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.635 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.635 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.635 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.635 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.636 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.636 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.636 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.636 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.636 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.636 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.636 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.636 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.636 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.636 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.636 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.636 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.637 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.637 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.637 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.637 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.637 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.637 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.637 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.637 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.637 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.637 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.638 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.638 INFO:teuthology.orchestra.run.smithi123.stdout: "mark_out_threshold": { 2024-06-02T04:19:45.638 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mark_out_threshold", 2024-06-02T04:19:45.638 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:45.638 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.638 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.638 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "2419200", 2024-06-02T04:19:45.638 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.638 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.638 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.639 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-06-02T04:19:45.639 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.639 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.639 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.639 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.639 INFO:teuthology.orchestra.run.smithi123.stdout: "pool_name": { 2024-06-02T04:19:45.639 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "pool_name", 2024-06-02T04:19:45.639 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.639 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.639 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.639 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "device_health_metrics", 2024-06-02T04:19:45.639 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.640 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.640 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.640 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "name of pool in which to store device health metrics", 2024-06-02T04:19:45.640 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.640 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.640 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.640 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.640 INFO:teuthology.orchestra.run.smithi123.stdout: "retention_period": { 2024-06-02T04:19:45.640 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "retention_period", 2024-06-02T04:19:45.640 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:45.641 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.641 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.641 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "15552000", 2024-06-02T04:19:45.641 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.641 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.641 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.641 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how long to retain device health metrics", 2024-06-02T04:19:45.641 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.641 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.641 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.641 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.642 INFO:teuthology.orchestra.run.smithi123.stdout: "scrape_frequency": { 2024-06-02T04:19:45.642 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "scrape_frequency", 2024-06-02T04:19:45.642 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:45.642 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.642 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.642 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "86400", 2024-06-02T04:19:45.642 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.642 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.642 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.642 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how frequently to scrape device health metrics", 2024-06-02T04:19:45.642 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.643 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.643 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.643 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.643 INFO:teuthology.orchestra.run.smithi123.stdout: "self_heal": { 2024-06-02T04:19:45.643 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "self_heal", 2024-06-02T04:19:45.643 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.643 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.643 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.643 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.643 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.644 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.644 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.644 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-06-02T04:19:45.644 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.644 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.644 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.644 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.644 INFO:teuthology.orchestra.run.smithi123.stdout: "sleep_interval": { 2024-06-02T04:19:45.644 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "sleep_interval", 2024-06-02T04:19:45.644 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:45.644 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.645 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.645 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "600", 2024-06-02T04:19:45.645 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.645 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.645 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.645 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how frequently to wake up and check device health", 2024-06-02T04:19:45.645 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.645 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.645 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.645 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.645 INFO:teuthology.orchestra.run.smithi123.stdout: "warn_threshold": { 2024-06-02T04:19:45.645 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "warn_threshold", 2024-06-02T04:19:45.646 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:45.646 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.646 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.646 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "7257600", 2024-06-02T04:19:45.646 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.646 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.646 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.646 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-06-02T04:19:45.646 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.646 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.647 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.647 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.647 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.647 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.647 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.647 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "diskprediction_local", 2024-06-02T04:19:45.647 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.647 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.647 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.647 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.647 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.647 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.648 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.648 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.648 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.648 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.648 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.648 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.648 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.648 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.648 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.648 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.648 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.649 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.649 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.649 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.649 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.649 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.649 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.649 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.649 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.649 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.649 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.649 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.649 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.650 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.650 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.650 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.650 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.650 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.650 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.650 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.650 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.650 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.650 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.651 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.651 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.651 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.651 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.651 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.651 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.651 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.651 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.651 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.651 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.651 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.652 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.652 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.652 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.652 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.652 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.652 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.652 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.652 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.652 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.652 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.653 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.653 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.653 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.653 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.653 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.653 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.653 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.653 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.653 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.653 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.653 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.654 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.654 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.654 INFO:teuthology.orchestra.run.smithi123.stdout: "predict_interval": { 2024-06-02T04:19:45.654 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "predict_interval", 2024-06-02T04:19:45.654 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.654 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.654 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.654 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "86400", 2024-06-02T04:19:45.654 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.654 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.654 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.655 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.655 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.655 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.655 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.655 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.655 INFO:teuthology.orchestra.run.smithi123.stdout: "predictor_model": { 2024-06-02T04:19:45.655 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "predictor_model", 2024-06-02T04:19:45.655 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.655 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.655 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.655 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "prophetstor", 2024-06-02T04:19:45.656 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.656 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.656 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.656 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.656 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.656 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.656 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.656 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.656 INFO:teuthology.orchestra.run.smithi123.stdout: "sleep_interval": { 2024-06-02T04:19:45.656 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "sleep_interval", 2024-06-02T04:19:45.656 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.656 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.657 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.657 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "600", 2024-06-02T04:19:45.657 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.657 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.657 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.657 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.657 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.657 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.657 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.657 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.657 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.658 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.658 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.658 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "influx", 2024-06-02T04:19:45.658 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": false, 2024-06-02T04:19:45.658 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "influxdb python module not found", 2024-06-02T04:19:45.658 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.658 INFO:teuthology.orchestra.run.smithi123.stdout: "batch_size": { 2024-06-02T04:19:45.658 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "batch_size", 2024-06-02T04:19:45.658 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.659 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.659 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.659 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "5000", 2024-06-02T04:19:45.659 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.659 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.659 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.659 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-06-02T04:19:45.659 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.659 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.659 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.659 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.660 INFO:teuthology.orchestra.run.smithi123.stdout: "database": { 2024-06-02T04:19:45.660 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "database", 2024-06-02T04:19:45.660 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.660 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.660 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.660 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "ceph", 2024-06-02T04:19:45.660 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.660 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.660 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.660 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-06-02T04:19:45.661 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.661 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.661 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.661 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.661 INFO:teuthology.orchestra.run.smithi123.stdout: "hostname": { 2024-06-02T04:19:45.661 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "hostname", 2024-06-02T04:19:45.661 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.661 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.661 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.661 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.661 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.662 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.662 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.662 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "InfluxDB server hostname", 2024-06-02T04:19:45.662 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.662 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.662 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.662 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.662 INFO:teuthology.orchestra.run.smithi123.stdout: "interval": { 2024-06-02T04:19:45.662 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "interval", 2024-06-02T04:19:45.662 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:45.662 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.663 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.663 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "30", 2024-06-02T04:19:45.663 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "5", 2024-06-02T04:19:45.663 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.663 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.663 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-06-02T04:19:45.663 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.663 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.663 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.663 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.663 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.664 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.664 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.664 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.664 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.664 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.664 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.664 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.664 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.664 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.664 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.664 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.665 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.665 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.665 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.665 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.665 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.665 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.665 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.665 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.665 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.665 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.665 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.665 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.666 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.666 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.666 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.666 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.666 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.666 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.666 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.666 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.666 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.666 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.666 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.667 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.667 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.667 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.667 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.667 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.667 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.667 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.667 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.667 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.667 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.667 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.667 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.668 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.668 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.668 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.668 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.668 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.668 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.668 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.668 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.668 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.668 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.668 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.669 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.669 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.669 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.669 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.669 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.669 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.669 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.669 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.669 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.669 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.669 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.670 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.670 INFO:teuthology.orchestra.run.smithi123.stdout: "password": { 2024-06-02T04:19:45.670 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "password", 2024-06-02T04:19:45.670 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.670 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.670 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.670 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.670 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.670 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.670 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.671 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "password of InfluxDB server user", 2024-06-02T04:19:45.671 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.671 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.671 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.671 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.671 INFO:teuthology.orchestra.run.smithi123.stdout: "port": { 2024-06-02T04:19:45.671 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "port", 2024-06-02T04:19:45.671 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.671 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.671 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.671 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "8086", 2024-06-02T04:19:45.672 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.672 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.672 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.672 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "InfluxDB server port", 2024-06-02T04:19:45.672 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.672 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.672 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.672 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.672 INFO:teuthology.orchestra.run.smithi123.stdout: "ssl": { 2024-06-02T04:19:45.672 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ssl", 2024-06-02T04:19:45.672 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.673 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.673 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.673 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "false", 2024-06-02T04:19:45.673 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.673 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.673 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.673 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-06-02T04:19:45.673 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.673 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.673 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.673 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.674 INFO:teuthology.orchestra.run.smithi123.stdout: "threads": { 2024-06-02T04:19:45.674 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "threads", 2024-06-02T04:19:45.674 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.674 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.674 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.674 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "5", 2024-06-02T04:19:45.674 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "1", 2024-06-02T04:19:45.674 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "32", 2024-06-02T04:19:45.674 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.674 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-06-02T04:19:45.674 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.675 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.675 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.675 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.675 INFO:teuthology.orchestra.run.smithi123.stdout: "username": { 2024-06-02T04:19:45.675 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "username", 2024-06-02T04:19:45.675 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.675 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.675 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.675 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.675 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.675 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.675 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.676 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "username of InfluxDB server user", 2024-06-02T04:19:45.676 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.676 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.676 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.676 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.676 INFO:teuthology.orchestra.run.smithi123.stdout: "verify_ssl": { 2024-06-02T04:19:45.676 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "verify_ssl", 2024-06-02T04:19:45.676 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.676 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.676 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.676 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "true", 2024-06-02T04:19:45.677 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.677 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.677 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.677 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-06-02T04:19:45.677 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.677 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.677 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.677 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.677 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.677 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.677 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.678 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "insights", 2024-06-02T04:19:45.678 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.678 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.678 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.678 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.678 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.678 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.678 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.678 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.678 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.678 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.679 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.679 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.679 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.679 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.679 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.679 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.679 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.679 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.679 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.679 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.679 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.679 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.680 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.680 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.680 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.680 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.680 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.680 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.680 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.680 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.680 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.680 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.680 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.680 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.681 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.681 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.681 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.681 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.681 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.681 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.681 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.681 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.681 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.681 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.681 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.682 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.682 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.682 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.682 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.682 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.682 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.682 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.682 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.682 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.682 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.682 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.682 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.683 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.683 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.683 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.683 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.683 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.683 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.683 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.683 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.683 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.683 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.683 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.684 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.684 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.684 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.684 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.684 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.684 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.684 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.684 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.684 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "iostat", 2024-06-02T04:19:45.684 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.684 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.684 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.685 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.685 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.685 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.685 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.685 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.685 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.685 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.685 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.685 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.685 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.685 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.685 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.686 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.686 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.686 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.686 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.686 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.686 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.686 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.686 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.686 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.686 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.687 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.687 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.687 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.687 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.687 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.687 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.687 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.687 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.687 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.687 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.687 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.688 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.688 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.688 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.688 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.688 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.688 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.688 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.688 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.688 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.688 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.688 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.688 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.689 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.689 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.689 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.689 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.689 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.689 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.689 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.689 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.689 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.689 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.689 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.690 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.690 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.690 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.690 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.690 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.690 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.690 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.690 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.690 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.690 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.690 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.690 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.691 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.691 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.691 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.691 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.691 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.691 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "k8sevents", 2024-06-02T04:19:45.691 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.691 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.691 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.691 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_event_retention_days": { 2024-06-02T04:19:45.691 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ceph_event_retention_days", 2024-06-02T04:19:45.692 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.692 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.692 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.692 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "7", 2024-06-02T04:19:45.692 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.692 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.692 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.692 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Days to hold ceph event information within local cache", 2024-06-02T04:19:45.692 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.692 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.692 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.693 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.693 INFO:teuthology.orchestra.run.smithi123.stdout: "config_check_secs": { 2024-06-02T04:19:45.693 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "config_check_secs", 2024-06-02T04:19:45.693 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.693 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.693 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.693 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-06-02T04:19:45.693 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "10", 2024-06-02T04:19:45.693 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.693 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.693 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-06-02T04:19:45.693 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.694 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.694 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.694 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.694 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.694 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.694 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.694 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.694 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.694 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.694 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.694 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.695 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.695 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.695 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.695 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.695 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.695 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.695 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.695 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.695 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.695 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.695 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.696 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.696 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.696 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.696 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.696 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.696 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.696 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.696 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.696 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.696 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.696 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.696 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.697 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.697 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.697 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.697 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.697 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.697 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.697 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.697 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.697 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.697 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.697 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.698 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.698 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.698 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.698 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.698 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.698 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.698 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.698 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.698 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.698 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.698 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.699 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.699 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.699 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.699 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.699 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.699 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.699 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.699 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.699 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.699 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.699 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.699 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.700 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.700 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.700 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.700 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.700 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.700 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.700 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.700 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.700 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "localpool", 2024-06-02T04:19:45.700 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.700 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.700 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.701 INFO:teuthology.orchestra.run.smithi123.stdout: "failure_domain": { 2024-06-02T04:19:45.701 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "failure_domain", 2024-06-02T04:19:45.701 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.701 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.701 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.701 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "host", 2024-06-02T04:19:45.701 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.701 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.701 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.701 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "failure domain for any created local pool", 2024-06-02T04:19:45.701 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-06-02T04:19:45.702 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.702 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.702 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.702 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.702 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.702 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.702 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.702 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.702 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.702 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.702 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.703 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.703 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.703 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.703 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.703 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.703 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.703 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.704 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.704 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.704 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.704 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.704 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.704 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.704 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.704 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.704 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.704 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.705 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.705 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.705 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.705 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.705 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.705 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.705 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.705 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.705 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.706 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.706 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.706 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.706 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.706 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.706 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.706 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.706 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.706 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.707 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.707 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.707 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.707 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.707 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.707 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.707 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.707 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.707 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.708 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.708 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.708 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.708 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.708 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.708 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.708 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.708 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.708 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.709 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.709 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.709 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.709 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.709 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.709 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.709 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.710 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.710 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.710 INFO:teuthology.orchestra.run.smithi123.stdout: "min_size": { 2024-06-02T04:19:45.710 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "min_size", 2024-06-02T04:19:45.710 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.710 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.710 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.711 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.711 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.711 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.711 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.711 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "default min_size for any created local pool", 2024-06-02T04:19:45.711 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-06-02T04:19:45.711 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.711 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.712 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.712 INFO:teuthology.orchestra.run.smithi123.stdout: "num_rep": { 2024-06-02T04:19:45.712 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "num_rep", 2024-06-02T04:19:45.712 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.712 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.712 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.712 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "3", 2024-06-02T04:19:45.713 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.713 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.713 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.713 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "default replica count for any created local pool", 2024-06-02T04:19:45.713 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.713 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.713 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.713 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.713 INFO:teuthology.orchestra.run.smithi123.stdout: "pg_num": { 2024-06-02T04:19:45.714 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "pg_num", 2024-06-02T04:19:45.714 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.714 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.714 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.714 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "128", 2024-06-02T04:19:45.714 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.714 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.714 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.714 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "default pg_num for any created local pool", 2024-06-02T04:19:45.714 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.715 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.715 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.715 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.715 INFO:teuthology.orchestra.run.smithi123.stdout: "prefix": { 2024-06-02T04:19:45.715 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "prefix", 2024-06-02T04:19:45.715 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.715 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.715 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.715 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.715 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.715 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.715 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.716 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "name prefix for any created local pool", 2024-06-02T04:19:45.716 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.716 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.716 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.716 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.716 INFO:teuthology.orchestra.run.smithi123.stdout: "subtree": { 2024-06-02T04:19:45.716 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "subtree", 2024-06-02T04:19:45.716 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.716 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.716 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.716 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "rack", 2024-06-02T04:19:45.717 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.717 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.717 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.717 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "CRUSH level for which to create a local pool", 2024-06-02T04:19:45.717 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-06-02T04:19:45.717 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.717 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.717 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.717 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.717 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.717 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.717 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mds_autoscaler", 2024-06-02T04:19:45.718 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.718 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.718 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.718 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.718 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.718 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.718 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.718 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.719 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.719 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.719 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.719 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.719 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.719 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.719 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.719 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.719 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.720 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.720 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.720 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.720 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.720 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.720 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.720 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.720 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.720 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.720 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.720 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.720 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.721 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.721 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.721 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.721 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.721 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.721 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.721 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.721 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.721 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.721 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.721 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.722 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.722 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.722 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.722 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.722 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.722 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.722 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.722 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.722 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.722 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.723 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.723 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.723 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.723 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.723 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.723 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.723 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.723 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.724 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.724 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.724 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.724 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.724 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.724 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.724 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.724 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.724 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.724 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.724 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.725 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.725 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.725 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.725 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.725 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.725 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.725 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.725 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mirroring", 2024-06-02T04:19:45.725 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.725 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.725 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.725 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.726 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.726 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.726 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.726 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.726 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.726 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.726 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.726 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.726 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.726 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.726 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.727 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.727 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.727 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.727 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.727 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.727 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.727 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.727 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.727 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.727 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.727 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.727 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.728 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.728 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.728 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.728 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.728 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.728 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.728 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.728 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.728 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.728 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.728 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.729 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.729 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.729 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.729 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.729 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.729 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.729 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.729 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.729 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.729 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.729 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.730 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.730 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.730 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.730 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.730 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.730 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.730 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.730 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.730 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.730 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.731 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.731 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.731 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.731 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.731 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.731 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.731 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.731 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.731 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.731 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.731 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.732 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.732 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.732 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.732 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.732 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.732 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.732 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "nfs", 2024-06-02T04:19:45.732 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.732 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.732 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.732 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.733 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.733 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.733 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.733 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.733 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.733 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.733 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.733 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.733 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.733 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.733 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.734 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.734 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.734 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.734 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.734 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.734 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.734 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.734 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.734 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.734 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.734 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.735 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.735 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.735 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.735 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.735 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.735 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.735 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.735 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.735 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.735 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.735 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.735 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.736 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.736 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.736 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.736 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.736 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.736 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.736 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.736 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.736 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.736 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.736 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.737 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.737 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.737 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.737 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.737 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.737 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.737 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.737 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.737 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.737 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.737 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.737 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.738 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.738 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.738 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.738 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.738 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.738 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.738 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.738 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.738 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.738 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.739 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.739 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.739 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.739 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.739 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.739 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "orchestrator", 2024-06-02T04:19:45.739 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.739 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.739 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.739 INFO:teuthology.orchestra.run.smithi123.stdout: "fail_fs": { 2024-06-02T04:19:45.739 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "fail_fs", 2024-06-02T04:19:45.740 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.740 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.740 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.740 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.740 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.740 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.740 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.740 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-06-02T04:19:45.740 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.740 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.740 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.741 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.741 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.741 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.741 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.741 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.741 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.741 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.742 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.742 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.742 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.742 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.742 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.742 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.742 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.742 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.742 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.742 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.742 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.743 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.743 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.743 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.743 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.743 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.743 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.743 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.744 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.744 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.744 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.744 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.744 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.744 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.744 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.744 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.744 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.744 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.744 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.745 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.745 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.745 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.745 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.745 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.745 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.745 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.746 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.746 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.746 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.746 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.746 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.746 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.746 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.747 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.747 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.747 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.747 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.747 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.747 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.748 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.748 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.748 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.748 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.748 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.748 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.748 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.748 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.748 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.749 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.749 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.749 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.749 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.749 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.749 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.749 INFO:teuthology.orchestra.run.smithi123.stdout: "orchestrator": { 2024-06-02T04:19:45.750 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "orchestrator", 2024-06-02T04:19:45.750 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.750 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.750 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.750 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.750 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.750 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.751 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.751 INFO:teuthology.orchestra.run.smithi123.stdout: "cephadm", 2024-06-02T04:19:45.751 INFO:teuthology.orchestra.run.smithi123.stdout: "rook", 2024-06-02T04:19:45.751 INFO:teuthology.orchestra.run.smithi123.stdout: "test_orchestrator" 2024-06-02T04:19:45.751 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.752 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Orchestrator backend", 2024-06-02T04:19:45.752 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.752 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.752 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.752 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.752 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.753 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.753 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.753 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "osd_perf_query", 2024-06-02T04:19:45.753 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.753 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.753 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.753 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.753 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.753 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.753 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.754 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.754 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.754 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.754 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.754 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.754 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.754 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.754 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.754 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.754 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.754 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.755 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.755 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.755 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.755 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.755 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.755 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.755 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.755 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.755 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.755 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.755 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.756 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.756 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.756 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.756 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.756 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.756 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.756 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.756 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.756 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.756 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.756 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.757 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.757 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.757 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.757 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.757 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.757 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.757 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.757 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.757 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.757 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.757 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.757 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.758 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.758 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.758 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.758 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.758 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.758 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.758 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.758 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.758 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.758 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.758 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.759 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.759 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.759 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.759 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.759 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.759 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.759 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.759 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.759 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.759 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.759 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.759 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.760 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.760 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "osd_support", 2024-06-02T04:19:45.760 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.760 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.760 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.760 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.760 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.760 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.760 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.760 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.760 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.760 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.761 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.761 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.761 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.761 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.761 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.761 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.761 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.761 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.761 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.761 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.761 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.761 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.762 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.762 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.762 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.762 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.762 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.762 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.762 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.762 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.762 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.762 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.763 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.763 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.763 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.763 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.763 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.763 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.763 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.763 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.763 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.763 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.763 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.763 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.764 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.764 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.764 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.764 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.764 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.764 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.764 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.764 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.764 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.764 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.765 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.765 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.765 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.765 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.765 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.765 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.765 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.765 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.765 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.765 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.765 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.766 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.766 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.766 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.766 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.766 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.766 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.766 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.766 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.766 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.766 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.766 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.767 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "pg_autoscaler", 2024-06-02T04:19:45.767 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.767 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.767 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.767 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.767 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.767 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.767 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.767 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.767 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.767 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.768 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.768 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.768 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.768 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.768 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.768 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.768 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.768 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.768 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.768 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.768 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.769 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.769 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.769 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.769 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.769 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.769 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.769 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.769 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.769 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.769 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.770 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.770 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.770 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.770 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.770 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.770 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.770 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.770 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.770 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.770 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.770 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.771 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.771 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.771 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.771 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.771 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.771 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.771 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.771 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.771 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.771 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.771 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.772 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.772 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.772 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.772 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.772 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.772 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.772 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.772 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.772 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.772 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.772 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.773 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.773 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.773 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.773 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.773 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.773 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.773 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.773 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.773 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.773 INFO:teuthology.orchestra.run.smithi123.stdout: "sleep_interval": { 2024-06-02T04:19:45.773 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "sleep_interval", 2024-06-02T04:19:45.774 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:45.774 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.774 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.774 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "60", 2024-06-02T04:19:45.774 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.774 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.774 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.774 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.774 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.774 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.774 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.775 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.775 INFO:teuthology.orchestra.run.smithi123.stdout: "threshold": { 2024-06-02T04:19:45.775 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "threshold", 2024-06-02T04:19:45.775 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-06-02T04:19:45.775 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.775 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.775 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "3.0", 2024-06-02T04:19:45.776 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "1.0", 2024-06-02T04:19:45.776 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.776 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.776 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "scaling threshold", 2024-06-02T04:19:45.776 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-06-02T04:19:45.776 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.776 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.776 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.776 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.776 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.776 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.777 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "progress", 2024-06-02T04:19:45.777 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.777 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.777 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.777 INFO:teuthology.orchestra.run.smithi123.stdout: "allow_pg_recovery_event": { 2024-06-02T04:19:45.777 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "allow_pg_recovery_event", 2024-06-02T04:19:45.777 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.777 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.777 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.778 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.778 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.778 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.778 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.778 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "allow the module to show pg recovery progress", 2024-06-02T04:19:45.778 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.778 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.778 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.778 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.779 INFO:teuthology.orchestra.run.smithi123.stdout: "enabled": { 2024-06-02T04:19:45.779 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "enabled", 2024-06-02T04:19:45.779 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.779 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.779 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.779 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.779 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.779 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.779 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.780 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.780 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.780 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.780 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.780 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.780 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.780 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.780 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.780 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.780 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.781 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.781 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.781 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.781 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.781 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.781 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.781 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.781 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.782 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.782 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.782 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.782 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.782 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.782 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.782 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.782 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.782 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.783 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.783 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.783 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.783 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.783 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.783 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.783 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.784 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.784 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.784 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.784 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.784 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.784 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.784 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.784 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.784 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.785 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.785 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.785 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.785 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.785 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.785 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.785 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.786 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.786 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.786 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.786 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.786 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.786 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.786 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.787 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.787 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.787 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.787 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.787 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.787 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.787 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.787 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.787 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.788 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.788 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.788 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.788 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.788 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.788 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.788 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.788 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.788 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.788 INFO:teuthology.orchestra.run.smithi123.stdout: "max_completed_events": { 2024-06-02T04:19:45.788 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "max_completed_events", 2024-06-02T04:19:45.789 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.789 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.789 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.789 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "50", 2024-06-02T04:19:45.789 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.789 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.789 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.789 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "number of past completed events to remember", 2024-06-02T04:19:45.789 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.789 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.789 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.790 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.790 INFO:teuthology.orchestra.run.smithi123.stdout: "sleep_interval": { 2024-06-02T04:19:45.790 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "sleep_interval", 2024-06-02T04:19:45.790 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:45.790 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.790 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.790 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "5", 2024-06-02T04:19:45.790 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.790 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.790 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.790 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how long the module is going to sleep", 2024-06-02T04:19:45.791 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.791 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.791 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.791 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.791 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.791 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.791 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.791 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "prometheus", 2024-06-02T04:19:45.791 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.791 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.791 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.792 INFO:teuthology.orchestra.run.smithi123.stdout: "cache": { 2024-06-02T04:19:45.792 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "cache", 2024-06-02T04:19:45.792 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.792 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.792 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.792 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.792 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.792 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.792 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.792 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.792 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.793 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.793 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.793 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.793 INFO:teuthology.orchestra.run.smithi123.stdout: "exclude_perf_counters": { 2024-06-02T04:19:45.793 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "exclude_perf_counters", 2024-06-02T04:19:45.793 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.793 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.793 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.793 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.793 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.793 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.794 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.794 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-06-02T04:19:45.794 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-06-02T04:19:45.794 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.794 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.794 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.794 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.794 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.794 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.794 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.794 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.795 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.795 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.795 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.795 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.795 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.795 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.795 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.795 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.795 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.795 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.795 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.795 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.796 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.796 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.796 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.796 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.796 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.796 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.796 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.796 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.796 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.796 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.796 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.796 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.797 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.797 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.797 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.797 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.797 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.797 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.797 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.797 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.797 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.797 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.797 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.798 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.798 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.798 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.798 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.798 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.798 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.798 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.798 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.798 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.798 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.798 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.798 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.799 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.799 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.799 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.799 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.799 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.799 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.799 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.799 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.799 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.799 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.799 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.800 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.800 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.800 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.800 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.800 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.800 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.800 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.800 INFO:teuthology.orchestra.run.smithi123.stdout: "rbd_stats_pools": { 2024-06-02T04:19:45.800 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rbd_stats_pools", 2024-06-02T04:19:45.800 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.801 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.801 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.801 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.801 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.801 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.801 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.801 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.801 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.801 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.801 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.801 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.802 INFO:teuthology.orchestra.run.smithi123.stdout: "rbd_stats_pools_refresh_interval": { 2024-06-02T04:19:45.802 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-06-02T04:19:45.802 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.802 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.802 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.802 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "300", 2024-06-02T04:19:45.802 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.802 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.802 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.802 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.802 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.803 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.803 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.803 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.803 INFO:teuthology.orchestra.run.smithi123.stdout: "scrape_interval": { 2024-06-02T04:19:45.803 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "scrape_interval", 2024-06-02T04:19:45.803 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-06-02T04:19:45.803 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.803 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.803 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "15.0", 2024-06-02T04:19:45.803 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.803 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.804 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.804 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.804 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.804 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.804 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.804 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.804 INFO:teuthology.orchestra.run.smithi123.stdout: "server_addr": { 2024-06-02T04:19:45.804 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_addr", 2024-06-02T04:19:45.804 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.804 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.804 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.804 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "::", 2024-06-02T04:19:45.805 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.805 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.805 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.805 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-06-02T04:19:45.805 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.805 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.805 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.805 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.805 INFO:teuthology.orchestra.run.smithi123.stdout: "server_port": { 2024-06-02T04:19:45.805 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_port", 2024-06-02T04:19:45.805 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.806 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.806 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.806 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "9283", 2024-06-02T04:19:45.806 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.806 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.806 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.806 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-06-02T04:19:45.806 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.806 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.806 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.806 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.807 INFO:teuthology.orchestra.run.smithi123.stdout: "stale_cache_strategy": { 2024-06-02T04:19:45.807 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "stale_cache_strategy", 2024-06-02T04:19:45.807 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.807 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.807 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.807 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "log", 2024-06-02T04:19:45.807 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.807 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.807 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.807 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.807 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.807 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.808 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.808 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.808 INFO:teuthology.orchestra.run.smithi123.stdout: "standby_behaviour": { 2024-06-02T04:19:45.808 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "standby_behaviour", 2024-06-02T04:19:45.808 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.808 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.808 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.808 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "default", 2024-06-02T04:19:45.808 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.808 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.809 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.809 INFO:teuthology.orchestra.run.smithi123.stdout: "default", 2024-06-02T04:19:45.809 INFO:teuthology.orchestra.run.smithi123.stdout: "error" 2024-06-02T04:19:45.809 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.809 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.809 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.809 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.809 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.809 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.809 INFO:teuthology.orchestra.run.smithi123.stdout: "standby_error_status_code": { 2024-06-02T04:19:45.809 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "standby_error_status_code", 2024-06-02T04:19:45.809 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.810 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.810 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.810 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "500", 2024-06-02T04:19:45.810 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "400", 2024-06-02T04:19:45.810 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "599", 2024-06-02T04:19:45.810 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.810 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.810 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.810 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.810 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.810 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.811 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.811 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.811 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.811 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rbd_support", 2024-06-02T04:19:45.811 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.811 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.811 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.811 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.812 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.812 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.812 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.812 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.812 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.812 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.812 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.812 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.812 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.812 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.812 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.813 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.813 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.813 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.813 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.813 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.813 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.813 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.813 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.813 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.814 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.814 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.814 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.814 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.814 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.814 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.814 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.814 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.814 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.815 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.815 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.815 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.815 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.815 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.815 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.815 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.815 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.815 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.816 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.816 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.816 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.816 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.816 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.816 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.816 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.816 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.816 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.816 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.817 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.817 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.817 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.817 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.817 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.817 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.817 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.817 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.817 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.818 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.818 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.818 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.818 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.818 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.818 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.818 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.818 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.818 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.819 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.819 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.819 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.819 INFO:teuthology.orchestra.run.smithi123.stdout: "max_concurrent_snap_create": { 2024-06-02T04:19:45.819 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "max_concurrent_snap_create", 2024-06-02T04:19:45.819 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.819 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.819 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.820 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-06-02T04:19:45.820 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.820 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.820 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.820 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.820 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.820 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.821 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.821 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.821 INFO:teuthology.orchestra.run.smithi123.stdout: "mirror_snapshot_schedule": { 2024-06-02T04:19:45.821 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mirror_snapshot_schedule", 2024-06-02T04:19:45.821 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.821 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.821 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.821 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.821 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.822 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.822 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.822 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.822 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.822 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.822 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.822 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.823 INFO:teuthology.orchestra.run.smithi123.stdout: "trash_purge_schedule": { 2024-06-02T04:19:45.823 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "trash_purge_schedule", 2024-06-02T04:19:45.823 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.823 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.823 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.823 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.823 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.823 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.824 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.824 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.824 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.824 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.824 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.824 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.824 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.824 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.824 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.824 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "restful", 2024-06-02T04:19:45.825 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.825 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.825 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.825 INFO:teuthology.orchestra.run.smithi123.stdout: "enable_auth": { 2024-06-02T04:19:45.825 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "enable_auth", 2024-06-02T04:19:45.825 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.825 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.825 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.825 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.825 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.825 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.825 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.826 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.826 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.826 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.826 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.826 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.826 INFO:teuthology.orchestra.run.smithi123.stdout: "key_file": { 2024-06-02T04:19:45.826 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "key_file", 2024-06-02T04:19:45.826 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.826 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.826 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.826 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.827 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.827 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.827 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.827 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.827 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.827 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.827 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.827 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.827 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.827 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.827 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.828 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.828 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.828 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.828 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.828 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.828 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.828 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.828 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.828 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.828 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.828 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.829 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.829 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.829 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.829 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.829 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.829 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.829 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.829 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.829 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.829 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.829 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.829 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.830 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.830 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.830 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.830 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.830 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.830 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.830 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.830 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.830 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.830 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.830 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.831 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.831 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.831 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.831 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.831 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.831 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.831 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.831 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.831 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.831 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.831 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.831 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.832 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.832 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.832 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.832 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.832 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.832 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.832 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.832 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.832 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.832 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.832 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.833 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.833 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.833 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.833 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.833 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.833 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.833 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.833 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.833 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.833 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.833 INFO:teuthology.orchestra.run.smithi123.stdout: "server_addr": { 2024-06-02T04:19:45.833 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_addr", 2024-06-02T04:19:45.834 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.834 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.834 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.834 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.834 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.834 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.834 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.834 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.834 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.834 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.834 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.835 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.835 INFO:teuthology.orchestra.run.smithi123.stdout: "server_port": { 2024-06-02T04:19:45.835 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_port", 2024-06-02T04:19:45.835 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.835 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.835 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.835 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.835 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.835 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.835 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.835 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.835 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.836 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.836 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.836 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.836 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.836 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.836 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.836 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rgw", 2024-06-02T04:19:45.836 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.836 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.836 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.836 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.836 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.837 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.837 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.837 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.837 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.837 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.837 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.837 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.837 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.837 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.837 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.838 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.838 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.838 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.838 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.838 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.838 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.838 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.838 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.838 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.838 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.838 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.839 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.839 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.839 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.839 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.839 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.839 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.839 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.839 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.839 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.839 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.839 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.839 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.840 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.840 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.840 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.840 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.840 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.840 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.840 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.840 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.840 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.840 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.840 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.841 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.841 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.841 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.841 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.841 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.841 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.841 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.841 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.841 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.841 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.841 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.842 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.842 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.842 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.842 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.842 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.842 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.842 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.842 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.842 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.842 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.842 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.842 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.843 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.843 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.843 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.843 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.843 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rook", 2024-06-02T04:19:45.843 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.843 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.843 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.843 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.843 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.843 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.844 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.844 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.844 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.844 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.844 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.844 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.844 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.844 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.845 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.845 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.845 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.845 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.845 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.845 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.845 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.845 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.845 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.845 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.846 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.846 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.846 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.846 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.846 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.846 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.846 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.846 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.846 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.846 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.847 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.847 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.847 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.847 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.847 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.847 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.847 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.847 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.848 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.848 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.848 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.848 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.848 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.848 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.848 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.848 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.848 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.848 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.848 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.849 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.849 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.849 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.849 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.849 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.849 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.849 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.849 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.850 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.850 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.850 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.850 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.850 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.850 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.850 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.850 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.850 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.850 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.851 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.851 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.851 INFO:teuthology.orchestra.run.smithi123.stdout: "storage_class": { 2024-06-02T04:19:45.851 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "storage_class", 2024-06-02T04:19:45.851 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.851 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.851 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.851 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "local", 2024-06-02T04:19:45.851 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.852 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.852 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.852 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-06-02T04:19:45.852 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.852 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.852 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.852 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.852 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.853 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.853 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.853 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "selftest", 2024-06-02T04:19:45.853 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.853 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.853 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.853 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.854 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.854 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.854 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.854 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.854 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.854 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.854 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.854 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.855 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.855 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.855 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.855 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.855 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.855 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.855 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.856 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.856 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.856 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.856 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.856 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.856 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.856 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.857 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.857 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.857 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.857 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.857 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.857 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.857 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.857 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.857 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.858 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.858 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.858 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.858 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.858 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.858 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.858 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.858 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.858 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.858 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.858 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.859 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.859 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.859 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.859 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.859 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.859 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.859 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.859 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.859 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.859 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.859 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.860 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.860 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.860 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.860 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.860 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.860 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.860 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.860 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.860 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.860 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.860 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.860 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.861 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.861 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.861 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.861 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.861 INFO:teuthology.orchestra.run.smithi123.stdout: "roption1": { 2024-06-02T04:19:45.861 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "roption1", 2024-06-02T04:19:45.861 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.861 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.861 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.861 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.861 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.862 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.862 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.862 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.862 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.862 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.862 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.862 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.862 INFO:teuthology.orchestra.run.smithi123.stdout: "roption2": { 2024-06-02T04:19:45.862 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "roption2", 2024-06-02T04:19:45.862 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.862 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.863 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.863 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "xyz", 2024-06-02T04:19:45.863 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.863 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.863 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.863 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.863 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.863 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.863 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.863 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.863 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption1": { 2024-06-02T04:19:45.863 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption1", 2024-06-02T04:19:45.864 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.864 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.864 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.864 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.864 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.864 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.864 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.864 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.864 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.864 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.864 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.865 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.865 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption2": { 2024-06-02T04:19:45.865 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption2", 2024-06-02T04:19:45.865 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.865 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.865 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.865 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.865 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.865 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.865 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.865 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.866 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.866 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.866 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.866 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.866 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption3": { 2024-06-02T04:19:45.866 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption3", 2024-06-02T04:19:45.866 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-06-02T04:19:45.866 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.866 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.866 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.866 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.867 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.867 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.867 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.867 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.867 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.867 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.867 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.867 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption4": { 2024-06-02T04:19:45.867 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption4", 2024-06-02T04:19:45.867 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.867 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.868 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.868 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.868 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.868 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.868 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.868 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.868 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.868 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.868 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.868 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.868 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption5": { 2024-06-02T04:19:45.868 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption5", 2024-06-02T04:19:45.869 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.869 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.869 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.869 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.869 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.869 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.869 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.869 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.869 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.869 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.869 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.870 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.870 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption6": { 2024-06-02T04:19:45.870 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption6", 2024-06-02T04:19:45.870 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.870 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.870 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.870 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.870 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.870 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.870 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.870 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.871 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.871 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.871 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.871 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.871 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption7": { 2024-06-02T04:19:45.871 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption7", 2024-06-02T04:19:45.871 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.871 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.871 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.871 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.871 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "1", 2024-06-02T04:19:45.871 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "42", 2024-06-02T04:19:45.872 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.872 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.872 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.872 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.872 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.872 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.872 INFO:teuthology.orchestra.run.smithi123.stdout: "testkey": { 2024-06-02T04:19:45.872 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "testkey", 2024-06-02T04:19:45.872 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.872 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.872 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.873 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.873 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.873 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.873 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.873 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.873 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.873 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.873 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.873 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.873 INFO:teuthology.orchestra.run.smithi123.stdout: "testlkey": { 2024-06-02T04:19:45.873 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "testlkey", 2024-06-02T04:19:45.874 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.874 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.874 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.874 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.874 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.874 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.874 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.874 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.874 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.874 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.874 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.874 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.875 INFO:teuthology.orchestra.run.smithi123.stdout: "testnewline": { 2024-06-02T04:19:45.875 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "testnewline", 2024-06-02T04:19:45.875 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.875 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.875 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.875 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.875 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.875 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.875 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.875 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.875 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.876 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.876 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.876 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.876 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.876 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.876 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.876 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "snap_schedule", 2024-06-02T04:19:45.876 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.876 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.876 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.876 INFO:teuthology.orchestra.run.smithi123.stdout: "allow_m_granularity": { 2024-06-02T04:19:45.877 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "allow_m_granularity", 2024-06-02T04:19:45.877 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.877 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.877 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.877 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.877 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.877 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.877 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.877 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "allow minute scheduled snapshots", 2024-06-02T04:19:45.877 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.878 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.878 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.878 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.878 INFO:teuthology.orchestra.run.smithi123.stdout: "dump_on_update": { 2024-06-02T04:19:45.878 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "dump_on_update", 2024-06-02T04:19:45.878 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.878 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.878 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.879 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.879 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.879 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.879 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.879 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "dump database to debug log on update", 2024-06-02T04:19:45.879 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.879 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.879 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.879 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.879 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.879 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.879 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.880 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.880 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.880 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.880 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.880 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.880 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.880 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.880 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.881 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.881 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.881 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.881 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.881 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.881 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.881 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.881 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.881 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.881 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.881 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.882 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.882 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.882 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.882 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.882 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.882 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.882 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.882 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.882 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.882 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.882 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.883 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.883 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.883 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.883 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.883 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.883 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.883 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.883 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.883 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.883 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.883 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.884 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.884 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.884 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.884 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.884 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.884 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.884 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.884 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.884 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.884 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.884 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.885 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.885 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.885 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.885 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.885 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.885 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.885 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.885 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.885 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.886 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.886 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.886 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.886 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.886 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.886 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.886 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.886 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.886 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.886 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "stats", 2024-06-02T04:19:45.886 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.887 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.887 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.887 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.887 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.887 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.887 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.887 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.887 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.888 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.888 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.888 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.888 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.888 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.888 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.888 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.888 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.888 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.888 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.889 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.889 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.889 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.889 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.889 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.889 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.889 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.889 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.889 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.890 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.890 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.890 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.890 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.890 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.890 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.890 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.890 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.891 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.891 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.891 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.891 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.891 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.891 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.891 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.892 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.892 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.892 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.892 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.892 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.892 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.892 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.892 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.893 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.893 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.893 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.893 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.893 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.893 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.893 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.893 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.894 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.894 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.894 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.894 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.894 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.894 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.894 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.894 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.894 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.894 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.894 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.895 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.895 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.895 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.895 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.895 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.895 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.895 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "status", 2024-06-02T04:19:45.895 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.895 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.895 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.895 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.896 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.896 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.896 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.896 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.896 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.896 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.896 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.896 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.896 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.896 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.896 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.897 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.897 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.897 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.897 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.897 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.897 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.897 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.897 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.897 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.897 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.897 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.897 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.898 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.898 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.898 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.898 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.898 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.898 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.898 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.898 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.898 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.898 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.898 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.899 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.899 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.899 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.899 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.899 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.899 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.899 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.899 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.899 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.899 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.899 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.900 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.900 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.900 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.900 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.900 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.900 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.900 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.900 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.900 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.900 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.900 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.900 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.901 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.901 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.901 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.901 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.901 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.901 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.901 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.901 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.901 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.901 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.901 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.902 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.902 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.902 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.902 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.902 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "telegraf", 2024-06-02T04:19:45.902 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.902 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.902 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.902 INFO:teuthology.orchestra.run.smithi123.stdout: "address": { 2024-06-02T04:19:45.902 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "address", 2024-06-02T04:19:45.902 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.903 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.903 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.903 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-06-02T04:19:45.903 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.903 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.903 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.903 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.903 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.903 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.903 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.903 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.904 INFO:teuthology.orchestra.run.smithi123.stdout: "interval": { 2024-06-02T04:19:45.904 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "interval", 2024-06-02T04:19:45.904 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:45.904 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.904 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.904 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "15", 2024-06-02T04:19:45.904 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.904 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.904 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.904 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.904 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.904 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.905 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.905 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.905 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.905 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.905 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.905 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.905 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.905 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.905 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.905 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.905 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.906 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.906 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.906 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.906 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.906 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.906 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.906 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.906 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.906 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.906 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.906 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.907 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.907 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.907 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.907 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.907 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.907 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.907 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.907 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.907 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.907 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.907 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.907 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.908 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.908 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.908 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.908 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.908 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.908 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.908 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.908 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.908 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.908 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.909 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.909 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.909 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.909 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.909 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.909 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.909 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.909 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.909 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.909 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.909 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.909 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.910 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.910 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.910 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.910 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.910 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.910 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.910 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.910 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.910 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.910 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.910 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.911 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.911 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.911 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.911 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.911 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.911 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.911 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.911 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.911 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "telemetry", 2024-06-02T04:19:45.911 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.911 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.911 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.912 INFO:teuthology.orchestra.run.smithi123.stdout: "channel_basic": { 2024-06-02T04:19:45.912 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "channel_basic", 2024-06-02T04:19:45.912 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.912 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.912 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.912 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.912 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.912 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.912 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.912 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Share basic cluster information (size, version)", 2024-06-02T04:19:45.913 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.913 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.913 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.913 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.913 INFO:teuthology.orchestra.run.smithi123.stdout: "channel_crash": { 2024-06-02T04:19:45.913 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "channel_crash", 2024-06-02T04:19:45.913 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.913 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.913 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.913 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.914 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.914 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.914 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.914 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-06-02T04:19:45.914 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.914 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.914 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.915 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.915 INFO:teuthology.orchestra.run.smithi123.stdout: "channel_device": { 2024-06-02T04:19:45.915 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "channel_device", 2024-06-02T04:19:45.915 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.915 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.915 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.915 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.915 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.915 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.915 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.915 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-06-02T04:19:45.916 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.916 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.916 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.916 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.916 INFO:teuthology.orchestra.run.smithi123.stdout: "channel_ident": { 2024-06-02T04:19:45.916 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "channel_ident", 2024-06-02T04:19:45.916 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.917 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.917 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.917 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.917 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.917 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.917 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.917 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-06-02T04:19:45.917 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.917 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.917 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.918 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.918 INFO:teuthology.orchestra.run.smithi123.stdout: "channel_perf": { 2024-06-02T04:19:45.918 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "channel_perf", 2024-06-02T04:19:45.918 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.918 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.918 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.918 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.918 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.919 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.919 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.919 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Share various performance metrics of a cluster", 2024-06-02T04:19:45.919 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.919 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.919 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.919 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.919 INFO:teuthology.orchestra.run.smithi123.stdout: "contact": { 2024-06-02T04:19:45.919 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "contact", 2024-06-02T04:19:45.920 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.920 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.920 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.920 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.920 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.920 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.920 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.920 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.920 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.920 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.921 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.921 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.921 INFO:teuthology.orchestra.run.smithi123.stdout: "description": { 2024-06-02T04:19:45.921 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "description", 2024-06-02T04:19:45.921 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.921 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.921 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.922 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.922 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.922 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.922 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.922 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.922 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.922 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.923 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.923 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.923 INFO:teuthology.orchestra.run.smithi123.stdout: "device_url": { 2024-06-02T04:19:45.923 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "device_url", 2024-06-02T04:19:45.923 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.923 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.923 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.924 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-06-02T04:19:45.924 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.924 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.924 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.924 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.924 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.924 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.924 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.925 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.925 INFO:teuthology.orchestra.run.smithi123.stdout: "enabled": { 2024-06-02T04:19:45.925 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "enabled", 2024-06-02T04:19:45.925 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.925 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.925 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.925 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.925 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.926 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.926 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.926 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.926 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.926 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.926 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.926 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.927 INFO:teuthology.orchestra.run.smithi123.stdout: "interval": { 2024-06-02T04:19:45.927 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "interval", 2024-06-02T04:19:45.927 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.927 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.927 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.927 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "24", 2024-06-02T04:19:45.927 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "8", 2024-06-02T04:19:45.927 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.927 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.927 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.928 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.928 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.928 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.928 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.928 INFO:teuthology.orchestra.run.smithi123.stdout: "last_opt_revision": { 2024-06-02T04:19:45.928 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "last_opt_revision", 2024-06-02T04:19:45.928 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.928 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.928 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.929 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "1", 2024-06-02T04:19:45.929 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.929 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.929 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.929 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.929 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.929 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.929 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.929 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.929 INFO:teuthology.orchestra.run.smithi123.stdout: "leaderboard": { 2024-06-02T04:19:45.930 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "leaderboard", 2024-06-02T04:19:45.930 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.930 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.930 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.930 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.930 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.930 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.930 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.930 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.930 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.930 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.931 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.931 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.931 INFO:teuthology.orchestra.run.smithi123.stdout: "leaderboard_description": { 2024-06-02T04:19:45.931 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "leaderboard_description", 2024-06-02T04:19:45.931 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.931 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.931 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.931 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.931 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.931 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.932 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.932 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.932 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.932 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.932 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.932 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.932 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.932 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.932 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.932 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.932 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.933 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.933 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.933 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.933 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.933 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.933 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.933 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.933 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.933 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.933 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.933 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.934 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.934 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.934 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.934 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.934 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.934 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.934 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.934 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.934 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.934 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.935 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.935 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.935 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.935 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.935 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.935 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.935 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.935 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.935 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.935 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.935 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.935 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.936 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.936 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.936 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.936 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.936 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.936 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.936 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.936 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.936 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.936 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.936 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.937 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.937 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.937 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.937 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.937 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.937 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.937 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.937 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.937 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.937 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.937 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.938 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.938 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.938 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.938 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.938 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.938 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.938 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.938 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.938 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.938 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.938 INFO:teuthology.orchestra.run.smithi123.stdout: "organization": { 2024-06-02T04:19:45.939 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "organization", 2024-06-02T04:19:45.939 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.939 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.939 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.939 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.939 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.939 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.939 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.939 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.939 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.939 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.939 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.940 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.940 INFO:teuthology.orchestra.run.smithi123.stdout: "proxy": { 2024-06-02T04:19:45.940 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "proxy", 2024-06-02T04:19:45.940 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.940 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.940 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.940 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.940 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.940 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.940 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.940 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.941 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.941 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.941 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.941 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.941 INFO:teuthology.orchestra.run.smithi123.stdout: "url": { 2024-06-02T04:19:45.941 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "url", 2024-06-02T04:19:45.941 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.941 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.941 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.941 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-06-02T04:19:45.941 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.941 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.942 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.942 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.942 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.942 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.942 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.942 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.942 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.942 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.942 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.942 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "test_orchestrator", 2024-06-02T04:19:45.942 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.943 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.943 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.943 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.943 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.943 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.943 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.943 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.943 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.943 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.943 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.943 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.944 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.944 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.944 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.944 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.944 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.944 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.944 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.944 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.944 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.944 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.944 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.944 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.945 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.945 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.945 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.945 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.945 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.945 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.945 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.945 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.945 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.945 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.945 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.945 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.946 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.946 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.946 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.946 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.946 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.946 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.946 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.946 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.946 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.946 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.946 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.947 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.947 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.947 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.947 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.947 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.947 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.947 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.947 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.947 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.947 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.947 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.948 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.948 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.948 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.948 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.948 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.948 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.948 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.949 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.949 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.949 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.949 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.949 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.949 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.949 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.949 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.949 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.949 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.949 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.950 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "volumes", 2024-06-02T04:19:45.950 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.950 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.950 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.950 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.950 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.950 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.950 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.951 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.951 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.951 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.951 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.951 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.951 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.951 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.951 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.951 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.951 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.952 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.952 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.952 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.952 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.952 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.952 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.952 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.952 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.953 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.953 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.953 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.953 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.953 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.953 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.953 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.953 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.953 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.953 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.953 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.954 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.954 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.954 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.954 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.954 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.954 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.954 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.954 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.954 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.954 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.954 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.955 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.955 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.955 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.955 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.955 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.955 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.955 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.955 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.955 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.955 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.955 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.955 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.956 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.956 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.956 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.956 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.956 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.956 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.956 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.956 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.956 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.956 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.956 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.957 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.957 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.957 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.957 INFO:teuthology.orchestra.run.smithi123.stdout: "max_concurrent_clones": { 2024-06-02T04:19:45.957 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "max_concurrent_clones", 2024-06-02T04:19:45.957 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.957 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.957 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.957 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "4", 2024-06-02T04:19:45.957 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.957 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.958 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.958 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Number of asynchronous cloner threads", 2024-06-02T04:19:45.958 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.958 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.958 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.958 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.958 INFO:teuthology.orchestra.run.smithi123.stdout: "snapshot_clone_delay": { 2024-06-02T04:19:45.958 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "snapshot_clone_delay", 2024-06-02T04:19:45.958 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.958 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.959 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.959 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0", 2024-06-02T04:19:45.959 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.959 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.959 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.959 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-06-02T04:19:45.959 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.959 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.960 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.960 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.960 INFO:teuthology.orchestra.run.smithi123.stdout: "snapshot_clone_no_wait": { 2024-06-02T04:19:45.960 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "snapshot_clone_no_wait", 2024-06-02T04:19:45.960 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.960 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.960 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.960 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.960 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.960 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.961 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.961 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-06-02T04:19:45.961 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.961 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.961 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.961 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.961 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.962 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.962 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.962 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "zabbix", 2024-06-02T04:19:45.962 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.962 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.962 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.962 INFO:teuthology.orchestra.run.smithi123.stdout: "discovery_interval": { 2024-06-02T04:19:45.963 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "discovery_interval", 2024-06-02T04:19:45.963 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "uint", 2024-06-02T04:19:45.963 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.963 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.963 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "100", 2024-06-02T04:19:45.963 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.963 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.963 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.964 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.964 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.964 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.964 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.964 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.964 INFO:teuthology.orchestra.run.smithi123.stdout: "identifier": { 2024-06-02T04:19:45.964 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "identifier", 2024-06-02T04:19:45.964 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.965 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.965 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.965 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.965 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.965 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.965 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.965 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.965 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.965 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.965 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.965 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.965 INFO:teuthology.orchestra.run.smithi123.stdout: "interval": { 2024-06-02T04:19:45.966 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "interval", 2024-06-02T04:19:45.966 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:45.966 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.966 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.966 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "60", 2024-06-02T04:19:45.966 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.966 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.966 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.966 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.966 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.966 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.967 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.967 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.967 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.967 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.967 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.967 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.967 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.967 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.967 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.967 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.967 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.967 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.968 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.968 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.968 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.968 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.968 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.968 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.968 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.968 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.968 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.968 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.968 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.968 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.969 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.969 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.969 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.969 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.969 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.969 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.969 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.969 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.969 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.969 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.969 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.970 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.970 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.970 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.970 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.970 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.970 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.970 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.970 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.970 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.970 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.970 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.971 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.971 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.971 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.971 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.971 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.971 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.971 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.971 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.971 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.972 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.972 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.972 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.972 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.972 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.972 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.972 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.972 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.972 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.972 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.972 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.972 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.972 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: "zabbix_host": { 2024-06-02T04:19:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "zabbix_host", 2024-06-02T04:19:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.973 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.974 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.974 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.974 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.974 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.974 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.974 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.974 INFO:teuthology.orchestra.run.smithi123.stdout: "zabbix_port": { 2024-06-02T04:19:45.974 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "zabbix_port", 2024-06-02T04:19:45.974 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.974 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.974 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.975 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10051", 2024-06-02T04:19:45.975 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.975 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.975 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.975 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.975 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.975 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.975 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.975 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.975 INFO:teuthology.orchestra.run.smithi123.stdout: "zabbix_sender": { 2024-06-02T04:19:45.975 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "zabbix_sender", 2024-06-02T04:19:45.975 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.975 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.976 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:45.976 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-06-02T04:19:45.976 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.976 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.976 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.976 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.976 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.976 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.976 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.976 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.976 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.976 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.976 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-06-02T04:19:45.977 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.977 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.977 INFO:teuthology.orchestra.run.smithi123.stdout: "modules": [ 2024-06-02T04:19:45.977 INFO:teuthology.orchestra.run.smithi123.stdout: "cephadm", 2024-06-02T04:19:45.977 INFO:teuthology.orchestra.run.smithi123.stdout: "dashboard", 2024-06-02T04:19:45.977 INFO:teuthology.orchestra.run.smithi123.stdout: "iostat", 2024-06-02T04:19:45.977 INFO:teuthology.orchestra.run.smithi123.stdout: "nfs", 2024-06-02T04:19:45.977 INFO:teuthology.orchestra.run.smithi123.stdout: "restful" 2024-06-02T04:19:45.977 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.977 INFO:teuthology.orchestra.run.smithi123.stdout: "available_modules": [ 2024-06-02T04:19:45.977 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.977 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "alerts", 2024-06-02T04:19:45.978 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.978 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.978 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.978 INFO:teuthology.orchestra.run.smithi123.stdout: "interval": { 2024-06-02T04:19:45.978 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "interval", 2024-06-02T04:19:45.978 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:45.978 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.978 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.978 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "60", 2024-06-02T04:19:45.978 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.978 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.978 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.979 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "How frequently to reexamine health status", 2024-06-02T04:19:45.979 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.979 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.979 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.979 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.979 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:45.979 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:45.979 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.979 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.979 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.979 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.979 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.979 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.979 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.980 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.980 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.981 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.981 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.981 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.981 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.981 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.981 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.982 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.982 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.982 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.982 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.982 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:45.982 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:45.982 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.982 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.982 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.982 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.982 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.982 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.983 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.983 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.983 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.983 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.983 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.983 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.983 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:45.983 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:45.983 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.983 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.983 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.983 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:45.983 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.983 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.984 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:45.984 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:45.984 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:45.984 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:45.984 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:45.984 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:45.984 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:45.984 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:45.984 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.984 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.984 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.984 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.984 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.985 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:45.985 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:45.985 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.985 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.985 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.985 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:45.985 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.985 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.985 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.985 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:45.985 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.985 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.985 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.986 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.986 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_destination": { 2024-06-02T04:19:45.986 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_destination", 2024-06-02T04:19:45.986 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.986 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.986 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.986 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.986 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.986 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.986 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.987 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Email address to send alerts to", 2024-06-02T04:19:45.987 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.987 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.987 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.987 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.987 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_from_name": { 2024-06-02T04:19:45.987 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_from_name", 2024-06-02T04:19:45.987 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.987 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.987 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.987 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "Ceph", 2024-06-02T04:19:45.988 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.988 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.988 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.988 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Email From: name", 2024-06-02T04:19:45.988 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.988 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.988 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.988 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.988 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_host": { 2024-06-02T04:19:45.988 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_host", 2024-06-02T04:19:45.988 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.988 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.988 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.989 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.989 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.989 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.989 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.989 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "SMTP server", 2024-06-02T04:19:45.989 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.989 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.989 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.989 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.990 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_password": { 2024-06-02T04:19:45.990 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_password", 2024-06-02T04:19:45.990 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.990 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.990 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.990 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.990 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.990 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.990 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.990 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Password to authenticate with", 2024-06-02T04:19:45.991 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.991 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.991 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.991 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.991 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_port": { 2024-06-02T04:19:45.991 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_port", 2024-06-02T04:19:45.991 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:45.991 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.991 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.992 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "465", 2024-06-02T04:19:45.992 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.992 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.992 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.992 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "SMTP port", 2024-06-02T04:19:45.992 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.992 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.992 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.992 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.992 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_sender": { 2024-06-02T04:19:45.992 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_sender", 2024-06-02T04:19:45.992 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.993 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.993 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.993 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.993 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.993 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.993 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.993 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "SMTP envelope sender", 2024-06-02T04:19:45.993 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.993 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.993 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.994 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.994 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_ssl": { 2024-06-02T04:19:45.994 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_ssl", 2024-06-02T04:19:45.994 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.994 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.994 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.994 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.994 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.994 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.994 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.995 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Use SSL to connect to SMTP server", 2024-06-02T04:19:45.995 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.995 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.995 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.995 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.995 INFO:teuthology.orchestra.run.smithi123.stdout: "smtp_user": { 2024-06-02T04:19:45.995 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "smtp_user", 2024-06-02T04:19:45.995 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.995 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.996 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.996 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:45.996 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.996 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.996 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.996 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "User to authenticate as", 2024-06-02T04:19:45.996 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.996 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.997 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.997 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.997 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:45.997 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.997 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:45.997 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "balancer", 2024-06-02T04:19:45.997 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:45.997 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:45.998 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:45.998 INFO:teuthology.orchestra.run.smithi123.stdout: "active": { 2024-06-02T04:19:45.998 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "active", 2024-06-02T04:19:45.998 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:45.998 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:45.998 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:45.998 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:45.998 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:45.999 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:45.999 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:45.999 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "automatically balance PGs across cluster", 2024-06-02T04:19:45.999 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:45.999 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:45.999 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:45.999 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:45.999 INFO:teuthology.orchestra.run.smithi123.stdout: "begin_time": { 2024-06-02T04:19:45.999 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "begin_time", 2024-06-02T04:19:45.999 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:45.999 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.000 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.000 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0000", 2024-06-02T04:19:46.000 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.000 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.000 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.000 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "beginning time of day to automatically balance", 2024-06-02T04:19:46.000 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-02T04:19:46.000 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.000 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.000 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.000 INFO:teuthology.orchestra.run.smithi123.stdout: "begin_weekday": { 2024-06-02T04:19:46.000 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "begin_weekday", 2024-06-02T04:19:46.001 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "uint", 2024-06-02T04:19:46.001 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.001 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.001 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0", 2024-06-02T04:19:46.001 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "0", 2024-06-02T04:19:46.001 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "6", 2024-06-02T04:19:46.001 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.001 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-06-02T04:19:46.001 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-02T04:19:46.001 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.001 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.001 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.001 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_compat_max_iterations": { 2024-06-02T04:19:46.002 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "crush_compat_max_iterations", 2024-06-02T04:19:46.002 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "uint", 2024-06-02T04:19:46.002 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.002 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.002 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "25", 2024-06-02T04:19:46.002 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "1", 2024-06-02T04:19:46.002 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "250", 2024-06-02T04:19:46.002 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.002 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-06-02T04:19:46.002 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.002 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.002 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.003 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.003 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_compat_metrics": { 2024-06-02T04:19:46.003 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "crush_compat_metrics", 2024-06-02T04:19:46.003 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.003 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.003 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.003 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "pgs,objects,bytes", 2024-06-02T04:19:46.003 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.003 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.003 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.003 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-06-02T04:19:46.003 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-06-02T04:19:46.003 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.004 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.004 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.004 INFO:teuthology.orchestra.run.smithi123.stdout: "crush_compat_step": { 2024-06-02T04:19:46.004 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "crush_compat_step", 2024-06-02T04:19:46.004 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-06-02T04:19:46.004 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.004 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.004 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0.5", 2024-06-02T04:19:46.004 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "0.001", 2024-06-02T04:19:46.004 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "0.999", 2024-06-02T04:19:46.004 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.004 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "aggressiveness of optimization", 2024-06-02T04:19:46.005 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-06-02T04:19:46.005 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.005 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.005 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.005 INFO:teuthology.orchestra.run.smithi123.stdout: "end_time": { 2024-06-02T04:19:46.005 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "end_time", 2024-06-02T04:19:46.005 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.005 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.005 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.005 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "2359", 2024-06-02T04:19:46.005 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.005 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.005 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.006 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "ending time of day to automatically balance", 2024-06-02T04:19:46.006 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-06-02T04:19:46.006 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.006 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.006 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.006 INFO:teuthology.orchestra.run.smithi123.stdout: "end_weekday": { 2024-06-02T04:19:46.006 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "end_weekday", 2024-06-02T04:19:46.006 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "uint", 2024-06-02T04:19:46.006 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.006 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.006 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0", 2024-06-02T04:19:46.006 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "0", 2024-06-02T04:19:46.006 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "6", 2024-06-02T04:19:46.007 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.007 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-06-02T04:19:46.007 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-06-02T04:19:46.007 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.007 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.007 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.007 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.007 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.007 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.007 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.007 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.007 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.007 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.008 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.008 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.008 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.008 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.008 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.008 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.008 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.008 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.008 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.008 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.008 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.008 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.008 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.009 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.009 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.009 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.009 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.009 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.009 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.009 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.009 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.009 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.009 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.009 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.009 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.009 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.010 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.010 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.010 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.010 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.010 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.010 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.010 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.010 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.010 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.010 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.010 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.010 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.011 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.011 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.011 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.011 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.011 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.011 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.011 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.011 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.011 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.011 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.011 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.011 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.011 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.012 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.012 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.012 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.012 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.012 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.012 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.012 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.012 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.012 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.012 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.012 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.012 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.012 INFO:teuthology.orchestra.run.smithi123.stdout: "min_score": { 2024-06-02T04:19:46.013 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "min_score", 2024-06-02T04:19:46.013 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-06-02T04:19:46.013 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.013 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.013 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0", 2024-06-02T04:19:46.013 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.013 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.013 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.013 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-06-02T04:19:46.013 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.013 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.013 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.013 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.013 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": { 2024-06-02T04:19:46.014 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mode", 2024-06-02T04:19:46.014 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.014 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.014 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.014 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "upmap", 2024-06-02T04:19:46.014 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.014 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.014 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.014 INFO:teuthology.orchestra.run.smithi123.stdout: "crush-compat", 2024-06-02T04:19:46.014 INFO:teuthology.orchestra.run.smithi123.stdout: "none", 2024-06-02T04:19:46.014 INFO:teuthology.orchestra.run.smithi123.stdout: "upmap" 2024-06-02T04:19:46.015 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.015 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Balancer mode", 2024-06-02T04:19:46.015 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.015 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.015 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.015 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.015 INFO:teuthology.orchestra.run.smithi123.stdout: "pool_ids": { 2024-06-02T04:19:46.015 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "pool_ids", 2024-06-02T04:19:46.015 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.015 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.015 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.015 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.015 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.015 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.016 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.016 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-06-02T04:19:46.016 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.016 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.016 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.016 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.016 INFO:teuthology.orchestra.run.smithi123.stdout: "sleep_interval": { 2024-06-02T04:19:46.016 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "sleep_interval", 2024-06-02T04:19:46.016 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:46.016 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.016 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.017 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "60", 2024-06-02T04:19:46.017 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.017 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.017 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.017 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-06-02T04:19:46.017 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.017 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.017 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.017 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.017 INFO:teuthology.orchestra.run.smithi123.stdout: "upmap_max_deviation": { 2024-06-02T04:19:46.017 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "upmap_max_deviation", 2024-06-02T04:19:46.018 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.018 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.018 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.018 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "5", 2024-06-02T04:19:46.018 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "1", 2024-06-02T04:19:46.018 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.018 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.018 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "deviation below which no optimization is attempted", 2024-06-02T04:19:46.018 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-06-02T04:19:46.018 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.018 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.018 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.019 INFO:teuthology.orchestra.run.smithi123.stdout: "upmap_max_optimizations": { 2024-06-02T04:19:46.019 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "upmap_max_optimizations", 2024-06-02T04:19:46.019 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "uint", 2024-06-02T04:19:46.019 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.019 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.019 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-06-02T04:19:46.019 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.019 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.019 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.019 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-06-02T04:19:46.019 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.019 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.019 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.020 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.020 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.020 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.020 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.020 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "cephadm", 2024-06-02T04:19:46.020 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:46.020 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:46.020 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:46.021 INFO:teuthology.orchestra.run.smithi123.stdout: "agent_down_multiplier": { 2024-06-02T04:19:46.021 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "agent_down_multiplier", 2024-06-02T04:19:46.021 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-06-02T04:19:46.021 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.021 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.021 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "3.0", 2024-06-02T04:19:46.021 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.021 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.021 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.021 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-06-02T04:19:46.021 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.021 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.021 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.022 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.022 INFO:teuthology.orchestra.run.smithi123.stdout: "agent_refresh_rate": { 2024-06-02T04:19:46.022 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "agent_refresh_rate", 2024-06-02T04:19:46.022 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:46.022 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.022 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.022 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "20", 2024-06-02T04:19:46.022 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.022 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.022 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.023 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-06-02T04:19:46.023 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.023 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.023 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.023 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.023 INFO:teuthology.orchestra.run.smithi123.stdout: "agent_starting_port": { 2024-06-02T04:19:46.023 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "agent_starting_port", 2024-06-02T04:19:46.023 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.023 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.023 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.023 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "4721", 2024-06-02T04:19:46.023 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.023 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.024 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.024 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-06-02T04:19:46.024 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.024 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.024 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.024 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.024 INFO:teuthology.orchestra.run.smithi123.stdout: "allow_ptrace": { 2024-06-02T04:19:46.024 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "allow_ptrace", 2024-06-02T04:19:46.024 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.024 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.024 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.025 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.025 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.025 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.025 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.025 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-06-02T04:19:46.025 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-06-02T04:19:46.025 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.025 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.025 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.025 INFO:teuthology.orchestra.run.smithi123.stdout: "autotune_interval": { 2024-06-02T04:19:46.025 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "autotune_interval", 2024-06-02T04:19:46.025 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:46.026 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.026 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.026 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "600", 2024-06-02T04:19:46.026 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.026 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.026 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.026 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how frequently to autotune daemon memory", 2024-06-02T04:19:46.026 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.026 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.027 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.027 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.027 INFO:teuthology.orchestra.run.smithi123.stdout: "autotune_memory_target_ratio": { 2024-06-02T04:19:46.027 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "autotune_memory_target_ratio", 2024-06-02T04:19:46.027 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-06-02T04:19:46.027 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.027 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.027 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0.7", 2024-06-02T04:19:46.027 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.027 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.027 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.028 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-06-02T04:19:46.028 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.028 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.028 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.028 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.028 INFO:teuthology.orchestra.run.smithi123.stdout: "cgroups_split": { 2024-06-02T04:19:46.028 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "cgroups_split", 2024-06-02T04:19:46.028 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.028 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.029 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.029 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.029 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.029 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.029 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.029 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-06-02T04:19:46.029 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.029 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.029 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.029 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.029 INFO:teuthology.orchestra.run.smithi123.stdout: "config_checks_enabled": { 2024-06-02T04:19:46.029 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "config_checks_enabled", 2024-06-02T04:19:46.029 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.029 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.030 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.030 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.030 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.030 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.030 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.030 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-06-02T04:19:46.030 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.030 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.030 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.030 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.030 INFO:teuthology.orchestra.run.smithi123.stdout: "config_dashboard": { 2024-06-02T04:19:46.031 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "config_dashboard", 2024-06-02T04:19:46.031 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.031 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.031 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.031 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.031 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.031 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.031 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.031 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-06-02T04:19:46.031 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.031 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.031 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.032 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.032 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_alertmanager": { 2024-06-02T04:19:46.032 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_alertmanager", 2024-06-02T04:19:46.032 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.032 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.032 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.032 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-06-02T04:19:46.032 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.032 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.032 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.032 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Prometheus container image", 2024-06-02T04:19:46.032 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.032 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.033 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.033 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.033 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_base": { 2024-06-02T04:19:46.033 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_base", 2024-06-02T04:19:46.033 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.033 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.033 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.033 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/ceph/ceph", 2024-06-02T04:19:46.033 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.033 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.034 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.034 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Container image name, without the tag", 2024-06-02T04:19:46.034 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.034 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.034 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.034 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.034 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_elasticsearch": { 2024-06-02T04:19:46.035 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_elasticsearch", 2024-06-02T04:19:46.035 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.035 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.035 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.035 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-06-02T04:19:46.035 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.035 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.035 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.036 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "elasticsearch container image", 2024-06-02T04:19:46.036 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.036 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.036 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.036 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.036 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_grafana": { 2024-06-02T04:19:46.036 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_grafana", 2024-06-02T04:19:46.036 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.037 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.037 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.037 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-06-02T04:19:46.037 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.037 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.037 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.037 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Prometheus container image", 2024-06-02T04:19:46.037 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.037 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.037 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.037 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.037 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_haproxy": { 2024-06-02T04:19:46.038 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_haproxy", 2024-06-02T04:19:46.038 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.038 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.038 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.038 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-06-02T04:19:46.038 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.038 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.038 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.038 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "HAproxy container image", 2024-06-02T04:19:46.038 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.038 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.038 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.038 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.039 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_jaeger_agent": { 2024-06-02T04:19:46.039 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_jaeger_agent", 2024-06-02T04:19:46.039 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.039 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.039 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.039 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-06-02T04:19:46.039 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.039 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.039 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.039 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Jaeger agent container image", 2024-06-02T04:19:46.039 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.039 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.039 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.040 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.040 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_jaeger_collector": { 2024-06-02T04:19:46.040 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_jaeger_collector", 2024-06-02T04:19:46.040 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.040 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.040 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.040 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-06-02T04:19:46.040 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.040 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.040 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.040 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Jaeger collector container image", 2024-06-02T04:19:46.040 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.040 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.040 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.041 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.041 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_jaeger_query": { 2024-06-02T04:19:46.041 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_jaeger_query", 2024-06-02T04:19:46.041 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.041 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.041 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.041 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-06-02T04:19:46.041 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.041 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.041 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.041 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Jaeger query container image", 2024-06-02T04:19:46.041 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.041 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.042 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.042 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.042 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_keepalived": { 2024-06-02T04:19:46.042 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_keepalived", 2024-06-02T04:19:46.042 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.042 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.042 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.042 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-06-02T04:19:46.042 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.042 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.042 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.042 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Keepalived container image", 2024-06-02T04:19:46.042 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.043 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.043 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.043 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.043 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_loki": { 2024-06-02T04:19:46.043 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_loki", 2024-06-02T04:19:46.043 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.043 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.043 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.043 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-06-02T04:19:46.043 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.043 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.043 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.043 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Loki container image", 2024-06-02T04:19:46.044 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.044 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.044 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.044 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.044 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_node_exporter": { 2024-06-02T04:19:46.044 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_node_exporter", 2024-06-02T04:19:46.044 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.044 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.044 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.044 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-06-02T04:19:46.044 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.044 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.044 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.045 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Prometheus container image", 2024-06-02T04:19:46.045 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.045 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.045 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.045 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.045 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_nvmeof": { 2024-06-02T04:19:46.045 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_nvmeof", 2024-06-02T04:19:46.045 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.045 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.045 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.045 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-06-02T04:19:46.045 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.045 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.046 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.046 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Nvme-of container image", 2024-06-02T04:19:46.046 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.046 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.046 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.046 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.046 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_prometheus": { 2024-06-02T04:19:46.046 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_prometheus", 2024-06-02T04:19:46.046 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.046 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.046 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.047 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-06-02T04:19:46.047 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.047 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.047 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.047 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Prometheus container image", 2024-06-02T04:19:46.047 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.047 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.047 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.047 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.047 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_promtail": { 2024-06-02T04:19:46.047 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_promtail", 2024-06-02T04:19:46.047 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.047 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.048 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.048 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-06-02T04:19:46.048 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.048 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.048 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.048 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Promtail container image", 2024-06-02T04:19:46.048 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.048 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.048 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.048 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.048 INFO:teuthology.orchestra.run.smithi123.stdout: "container_image_snmp_gateway": { 2024-06-02T04:19:46.048 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_image_snmp_gateway", 2024-06-02T04:19:46.048 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.048 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.049 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.049 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-06-02T04:19:46.049 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.049 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.049 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.049 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "SNMP Gateway container image", 2024-06-02T04:19:46.049 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.049 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.049 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.049 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.049 INFO:teuthology.orchestra.run.smithi123.stdout: "container_init": { 2024-06-02T04:19:46.049 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "container_init", 2024-06-02T04:19:46.049 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.049 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.050 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.050 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.050 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.050 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.050 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.050 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Run podman/docker with `--init`", 2024-06-02T04:19:46.050 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.050 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.050 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.050 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.050 INFO:teuthology.orchestra.run.smithi123.stdout: "daemon_cache_timeout": { 2024-06-02T04:19:46.050 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "daemon_cache_timeout", 2024-06-02T04:19:46.051 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:46.051 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.051 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.051 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "600", 2024-06-02T04:19:46.051 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.051 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.051 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.051 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-06-02T04:19:46.051 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.051 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.051 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.052 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.052 INFO:teuthology.orchestra.run.smithi123.stdout: "default_cephadm_command_timeout": { 2024-06-02T04:19:46.052 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "default_cephadm_command_timeout", 2024-06-02T04:19:46.052 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.052 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.052 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.052 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "900", 2024-06-02T04:19:46.052 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.052 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.052 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.052 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-06-02T04:19:46.052 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.053 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.053 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.053 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.053 INFO:teuthology.orchestra.run.smithi123.stdout: "default_registry": { 2024-06-02T04:19:46.053 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "default_registry", 2024-06-02T04:19:46.053 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.053 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.053 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.053 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "docker.io", 2024-06-02T04:19:46.053 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.053 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.053 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.053 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-06-02T04:19:46.053 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.054 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.054 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.054 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.054 INFO:teuthology.orchestra.run.smithi123.stdout: "device_cache_timeout": { 2024-06-02T04:19:46.054 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "device_cache_timeout", 2024-06-02T04:19:46.054 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:46.054 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.054 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.054 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "1800", 2024-06-02T04:19:46.054 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.055 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.055 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.055 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "seconds to cache device inventory", 2024-06-02T04:19:46.055 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.055 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.055 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.055 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.055 INFO:teuthology.orchestra.run.smithi123.stdout: "device_enhanced_scan": { 2024-06-02T04:19:46.055 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "device_enhanced_scan", 2024-06-02T04:19:46.055 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.055 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.055 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.055 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.056 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.056 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.056 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.056 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Use libstoragemgmt during device scans", 2024-06-02T04:19:46.056 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.056 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.056 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.056 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.056 INFO:teuthology.orchestra.run.smithi123.stdout: "facts_cache_timeout": { 2024-06-02T04:19:46.056 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "facts_cache_timeout", 2024-06-02T04:19:46.056 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:46.056 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.056 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.057 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "60", 2024-06-02T04:19:46.057 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.057 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.057 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.057 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "seconds to cache host facts data", 2024-06-02T04:19:46.057 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.057 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.057 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.057 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.057 INFO:teuthology.orchestra.run.smithi123.stdout: "host_check_interval": { 2024-06-02T04:19:46.057 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "host_check_interval", 2024-06-02T04:19:46.057 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:46.057 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.057 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.058 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "600", 2024-06-02T04:19:46.058 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.058 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.058 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.058 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how frequently to perform a host check", 2024-06-02T04:19:46.058 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.058 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.058 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.058 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.058 INFO:teuthology.orchestra.run.smithi123.stdout: "hw_monitoring": { 2024-06-02T04:19:46.059 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "hw_monitoring", 2024-06-02T04:19:46.059 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.059 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.059 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.059 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.059 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.059 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.059 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.059 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-06-02T04:19:46.059 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.059 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.059 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.059 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.059 INFO:teuthology.orchestra.run.smithi123.stdout: "inventory_list_all": { 2024-06-02T04:19:46.060 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "inventory_list_all", 2024-06-02T04:19:46.060 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.060 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.060 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.060 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.060 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.060 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.060 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.060 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-06-02T04:19:46.060 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.060 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.061 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.061 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.061 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.061 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.061 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.061 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.061 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.061 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.061 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.061 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.061 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.062 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.062 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.062 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.062 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.062 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.062 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.062 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.062 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.062 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.062 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.063 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.063 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.063 INFO:teuthology.orchestra.run.smithi123.stdout: "log_refresh_metadata": { 2024-06-02T04:19:46.063 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_refresh_metadata", 2024-06-02T04:19:46.063 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.063 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.063 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.063 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.063 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.063 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.063 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.063 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-06-02T04:19:46.064 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.064 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.064 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.064 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.064 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.064 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.064 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.064 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.064 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.064 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.064 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.065 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.065 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.065 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-06-02T04:19:46.065 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.065 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.065 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.065 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.065 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.065 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.065 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.065 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.066 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.066 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.066 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.066 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.066 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.066 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.066 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.066 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.066 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.066 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.067 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.067 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.067 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.067 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.067 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.067 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.067 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.067 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.067 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.067 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.068 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.068 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.068 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.068 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.068 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.068 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.068 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.068 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.068 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.069 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.069 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.069 INFO:teuthology.orchestra.run.smithi123.stdout: "manage_etc_ceph_ceph_conf": { 2024-06-02T04:19:46.069 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-06-02T04:19:46.069 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.069 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.069 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.070 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.070 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.070 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.070 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.070 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-06-02T04:19:46.070 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.070 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.070 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.071 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.071 INFO:teuthology.orchestra.run.smithi123.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-06-02T04:19:46.071 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-06-02T04:19:46.071 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.071 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.071 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.071 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "*", 2024-06-02T04:19:46.071 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.071 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.071 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.071 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-06-02T04:19:46.071 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.071 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.072 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.072 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.072 INFO:teuthology.orchestra.run.smithi123.stdout: "max_count_per_host": { 2024-06-02T04:19:46.072 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "max_count_per_host", 2024-06-02T04:19:46.072 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.072 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.072 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.072 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-06-02T04:19:46.072 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.072 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.072 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.072 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "max number of daemons per service per host", 2024-06-02T04:19:46.072 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.072 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.073 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.073 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.073 INFO:teuthology.orchestra.run.smithi123.stdout: "max_osd_draining_count": { 2024-06-02T04:19:46.073 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "max_osd_draining_count", 2024-06-02T04:19:46.073 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.073 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.073 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.073 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-06-02T04:19:46.073 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.073 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.073 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.073 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-06-02T04:19:46.073 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.074 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.074 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.074 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.074 INFO:teuthology.orchestra.run.smithi123.stdout: "migration_current": { 2024-06-02T04:19:46.074 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "migration_current", 2024-06-02T04:19:46.074 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.074 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.074 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.074 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.074 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.074 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.074 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.074 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "internal - do not modify", 2024-06-02T04:19:46.075 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.075 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.075 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.075 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.075 INFO:teuthology.orchestra.run.smithi123.stdout: "mode": { 2024-06-02T04:19:46.075 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mode", 2024-06-02T04:19:46.075 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.075 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.075 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.075 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "root", 2024-06-02T04:19:46.075 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.075 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.075 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.075 INFO:teuthology.orchestra.run.smithi123.stdout: "cephadm-package", 2024-06-02T04:19:46.076 INFO:teuthology.orchestra.run.smithi123.stdout: "root" 2024-06-02T04:19:46.076 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.076 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "mode for remote execution of cephadm", 2024-06-02T04:19:46.076 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.076 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.076 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.076 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.076 INFO:teuthology.orchestra.run.smithi123.stdout: "oob_default_addr": { 2024-06-02T04:19:46.076 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "oob_default_addr", 2024-06-02T04:19:46.076 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.076 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.076 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.076 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "169.254.1.1", 2024-06-02T04:19:46.076 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.076 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.077 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.077 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Default address for RedFish API (oob management).", 2024-06-02T04:19:46.077 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.077 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.077 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.077 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.077 INFO:teuthology.orchestra.run.smithi123.stdout: "prometheus_alerts_path": { 2024-06-02T04:19:46.077 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "prometheus_alerts_path", 2024-06-02T04:19:46.077 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.077 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.077 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.077 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-06-02T04:19:46.077 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.077 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.078 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.078 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-06-02T04:19:46.078 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.078 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.078 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.078 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.078 INFO:teuthology.orchestra.run.smithi123.stdout: "registry_insecure": { 2024-06-02T04:19:46.078 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "registry_insecure", 2024-06-02T04:19:46.078 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.078 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.078 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.078 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.078 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.078 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.079 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.079 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-06-02T04:19:46.079 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.079 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.079 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.079 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.079 INFO:teuthology.orchestra.run.smithi123.stdout: "registry_password": { 2024-06-02T04:19:46.079 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "registry_password", 2024-06-02T04:19:46.079 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.079 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.079 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.079 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.079 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.079 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.080 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.080 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-06-02T04:19:46.080 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.080 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.080 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.080 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.080 INFO:teuthology.orchestra.run.smithi123.stdout: "registry_url": { 2024-06-02T04:19:46.080 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "registry_url", 2024-06-02T04:19:46.080 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.080 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.080 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.080 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.080 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.080 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.081 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.081 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-06-02T04:19:46.081 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.081 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.081 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.081 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.081 INFO:teuthology.orchestra.run.smithi123.stdout: "registry_username": { 2024-06-02T04:19:46.081 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "registry_username", 2024-06-02T04:19:46.081 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.081 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.081 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.081 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.081 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.081 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.082 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.082 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-06-02T04:19:46.082 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.082 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.082 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.082 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.082 INFO:teuthology.orchestra.run.smithi123.stdout: "secure_monitoring_stack": { 2024-06-02T04:19:46.082 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "secure_monitoring_stack", 2024-06-02T04:19:46.082 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.082 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.082 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.082 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.083 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.083 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.083 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.083 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-06-02T04:19:46.083 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.083 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.083 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.083 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.083 INFO:teuthology.orchestra.run.smithi123.stdout: "service_discovery_port": { 2024-06-02T04:19:46.083 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "service_discovery_port", 2024-06-02T04:19:46.083 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.083 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.083 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.083 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "8765", 2024-06-02T04:19:46.084 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.084 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.084 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.084 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "cephadm service discovery port", 2024-06-02T04:19:46.084 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.084 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.084 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.084 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.084 INFO:teuthology.orchestra.run.smithi123.stdout: "ssh_config_file": { 2024-06-02T04:19:46.084 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ssh_config_file", 2024-06-02T04:19:46.084 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.084 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.084 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.084 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.085 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.085 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.085 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.085 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-06-02T04:19:46.085 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.085 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.085 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.085 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.085 INFO:teuthology.orchestra.run.smithi123.stdout: "use_agent": { 2024-06-02T04:19:46.085 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "use_agent", 2024-06-02T04:19:46.085 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.085 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.085 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.085 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.086 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.086 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.086 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.086 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-06-02T04:19:46.086 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.086 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.086 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.086 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.086 INFO:teuthology.orchestra.run.smithi123.stdout: "use_repo_digest": { 2024-06-02T04:19:46.086 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "use_repo_digest", 2024-06-02T04:19:46.086 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.086 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.087 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.087 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.087 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.087 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.087 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.087 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-06-02T04:19:46.087 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.087 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.087 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.087 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.087 INFO:teuthology.orchestra.run.smithi123.stdout: "warn_on_failed_host_check": { 2024-06-02T04:19:46.087 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "warn_on_failed_host_check", 2024-06-02T04:19:46.087 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.087 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.088 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.088 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.088 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.088 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.088 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.088 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "raise a health warning if the host check fails", 2024-06-02T04:19:46.088 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.088 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.088 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.088 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.088 INFO:teuthology.orchestra.run.smithi123.stdout: "warn_on_stray_daemons": { 2024-06-02T04:19:46.088 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "warn_on_stray_daemons", 2024-06-02T04:19:46.089 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.089 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.089 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.089 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.089 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.089 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.089 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.089 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-06-02T04:19:46.089 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.089 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.089 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.089 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.089 INFO:teuthology.orchestra.run.smithi123.stdout: "warn_on_stray_hosts": { 2024-06-02T04:19:46.089 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "warn_on_stray_hosts", 2024-06-02T04:19:46.090 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.090 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.090 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.090 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.090 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.090 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.090 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.090 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-06-02T04:19:46.090 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.090 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.090 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.090 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.090 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.091 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.091 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.091 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "crash", 2024-06-02T04:19:46.091 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:46.091 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:46.091 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:46.091 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.091 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.091 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.091 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.091 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.091 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.092 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.092 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.092 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.092 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.092 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.092 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.092 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.092 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.092 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.093 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.093 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.093 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.093 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.093 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.093 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.093 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.093 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.093 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.093 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.093 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.093 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.094 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.094 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.094 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.094 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.094 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.094 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.094 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.094 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.094 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.095 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.095 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.095 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.095 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.095 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.095 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.095 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.095 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.095 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.095 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.095 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.095 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.095 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.095 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.096 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.096 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.096 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.096 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.096 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.096 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.096 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.096 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.096 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.097 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.097 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.097 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.097 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.097 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.097 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.097 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.097 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.097 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.097 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.097 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.098 INFO:teuthology.orchestra.run.smithi123.stdout: "retain_interval": { 2024-06-02T04:19:46.098 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "retain_interval", 2024-06-02T04:19:46.098 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:46.098 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.098 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.098 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "31536000", 2024-06-02T04:19:46.098 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.098 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.099 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.099 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how long to retain crashes before pruning them", 2024-06-02T04:19:46.099 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.099 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.099 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.099 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.099 INFO:teuthology.orchestra.run.smithi123.stdout: "warn_recent_interval": { 2024-06-02T04:19:46.099 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "warn_recent_interval", 2024-06-02T04:19:46.099 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:46.099 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.100 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.100 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "1209600", 2024-06-02T04:19:46.100 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.100 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.100 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.100 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "time interval in which to warn about recent crashes", 2024-06-02T04:19:46.100 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.100 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.100 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.101 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.101 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.101 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.101 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.101 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "dashboard", 2024-06-02T04:19:46.101 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:46.101 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:46.101 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:46.101 INFO:teuthology.orchestra.run.smithi123.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-06-02T04:19:46.102 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-06-02T04:19:46.102 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.102 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.102 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.102 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-06-02T04:19:46.102 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.102 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.102 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.102 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.102 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.102 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.102 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.102 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.103 INFO:teuthology.orchestra.run.smithi123.stdout: "ALERTMANAGER_API_HOST": { 2024-06-02T04:19:46.103 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ALERTMANAGER_API_HOST", 2024-06-02T04:19:46.103 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.103 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.103 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.103 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.103 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.103 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.103 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.103 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.103 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.103 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.103 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.104 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.104 INFO:teuthology.orchestra.run.smithi123.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-06-02T04:19:46.104 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-06-02T04:19:46.104 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.104 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.104 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.104 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.104 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.104 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.104 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.104 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.104 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.104 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.105 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.105 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.105 INFO:teuthology.orchestra.run.smithi123.stdout: "AUDIT_API_ENABLED": { 2024-06-02T04:19:46.105 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "AUDIT_API_ENABLED", 2024-06-02T04:19:46.105 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.105 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.105 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.105 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.105 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.105 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.105 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.105 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.105 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.106 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.106 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.106 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.106 INFO:teuthology.orchestra.run.smithi123.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-06-02T04:19:46.106 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-06-02T04:19:46.106 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.106 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.106 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.106 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.107 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.107 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.107 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.107 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.107 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.107 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.107 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.107 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.108 INFO:teuthology.orchestra.run.smithi123.stdout: "ENABLE_BROWSABLE_API": { 2024-06-02T04:19:46.108 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ENABLE_BROWSABLE_API", 2024-06-02T04:19:46.108 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.108 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.108 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.108 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.108 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.108 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.108 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.109 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.109 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.109 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.109 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.109 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.109 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-06-02T04:19:46.109 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-06-02T04:19:46.109 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.109 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.109 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.109 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.109 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.110 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.110 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.110 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.110 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.110 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.110 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.110 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.110 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-06-02T04:19:46.110 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-06-02T04:19:46.110 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.110 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.110 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.110 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.111 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.111 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.111 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.111 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.111 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.111 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.111 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.111 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.111 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-06-02T04:19:46.111 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-06-02T04:19:46.111 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.111 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.111 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.112 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.112 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.112 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.112 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.112 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.112 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.112 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.112 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.112 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.112 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-06-02T04:19:46.112 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-06-02T04:19:46.112 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.112 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.112 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.113 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.113 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.113 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.113 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.113 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.113 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.113 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.113 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.113 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.113 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_NFS": { 2024-06-02T04:19:46.113 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-06-02T04:19:46.113 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.113 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.114 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.114 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.114 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.114 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.114 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.114 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.114 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.114 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.114 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.114 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.115 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_RBD": { 2024-06-02T04:19:46.115 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-06-02T04:19:46.115 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.115 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.115 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.115 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.115 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.115 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.115 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.115 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.115 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.115 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.115 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.116 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.116 INFO:teuthology.orchestra.run.smithi123.stdout: "FEATURE_TOGGLE_RGW": { 2024-06-02T04:19:46.116 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-06-02T04:19:46.116 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.116 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.116 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.116 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.116 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.116 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.116 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.116 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.116 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.116 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.117 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.117 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.117 INFO:teuthology.orchestra.run.smithi123.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-06-02T04:19:46.117 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-06-02T04:19:46.117 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.117 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.117 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.117 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.117 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.117 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.117 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.117 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.117 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.118 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.118 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.118 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.118 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_API_PASSWORD": { 2024-06-02T04:19:46.118 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_API_PASSWORD", 2024-06-02T04:19:46.118 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.118 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.118 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.118 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "admin", 2024-06-02T04:19:46.118 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.118 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.118 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.118 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.119 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.119 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.119 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.119 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.119 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-06-02T04:19:46.119 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-06-02T04:19:46.119 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.119 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.119 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.119 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.119 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.119 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.119 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.119 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.120 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.120 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.120 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.120 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.120 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_API_URL": { 2024-06-02T04:19:46.120 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_API_URL", 2024-06-02T04:19:46.120 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.120 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.120 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.120 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.120 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.120 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.120 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.121 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.121 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.121 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.121 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.121 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.121 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_API_USERNAME": { 2024-06-02T04:19:46.121 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_API_USERNAME", 2024-06-02T04:19:46.121 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.121 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.121 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.121 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "admin", 2024-06-02T04:19:46.121 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.121 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.122 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.122 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.122 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.122 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.122 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.122 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.122 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-06-02T04:19:46.122 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-06-02T04:19:46.122 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.122 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.122 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.122 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.123 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.123 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.123 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.123 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.123 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.123 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.123 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.123 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.123 INFO:teuthology.orchestra.run.smithi123.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-06-02T04:19:46.123 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-06-02T04:19:46.123 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.123 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.123 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.124 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.124 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.124 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.124 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.124 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.124 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.124 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.124 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.124 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.124 INFO:teuthology.orchestra.run.smithi123.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-06-02T04:19:46.124 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-06-02T04:19:46.124 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.124 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.124 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.125 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.125 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.125 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.125 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.125 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.125 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.125 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.125 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.125 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.125 INFO:teuthology.orchestra.run.smithi123.stdout: "ISSUE_TRACKER_API_KEY": { 2024-06-02T04:19:46.125 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-06-02T04:19:46.125 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.125 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.125 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.126 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.126 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.126 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.126 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.126 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.126 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.126 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.126 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.126 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.126 INFO:teuthology.orchestra.run.smithi123.stdout: "PROMETHEUS_API_HOST": { 2024-06-02T04:19:46.126 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PROMETHEUS_API_HOST", 2024-06-02T04:19:46.126 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.127 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.127 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.127 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.127 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.127 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.127 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.127 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.127 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.127 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.127 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.127 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.127 INFO:teuthology.orchestra.run.smithi123.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-06-02T04:19:46.127 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-06-02T04:19:46.128 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.128 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.128 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.128 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.128 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.128 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.128 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.128 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.128 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.128 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.128 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.128 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.129 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-06-02T04:19:46.129 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-06-02T04:19:46.129 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.129 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.129 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.129 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.129 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.129 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.129 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.129 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.129 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.129 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.130 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.130 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.130 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-06-02T04:19:46.130 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-06-02T04:19:46.130 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.130 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.130 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.130 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.130 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.131 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.131 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.131 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.131 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.131 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.131 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.131 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.131 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-06-02T04:19:46.131 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-06-02T04:19:46.131 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.131 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.132 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.132 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.132 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.132 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.132 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.132 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.132 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.132 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.132 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.133 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.133 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-06-02T04:19:46.133 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-06-02T04:19:46.133 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.133 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.133 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.133 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.133 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.133 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.133 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.133 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.133 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.134 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.134 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.134 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.134 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-06-02T04:19:46.134 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-06-02T04:19:46.134 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.134 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.135 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.135 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.135 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.135 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.135 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.135 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.135 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.135 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.135 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.135 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.135 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-06-02T04:19:46.135 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-06-02T04:19:46.136 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.136 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.136 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.136 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.136 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.136 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.136 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.136 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.136 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.137 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.137 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.137 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.137 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-06-02T04:19:46.137 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-06-02T04:19:46.137 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.137 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.137 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.137 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.137 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.138 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.138 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.138 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.138 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.138 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.138 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.138 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.138 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_ENABLED": { 2024-06-02T04:19:46.139 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_ENABLED", 2024-06-02T04:19:46.139 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.139 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.139 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.139 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.139 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.139 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.139 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.140 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.140 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.140 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.140 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.140 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.140 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-06-02T04:19:46.140 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-06-02T04:19:46.140 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.141 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.141 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.141 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-06-02T04:19:46.141 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.141 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.141 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.141 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.141 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.141 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.142 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.142 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.142 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-06-02T04:19:46.142 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-06-02T04:19:46.142 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.142 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.142 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.142 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-06-02T04:19:46.142 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.142 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.142 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.143 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.143 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.143 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.143 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.143 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.143 INFO:teuthology.orchestra.run.smithi123.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-06-02T04:19:46.143 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-06-02T04:19:46.143 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.143 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.143 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.143 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "8", 2024-06-02T04:19:46.143 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.144 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.144 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.144 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.144 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.144 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.144 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.144 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.144 INFO:teuthology.orchestra.run.smithi123.stdout: "REST_REQUESTS_TIMEOUT": { 2024-06-02T04:19:46.144 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-06-02T04:19:46.144 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.144 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.144 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.144 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "45", 2024-06-02T04:19:46.145 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.145 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.145 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.145 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.145 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.145 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.145 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.145 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.145 INFO:teuthology.orchestra.run.smithi123.stdout: "RGW_API_ACCESS_KEY": { 2024-06-02T04:19:46.145 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RGW_API_ACCESS_KEY", 2024-06-02T04:19:46.145 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.145 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.145 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.145 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.146 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.146 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.146 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.146 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.146 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.146 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.146 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.146 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.146 INFO:teuthology.orchestra.run.smithi123.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-06-02T04:19:46.146 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-06-02T04:19:46.146 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.146 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.146 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.147 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "admin", 2024-06-02T04:19:46.147 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.147 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.147 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.147 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.147 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.147 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.147 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.147 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.147 INFO:teuthology.orchestra.run.smithi123.stdout: "RGW_API_SECRET_KEY": { 2024-06-02T04:19:46.147 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RGW_API_SECRET_KEY", 2024-06-02T04:19:46.147 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.147 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.147 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.148 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.148 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.148 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.148 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.148 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.148 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.148 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.148 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.148 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.148 INFO:teuthology.orchestra.run.smithi123.stdout: "RGW_API_SSL_VERIFY": { 2024-06-02T04:19:46.148 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "RGW_API_SSL_VERIFY", 2024-06-02T04:19:46.148 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.149 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.149 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.149 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.149 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.149 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.149 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.149 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.149 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.149 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.149 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.149 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.149 INFO:teuthology.orchestra.run.smithi123.stdout: "UNSAFE_TLS_v1_2": { 2024-06-02T04:19:46.149 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "UNSAFE_TLS_v1_2", 2024-06-02T04:19:46.150 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.150 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.150 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.150 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.150 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.150 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.150 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.150 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.150 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.150 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.150 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.150 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.150 INFO:teuthology.orchestra.run.smithi123.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-06-02T04:19:46.151 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-06-02T04:19:46.151 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.151 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.151 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.151 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0", 2024-06-02T04:19:46.151 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.151 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.151 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.151 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.151 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.151 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.151 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.151 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.152 INFO:teuthology.orchestra.run.smithi123.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-06-02T04:19:46.152 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-06-02T04:19:46.152 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.152 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.152 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.152 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-06-02T04:19:46.152 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.152 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.152 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.152 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.152 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.152 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.152 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.153 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.153 INFO:teuthology.orchestra.run.smithi123.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-06-02T04:19:46.153 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-06-02T04:19:46.153 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.153 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.153 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.153 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "5", 2024-06-02T04:19:46.153 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.153 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.153 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.153 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.153 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.153 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.154 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.154 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.154 INFO:teuthology.orchestra.run.smithi123.stdout: "cross_origin_url": { 2024-06-02T04:19:46.154 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "cross_origin_url", 2024-06-02T04:19:46.154 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.154 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.154 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.154 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.154 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.154 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.154 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.154 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.155 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.155 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.155 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.155 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.155 INFO:teuthology.orchestra.run.smithi123.stdout: "crt_file": { 2024-06-02T04:19:46.155 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "crt_file", 2024-06-02T04:19:46.155 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.155 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.155 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.155 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.155 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.155 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.156 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.156 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.156 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.156 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.156 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.156 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.156 INFO:teuthology.orchestra.run.smithi123.stdout: "debug": { 2024-06-02T04:19:46.156 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "debug", 2024-06-02T04:19:46.156 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.156 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.156 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.157 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.157 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.157 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.157 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.157 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Enable/disable debug options", 2024-06-02T04:19:46.157 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.157 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.157 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.157 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.157 INFO:teuthology.orchestra.run.smithi123.stdout: "jwt_token_ttl": { 2024-06-02T04:19:46.157 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "jwt_token_ttl", 2024-06-02T04:19:46.157 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.157 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.157 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.158 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "28800", 2024-06-02T04:19:46.158 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.158 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.158 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.158 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.158 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.158 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.158 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.158 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.158 INFO:teuthology.orchestra.run.smithi123.stdout: "key_file": { 2024-06-02T04:19:46.158 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "key_file", 2024-06-02T04:19:46.158 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.158 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.158 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.159 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.159 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.159 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.159 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.159 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.159 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.159 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.159 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.159 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.159 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.159 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.159 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.159 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.160 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.160 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.160 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.160 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.160 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.160 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.160 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.160 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.160 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.160 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.160 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.160 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.161 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.161 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.161 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.161 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.161 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.161 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.161 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.161 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.161 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.161 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.161 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.161 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.161 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.161 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.162 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.162 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.162 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.162 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.162 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.162 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.162 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.162 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.162 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.162 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.162 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.162 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.163 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.163 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.163 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.163 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.163 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.163 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.163 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.163 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.164 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.164 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.164 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.164 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.164 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.164 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.164 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.164 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.164 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.164 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.164 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.164 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.164 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.165 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.165 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.165 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.165 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.165 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.165 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.165 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.165 INFO:teuthology.orchestra.run.smithi123.stdout: "motd": { 2024-06-02T04:19:46.165 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "motd", 2024-06-02T04:19:46.165 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.165 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.166 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.166 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.166 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.166 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.166 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.166 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "The message of the day", 2024-06-02T04:19:46.166 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.166 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.166 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.166 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.166 INFO:teuthology.orchestra.run.smithi123.stdout: "redirect_resolve_ip_addr": { 2024-06-02T04:19:46.167 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "redirect_resolve_ip_addr", 2024-06-02T04:19:46.167 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.167 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.167 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.167 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.167 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.167 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.167 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.167 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.167 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.167 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.167 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.167 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.168 INFO:teuthology.orchestra.run.smithi123.stdout: "server_addr": { 2024-06-02T04:19:46.168 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_addr", 2024-06-02T04:19:46.168 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.168 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.168 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.168 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "::", 2024-06-02T04:19:46.168 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.168 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.168 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.168 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.169 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.169 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.169 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.169 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.169 INFO:teuthology.orchestra.run.smithi123.stdout: "server_port": { 2024-06-02T04:19:46.169 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_port", 2024-06-02T04:19:46.169 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.169 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.169 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.170 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "8080", 2024-06-02T04:19:46.170 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.170 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.170 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.170 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.170 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.170 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.170 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.170 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.170 INFO:teuthology.orchestra.run.smithi123.stdout: "ssl": { 2024-06-02T04:19:46.171 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ssl", 2024-06-02T04:19:46.171 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.171 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.171 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.171 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.171 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.171 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.171 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.171 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.172 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.172 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.172 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.172 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.172 INFO:teuthology.orchestra.run.smithi123.stdout: "ssl_server_port": { 2024-06-02T04:19:46.172 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ssl_server_port", 2024-06-02T04:19:46.172 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.172 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.173 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.173 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "8443", 2024-06-02T04:19:46.173 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.173 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.173 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.173 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.173 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.173 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.173 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.173 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.173 INFO:teuthology.orchestra.run.smithi123.stdout: "standby_behaviour": { 2024-06-02T04:19:46.173 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "standby_behaviour", 2024-06-02T04:19:46.174 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.174 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.174 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.174 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "redirect", 2024-06-02T04:19:46.174 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.174 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.174 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.174 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.174 INFO:teuthology.orchestra.run.smithi123.stdout: "redirect" 2024-06-02T04:19:46.175 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.175 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.175 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.175 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.175 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.175 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.175 INFO:teuthology.orchestra.run.smithi123.stdout: "standby_error_status_code": { 2024-06-02T04:19:46.175 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "standby_error_status_code", 2024-06-02T04:19:46.175 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.175 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.175 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.176 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "500", 2024-06-02T04:19:46.176 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "400", 2024-06-02T04:19:46.176 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "599", 2024-06-02T04:19:46.176 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.176 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.176 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.176 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.176 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.176 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.176 INFO:teuthology.orchestra.run.smithi123.stdout: "url_prefix": { 2024-06-02T04:19:46.176 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "url_prefix", 2024-06-02T04:19:46.176 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.177 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.177 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.177 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.177 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.177 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.177 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.177 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.177 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.177 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.177 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.177 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.177 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.177 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.178 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.178 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "devicehealth", 2024-06-02T04:19:46.178 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:46.178 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:46.178 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:46.178 INFO:teuthology.orchestra.run.smithi123.stdout: "enable_monitoring": { 2024-06-02T04:19:46.178 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "enable_monitoring", 2024-06-02T04:19:46.178 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.178 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.178 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.178 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.178 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.179 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.179 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.179 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "monitor device health metrics", 2024-06-02T04:19:46.179 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.179 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.179 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.179 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.179 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.180 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.180 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.180 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.180 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.180 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.180 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.180 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.180 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.180 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.180 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.180 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.180 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.181 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.181 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.181 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.181 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.181 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.181 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.181 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.181 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.181 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.181 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.181 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.181 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.181 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.182 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.182 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.182 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.182 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.182 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.182 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.182 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.182 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.182 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.182 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.182 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.182 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.183 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.183 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.183 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.183 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.183 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.183 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.183 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.183 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.183 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.183 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.183 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.183 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.183 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.184 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.184 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.184 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.184 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.185 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.186 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.186 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.186 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.187 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.187 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.187 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.187 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.187 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.187 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.187 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.187 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.187 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.187 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.187 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.187 INFO:teuthology.orchestra.run.smithi123.stdout: "mark_out_threshold": { 2024-06-02T04:19:46.187 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mark_out_threshold", 2024-06-02T04:19:46.187 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:46.188 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.188 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.188 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "2419200", 2024-06-02T04:19:46.188 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.188 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.188 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.188 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-06-02T04:19:46.188 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.188 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.188 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.188 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.188 INFO:teuthology.orchestra.run.smithi123.stdout: "pool_name": { 2024-06-02T04:19:46.188 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "pool_name", 2024-06-02T04:19:46.189 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.189 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.189 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.189 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "device_health_metrics", 2024-06-02T04:19:46.189 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.189 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.189 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.189 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "name of pool in which to store device health metrics", 2024-06-02T04:19:46.189 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.189 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.189 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.189 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.189 INFO:teuthology.orchestra.run.smithi123.stdout: "retention_period": { 2024-06-02T04:19:46.190 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "retention_period", 2024-06-02T04:19:46.190 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:46.190 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.190 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.190 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "15552000", 2024-06-02T04:19:46.190 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.190 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.190 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.190 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how long to retain device health metrics", 2024-06-02T04:19:46.190 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.190 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.190 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.191 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.191 INFO:teuthology.orchestra.run.smithi123.stdout: "scrape_frequency": { 2024-06-02T04:19:46.191 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "scrape_frequency", 2024-06-02T04:19:46.191 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:46.191 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.191 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.191 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "86400", 2024-06-02T04:19:46.191 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.191 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.191 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.191 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how frequently to scrape device health metrics", 2024-06-02T04:19:46.191 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.191 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.192 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.192 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.192 INFO:teuthology.orchestra.run.smithi123.stdout: "self_heal": { 2024-06-02T04:19:46.192 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "self_heal", 2024-06-02T04:19:46.192 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.192 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.192 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.192 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.192 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.192 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.192 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.192 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-06-02T04:19:46.192 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.193 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.193 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.193 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.193 INFO:teuthology.orchestra.run.smithi123.stdout: "sleep_interval": { 2024-06-02T04:19:46.193 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "sleep_interval", 2024-06-02T04:19:46.193 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:46.193 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.193 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.193 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "600", 2024-06-02T04:19:46.193 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.193 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.193 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.193 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how frequently to wake up and check device health", 2024-06-02T04:19:46.193 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.194 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.194 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.194 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.194 INFO:teuthology.orchestra.run.smithi123.stdout: "warn_threshold": { 2024-06-02T04:19:46.194 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "warn_threshold", 2024-06-02T04:19:46.194 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:46.194 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.194 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.194 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "7257600", 2024-06-02T04:19:46.194 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.194 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.194 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.195 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-06-02T04:19:46.195 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.195 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.195 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.195 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.195 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.195 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.195 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.195 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "diskprediction_local", 2024-06-02T04:19:46.195 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:46.195 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:46.195 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:46.195 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.195 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.196 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.196 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.196 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.196 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.196 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.196 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.196 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.196 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.196 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.196 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.196 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.196 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.196 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.196 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.197 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.197 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.197 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.197 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.197 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.197 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.197 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.197 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.197 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.197 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.197 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.198 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.198 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.198 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.198 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.198 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.198 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.198 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.198 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.198 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.198 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.198 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.199 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.199 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.199 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.199 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.199 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.199 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.199 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.199 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.199 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.199 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.199 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.199 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.200 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.200 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.200 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.200 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.200 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.200 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.200 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.200 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.200 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.200 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.200 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.200 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.200 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.200 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.201 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.201 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.201 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.201 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.201 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.201 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.201 INFO:teuthology.orchestra.run.smithi123.stdout: "predict_interval": { 2024-06-02T04:19:46.201 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "predict_interval", 2024-06-02T04:19:46.201 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.201 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.201 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.201 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "86400", 2024-06-02T04:19:46.201 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.202 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.202 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.202 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.202 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.202 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.202 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.202 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.202 INFO:teuthology.orchestra.run.smithi123.stdout: "predictor_model": { 2024-06-02T04:19:46.202 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "predictor_model", 2024-06-02T04:19:46.202 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.202 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.202 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.203 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "prophetstor", 2024-06-02T04:19:46.203 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.203 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.203 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.203 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.203 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.203 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.203 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.203 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.203 INFO:teuthology.orchestra.run.smithi123.stdout: "sleep_interval": { 2024-06-02T04:19:46.203 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "sleep_interval", 2024-06-02T04:19:46.203 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.204 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.204 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.204 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "600", 2024-06-02T04:19:46.204 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.204 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.204 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.204 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.204 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.204 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.204 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.204 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.205 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.205 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.205 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.205 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "influx", 2024-06-02T04:19:46.205 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": false, 2024-06-02T04:19:46.205 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "influxdb python module not found", 2024-06-02T04:19:46.205 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:46.205 INFO:teuthology.orchestra.run.smithi123.stdout: "batch_size": { 2024-06-02T04:19:46.206 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "batch_size", 2024-06-02T04:19:46.206 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.206 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.206 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.206 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "5000", 2024-06-02T04:19:46.206 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.206 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.206 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.206 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-06-02T04:19:46.206 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.206 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.206 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.206 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.207 INFO:teuthology.orchestra.run.smithi123.stdout: "database": { 2024-06-02T04:19:46.207 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "database", 2024-06-02T04:19:46.207 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.207 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.207 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.207 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "ceph", 2024-06-02T04:19:46.207 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.207 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.207 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.207 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-06-02T04:19:46.207 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.208 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.208 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.208 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.208 INFO:teuthology.orchestra.run.smithi123.stdout: "hostname": { 2024-06-02T04:19:46.208 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "hostname", 2024-06-02T04:19:46.208 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.208 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.208 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.208 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.208 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.209 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.209 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.209 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "InfluxDB server hostname", 2024-06-02T04:19:46.209 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.209 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.209 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.209 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.209 INFO:teuthology.orchestra.run.smithi123.stdout: "interval": { 2024-06-02T04:19:46.209 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "interval", 2024-06-02T04:19:46.209 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:46.210 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.210 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.210 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "30", 2024-06-02T04:19:46.210 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "5", 2024-06-02T04:19:46.210 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.210 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.210 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-06-02T04:19:46.210 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.210 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.211 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.211 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.211 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.211 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.211 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.211 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.211 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.211 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.211 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.211 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.211 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.211 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.212 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.212 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.212 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.212 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.212 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.212 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.212 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.212 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.212 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.212 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.213 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.213 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.213 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.213 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.213 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.213 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.213 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.213 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.213 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.213 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.213 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.214 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.214 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.214 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.214 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.214 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.214 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.214 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.214 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.214 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.214 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.214 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.214 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.215 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.215 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.215 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.215 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.215 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.215 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.215 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.215 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.215 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.215 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.216 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.216 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.216 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.216 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.216 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.216 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.216 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.216 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.216 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.216 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.217 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.217 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.217 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.217 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.217 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.217 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.217 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.217 INFO:teuthology.orchestra.run.smithi123.stdout: "password": { 2024-06-02T04:19:46.218 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "password", 2024-06-02T04:19:46.218 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.218 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.218 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.218 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.218 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.218 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.218 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.218 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "password of InfluxDB server user", 2024-06-02T04:19:46.219 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.219 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.219 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.219 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.219 INFO:teuthology.orchestra.run.smithi123.stdout: "port": { 2024-06-02T04:19:46.219 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "port", 2024-06-02T04:19:46.219 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.219 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.219 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.219 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "8086", 2024-06-02T04:19:46.219 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.219 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.219 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.220 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "InfluxDB server port", 2024-06-02T04:19:46.220 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.220 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.220 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.220 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.220 INFO:teuthology.orchestra.run.smithi123.stdout: "ssl": { 2024-06-02T04:19:46.220 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ssl", 2024-06-02T04:19:46.220 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.220 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.220 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.220 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "false", 2024-06-02T04:19:46.220 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.220 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.221 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.221 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-06-02T04:19:46.221 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.221 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.221 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.221 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.221 INFO:teuthology.orchestra.run.smithi123.stdout: "threads": { 2024-06-02T04:19:46.221 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "threads", 2024-06-02T04:19:46.221 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.221 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.221 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.221 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "5", 2024-06-02T04:19:46.221 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "1", 2024-06-02T04:19:46.222 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "32", 2024-06-02T04:19:46.222 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.222 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-06-02T04:19:46.222 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.222 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.222 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.222 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.222 INFO:teuthology.orchestra.run.smithi123.stdout: "username": { 2024-06-02T04:19:46.222 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "username", 2024-06-02T04:19:46.222 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.222 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.222 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.222 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.223 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.223 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.223 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.223 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "username of InfluxDB server user", 2024-06-02T04:19:46.223 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.223 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.223 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.223 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.223 INFO:teuthology.orchestra.run.smithi123.stdout: "verify_ssl": { 2024-06-02T04:19:46.223 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "verify_ssl", 2024-06-02T04:19:46.223 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.223 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.223 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.224 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "true", 2024-06-02T04:19:46.224 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.224 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.224 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.224 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-06-02T04:19:46.224 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.224 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.224 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.224 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.224 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.224 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.224 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.225 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "insights", 2024-06-02T04:19:46.225 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:46.225 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:46.225 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:46.225 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.225 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.225 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.225 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.225 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.225 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.225 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.225 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.225 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.226 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.226 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.226 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.226 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.226 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.226 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.226 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.226 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.226 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.226 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.226 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.226 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.227 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.227 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.227 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.227 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.227 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.227 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.227 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.227 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.227 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.227 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.227 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.227 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.228 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.228 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.228 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.228 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.228 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.228 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.228 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.228 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.228 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.228 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.228 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.228 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.228 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.229 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.229 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.229 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.229 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.229 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.229 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.229 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.229 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.229 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.229 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.229 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.229 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.229 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.229 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.230 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.230 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.230 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.230 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.230 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.230 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.230 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.230 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.230 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.230 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.230 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.230 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.230 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.231 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "iostat", 2024-06-02T04:19:46.231 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:46.231 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:46.231 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:46.231 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.231 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.231 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.231 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.231 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.231 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.231 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.231 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.232 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.232 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.232 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.232 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.232 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.232 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.232 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.232 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.232 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.232 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.232 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.232 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.232 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.233 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.233 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.233 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.233 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.233 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.233 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.233 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.233 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.233 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.233 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.233 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.233 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.233 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.233 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.234 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.234 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.234 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.234 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.234 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.234 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.234 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.234 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.234 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.234 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.234 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.234 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.234 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.235 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.235 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.235 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.235 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.235 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.235 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.235 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.235 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.235 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.235 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.235 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.235 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.235 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.236 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.236 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.236 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.236 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.236 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.236 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.236 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.236 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.236 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.236 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.236 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.236 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.236 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "k8sevents", 2024-06-02T04:19:46.237 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:46.237 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:46.237 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:46.237 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_event_retention_days": { 2024-06-02T04:19:46.237 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "ceph_event_retention_days", 2024-06-02T04:19:46.237 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.237 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.237 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.237 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "7", 2024-06-02T04:19:46.237 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.237 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.237 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.237 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Days to hold ceph event information within local cache", 2024-06-02T04:19:46.238 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.238 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.238 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.238 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.238 INFO:teuthology.orchestra.run.smithi123.stdout: "config_check_secs": { 2024-06-02T04:19:46.238 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "config_check_secs", 2024-06-02T04:19:46.238 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.238 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.238 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.238 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-06-02T04:19:46.238 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "10", 2024-06-02T04:19:46.239 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.239 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.239 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-06-02T04:19:46.239 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.239 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.239 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.239 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.239 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.239 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.239 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.239 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.240 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.240 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.240 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.240 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.240 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.240 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.240 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.240 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.240 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.240 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.240 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.241 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.241 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.241 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.241 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.241 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.241 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.241 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.241 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.241 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.241 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.241 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.241 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.242 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.242 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.242 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.242 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.242 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.242 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.242 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.242 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.242 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.242 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.243 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.243 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.243 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.243 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.243 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.243 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.243 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.243 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.243 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.243 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.243 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.243 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.243 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.244 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.244 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.244 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.244 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.244 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.244 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.244 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.244 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.244 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.244 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.245 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.245 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.245 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.245 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.245 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.245 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.245 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.245 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.245 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.245 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.245 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.245 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.245 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.246 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "localpool", 2024-06-02T04:19:46.246 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:46.246 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:46.246 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:46.246 INFO:teuthology.orchestra.run.smithi123.stdout: "failure_domain": { 2024-06-02T04:19:46.246 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "failure_domain", 2024-06-02T04:19:46.246 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.246 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.247 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.247 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "host", 2024-06-02T04:19:46.247 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.247 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.247 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.247 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "failure domain for any created local pool", 2024-06-02T04:19:46.247 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-06-02T04:19:46.247 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.247 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.247 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.247 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.247 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.248 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.248 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.248 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.248 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.248 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.248 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.248 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.248 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.248 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.248 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.248 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.249 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.249 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.249 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.249 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.249 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.249 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.249 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.249 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.249 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.250 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.250 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.250 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.250 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.250 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.250 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.250 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.250 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.250 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.250 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.251 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.251 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.251 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.251 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.251 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.251 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.251 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.251 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.251 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.252 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.252 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.252 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.252 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.252 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.252 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.252 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.252 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.252 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.253 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.253 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.253 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.253 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.253 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.253 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.253 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.253 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.253 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.253 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.253 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.253 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.253 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.254 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.254 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.254 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.254 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.254 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.254 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.254 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.254 INFO:teuthology.orchestra.run.smithi123.stdout: "min_size": { 2024-06-02T04:19:46.254 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "min_size", 2024-06-02T04:19:46.254 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.254 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.254 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.254 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.255 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.255 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.255 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.255 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "default min_size for any created local pool", 2024-06-02T04:19:46.255 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-06-02T04:19:46.255 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.255 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.255 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.255 INFO:teuthology.orchestra.run.smithi123.stdout: "num_rep": { 2024-06-02T04:19:46.255 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "num_rep", 2024-06-02T04:19:46.255 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.255 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.255 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.256 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "3", 2024-06-02T04:19:46.256 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.256 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.256 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.256 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "default replica count for any created local pool", 2024-06-02T04:19:46.256 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.256 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.256 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.256 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.256 INFO:teuthology.orchestra.run.smithi123.stdout: "pg_num": { 2024-06-02T04:19:46.256 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "pg_num", 2024-06-02T04:19:46.256 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.257 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.257 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.257 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "128", 2024-06-02T04:19:46.257 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.257 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.257 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.257 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "default pg_num for any created local pool", 2024-06-02T04:19:46.257 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.257 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.257 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.257 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.258 INFO:teuthology.orchestra.run.smithi123.stdout: "prefix": { 2024-06-02T04:19:46.258 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "prefix", 2024-06-02T04:19:46.258 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.258 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.258 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.258 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.258 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.258 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.258 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.258 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "name prefix for any created local pool", 2024-06-02T04:19:46.258 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.258 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.259 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.259 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.259 INFO:teuthology.orchestra.run.smithi123.stdout: "subtree": { 2024-06-02T04:19:46.259 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "subtree", 2024-06-02T04:19:46.259 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.259 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.259 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.259 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "rack", 2024-06-02T04:19:46.259 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.259 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.259 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.259 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "CRUSH level for which to create a local pool", 2024-06-02T04:19:46.259 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-06-02T04:19:46.260 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.260 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.260 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.260 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.260 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.260 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.260 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mds_autoscaler", 2024-06-02T04:19:46.260 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:46.260 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:46.260 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:46.260 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.260 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.261 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.261 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.261 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.261 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.261 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.261 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.261 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.261 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.261 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.261 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.261 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.261 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.261 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.262 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.262 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.262 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.262 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.262 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.262 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.262 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.262 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.262 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.262 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.262 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.262 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.263 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.263 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.263 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.263 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.263 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.263 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.263 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.263 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.263 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.263 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.263 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.263 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.264 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.264 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.264 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.264 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.264 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.264 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.264 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.264 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.264 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.264 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.264 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.264 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.264 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.265 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.265 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.265 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.265 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.265 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.265 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.265 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.265 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.265 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.265 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.265 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.265 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.265 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.266 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.266 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.266 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.266 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.266 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.266 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.266 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.266 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.266 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mirroring", 2024-06-02T04:19:46.266 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:46.266 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:46.266 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:46.266 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.267 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.267 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.267 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.267 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.267 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.267 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.267 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.267 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.267 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.267 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.267 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.268 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.268 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.268 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.268 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.268 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.268 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.268 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.268 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.268 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.268 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.268 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.268 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.268 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.269 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.269 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.269 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.269 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.269 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.269 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.269 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.269 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.269 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.269 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.269 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.269 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.269 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.269 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.270 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.270 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.270 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.270 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.270 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.270 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.270 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.270 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.270 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.270 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.270 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.270 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.270 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.271 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.271 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.271 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.271 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.271 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.271 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.271 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.271 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.271 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.271 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.271 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.271 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.271 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.271 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.272 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.272 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.272 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.272 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.272 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.272 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.272 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.272 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "nfs", 2024-06-02T04:19:46.272 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:46.272 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:46.272 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:46.272 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.272 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.273 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.273 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.273 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.273 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.273 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.273 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.273 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.273 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.273 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.273 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.273 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.273 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.273 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.273 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.274 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.274 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.274 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.274 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.274 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.274 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.274 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.274 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.274 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.274 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.274 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.274 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.274 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.275 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.275 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.275 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.275 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.275 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.275 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.275 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.275 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.275 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.275 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.275 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.275 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.275 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.275 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.276 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.276 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.276 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.276 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.276 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.276 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.276 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.276 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.276 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.277 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.277 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.277 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.277 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.277 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.277 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.277 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.277 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.277 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.277 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.277 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.278 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.278 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.278 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.278 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.278 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.278 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.278 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.278 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.278 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.278 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.278 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "orchestrator", 2024-06-02T04:19:46.279 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:46.279 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:46.279 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:46.279 INFO:teuthology.orchestra.run.smithi123.stdout: "fail_fs": { 2024-06-02T04:19:46.279 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "fail_fs", 2024-06-02T04:19:46.279 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.279 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.279 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.279 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.279 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.279 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.280 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.280 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-06-02T04:19:46.280 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.280 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.280 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.280 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.280 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.280 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.280 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.280 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.280 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.281 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.281 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.281 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.281 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.281 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.281 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.281 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.281 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.281 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.281 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.282 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.282 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.282 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.282 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.282 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.282 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.282 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.282 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.282 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.282 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.283 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.283 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.283 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.283 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.283 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.283 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.283 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.283 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.283 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.283 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.283 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.284 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.284 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.284 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.284 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.284 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.284 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.284 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.284 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.284 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.284 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.285 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.285 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.285 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.285 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.285 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.285 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.285 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.285 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.285 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.285 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.286 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.286 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.286 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.286 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.286 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.286 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.286 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.286 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.286 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.286 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.287 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.287 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.287 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.287 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.287 INFO:teuthology.orchestra.run.smithi123.stdout: "orchestrator": { 2024-06-02T04:19:46.287 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "orchestrator", 2024-06-02T04:19:46.287 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.287 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.287 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.288 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.288 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.288 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.288 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.288 INFO:teuthology.orchestra.run.smithi123.stdout: "cephadm", 2024-06-02T04:19:46.288 INFO:teuthology.orchestra.run.smithi123.stdout: "rook", 2024-06-02T04:19:46.288 INFO:teuthology.orchestra.run.smithi123.stdout: "test_orchestrator" 2024-06-02T04:19:46.288 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.289 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Orchestrator backend", 2024-06-02T04:19:46.289 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.289 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.289 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.289 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.289 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.289 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.289 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.289 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "osd_perf_query", 2024-06-02T04:19:46.289 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:46.290 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:46.290 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:46.290 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.290 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.290 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.290 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.290 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.290 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.290 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.290 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.290 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.290 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.290 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.291 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.291 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.291 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.291 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.291 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.291 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.291 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.291 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.291 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.291 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.291 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.291 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.291 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.291 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.292 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.292 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.292 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.292 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.292 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.292 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.292 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.292 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.292 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.292 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.292 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.292 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.292 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.293 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.293 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.293 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.293 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.293 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.293 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.293 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.293 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.293 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.293 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.293 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.293 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.293 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.293 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.294 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.294 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.294 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.294 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.294 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.294 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.294 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.294 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.294 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.294 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.294 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.294 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.294 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.295 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.295 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.295 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.295 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.295 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.295 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.295 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.295 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.295 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "osd_support", 2024-06-02T04:19:46.295 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:46.295 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:46.295 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:46.295 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.296 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.296 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.296 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.296 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.296 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.296 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.296 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.296 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.296 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.296 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.296 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.296 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.296 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.297 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.297 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.297 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.297 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.297 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.297 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.297 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.297 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.297 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.297 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.297 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.298 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.298 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.298 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.298 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.298 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.298 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.298 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.298 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.298 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.298 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.298 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.298 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.299 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.299 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.299 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.299 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.299 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.299 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.299 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.299 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.299 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.299 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.299 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.299 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.299 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.300 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.300 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.300 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.300 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.300 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.300 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.300 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.300 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.300 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.300 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.300 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.300 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.300 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.300 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.301 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.301 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.301 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.301 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.301 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.301 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.301 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.301 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.301 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.301 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "pg_autoscaler", 2024-06-02T04:19:46.301 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:46.301 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:46.301 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:46.302 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.302 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.302 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.302 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.302 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.302 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.302 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.302 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.302 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.302 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.302 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.302 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.303 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.303 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.303 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.303 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.303 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.303 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.303 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.303 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.303 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.303 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.303 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.303 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.303 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.304 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.304 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.304 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.304 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.304 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.304 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.304 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.304 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.304 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.304 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.304 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.304 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.305 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.305 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.305 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.305 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.305 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.305 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.305 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.305 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.305 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.305 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.305 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.305 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.306 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.306 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.306 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.306 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.306 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.306 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.306 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.306 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.306 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.306 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.306 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.306 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.306 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.307 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.307 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.307 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.307 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.307 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.307 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.307 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.307 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.307 INFO:teuthology.orchestra.run.smithi123.stdout: "sleep_interval": { 2024-06-02T04:19:46.307 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "sleep_interval", 2024-06-02T04:19:46.307 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:46.307 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.307 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.308 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "60", 2024-06-02T04:19:46.308 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.308 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.308 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.308 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.308 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.308 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.308 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.308 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.308 INFO:teuthology.orchestra.run.smithi123.stdout: "threshold": { 2024-06-02T04:19:46.308 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "threshold", 2024-06-02T04:19:46.308 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-06-02T04:19:46.308 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.309 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.309 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "3.0", 2024-06-02T04:19:46.309 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "1.0", 2024-06-02T04:19:46.309 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.309 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.309 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "scaling threshold", 2024-06-02T04:19:46.309 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-06-02T04:19:46.309 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.309 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.309 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.309 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.309 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.310 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.310 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "progress", 2024-06-02T04:19:46.310 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:46.310 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:46.310 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:46.310 INFO:teuthology.orchestra.run.smithi123.stdout: "allow_pg_recovery_event": { 2024-06-02T04:19:46.310 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "allow_pg_recovery_event", 2024-06-02T04:19:46.310 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.310 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.310 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.310 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.311 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.311 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.311 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.311 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "allow the module to show pg recovery progress", 2024-06-02T04:19:46.311 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.311 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.311 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.311 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.311 INFO:teuthology.orchestra.run.smithi123.stdout: "enabled": { 2024-06-02T04:19:46.311 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "enabled", 2024-06-02T04:19:46.312 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.312 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.312 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.312 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.312 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.312 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.312 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.312 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.312 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.312 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.312 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.312 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.312 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.313 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.313 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.313 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.313 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.313 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.313 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.313 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.313 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.313 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.314 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.314 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.314 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.314 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.314 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.314 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.314 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.314 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.314 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.314 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.314 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.314 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.314 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.315 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.315 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.315 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.315 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.315 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.315 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.315 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.315 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.315 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.316 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.316 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.316 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.316 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.316 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.316 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.316 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.316 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.316 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.316 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.316 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.316 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.316 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.317 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.317 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.317 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.317 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.317 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.317 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.317 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.317 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.317 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.318 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.318 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.318 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.318 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.318 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.318 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.318 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.318 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.318 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.318 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.318 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.319 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.319 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.319 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.319 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.319 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.319 INFO:teuthology.orchestra.run.smithi123.stdout: "max_completed_events": { 2024-06-02T04:19:46.319 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "max_completed_events", 2024-06-02T04:19:46.319 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.319 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.319 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.320 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "50", 2024-06-02T04:19:46.320 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.320 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.320 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.320 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "number of past completed events to remember", 2024-06-02T04:19:46.320 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.320 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.320 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.320 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.320 INFO:teuthology.orchestra.run.smithi123.stdout: "sleep_interval": { 2024-06-02T04:19:46.320 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "sleep_interval", 2024-06-02T04:19:46.321 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:46.321 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.321 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.321 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "5", 2024-06-02T04:19:46.321 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.321 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.321 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.321 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "how long the module is going to sleep", 2024-06-02T04:19:46.322 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.322 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.322 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.322 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.322 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.322 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.322 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.323 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "prometheus", 2024-06-02T04:19:46.323 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:46.323 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:46.323 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:46.323 INFO:teuthology.orchestra.run.smithi123.stdout: "cache": { 2024-06-02T04:19:46.323 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "cache", 2024-06-02T04:19:46.323 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.323 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.323 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.324 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.324 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.324 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.324 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.324 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.324 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.324 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.324 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.324 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.324 INFO:teuthology.orchestra.run.smithi123.stdout: "exclude_perf_counters": { 2024-06-02T04:19:46.324 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "exclude_perf_counters", 2024-06-02T04:19:46.324 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.324 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-06-02T04:19:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-06-02T04:19:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.325 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.326 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.326 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.326 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.326 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.326 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.326 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.326 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.326 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.326 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.326 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.326 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.326 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.326 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.327 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.327 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.327 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.327 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.327 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.327 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.327 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.327 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.327 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.327 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.327 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.327 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.328 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.328 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.328 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.328 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.328 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.328 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.328 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.328 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.328 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.328 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.328 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.328 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.328 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.329 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.329 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.329 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.329 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.329 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.329 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.329 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.329 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.329 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.329 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.329 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.329 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.329 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.329 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.330 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.330 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.330 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.330 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.330 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.330 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.330 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.330 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.330 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.330 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.330 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.330 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.331 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.331 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.331 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.331 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.331 INFO:teuthology.orchestra.run.smithi123.stdout: "rbd_stats_pools": { 2024-06-02T04:19:46.331 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rbd_stats_pools", 2024-06-02T04:19:46.331 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.331 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.331 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.331 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.331 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.331 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: "rbd_stats_pools_refresh_interval": { 2024-06-02T04:19:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-06-02T04:19:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "300", 2024-06-02T04:19:46.332 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: "scrape_interval": { 2024-06-02T04:19:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "scrape_interval", 2024-06-02T04:19:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-06-02T04:19:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.333 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "15.0", 2024-06-02T04:19:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: "server_addr": { 2024-06-02T04:19:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_addr", 2024-06-02T04:19:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.334 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "::", 2024-06-02T04:19:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-06-02T04:19:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: "server_port": { 2024-06-02T04:19:46.335 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_port", 2024-06-02T04:19:46.336 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.336 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.336 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.336 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "9283", 2024-06-02T04:19:46.336 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.336 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.336 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.336 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-06-02T04:19:46.336 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.336 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.336 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.336 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.336 INFO:teuthology.orchestra.run.smithi123.stdout: "stale_cache_strategy": { 2024-06-02T04:19:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "stale_cache_strategy", 2024-06-02T04:19:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "log", 2024-06-02T04:19:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.337 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: "standby_behaviour": { 2024-06-02T04:19:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "standby_behaviour", 2024-06-02T04:19:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "default", 2024-06-02T04:19:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.338 INFO:teuthology.orchestra.run.smithi123.stdout: "default", 2024-06-02T04:19:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: "error" 2024-06-02T04:19:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: "standby_error_status_code": { 2024-06-02T04:19:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "standby_error_status_code", 2024-06-02T04:19:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.339 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "500", 2024-06-02T04:19:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "400", 2024-06-02T04:19:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "599", 2024-06-02T04:19:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.340 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rbd_support", 2024-06-02T04:19:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.341 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.342 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.343 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.344 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.344 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.344 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.344 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.344 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.344 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.344 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.344 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.344 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.344 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.344 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.345 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.345 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.345 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.345 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.345 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.345 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.345 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.345 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.345 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.345 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.346 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.346 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.346 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.346 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.346 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.346 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.346 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.346 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.346 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.346 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.346 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.346 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.346 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.347 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.347 INFO:teuthology.orchestra.run.smithi123.stdout: "max_concurrent_snap_create": { 2024-06-02T04:19:46.347 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "max_concurrent_snap_create", 2024-06-02T04:19:46.347 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.347 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.347 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.347 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10", 2024-06-02T04:19:46.347 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.347 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.348 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.348 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.348 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.348 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.348 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.348 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.348 INFO:teuthology.orchestra.run.smithi123.stdout: "mirror_snapshot_schedule": { 2024-06-02T04:19:46.348 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "mirror_snapshot_schedule", 2024-06-02T04:19:46.348 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.348 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.348 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.348 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.348 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.349 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.349 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.349 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.349 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.349 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.349 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.349 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.349 INFO:teuthology.orchestra.run.smithi123.stdout: "trash_purge_schedule": { 2024-06-02T04:19:46.349 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "trash_purge_schedule", 2024-06-02T04:19:46.349 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.349 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.349 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.349 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.349 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.350 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.350 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.350 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.350 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.350 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.350 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.350 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.350 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.350 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.350 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.350 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "restful", 2024-06-02T04:19:46.350 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:46.351 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:46.351 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:46.351 INFO:teuthology.orchestra.run.smithi123.stdout: "enable_auth": { 2024-06-02T04:19:46.351 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "enable_auth", 2024-06-02T04:19:46.351 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.351 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.351 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.351 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.351 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.351 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.351 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.351 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.351 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.352 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.352 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.352 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.352 INFO:teuthology.orchestra.run.smithi123.stdout: "key_file": { 2024-06-02T04:19:46.352 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "key_file", 2024-06-02T04:19:46.352 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.352 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.352 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.352 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.352 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.352 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.352 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.353 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.353 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.353 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.353 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.353 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.353 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.353 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.353 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.353 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.353 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.353 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.353 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.353 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.354 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.354 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.354 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.354 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.354 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.354 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.354 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.354 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.354 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.354 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.354 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.354 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.355 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.355 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.355 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.355 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.355 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.355 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.355 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.355 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.355 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.356 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.356 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.356 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.356 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.356 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.356 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.356 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.356 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.356 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.356 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.356 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.357 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.357 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.357 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.357 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.357 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.357 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.357 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.357 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.357 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.358 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.358 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.358 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.358 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.358 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.358 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.358 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.358 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.358 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.359 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.359 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.359 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.359 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.359 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.359 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.359 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.359 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.359 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.360 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.360 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.360 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.360 INFO:teuthology.orchestra.run.smithi123.stdout: "server_addr": { 2024-06-02T04:19:46.360 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_addr", 2024-06-02T04:19:46.360 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.360 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.360 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.360 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.361 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.361 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.361 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.361 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.361 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.361 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.361 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.361 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.361 INFO:teuthology.orchestra.run.smithi123.stdout: "server_port": { 2024-06-02T04:19:46.361 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "server_port", 2024-06-02T04:19:46.362 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.362 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.362 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.362 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.362 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.362 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.362 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.362 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.362 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.362 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.362 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.362 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.362 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.363 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.363 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.363 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rgw", 2024-06-02T04:19:46.363 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:46.363 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:46.363 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:46.363 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.363 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.363 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.363 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.363 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.363 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.363 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.364 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.364 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.364 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.364 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.364 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.364 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.364 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.364 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.364 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.364 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.364 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.364 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.365 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.365 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.365 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.365 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.365 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.365 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.365 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.365 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.365 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.365 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.365 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.365 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.366 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.366 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.366 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.366 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.366 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.366 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.366 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.366 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.366 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.366 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.366 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.366 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.366 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.367 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.367 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.367 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.367 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.367 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.367 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.367 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.367 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.367 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.367 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.367 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.367 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.367 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.367 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.368 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.368 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.368 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.368 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.368 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.368 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.368 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.368 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.368 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.368 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.368 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.368 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.368 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.368 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.369 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.369 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rook", 2024-06-02T04:19:46.369 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:46.369 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:46.369 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:46.369 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.369 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.369 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.369 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.369 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.369 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.369 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.370 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.370 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.370 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.370 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.370 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.370 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.370 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.370 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.370 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.370 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.370 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.370 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.370 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.371 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.371 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.371 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.371 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.371 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.371 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.371 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.371 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.371 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.371 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.371 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.371 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.371 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.371 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.372 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.372 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.372 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.372 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.372 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.372 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.372 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.372 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.372 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.372 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.372 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.372 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.372 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.372 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.373 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.373 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.373 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.373 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.373 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.373 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.373 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.373 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.373 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.373 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.373 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.373 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.373 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.374 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.374 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.374 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.374 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.374 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.374 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.374 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.374 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.374 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.374 INFO:teuthology.orchestra.run.smithi123.stdout: "storage_class": { 2024-06-02T04:19:46.374 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "storage_class", 2024-06-02T04:19:46.374 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.374 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.375 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.375 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "local", 2024-06-02T04:19:46.375 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.375 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.375 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.375 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-06-02T04:19:46.375 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.375 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.375 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.375 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.375 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.375 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.375 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.375 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "selftest", 2024-06-02T04:19:46.376 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:46.376 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:46.376 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:46.376 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.376 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.376 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.376 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.376 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.376 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.376 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.376 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.376 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.376 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.377 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.377 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.377 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.377 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.377 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.377 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.377 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.377 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.377 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.377 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.377 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.377 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.377 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.378 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.378 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.378 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.378 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.378 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.378 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.378 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.378 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.378 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.378 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.378 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.378 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.378 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.379 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.379 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.379 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.379 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.379 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.379 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.379 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.379 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.379 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.379 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.379 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.379 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.379 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.380 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.380 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.380 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.380 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.380 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.380 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.380 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.380 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.380 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.380 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.380 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.380 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.381 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.381 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.381 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.381 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.381 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.381 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.381 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.381 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.381 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.381 INFO:teuthology.orchestra.run.smithi123.stdout: "roption1": { 2024-06-02T04:19:46.381 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "roption1", 2024-06-02T04:19:46.381 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.382 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.382 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.382 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.382 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.382 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.382 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.382 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.382 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.382 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.383 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.383 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.383 INFO:teuthology.orchestra.run.smithi123.stdout: "roption2": { 2024-06-02T04:19:46.383 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "roption2", 2024-06-02T04:19:46.383 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.383 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.383 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.383 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "xyz", 2024-06-02T04:19:46.383 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.383 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.383 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.384 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.384 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.384 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.384 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.384 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.384 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption1": { 2024-06-02T04:19:46.384 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption1", 2024-06-02T04:19:46.384 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.384 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.384 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.384 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.384 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.385 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.385 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.385 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.385 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.385 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.385 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.385 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.385 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption2": { 2024-06-02T04:19:46.385 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption2", 2024-06-02T04:19:46.386 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.386 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.386 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.386 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.386 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.386 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.386 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.386 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.386 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.386 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.386 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.386 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.387 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption3": { 2024-06-02T04:19:46.387 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption3", 2024-06-02T04:19:46.387 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "float", 2024-06-02T04:19:46.387 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.387 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.387 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.387 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.387 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.387 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.387 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.388 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.388 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.388 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.389 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.389 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption4": { 2024-06-02T04:19:46.389 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption4", 2024-06-02T04:19:46.389 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.389 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.390 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.390 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.390 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.390 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.390 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.390 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.390 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.390 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.390 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.390 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.390 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption5": { 2024-06-02T04:19:46.390 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption5", 2024-06-02T04:19:46.390 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.391 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.391 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.391 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.391 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.391 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.391 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.391 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.391 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.391 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.391 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.391 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.391 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption6": { 2024-06-02T04:19:46.391 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption6", 2024-06-02T04:19:46.392 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.392 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.392 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.392 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.392 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.392 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.392 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.392 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.392 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.393 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.393 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.393 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.393 INFO:teuthology.orchestra.run.smithi123.stdout: "rwoption7": { 2024-06-02T04:19:46.393 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rwoption7", 2024-06-02T04:19:46.393 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.393 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.393 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.393 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.393 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "1", 2024-06-02T04:19:46.393 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "42", 2024-06-02T04:19:46.394 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.394 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.394 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.394 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.394 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.394 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.394 INFO:teuthology.orchestra.run.smithi123.stdout: "testkey": { 2024-06-02T04:19:46.394 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "testkey", 2024-06-02T04:19:46.394 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.394 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.395 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.395 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.395 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.395 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.395 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.395 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.395 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.395 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.395 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.395 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.395 INFO:teuthology.orchestra.run.smithi123.stdout: "testlkey": { 2024-06-02T04:19:46.396 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "testlkey", 2024-06-02T04:19:46.396 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.396 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.396 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.396 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.396 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.396 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.396 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.396 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.396 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.397 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.397 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.397 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.397 INFO:teuthology.orchestra.run.smithi123.stdout: "testnewline": { 2024-06-02T04:19:46.397 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "testnewline", 2024-06-02T04:19:46.397 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.397 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.397 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.397 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.397 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.398 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.398 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.398 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.398 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.398 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.398 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.398 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.398 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.398 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.399 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.399 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "snap_schedule", 2024-06-02T04:19:46.399 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:46.399 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:46.399 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:46.399 INFO:teuthology.orchestra.run.smithi123.stdout: "allow_m_granularity": { 2024-06-02T04:19:46.399 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "allow_m_granularity", 2024-06-02T04:19:46.399 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.399 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.399 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.399 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.399 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.399 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.400 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.400 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "allow minute scheduled snapshots", 2024-06-02T04:19:46.400 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.400 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.400 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.400 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.400 INFO:teuthology.orchestra.run.smithi123.stdout: "dump_on_update": { 2024-06-02T04:19:46.400 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "dump_on_update", 2024-06-02T04:19:46.400 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.400 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.400 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.401 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.401 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.401 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.401 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.401 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "dump database to debug log on update", 2024-06-02T04:19:46.401 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.401 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.401 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.401 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.401 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.401 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.401 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.401 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.402 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.402 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.402 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.402 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.402 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.402 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.402 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.402 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.402 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.402 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.402 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.402 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.402 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.403 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.403 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.403 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.403 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.403 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.403 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.403 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.403 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.403 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.403 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.403 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.403 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.403 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.403 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.404 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.404 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.404 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.404 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.404 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.404 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.404 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.404 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.404 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.404 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.404 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.404 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.404 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.405 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.405 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.405 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.405 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.405 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.405 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.405 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.405 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.405 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.405 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.405 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.405 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.405 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.406 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.406 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.406 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.406 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.406 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.406 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.406 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.406 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.406 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.406 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.406 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.406 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.406 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.407 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.407 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.407 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.407 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "stats", 2024-06-02T04:19:46.407 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:46.407 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:46.407 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:46.407 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.407 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.407 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.407 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.407 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.407 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.408 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.408 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.408 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.408 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.408 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.408 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.408 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.408 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.408 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.408 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.408 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.408 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.408 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.408 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.409 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.409 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.409 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.409 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.409 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.409 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.409 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.409 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.409 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.409 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.409 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.409 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.409 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.410 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.410 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.410 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.410 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.410 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.410 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.410 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.410 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.410 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.410 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.410 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.410 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.410 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.411 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.411 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.411 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.411 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.411 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.411 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.411 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.411 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.411 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.411 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.411 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.411 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.411 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.412 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.412 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.412 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.412 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.412 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.412 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.412 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.412 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.412 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.412 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.412 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.412 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.412 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.413 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.413 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "status", 2024-06-02T04:19:46.413 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:46.413 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:46.413 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:46.413 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.413 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.413 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.413 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.413 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.413 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.413 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.413 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.414 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.414 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.414 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.414 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.414 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.414 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.414 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.414 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.414 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.414 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.414 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.414 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.414 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.415 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.415 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.415 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.415 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.415 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.415 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.415 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.415 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.415 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.415 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.415 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.415 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.415 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.415 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.416 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.416 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.416 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.416 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.416 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.416 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.416 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.416 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.416 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.416 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.416 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.416 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.416 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.417 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.417 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.417 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.417 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.417 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.417 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.417 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.417 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.417 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.417 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.417 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.417 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.418 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.418 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.418 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.418 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.418 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.418 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.418 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.418 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.418 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.418 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.418 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.419 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.419 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.419 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "telegraf", 2024-06-02T04:19:46.419 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:46.419 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:46.419 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:46.419 INFO:teuthology.orchestra.run.smithi123.stdout: "address": { 2024-06-02T04:19:46.419 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "address", 2024-06-02T04:19:46.419 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.419 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.419 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.419 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-06-02T04:19:46.419 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.420 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.420 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.420 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.420 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.420 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.420 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.420 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.420 INFO:teuthology.orchestra.run.smithi123.stdout: "interval": { 2024-06-02T04:19:46.420 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "interval", 2024-06-02T04:19:46.420 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:46.420 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.421 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.421 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "15", 2024-06-02T04:19:46.421 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.421 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.421 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.421 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.421 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.421 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.421 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.421 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.422 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.422 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.422 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.422 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.422 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.422 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.422 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.422 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.422 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.422 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.423 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.423 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.423 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.423 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.423 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.423 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.423 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.423 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.423 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.424 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.424 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.424 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.424 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.424 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.424 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.424 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.424 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.424 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.424 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.424 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.425 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.425 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.425 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.425 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.425 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.425 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.425 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.425 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.425 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.426 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.426 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.426 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.426 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.426 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.426 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.426 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.426 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.426 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.426 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.427 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.427 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.427 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.427 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.427 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.427 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.427 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.427 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.427 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.427 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.427 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.427 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.427 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.428 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.428 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.428 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.428 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.428 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.428 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.428 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.428 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.428 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.428 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.428 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.428 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "telemetry", 2024-06-02T04:19:46.429 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:46.429 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:46.429 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:46.429 INFO:teuthology.orchestra.run.smithi123.stdout: "channel_basic": { 2024-06-02T04:19:46.429 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "channel_basic", 2024-06-02T04:19:46.429 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.429 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.429 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.429 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.429 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.429 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.429 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.429 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Share basic cluster information (size, version)", 2024-06-02T04:19:46.430 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.430 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.430 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.430 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.430 INFO:teuthology.orchestra.run.smithi123.stdout: "channel_crash": { 2024-06-02T04:19:46.430 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "channel_crash", 2024-06-02T04:19:46.430 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.430 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.430 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.430 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.430 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.430 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.431 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.431 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-06-02T04:19:46.431 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.431 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.431 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.431 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.431 INFO:teuthology.orchestra.run.smithi123.stdout: "channel_device": { 2024-06-02T04:19:46.431 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "channel_device", 2024-06-02T04:19:46.431 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.431 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.431 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.432 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.432 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.432 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.432 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.432 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-06-02T04:19:46.432 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.432 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.432 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.432 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.432 INFO:teuthology.orchestra.run.smithi123.stdout: "channel_ident": { 2024-06-02T04:19:46.432 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "channel_ident", 2024-06-02T04:19:46.433 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.433 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.433 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.433 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.433 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.433 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.433 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.434 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-06-02T04:19:46.434 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.434 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.434 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.434 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.434 INFO:teuthology.orchestra.run.smithi123.stdout: "channel_perf": { 2024-06-02T04:19:46.434 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "channel_perf", 2024-06-02T04:19:46.434 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.434 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.434 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.434 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.435 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.435 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.435 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.435 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Share various performance metrics of a cluster", 2024-06-02T04:19:46.435 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.435 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.435 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.435 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.435 INFO:teuthology.orchestra.run.smithi123.stdout: "contact": { 2024-06-02T04:19:46.435 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "contact", 2024-06-02T04:19:46.436 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.436 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.436 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.436 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.436 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.436 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.436 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.436 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.436 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.437 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.437 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.437 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.437 INFO:teuthology.orchestra.run.smithi123.stdout: "description": { 2024-06-02T04:19:46.437 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "description", 2024-06-02T04:19:46.437 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.437 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.437 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.437 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.437 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.438 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.438 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.438 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.438 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.438 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.438 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.438 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.438 INFO:teuthology.orchestra.run.smithi123.stdout: "device_url": { 2024-06-02T04:19:46.438 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "device_url", 2024-06-02T04:19:46.438 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.438 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.439 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.439 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-06-02T04:19:46.439 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.439 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.439 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.439 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.439 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.439 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.439 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.439 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.439 INFO:teuthology.orchestra.run.smithi123.stdout: "enabled": { 2024-06-02T04:19:46.439 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "enabled", 2024-06-02T04:19:46.439 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.440 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.440 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.440 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.440 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.440 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.440 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.440 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.440 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.440 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.440 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.440 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.440 INFO:teuthology.orchestra.run.smithi123.stdout: "interval": { 2024-06-02T04:19:46.440 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "interval", 2024-06-02T04:19:46.441 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.441 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.441 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.441 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "24", 2024-06-02T04:19:46.441 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "8", 2024-06-02T04:19:46.441 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.441 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.441 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.441 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.441 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.441 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.441 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.441 INFO:teuthology.orchestra.run.smithi123.stdout: "last_opt_revision": { 2024-06-02T04:19:46.442 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "last_opt_revision", 2024-06-02T04:19:46.442 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.442 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.442 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.442 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "1", 2024-06-02T04:19:46.442 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.442 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.442 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.442 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.442 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.442 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.442 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.442 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.443 INFO:teuthology.orchestra.run.smithi123.stdout: "leaderboard": { 2024-06-02T04:19:46.443 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "leaderboard", 2024-06-02T04:19:46.443 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.443 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.443 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.443 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.443 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.443 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.443 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.443 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.443 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.443 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.443 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.444 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.444 INFO:teuthology.orchestra.run.smithi123.stdout: "leaderboard_description": { 2024-06-02T04:19:46.444 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "leaderboard_description", 2024-06-02T04:19:46.444 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.444 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.444 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.444 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.444 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.444 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.444 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.444 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.444 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.444 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.444 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.445 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.445 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.445 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.445 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.445 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.445 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.445 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.445 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.445 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.445 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.445 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.445 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.445 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.446 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.446 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.446 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.446 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.446 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.446 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.446 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.446 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.446 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.446 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.446 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.446 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.446 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.447 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.447 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.447 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.447 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.447 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.447 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.447 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.447 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.447 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.447 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.447 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.447 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.447 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.448 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.448 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.448 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.448 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.448 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.448 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.448 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.448 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.448 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.448 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.448 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.448 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.448 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.449 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.449 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.449 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.449 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.449 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.449 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.449 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.449 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.449 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.449 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.449 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.449 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.449 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.450 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.450 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.450 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.450 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.450 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.450 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.450 INFO:teuthology.orchestra.run.smithi123.stdout: "organization": { 2024-06-02T04:19:46.450 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "organization", 2024-06-02T04:19:46.450 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.450 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.450 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.450 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.450 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.451 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.451 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.451 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.451 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.451 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.451 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.451 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.451 INFO:teuthology.orchestra.run.smithi123.stdout: "proxy": { 2024-06-02T04:19:46.451 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "proxy", 2024-06-02T04:19:46.451 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.451 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.451 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.451 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.452 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.452 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.452 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.452 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.452 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.452 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.452 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.452 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.452 INFO:teuthology.orchestra.run.smithi123.stdout: "url": { 2024-06-02T04:19:46.452 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "url", 2024-06-02T04:19:46.452 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.452 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.452 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.452 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-06-02T04:19:46.453 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.453 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.453 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.453 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.453 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.453 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.453 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.453 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.453 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.453 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.453 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.453 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "test_orchestrator", 2024-06-02T04:19:46.453 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:46.454 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:46.454 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:46.454 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.454 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.454 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.454 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.454 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.454 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.454 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.454 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.454 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.454 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.454 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.455 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.455 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.455 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.455 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.455 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.455 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.455 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.455 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.455 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.455 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.455 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.455 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.455 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.455 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.456 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.456 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.456 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.456 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.456 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.456 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.456 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.456 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.456 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.456 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.456 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.456 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.456 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.457 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.457 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.457 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.457 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.457 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.457 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.457 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.457 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.457 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.457 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.457 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.457 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.457 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.457 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.458 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.458 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.458 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.458 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.458 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.458 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.458 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.458 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.458 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.458 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.458 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.458 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.459 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.459 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.459 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.459 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.459 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.459 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.459 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.459 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.459 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.459 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "volumes", 2024-06-02T04:19:46.459 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:46.459 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:46.460 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:46.460 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.460 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.460 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.460 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.460 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.460 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.460 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.460 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.461 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.461 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.461 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.461 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.461 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.461 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.461 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.461 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.461 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.461 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.461 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.461 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.461 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.461 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.462 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.462 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.462 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.462 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.462 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.462 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.462 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.462 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.463 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.463 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.463 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.463 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.463 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.463 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.463 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.463 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.463 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.463 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.463 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.463 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.463 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.463 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.464 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.464 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.464 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.464 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.464 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.464 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.464 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.464 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.464 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.465 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.465 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.465 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.465 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.465 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.465 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.465 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.465 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.465 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.465 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.465 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.465 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.466 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.466 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.466 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.466 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.466 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.466 INFO:teuthology.orchestra.run.smithi123.stdout: "max_concurrent_clones": { 2024-06-02T04:19:46.466 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "max_concurrent_clones", 2024-06-02T04:19:46.466 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.466 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.467 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.467 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "4", 2024-06-02T04:19:46.467 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.467 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.467 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.467 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Number of asynchronous cloner threads", 2024-06-02T04:19:46.467 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.467 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.467 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.467 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.467 INFO:teuthology.orchestra.run.smithi123.stdout: "snapshot_clone_delay": { 2024-06-02T04:19:46.468 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "snapshot_clone_delay", 2024-06-02T04:19:46.468 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.468 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.468 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.468 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "0", 2024-06-02T04:19:46.468 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.468 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.468 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.468 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-06-02T04:19:46.468 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.468 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.469 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.469 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.469 INFO:teuthology.orchestra.run.smithi123.stdout: "snapshot_clone_no_wait": { 2024-06-02T04:19:46.469 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "snapshot_clone_no_wait", 2024-06-02T04:19:46.469 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.469 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.469 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.469 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "True", 2024-06-02T04:19:46.469 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.469 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.470 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.470 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-06-02T04:19:46.470 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.470 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.470 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.470 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.470 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.470 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.470 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.471 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "zabbix", 2024-06-02T04:19:46.471 INFO:teuthology.orchestra.run.smithi123.stdout: "can_run": true, 2024-06-02T04:19:46.471 INFO:teuthology.orchestra.run.smithi123.stdout: "error_string": "", 2024-06-02T04:19:46.471 INFO:teuthology.orchestra.run.smithi123.stdout: "module_options": { 2024-06-02T04:19:46.471 INFO:teuthology.orchestra.run.smithi123.stdout: "discovery_interval": { 2024-06-02T04:19:46.471 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "discovery_interval", 2024-06-02T04:19:46.471 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "uint", 2024-06-02T04:19:46.471 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.471 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.472 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "100", 2024-06-02T04:19:46.472 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.472 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.472 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.472 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.472 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.472 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.472 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.472 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.472 INFO:teuthology.orchestra.run.smithi123.stdout: "identifier": { 2024-06-02T04:19:46.473 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "identifier", 2024-06-02T04:19:46.473 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.473 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.473 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.473 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.473 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.473 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.473 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.473 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.473 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.473 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.473 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.473 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.474 INFO:teuthology.orchestra.run.smithi123.stdout: "interval": { 2024-06-02T04:19:46.474 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "interval", 2024-06-02T04:19:46.474 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "secs", 2024-06-02T04:19:46.474 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.474 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.474 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "60", 2024-06-02T04:19:46.474 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.474 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.474 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.474 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.474 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.474 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.474 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.474 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.475 INFO:teuthology.orchestra.run.smithi123.stdout: "log_level": { 2024-06-02T04:19:46.475 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_level", 2024-06-02T04:19:46.475 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.475 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.475 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.475 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.475 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.475 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.475 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.475 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.475 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.475 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.475 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.476 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.476 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.476 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.476 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.476 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.476 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.476 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.476 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.476 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster": { 2024-06-02T04:19:46.476 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster", 2024-06-02T04:19:46.476 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.476 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.476 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.476 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.477 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.477 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.477 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.477 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.477 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.477 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.477 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.477 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.477 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_cluster_level": { 2024-06-02T04:19:46.477 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_cluster_level", 2024-06-02T04:19:46.477 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.477 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.477 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.478 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "info", 2024-06-02T04:19:46.478 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.478 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.478 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [ 2024-06-02T04:19:46.478 INFO:teuthology.orchestra.run.smithi123.stdout: "", 2024-06-02T04:19:46.478 INFO:teuthology.orchestra.run.smithi123.stdout: "critical", 2024-06-02T04:19:46.478 INFO:teuthology.orchestra.run.smithi123.stdout: "debug", 2024-06-02T04:19:46.478 INFO:teuthology.orchestra.run.smithi123.stdout: "error", 2024-06-02T04:19:46.478 INFO:teuthology.orchestra.run.smithi123.stdout: "info", 2024-06-02T04:19:46.478 INFO:teuthology.orchestra.run.smithi123.stdout: "warning" 2024-06-02T04:19:46.478 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.478 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.478 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.479 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.479 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.479 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.479 INFO:teuthology.orchestra.run.smithi123.stdout: "log_to_file": { 2024-06-02T04:19:46.479 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "log_to_file", 2024-06-02T04:19:46.479 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "bool", 2024-06-02T04:19:46.479 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.479 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 1, 2024-06-02T04:19:46.479 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "False", 2024-06-02T04:19:46.479 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.479 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.479 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.479 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.480 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.480 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.480 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.480 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.480 INFO:teuthology.orchestra.run.smithi123.stdout: "zabbix_host": { 2024-06-02T04:19:46.480 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "zabbix_host", 2024-06-02T04:19:46.480 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.480 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.480 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.480 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "", 2024-06-02T04:19:46.480 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.480 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.480 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.481 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.481 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.481 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.481 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.481 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.481 INFO:teuthology.orchestra.run.smithi123.stdout: "zabbix_port": { 2024-06-02T04:19:46.481 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "zabbix_port", 2024-06-02T04:19:46.481 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "int", 2024-06-02T04:19:46.481 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.481 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.481 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "10051", 2024-06-02T04:19:46.481 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.481 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.482 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.482 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.482 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.482 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.482 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.482 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.482 INFO:teuthology.orchestra.run.smithi123.stdout: "zabbix_sender": { 2024-06-02T04:19:46.482 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "zabbix_sender", 2024-06-02T04:19:46.482 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "str", 2024-06-02T04:19:46.482 INFO:teuthology.orchestra.run.smithi123.stdout: "level": "advanced", 2024-06-02T04:19:46.482 INFO:teuthology.orchestra.run.smithi123.stdout: "flags": 0, 2024-06-02T04:19:46.482 INFO:teuthology.orchestra.run.smithi123.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-06-02T04:19:46.483 INFO:teuthology.orchestra.run.smithi123.stdout: "min": "", 2024-06-02T04:19:46.483 INFO:teuthology.orchestra.run.smithi123.stdout: "max": "", 2024-06-02T04:19:46.483 INFO:teuthology.orchestra.run.smithi123.stdout: "enum_allowed": [], 2024-06-02T04:19:46.483 INFO:teuthology.orchestra.run.smithi123.stdout: "desc": "", 2024-06-02T04:19:46.483 INFO:teuthology.orchestra.run.smithi123.stdout: "long_desc": "", 2024-06-02T04:19:46.483 INFO:teuthology.orchestra.run.smithi123.stdout: "tags": [], 2024-06-02T04:19:46.483 INFO:teuthology.orchestra.run.smithi123.stdout: "see_also": [] 2024-06-02T04:19:46.483 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.483 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.483 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.483 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.483 INFO:teuthology.orchestra.run.smithi123.stdout: "services": { 2024-06-02T04:19:46.483 INFO:teuthology.orchestra.run.smithi123.stdout: "dashboard": "https://172.21.15.123:8443/" 2024-06-02T04:19:46.483 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.484 INFO:teuthology.orchestra.run.smithi123.stdout: "always_on_modules": { 2024-06-02T04:19:46.484 INFO:teuthology.orchestra.run.smithi123.stdout: "octopus": [ 2024-06-02T04:19:46.484 INFO:teuthology.orchestra.run.smithi123.stdout: "balancer", 2024-06-02T04:19:46.484 INFO:teuthology.orchestra.run.smithi123.stdout: "crash", 2024-06-02T04:19:46.484 INFO:teuthology.orchestra.run.smithi123.stdout: "devicehealth", 2024-06-02T04:19:46.484 INFO:teuthology.orchestra.run.smithi123.stdout: "orchestrator", 2024-06-02T04:19:46.484 INFO:teuthology.orchestra.run.smithi123.stdout: "pg_autoscaler", 2024-06-02T04:19:46.484 INFO:teuthology.orchestra.run.smithi123.stdout: "progress", 2024-06-02T04:19:46.484 INFO:teuthology.orchestra.run.smithi123.stdout: "rbd_support", 2024-06-02T04:19:46.484 INFO:teuthology.orchestra.run.smithi123.stdout: "status", 2024-06-02T04:19:46.484 INFO:teuthology.orchestra.run.smithi123.stdout: "telemetry", 2024-06-02T04:19:46.484 INFO:teuthology.orchestra.run.smithi123.stdout: "volumes" 2024-06-02T04:19:46.484 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.485 INFO:teuthology.orchestra.run.smithi123.stdout: "pacific": [ 2024-06-02T04:19:46.485 INFO:teuthology.orchestra.run.smithi123.stdout: "balancer", 2024-06-02T04:19:46.485 INFO:teuthology.orchestra.run.smithi123.stdout: "crash", 2024-06-02T04:19:46.485 INFO:teuthology.orchestra.run.smithi123.stdout: "devicehealth", 2024-06-02T04:19:46.485 INFO:teuthology.orchestra.run.smithi123.stdout: "orchestrator", 2024-06-02T04:19:46.485 INFO:teuthology.orchestra.run.smithi123.stdout: "pg_autoscaler", 2024-06-02T04:19:46.485 INFO:teuthology.orchestra.run.smithi123.stdout: "progress", 2024-06-02T04:19:46.485 INFO:teuthology.orchestra.run.smithi123.stdout: "rbd_support", 2024-06-02T04:19:46.485 INFO:teuthology.orchestra.run.smithi123.stdout: "status", 2024-06-02T04:19:46.485 INFO:teuthology.orchestra.run.smithi123.stdout: "telemetry", 2024-06-02T04:19:46.485 INFO:teuthology.orchestra.run.smithi123.stdout: "volumes" 2024-06-02T04:19:46.485 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.485 INFO:teuthology.orchestra.run.smithi123.stdout: "quincy": [ 2024-06-02T04:19:46.486 INFO:teuthology.orchestra.run.smithi123.stdout: "balancer", 2024-06-02T04:19:46.486 INFO:teuthology.orchestra.run.smithi123.stdout: "crash", 2024-06-02T04:19:46.486 INFO:teuthology.orchestra.run.smithi123.stdout: "devicehealth", 2024-06-02T04:19:46.486 INFO:teuthology.orchestra.run.smithi123.stdout: "orchestrator", 2024-06-02T04:19:46.486 INFO:teuthology.orchestra.run.smithi123.stdout: "pg_autoscaler", 2024-06-02T04:19:46.486 INFO:teuthology.orchestra.run.smithi123.stdout: "progress", 2024-06-02T04:19:46.486 INFO:teuthology.orchestra.run.smithi123.stdout: "rbd_support", 2024-06-02T04:19:46.486 INFO:teuthology.orchestra.run.smithi123.stdout: "status", 2024-06-02T04:19:46.486 INFO:teuthology.orchestra.run.smithi123.stdout: "telemetry", 2024-06-02T04:19:46.486 INFO:teuthology.orchestra.run.smithi123.stdout: "volumes" 2024-06-02T04:19:46.486 INFO:teuthology.orchestra.run.smithi123.stdout: ], 2024-06-02T04:19:46.486 INFO:teuthology.orchestra.run.smithi123.stdout: "reef": [ 2024-06-02T04:19:46.486 INFO:teuthology.orchestra.run.smithi123.stdout: "balancer", 2024-06-02T04:19:46.487 INFO:teuthology.orchestra.run.smithi123.stdout: "crash", 2024-06-02T04:19:46.487 INFO:teuthology.orchestra.run.smithi123.stdout: "devicehealth", 2024-06-02T04:19:46.487 INFO:teuthology.orchestra.run.smithi123.stdout: "orchestrator", 2024-06-02T04:19:46.487 INFO:teuthology.orchestra.run.smithi123.stdout: "pg_autoscaler", 2024-06-02T04:19:46.487 INFO:teuthology.orchestra.run.smithi123.stdout: "progress", 2024-06-02T04:19:46.487 INFO:teuthology.orchestra.run.smithi123.stdout: "rbd_support", 2024-06-02T04:19:46.487 INFO:teuthology.orchestra.run.smithi123.stdout: "status", 2024-06-02T04:19:46.487 INFO:teuthology.orchestra.run.smithi123.stdout: "telemetry", 2024-06-02T04:19:46.487 INFO:teuthology.orchestra.run.smithi123.stdout: "volumes" 2024-06-02T04:19:46.487 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-06-02T04:19:46.487 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.487 INFO:teuthology.orchestra.run.smithi123.stdout: "last_failure_osd_epoch": 3, 2024-06-02T04:19:46.488 INFO:teuthology.orchestra.run.smithi123.stdout: "active_clients": [ 2024-06-02T04:19:46.488 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.488 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "devicehealth", 2024-06-02T04:19:46.488 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-06-02T04:19:46.488 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.488 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-06-02T04:19:46.488 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:0", 2024-06-02T04:19:46.488 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 286437755 2024-06-02T04:19:46.488 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.488 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-06-02T04:19:46.488 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.488 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.488 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "libcephsqlite", 2024-06-02T04:19:46.489 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-06-02T04:19:46.489 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.489 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-06-02T04:19:46.489 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:0", 2024-06-02T04:19:46.489 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 4015533888 2024-06-02T04:19:46.489 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.489 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-06-02T04:19:46.489 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.489 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.489 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "rbd_support", 2024-06-02T04:19:46.489 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-06-02T04:19:46.489 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.489 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-06-02T04:19:46.490 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:0", 2024-06-02T04:19:46.490 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 2431972677 2024-06-02T04:19:46.490 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.490 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-06-02T04:19:46.490 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:46.490 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.490 INFO:teuthology.orchestra.run.smithi123.stdout: "name": "volumes", 2024-06-02T04:19:46.490 INFO:teuthology.orchestra.run.smithi123.stdout: "addrvec": [ 2024-06-02T04:19:46.490 INFO:teuthology.orchestra.run.smithi123.stdout: { 2024-06-02T04:19:46.490 INFO:teuthology.orchestra.run.smithi123.stdout: "type": "v2", 2024-06-02T04:19:46.490 INFO:teuthology.orchestra.run.smithi123.stdout: "addr": "172.21.15.123:0", 2024-06-02T04:19:46.490 INFO:teuthology.orchestra.run.smithi123.stdout: "nonce": 2789552618 2024-06-02T04:19:46.490 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.491 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-06-02T04:19:46.491 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:46.491 INFO:teuthology.orchestra.run.smithi123.stdout: ] 2024-06-02T04:19:46.491 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-06-02T04:19:46.493 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:44 smithi136 ceph-mon[47443]: pgmap v722: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 29 MiB/s wr, 2.11k op/s 2024-06-02T04:19:46.493 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:44 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/3379413573' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:19:46.493 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:44 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/260508518' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:19:46.493 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:44 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/1857211508' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:19:46.493 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:45 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/1727398577' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-06-02T04:19:46.493 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:44 smithi162 ceph-mon[47009]: pgmap v722: 97 pgs: 97 active+clean; 1.7 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 29 MiB/s wr, 2.11k op/s 2024-06-02T04:19:46.493 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:44 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/3379413573' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:19:46.493 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:44 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/260508518' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:19:46.493 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:44 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/1857211508' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:19:46.493 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:45 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/1727398577' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-06-02T04:19:46.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.847+0000 7f496d806700 1 -- 172.21.15.123:0/1727398577 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f49540a11a0 msgr2=0x7f49540a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:19:46.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.847+0000 7f496d806700 1 --2- 172.21.15.123:0/1727398577 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f49540a11a0 0x7f49540a3660 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4958005950 tx=0x7f49580058e0 comp rx=0 tx=0).stop 2024-06-02T04:19:46.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.847+0000 7f496d806700 1 -- 172.21.15.123:0/1727398577 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4968102990 msgr2=0x7f496819e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:19:46.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.847+0000 7f496d806700 1 --2- 172.21.15.123:0/1727398577 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4968102990 0x7f496819e4c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4960006070 tx=0x7f4960004db0 comp rx=0 tx=0).stop 2024-06-02T04:19:46.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.847+0000 7f496d806700 1 -- 172.21.15.123:0/1727398577 shutdown_connections 2024-06-02T04:19:46.494 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.847+0000 7f496d806700 1 --2- 172.21.15.123:0/1727398577 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4968102990 0x7f496819e4c0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:46.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.847+0000 7f496d806700 1 --2- 172.21.15.123:0/1727398577 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f49540a11a0 0x7f49540a3660 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:46.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.847+0000 7f496d806700 1 --2- 172.21.15.123:0/1727398577 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4968100e80 0x7f4968196f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:46.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.847+0000 7f496d806700 1 --2- 172.21.15.123:0/1727398577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4968101fd0 0x7f49681974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:19:46.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.847+0000 7f496d806700 1 -- 172.21.15.123:0/1727398577 >> 172.21.15.123:0/1727398577 conn(0x7f49680fc410 msgr2=0x7f49681053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:19:46.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.847+0000 7f496d806700 1 -- 172.21.15.123:0/1727398577 shutdown_connections 2024-06-02T04:19:46.495 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:19:44.847+0000 7f496d806700 1 -- 172.21.15.123:0/1727398577 wait complete. 2024-06-02T04:19:46.502 DEBUG:tasks.check_counter:Getting stats from a 2024-06-02T04:19:46.502 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph daemon mds.a perf dump 2024-06-02T04:19:46.502 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:45 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1727398577' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-06-02T04:19:46.775 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:19:46.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:46 smithi123 ceph-mon[42885]: pgmap v723: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 24 MiB/s wr, 1.81k op/s 2024-06-02T04:19:47.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:46 smithi162 ceph-mon[47009]: pgmap v723: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 24 MiB/s wr, 1.81k op/s 2024-06-02T04:19:47.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:46 smithi136 ceph-mon[47443]: pgmap v723: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 24 MiB/s wr, 1.81k op/s 2024-06-02T04:19:47.803 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-06-02T04:19:47.803 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T04:19:47.803 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 1265, 2024-06-02T04:19:47.803 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 1261, 2024-06-02T04:19:47.803 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 840048, 2024-06-02T04:19:47.803 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 461231, 2024-06-02T04:19:47.804 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 5, 2024-06-02T04:19:47.804 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 1, 2024-06-02T04:19:47.804 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.128868844, 2024-06-02T04:19:47.804 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.042790045, 2024-06-02T04:19:47.804 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.038212008, 2024-06-02T04:19:47.804 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.038137349, 2024-06-02T04:19:47.804 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:19:47.804 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1260, 2024-06-02T04:19:47.804 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.314654204, 2024-06-02T04:19:47.804 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000249725 2024-06-02T04:19:47.805 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.805 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:19:47.805 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.805 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.805 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.805 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.805 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 509088, 2024-06-02T04:19:47.805 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 154896 2024-06-02T04:19:47.805 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.806 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T04:19:47.806 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 9, 2024-06-02T04:19:47.806 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 211, 2024-06-02T04:19:47.806 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 4702, 2024-06-02T04:19:47.806 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 520233, 2024-06-02T04:19:47.806 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 8, 2024-06-02T04:19:47.806 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 4, 2024-06-02T04:19:47.806 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.015325552, 2024-06-02T04:19:47.806 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.010714752, 2024-06-02T04:19:47.806 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.002805641, 2024-06-02T04:19:47.806 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.000063095, 2024-06-02T04:19:47.806 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:19:47.806 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 210, 2024-06-02T04:19:47.807 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.093171567, 2024-06-02T04:19:47.807 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000443674 2024-06-02T04:19:47.807 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.807 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:19:47.807 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.807 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.807 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.807 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.807 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-06-02T04:19:47.807 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 519232 2024-06-02T04:19:47.808 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.808 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T04:19:47.808 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 988, 2024-06-02T04:19:47.808 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 990, 2024-06-02T04:19:47.808 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 259405, 2024-06-02T04:19:47.808 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 307269, 2024-06-02T04:19:47.808 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 5, 2024-06-02T04:19:47.808 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 3, 2024-06-02T04:19:47.809 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.076249440, 2024-06-02T04:19:47.809 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.020506432, 2024-06-02T04:19:47.809 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.021749791, 2024-06-02T04:19:47.809 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.027608045, 2024-06-02T04:19:47.809 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:19:47.809 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 988, 2024-06-02T04:19:47.809 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.129045247, 2024-06-02T04:19:47.809 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000130612 2024-06-02T04:19:47.809 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.809 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:19:47.809 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.810 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.810 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.810 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.810 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-02T04:19:47.810 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 0 2024-06-02T04:19:47.810 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.810 INFO:teuthology.orchestra.run.smithi123.stdout: "cct": { 2024-06-02T04:19:47.810 INFO:teuthology.orchestra.run.smithi123.stdout: "total_workers": 1, 2024-06-02T04:19:47.810 INFO:teuthology.orchestra.run.smithi123.stdout: "unhealthy_workers": 0 2024-06-02T04:19:47.810 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.810 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-MDSRank": { 2024-06-02T04:19:47.810 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-06-02T04:19:47.810 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-06-02T04:19:47.811 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 3945, 2024-06-02T04:19:47.811 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.100452119, 2024-06-02T04:19:47.811 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000025463 2024-06-02T04:19:47.811 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:47.811 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.811 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-PurgeQueue": { 2024-06-02T04:19:47.811 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-06-02T04:19:47.811 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-06-02T04:19:47.811 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.811 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.811 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.811 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:47.811 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.812 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-06-02T04:19:47.812 INFO:teuthology.orchestra.run.smithi123.stdout: "request": 0, 2024-06-02T04:19:47.812 INFO:teuthology.orchestra.run.smithi123.stdout: "reply": 0, 2024-06-02T04:19:47.812 INFO:teuthology.orchestra.run.smithi123.stdout: "reply_latency": { 2024-06-02T04:19:47.812 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.812 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.812 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.812 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.812 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_reply": 0, 2024-06-02T04:19:47.812 INFO:teuthology.orchestra.run.smithi123.stdout: "forward": 0, 2024-06-02T04:19:47.812 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_complete": 0, 2024-06-02T04:19:47.812 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_keys": 0, 2024-06-02T04:19:47.813 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_commit": 0, 2024-06-02T04:19:47.813 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_split": 0, 2024-06-02T04:19:47.813 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_merge": 0, 2024-06-02T04:19:47.813 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes": 0, 2024-06-02T04:19:47.813 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_top": 0, 2024-06-02T04:19:47.813 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_bottom": 0, 2024-06-02T04:19:47.813 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pin_tail": 0, 2024-06-02T04:19:47.813 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pinned": 0, 2024-06-02T04:19:47.813 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_expired": 0, 2024-06-02T04:19:47.813 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_with_caps": 0, 2024-06-02T04:19:47.813 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": 0, 2024-06-02T04:19:47.813 INFO:teuthology.orchestra.run.smithi123.stdout: "subtrees": 1, 2024-06-02T04:19:47.813 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse": 0, 2024-06-02T04:19:47.814 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_hit": 0, 2024-06-02T04:19:47.814 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_forward": 0, 2024-06-02T04:19:47.814 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_discover": 0, 2024-06-02T04:19:47.814 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_dir_fetch": 0, 2024-06-02T04:19:47.814 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_remote_ino": 0, 2024-06-02T04:19:47.814 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_lock": 0, 2024-06-02T04:19:47.814 INFO:teuthology.orchestra.run.smithi123.stdout: "load_cent": 0, 2024-06-02T04:19:47.814 INFO:teuthology.orchestra.run.smithi123.stdout: "q": 0, 2024-06-02T04:19:47.814 INFO:teuthology.orchestra.run.smithi123.stdout: "exported": 0, 2024-06-02T04:19:47.814 INFO:teuthology.orchestra.run.smithi123.stdout: "exported_inodes": 0, 2024-06-02T04:19:47.814 INFO:teuthology.orchestra.run.smithi123.stdout: "imported": 0, 2024-06-02T04:19:47.814 INFO:teuthology.orchestra.run.smithi123.stdout: "imported_inodes": 0, 2024-06-02T04:19:47.814 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_dir_fetch": 0, 2024-06-02T04:19:47.815 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_backtrace_fetch": 0, 2024-06-02T04:19:47.815 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_peer_discover": 0, 2024-06-02T04:19:47.815 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rfiles": 0, 2024-06-02T04:19:47.815 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rbytes": 0, 2024-06-02T04:19:47.815 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rsnaps": 0, 2024-06-02T04:19:47.815 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_fetch": 0, 2024-06-02T04:19:47.815 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_set_tag": 0, 2024-06-02T04:19:47.815 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_repaired": 0, 2024-06-02T04:19:47.815 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_inotable_repaired": 0, 2024-06-02T04:19:47.816 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_inodes": 0, 2024-06-02T04:19:47.816 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_base_inodes": 0, 2024-06-02T04:19:47.816 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dirfrag_rstats": 0, 2024-06-02T04:19:47.816 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_file_inodes": 0, 2024-06-02T04:19:47.816 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_inode_file_caps": 0, 2024-06-02T04:19:47.816 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_revoke": 0, 2024-06-02T04:19:47.816 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_grant": 0, 2024-06-02T04:19:47.816 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_trunc": 0, 2024-06-02T04:19:47.816 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-02T04:19:47.816 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-02T04:19:47.816 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps": 0, 2024-06-02T04:19:47.816 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps_dirty": 0, 2024-06-02T04:19:47.817 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_cap_release": 0, 2024-06-02T04:19:47.817 INFO:teuthology.orchestra.run.smithi123.stdout: "process_request_cap_release": 0 2024-06-02T04:19:47.817 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.817 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_cache": { 2024-06-02T04:19:47.817 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update": 0, 2024-06-02T04:19:47.817 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update_receipt": 0, 2024-06-02T04:19:47.817 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_try_discover": 0, 2024-06-02T04:19:47.817 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_send_discover": 0, 2024-06-02T04:19:47.817 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_handle_discover": 0, 2024-06-02T04:19:47.818 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays": 0, 2024-06-02T04:19:47.818 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_delayed": 0, 2024-06-02T04:19:47.818 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_enqueuing": 0, 2024-06-02T04:19:47.818 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_created": 0, 2024-06-02T04:19:47.818 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_enqueued": 0, 2024-06-02T04:19:47.818 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_reintegrated": 0, 2024-06-02T04:19:47.818 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_migrated": 0, 2024-06-02T04:19:47.818 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_processing": 0, 2024-06-02T04:19:47.818 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_enqueued": 0, 2024-06-02T04:19:47.818 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_prioritized": 0, 2024-06-02T04:19:47.818 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_started": 0, 2024-06-02T04:19:47.819 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_completed": 0, 2024-06-02T04:19:47.819 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_enqueue_scrub": 0, 2024-06-02T04:19:47.819 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_exportdir": 0, 2024-06-02T04:19:47.819 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_flush": 0, 2024-06-02T04:19:47.819 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragmentdir": 0, 2024-06-02T04:19:47.819 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragstats": 0, 2024-06-02T04:19:47.819 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_inodestats": 0 2024-06-02T04:19:47.819 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.819 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_log": { 2024-06-02T04:19:47.819 INFO:teuthology.orchestra.run.smithi123.stdout: "evadd": 0, 2024-06-02T04:19:47.820 INFO:teuthology.orchestra.run.smithi123.stdout: "evex": 0, 2024-06-02T04:19:47.820 INFO:teuthology.orchestra.run.smithi123.stdout: "evtrm": 0, 2024-06-02T04:19:47.820 INFO:teuthology.orchestra.run.smithi123.stdout: "ev": 1, 2024-06-02T04:19:47.820 INFO:teuthology.orchestra.run.smithi123.stdout: "evexg": 0, 2024-06-02T04:19:47.820 INFO:teuthology.orchestra.run.smithi123.stdout: "evexd": 0, 2024-06-02T04:19:47.820 INFO:teuthology.orchestra.run.smithi123.stdout: "segadd": 0, 2024-06-02T04:19:47.820 INFO:teuthology.orchestra.run.smithi123.stdout: "segex": 0, 2024-06-02T04:19:47.820 INFO:teuthology.orchestra.run.smithi123.stdout: "segtrm": 0, 2024-06-02T04:19:47.820 INFO:teuthology.orchestra.run.smithi123.stdout: "seg": 1, 2024-06-02T04:19:47.820 INFO:teuthology.orchestra.run.smithi123.stdout: "segexg": 0, 2024-06-02T04:19:47.821 INFO:teuthology.orchestra.run.smithi123.stdout: "segexd": 0, 2024-06-02T04:19:47.821 INFO:teuthology.orchestra.run.smithi123.stdout: "expos": 4194304, 2024-06-02T04:19:47.821 INFO:teuthology.orchestra.run.smithi123.stdout: "wrpos": 4194844, 2024-06-02T04:19:47.821 INFO:teuthology.orchestra.run.smithi123.stdout: "rdpos": 4194304, 2024-06-02T04:19:47.821 INFO:teuthology.orchestra.run.smithi123.stdout: "jlat": { 2024-06-02T04:19:47.821 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.822 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.822 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.822 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.822 INFO:teuthology.orchestra.run.smithi123.stdout: "replayed": 1 2024-06-02T04:19:47.822 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.822 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_mem": { 2024-06-02T04:19:47.822 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 3, 2024-06-02T04:19:47.822 INFO:teuthology.orchestra.run.smithi123.stdout: "ino+": 3, 2024-06-02T04:19:47.822 INFO:teuthology.orchestra.run.smithi123.stdout: "ino-": 0, 2024-06-02T04:19:47.825 INFO:teuthology.orchestra.run.smithi123.stdout: "dir": 1, 2024-06-02T04:19:47.826 INFO:teuthology.orchestra.run.smithi123.stdout: "dir+": 1, 2024-06-02T04:19:47.826 INFO:teuthology.orchestra.run.smithi123.stdout: "dir-": 0, 2024-06-02T04:19:47.826 INFO:teuthology.orchestra.run.smithi123.stdout: "dn": 0, 2024-06-02T04:19:47.826 INFO:teuthology.orchestra.run.smithi123.stdout: "dn+": 0, 2024-06-02T04:19:47.826 INFO:teuthology.orchestra.run.smithi123.stdout: "dn-": 0, 2024-06-02T04:19:47.826 INFO:teuthology.orchestra.run.smithi123.stdout: "cap": 0, 2024-06-02T04:19:47.826 INFO:teuthology.orchestra.run.smithi123.stdout: "cap+": 0, 2024-06-02T04:19:47.826 INFO:teuthology.orchestra.run.smithi123.stdout: "cap-": 0, 2024-06-02T04:19:47.826 INFO:teuthology.orchestra.run.smithi123.stdout: "rss": 47680, 2024-06-02T04:19:47.826 INFO:teuthology.orchestra.run.smithi123.stdout: "heap": 207156 2024-06-02T04:19:47.826 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.827 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_server": { 2024-06-02T04:19:47.827 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_client_request": 0, 2024-06-02T04:19:47.827 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_server_request": 0, 2024-06-02T04:19:47.827 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_request": 0, 2024-06-02T04:19:47.827 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_session": 0, 2024-06-02T04:19:47.827 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_peer_request": 0, 2024-06-02T04:19:47.827 INFO:teuthology.orchestra.run.smithi123.stdout: "req_create_latency": { 2024-06-02T04:19:47.828 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.828 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.828 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.828 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.828 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getattr_latency": { 2024-06-02T04:19:47.828 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.828 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.828 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.828 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.828 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getfilelock_latency": { 2024-06-02T04:19:47.828 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.828 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.829 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.829 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.829 INFO:teuthology.orchestra.run.smithi123.stdout: "req_link_latency": { 2024-06-02T04:19:47.829 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.829 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.829 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.829 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.829 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookup_latency": { 2024-06-02T04:19:47.829 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.829 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.829 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.829 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.829 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookuphash_latency": { 2024-06-02T04:19:47.829 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.830 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.830 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.830 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.830 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupino_latency": { 2024-06-02T04:19:47.830 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.830 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.830 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.830 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.830 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupname_latency": { 2024-06-02T04:19:47.830 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.830 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.830 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.830 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.831 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupparent_latency": { 2024-06-02T04:19:47.831 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.831 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.831 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.831 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.831 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupsnap_latency": { 2024-06-02T04:19:47.831 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.831 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.831 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.831 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.831 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lssnap_latency": { 2024-06-02T04:19:47.831 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.832 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.832 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.832 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.832 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mkdir_latency": { 2024-06-02T04:19:47.832 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.832 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.832 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.832 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.832 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mknod_latency": { 2024-06-02T04:19:47.832 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.833 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.833 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.833 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.833 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mksnap_latency": { 2024-06-02T04:19:47.833 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.833 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.833 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.833 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.833 INFO:teuthology.orchestra.run.smithi123.stdout: "req_open_latency": { 2024-06-02T04:19:47.833 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.833 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.833 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.834 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.834 INFO:teuthology.orchestra.run.smithi123.stdout: "req_readdir_latency": { 2024-06-02T04:19:47.834 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.834 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.834 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.834 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.834 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rename_latency": { 2024-06-02T04:19:47.834 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.834 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.834 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.834 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.834 INFO:teuthology.orchestra.run.smithi123.stdout: "req_renamesnap_latency": { 2024-06-02T04:19:47.834 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.835 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.835 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.835 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.835 INFO:teuthology.orchestra.run.smithi123.stdout: "req_snapdiff_latency": { 2024-06-02T04:19:47.835 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.835 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.835 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.835 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.835 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmdir_latency": { 2024-06-02T04:19:47.835 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.835 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.835 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.835 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.835 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmsnap_latency": { 2024-06-02T04:19:47.836 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.836 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.836 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.836 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.836 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmxattr_latency": { 2024-06-02T04:19:47.836 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.836 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.836 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.836 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.836 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setattr_latency": { 2024-06-02T04:19:47.836 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.836 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.837 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.837 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.837 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setdirlayout_latency": { 2024-06-02T04:19:47.837 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.837 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.837 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.837 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.837 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setfilelock_latency": { 2024-06-02T04:19:47.837 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.837 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.837 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.837 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.837 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setlayout_latency": { 2024-06-02T04:19:47.838 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.838 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.838 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.838 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.838 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setxattr_latency": { 2024-06-02T04:19:47.838 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.838 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.838 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.838 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.838 INFO:teuthology.orchestra.run.smithi123.stdout: "req_symlink_latency": { 2024-06-02T04:19:47.838 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.838 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.838 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.839 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.839 INFO:teuthology.orchestra.run.smithi123.stdout: "req_unlink_latency": { 2024-06-02T04:19:47.839 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.839 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.839 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.839 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.839 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_revoke_eviction": 0, 2024-06-02T04:19:47.839 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_acquisition_throttle": 0, 2024-06-02T04:19:47.839 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getvxattr_latency": { 2024-06-02T04:19:47.839 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.839 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.839 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.839 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:47.840 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.840 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_sessions": { 2024-06-02T04:19:47.840 INFO:teuthology.orchestra.run.smithi123.stdout: "session_count": 0, 2024-06-02T04:19:47.840 INFO:teuthology.orchestra.run.smithi123.stdout: "session_add": 0, 2024-06-02T04:19:47.840 INFO:teuthology.orchestra.run.smithi123.stdout: "session_remove": 0, 2024-06-02T04:19:47.840 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_open": 0, 2024-06-02T04:19:47.840 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_stale": 0, 2024-06-02T04:19:47.840 INFO:teuthology.orchestra.run.smithi123.stdout: "total_load": 0, 2024-06-02T04:19:47.840 INFO:teuthology.orchestra.run.smithi123.stdout: "average_load": 0, 2024-06-02T04:19:47.840 INFO:teuthology.orchestra.run.smithi123.stdout: "avg_session_uptime": 0, 2024-06-02T04:19:47.840 INFO:teuthology.orchestra.run.smithi123.stdout: "mdthresh_evicted": 0 2024-06-02T04:19:47.840 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.840 INFO:teuthology.orchestra.run.smithi123.stdout: "mempool": { 2024-06-02T04:19:47.841 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_bytes": 0, 2024-06-02T04:19:47.841 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_items": 0, 2024-06-02T04:19:47.841 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T04:19:47.841 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_items": 0, 2024-06-02T04:19:47.841 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T04:19:47.841 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_items": 0, 2024-06-02T04:19:47.841 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T04:19:47.841 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T04:19:47.841 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T04:19:47.841 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T04:19:47.841 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T04:19:47.841 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_items": 0, 2024-06-02T04:19:47.841 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T04:19:47.841 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T04:19:47.842 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_bytes": 0, 2024-06-02T04:19:47.842 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_items": 0, 2024-06-02T04:19:47.842 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_bytes": 0, 2024-06-02T04:19:47.842 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_items": 0, 2024-06-02T04:19:47.842 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T04:19:47.842 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T04:19:47.842 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T04:19:47.842 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T04:19:47.842 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T04:19:47.842 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_items": 0, 2024-06-02T04:19:47.842 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_bytes": 0, 2024-06-02T04:19:47.842 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_items": 0, 2024-06-02T04:19:47.843 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T04:19:47.843 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T04:19:47.843 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_bytes": 0, 2024-06-02T04:19:47.843 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_items": 0, 2024-06-02T04:19:47.843 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_bytes": 0, 2024-06-02T04:19:47.843 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_items": 0, 2024-06-02T04:19:47.843 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T04:19:47.843 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_items": 0, 2024-06-02T04:19:47.843 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T04:19:47.843 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_items": 0, 2024-06-02T04:19:47.843 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_bytes": 190151, 2024-06-02T04:19:47.843 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_items": 51, 2024-06-02T04:19:47.844 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_bytes": 0, 2024-06-02T04:19:47.844 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_items": 0, 2024-06-02T04:19:47.844 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_bytes": 0, 2024-06-02T04:19:47.844 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_items": 0, 2024-06-02T04:19:47.844 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_bytes": 0, 2024-06-02T04:19:47.844 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_items": 0, 2024-06-02T04:19:47.844 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_bytes": 0, 2024-06-02T04:19:47.844 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_items": 0, 2024-06-02T04:19:47.844 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_bytes": 7240, 2024-06-02T04:19:47.844 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_items": 152, 2024-06-02T04:19:47.844 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T04:19:47.844 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_items": 0, 2024-06-02T04:19:47.844 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_bytes": 0, 2024-06-02T04:19:47.845 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_items": 0, 2024-06-02T04:19:47.845 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_bytes": 8320, 2024-06-02T04:19:47.845 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_items": 13, 2024-06-02T04:19:47.845 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_bytes": 0, 2024-06-02T04:19:47.845 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_items": 0, 2024-06-02T04:19:47.845 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_bytes": 0, 2024-06-02T04:19:47.845 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_items": 0 2024-06-02T04:19:47.845 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.845 INFO:teuthology.orchestra.run.smithi123.stdout: "objecter": { 2024-06-02T04:19:47.845 INFO:teuthology.orchestra.run.smithi123.stdout: "op_active": 0, 2024-06-02T04:19:47.845 INFO:teuthology.orchestra.run.smithi123.stdout: "op_laggy": 0, 2024-06-02T04:19:47.845 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send": 1976, 2024-06-02T04:19:47.845 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send_bytes": 21, 2024-06-02T04:19:47.846 INFO:teuthology.orchestra.run.smithi123.stdout: "op_resend": 3, 2024-06-02T04:19:47.846 INFO:teuthology.orchestra.run.smithi123.stdout: "op_reply": 1976, 2024-06-02T04:19:47.846 INFO:teuthology.orchestra.run.smithi123.stdout: "op_latency": { 2024-06-02T04:19:47.846 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1976, 2024-06-02T04:19:47.846 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 9.143789514, 2024-06-02T04:19:47.846 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.004627423 2024-06-02T04:19:47.846 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.846 INFO:teuthology.orchestra.run.smithi123.stdout: "op_inflight": 0, 2024-06-02T04:19:47.846 INFO:teuthology.orchestra.run.smithi123.stdout: "oplen_avg": { 2024-06-02T04:19:47.846 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1976, 2024-06-02T04:19:47.846 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 1977 2024-06-02T04:19:47.846 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.846 INFO:teuthology.orchestra.run.smithi123.stdout: "op": 1976, 2024-06-02T04:19:47.847 INFO:teuthology.orchestra.run.smithi123.stdout: "op_r": 1976, 2024-06-02T04:19:47.847 INFO:teuthology.orchestra.run.smithi123.stdout: "op_w": 0, 2024-06-02T04:19:47.847 INFO:teuthology.orchestra.run.smithi123.stdout: "op_rmw": 0, 2024-06-02T04:19:47.847 INFO:teuthology.orchestra.run.smithi123.stdout: "op_pg": 0, 2024-06-02T04:19:47.847 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_stat": 985, 2024-06-02T04:19:47.847 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_create": 0, 2024-06-02T04:19:47.847 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_read": 989, 2024-06-02T04:19:47.847 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_write": 0, 2024-06-02T04:19:47.847 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writefull": 0, 2024-06-02T04:19:47.847 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writesame": 0, 2024-06-02T04:19:47.847 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_append": 0, 2024-06-02T04:19:47.847 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_zero": 0, 2024-06-02T04:19:47.848 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_truncate": 0, 2024-06-02T04:19:47.848 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_delete": 0, 2024-06-02T04:19:47.848 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_mapext": 0, 2024-06-02T04:19:47.848 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_sparse_read": 0, 2024-06-02T04:19:47.848 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_clonerange": 0, 2024-06-02T04:19:47.848 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_getxattr": 1, 2024-06-02T04:19:47.848 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_setxattr": 0, 2024-06-02T04:19:47.848 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_cmpxattr": 0, 2024-06-02T04:19:47.848 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_rmxattr": 0, 2024-06-02T04:19:47.848 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_resetxattrs": 0, 2024-06-02T04:19:47.849 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_call": 0, 2024-06-02T04:19:47.849 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_watch": 0, 2024-06-02T04:19:47.849 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_notify": 0, 2024-06-02T04:19:47.849 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_src_cmpxattr": 0, 2024-06-02T04:19:47.849 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls": 0, 2024-06-02T04:19:47.849 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls_filter": 0, 2024-06-02T04:19:47.849 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_other": 0, 2024-06-02T04:19:47.849 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_active": 0, 2024-06-02T04:19:47.849 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_send": 0, 2024-06-02T04:19:47.849 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_resend": 0, 2024-06-02T04:19:47.849 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_ping": 0, 2024-06-02T04:19:47.849 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_active": 0, 2024-06-02T04:19:47.849 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_send": 0, 2024-06-02T04:19:47.849 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_resend": 0, 2024-06-02T04:19:47.850 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_active": 0, 2024-06-02T04:19:47.850 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_send": 0, 2024-06-02T04:19:47.850 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_resend": 0, 2024-06-02T04:19:47.850 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_active": 0, 2024-06-02T04:19:47.850 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_send": 0, 2024-06-02T04:19:47.850 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_resend": 0, 2024-06-02T04:19:47.850 INFO:teuthology.orchestra.run.smithi123.stdout: "command_active": 0, 2024-06-02T04:19:47.850 INFO:teuthology.orchestra.run.smithi123.stdout: "command_send": 0, 2024-06-02T04:19:47.850 INFO:teuthology.orchestra.run.smithi123.stdout: "command_resend": 0, 2024-06-02T04:19:47.851 INFO:teuthology.orchestra.run.smithi123.stdout: "map_epoch": 84, 2024-06-02T04:19:47.851 INFO:teuthology.orchestra.run.smithi123.stdout: "map_full": 0, 2024-06-02T04:19:47.851 INFO:teuthology.orchestra.run.smithi123.stdout: "map_inc": 2, 2024-06-02T04:19:47.851 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_sessions": 5, 2024-06-02T04:19:47.851 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_open": 8, 2024-06-02T04:19:47.851 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_close": 3, 2024-06-02T04:19:47.851 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_laggy": 0, 2024-06-02T04:19:47.851 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_wr": 0, 2024-06-02T04:19:47.851 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_rd": 2, 2024-06-02T04:19:47.851 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_del": 0 2024-06-02T04:19:47.851 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.851 INFO:teuthology.orchestra.run.smithi123.stdout: "oft": { 2024-06-02T04:19:47.851 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_objs": 0, 2024-06-02T04:19:47.852 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_kv_pairs": 0, 2024-06-02T04:19:47.852 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_updates": 0, 2024-06-02T04:19:47.852 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_removes": 0 2024-06-02T04:19:47.852 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.852 INFO:teuthology.orchestra.run.smithi123.stdout: "osd-slow-ops": { 2024-06-02T04:19:47.852 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_ops_count": 0 2024-06-02T04:19:47.852 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.852 INFO:teuthology.orchestra.run.smithi123.stdout: "purge_queue": { 2024-06-02T04:19:47.852 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops": 0, 2024-06-02T04:19:47.852 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops_high_water": 0, 2024-06-02T04:19:47.853 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing": 0, 2024-06-02T04:19:47.853 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_high_water": 0, 2024-06-02T04:19:47.853 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executed": 0, 2024-06-02T04:19:47.853 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_item_in_journal": 0 2024-06-02T04:19:47.853 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.853 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T04:19:47.853 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-06-02T04:19:47.853 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-06-02T04:19:47.853 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-06-02T04:19:47.853 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 2258, 2024-06-02T04:19:47.853 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 883485, 2024-06-02T04:19:47.853 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-06-02T04:19:47.853 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 2258, 2024-06-02T04:19:47.854 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-06-02T04:19:47.854 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-06-02T04:19:47.854 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 2258, 2024-06-02T04:19:47.854 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 883485, 2024-06-02T04:19:47.854 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-06-02T04:19:47.854 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.854 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.854 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.854 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:47.854 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.855 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_bytes": { 2024-06-02T04:19:47.855 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-06-02T04:19:47.855 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-06-02T04:19:47.855 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-06-02T04:19:47.855 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-06-02T04:19:47.855 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-06-02T04:19:47.855 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-06-02T04:19:47.855 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-06-02T04:19:47.855 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 1976, 2024-06-02T04:19:47.855 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 545, 2024-06-02T04:19:47.855 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 1976, 2024-06-02T04:19:47.855 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 545, 2024-06-02T04:19:47.856 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-06-02T04:19:47.856 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.856 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.856 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.856 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:47.856 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.856 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_ops": { 2024-06-02T04:19:47.856 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-06-02T04:19:47.856 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 1024, 2024-06-02T04:19:47.856 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-06-02T04:19:47.856 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-06-02T04:19:47.857 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-06-02T04:19:47.857 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-06-02T04:19:47.857 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-06-02T04:19:47.857 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 1976, 2024-06-02T04:19:47.857 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 1976, 2024-06-02T04:19:47.857 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 1976, 2024-06-02T04:19:47.857 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 1976, 2024-06-02T04:19:47.857 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-06-02T04:19:47.857 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.858 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.858 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.858 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:47.858 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.858 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle": { 2024-06-02T04:19:47.858 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-06-02T04:19:47.858 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-06-02T04:19:47.858 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-06-02T04:19:47.858 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-06-02T04:19:47.859 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-06-02T04:19:47.859 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-06-02T04:19:47.859 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-06-02T04:19:47.859 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-06-02T04:19:47.859 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-06-02T04:19:47.859 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 0, 2024-06-02T04:19:47.859 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 0, 2024-06-02T04:19:47.859 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-06-02T04:19:47.859 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.860 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.860 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.860 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:47.860 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:47.860 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle-0x55f6f009e500": { 2024-06-02T04:19:47.860 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-06-02T04:19:47.860 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-06-02T04:19:47.860 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-06-02T04:19:47.860 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-06-02T04:19:47.860 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-06-02T04:19:47.861 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-06-02T04:19:47.861 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-06-02T04:19:47.861 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-06-02T04:19:47.861 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-06-02T04:19:47.861 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 0, 2024-06-02T04:19:47.861 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 0, 2024-06-02T04:19:47.861 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-06-02T04:19:47.861 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:47.861 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:47.861 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:47.861 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:47.861 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:47.861 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-06-02T04:19:48.166 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-06-02T04:19:48.166 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-06-02T04:19:48.166 DEBUG:tasks.check_counter:Getting stats from d 2024-06-02T04:19:48.167 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph daemon mds.d perf dump 2024-06-02T04:19:48.389 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:19:48.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:48 smithi123 ceph-mon[42885]: pgmap v724: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 12 MiB/s wr, 1.12k op/s 2024-06-02T04:19:49.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:48 smithi162 ceph-mon[47009]: pgmap v724: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 12 MiB/s wr, 1.12k op/s 2024-06-02T04:19:49.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:48 smithi136 ceph-mon[47443]: pgmap v724: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 12 MiB/s wr, 1.12k op/s 2024-06-02T04:19:49.370 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-06-02T04:19:49.370 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T04:19:49.370 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 276, 2024-06-02T04:19:49.370 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 273, 2024-06-02T04:19:49.370 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 488528, 2024-06-02T04:19:49.370 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 156064, 2024-06-02T04:19:49.370 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 4, 2024-06-02T04:19:49.371 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 0, 2024-06-02T04:19:49.371 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.036559887, 2024-06-02T04:19:49.371 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.014087591, 2024-06-02T04:19:49.371 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.014672161, 2024-06-02T04:19:49.371 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.006102257, 2024-06-02T04:19:49.371 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:19:49.371 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 272, 2024-06-02T04:19:49.371 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.054048458, 2024-06-02T04:19:49.371 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000198707 2024-06-02T04:19:49.371 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:49.371 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:19:49.371 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:49.372 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:49.372 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:49.372 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:49.372 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 488528, 2024-06-02T04:19:49.372 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 156064 2024-06-02T04:19:49.372 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:49.372 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T04:19:49.372 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 6, 2024-06-02T04:19:49.372 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 211, 2024-06-02T04:19:49.372 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 3312, 2024-06-02T04:19:49.372 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 189840, 2024-06-02T04:19:49.372 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 4, 2024-06-02T04:19:49.372 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 2, 2024-06-02T04:19:49.372 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.013262127, 2024-06-02T04:19:49.373 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.009958271, 2024-06-02T04:19:49.373 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.001742725, 2024-06-02T04:19:49.373 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-02T04:19:49.373 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:19:49.373 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 210, 2024-06-02T04:19:49.373 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.034963918, 2024-06-02T04:19:49.373 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000166494 2024-06-02T04:19:49.373 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:49.373 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:19:49.373 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:49.373 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:49.373 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:49.374 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:49.374 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-06-02T04:19:49.374 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 189840 2024-06-02T04:19:49.374 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:49.374 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T04:19:49.374 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 0, 2024-06-02T04:19:49.374 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 2, 2024-06-02T04:19:49.374 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 0, 2024-06-02T04:19:49.374 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 0, 2024-06-02T04:19:49.374 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 2, 2024-06-02T04:19:49.374 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 1, 2024-06-02T04:19:49.374 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.000251940, 2024-06-02T04:19:49.375 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.000000000, 2024-06-02T04:19:49.375 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.000184469, 2024-06-02T04:19:49.375 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-02T04:19:49.375 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:19:49.375 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:49.375 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:49.375 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:49.375 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:49.375 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:19:49.375 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:49.375 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:49.375 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:49.375 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:49.376 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-02T04:19:49.376 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 0 2024-06-02T04:19:49.376 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:49.376 INFO:teuthology.orchestra.run.smithi123.stdout: "cct": { 2024-06-02T04:19:49.376 INFO:teuthology.orchestra.run.smithi123.stdout: "total_workers": 0, 2024-06-02T04:19:49.376 INFO:teuthology.orchestra.run.smithi123.stdout: "unhealthy_workers": 0 2024-06-02T04:19:49.376 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:49.376 INFO:teuthology.orchestra.run.smithi123.stdout: "mempool": { 2024-06-02T04:19:49.376 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_bytes": 0, 2024-06-02T04:19:49.376 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_items": 0, 2024-06-02T04:19:49.376 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T04:19:49.376 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_items": 0, 2024-06-02T04:19:49.376 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T04:19:49.377 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_items": 0, 2024-06-02T04:19:49.377 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T04:19:49.377 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T04:19:49.377 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T04:19:49.377 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T04:19:49.377 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T04:19:49.377 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_items": 0, 2024-06-02T04:19:49.377 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T04:19:49.377 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T04:19:49.377 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_bytes": 0, 2024-06-02T04:19:49.377 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_items": 0, 2024-06-02T04:19:49.377 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_bytes": 0, 2024-06-02T04:19:49.377 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_items": 0, 2024-06-02T04:19:49.377 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T04:19:49.378 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T04:19:49.378 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T04:19:49.378 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T04:19:49.378 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T04:19:49.378 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_items": 0, 2024-06-02T04:19:49.378 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_bytes": 0, 2024-06-02T04:19:49.378 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_items": 0, 2024-06-02T04:19:49.378 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T04:19:49.378 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T04:19:49.378 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_bytes": 0, 2024-06-02T04:19:49.378 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_items": 0, 2024-06-02T04:19:49.378 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_bytes": 0, 2024-06-02T04:19:49.378 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_items": 0, 2024-06-02T04:19:49.379 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T04:19:49.379 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_items": 0, 2024-06-02T04:19:49.379 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T04:19:49.379 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_items": 0, 2024-06-02T04:19:49.379 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_bytes": 147920, 2024-06-02T04:19:49.379 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_items": 27, 2024-06-02T04:19:49.379 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_bytes": 0, 2024-06-02T04:19:49.379 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_items": 0, 2024-06-02T04:19:49.379 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_bytes": 0, 2024-06-02T04:19:49.379 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_items": 0, 2024-06-02T04:19:49.379 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_bytes": 0, 2024-06-02T04:19:49.379 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_items": 0, 2024-06-02T04:19:49.379 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_bytes": 0, 2024-06-02T04:19:49.380 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_items": 0, 2024-06-02T04:19:49.380 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_bytes": 0, 2024-06-02T04:19:49.380 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_items": 0, 2024-06-02T04:19:49.380 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T04:19:49.380 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_items": 0, 2024-06-02T04:19:49.380 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_bytes": 0, 2024-06-02T04:19:49.380 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_items": 0, 2024-06-02T04:19:49.380 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_bytes": 928, 2024-06-02T04:19:49.380 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_items": 2, 2024-06-02T04:19:49.380 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_bytes": 0, 2024-06-02T04:19:49.380 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_items": 0, 2024-06-02T04:19:49.380 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_bytes": 0, 2024-06-02T04:19:49.380 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_items": 0 2024-06-02T04:19:49.381 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:49.381 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T04:19:49.381 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-06-02T04:19:49.381 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-06-02T04:19:49.381 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-06-02T04:19:49.381 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 278, 2024-06-02T04:19:49.381 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 449516, 2024-06-02T04:19:49.381 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-06-02T04:19:49.381 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 278, 2024-06-02T04:19:49.381 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-06-02T04:19:49.381 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-06-02T04:19:49.381 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 278, 2024-06-02T04:19:49.381 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 449516, 2024-06-02T04:19:49.381 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-06-02T04:19:49.382 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:49.382 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:49.382 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:49.382 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:49.382 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:49.382 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-06-02T04:19:49.733 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-06-02T04:19:49.733 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-06-02T04:19:49.733 DEBUG:tasks.check_counter:Getting stats from g 2024-06-02T04:19:49.733 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph daemon mds.g perf dump 2024-06-02T04:19:49.959 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:19:50.939 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:50 smithi123 ceph-mon[42885]: pgmap v725: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.6 MiB/s wr, 896 op/s 2024-06-02T04:19:51.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:50 smithi162 ceph-mon[47009]: pgmap v725: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.6 MiB/s wr, 896 op/s 2024-06-02T04:19:51.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:50 smithi136 ceph-mon[47443]: pgmap v725: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.6 MiB/s wr, 896 op/s 2024-06-02T04:19:51.679 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-06-02T04:19:51.679 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T04:19:51.679 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 994, 2024-06-02T04:19:51.680 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 996, 2024-06-02T04:19:51.680 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 333929, 2024-06-02T04:19:51.680 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 309135, 2024-06-02T04:19:51.680 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 7, 2024-06-02T04:19:51.680 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 2, 2024-06-02T04:19:51.680 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.106935455, 2024-06-02T04:19:51.680 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.036302672, 2024-06-02T04:19:51.680 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.028004913, 2024-06-02T04:19:51.680 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.033422673, 2024-06-02T04:19:51.680 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:19:51.680 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 994, 2024-06-02T04:19:51.681 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.372552565, 2024-06-02T04:19:51.681 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000374801 2024-06-02T04:19:51.681 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.681 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:19:51.681 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.681 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.681 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.681 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.681 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-02T04:19:51.681 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 0 2024-06-02T04:19:51.681 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.682 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T04:19:51.682 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 1281, 2024-06-02T04:19:51.682 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 1275, 2024-06-02T04:19:51.682 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 773886, 2024-06-02T04:19:51.682 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 466030, 2024-06-02T04:19:51.682 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 5, 2024-06-02T04:19:51.682 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 3, 2024-06-02T04:19:51.682 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.114528179, 2024-06-02T04:19:51.682 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.036096042, 2024-06-02T04:19:51.682 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.038765082, 2024-06-02T04:19:51.682 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.033148996, 2024-06-02T04:19:51.683 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:19:51.683 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1275, 2024-06-02T04:19:51.683 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.262502184, 2024-06-02T04:19:51.683 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000205884 2024-06-02T04:19:51.683 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.683 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:19:51.683 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.683 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.683 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.683 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.684 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 512624, 2024-06-02T04:19:51.684 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 156528 2024-06-02T04:19:51.684 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.684 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T04:19:51.684 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 5, 2024-06-02T04:19:51.684 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 210, 2024-06-02T04:19:51.684 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 1668, 2024-06-02T04:19:51.684 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 521472, 2024-06-02T04:19:51.684 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 8, 2024-06-02T04:19:51.684 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 4, 2024-06-02T04:19:51.684 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.017229264, 2024-06-02T04:19:51.685 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.010583359, 2024-06-02T04:19:51.685 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.004840496, 2024-06-02T04:19:51.685 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.000051445, 2024-06-02T04:19:51.685 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:19:51.685 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 208, 2024-06-02T04:19:51.685 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.082004912, 2024-06-02T04:19:51.685 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000394254 2024-06-02T04:19:51.685 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.685 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:19:51.686 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.686 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.686 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.686 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.686 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 320, 2024-06-02T04:19:51.686 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 520528 2024-06-02T04:19:51.686 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.686 INFO:teuthology.orchestra.run.smithi123.stdout: "cct": { 2024-06-02T04:19:51.686 INFO:teuthology.orchestra.run.smithi123.stdout: "total_workers": 1, 2024-06-02T04:19:51.686 INFO:teuthology.orchestra.run.smithi123.stdout: "unhealthy_workers": 0 2024-06-02T04:19:51.686 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.686 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-MDSRank": { 2024-06-02T04:19:51.687 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-06-02T04:19:51.687 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-06-02T04:19:51.687 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 3977, 2024-06-02T04:19:51.687 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.102777890, 2024-06-02T04:19:51.687 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000025843 2024-06-02T04:19:51.687 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:51.687 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.687 INFO:teuthology.orchestra.run.smithi123.stdout: "finisher-PurgeQueue": { 2024-06-02T04:19:51.687 INFO:teuthology.orchestra.run.smithi123.stdout: "queue_len": 0, 2024-06-02T04:19:51.687 INFO:teuthology.orchestra.run.smithi123.stdout: "complete_latency": { 2024-06-02T04:19:51.687 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.688 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.688 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.688 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:51.688 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.688 INFO:teuthology.orchestra.run.smithi123.stdout: "mds": { 2024-06-02T04:19:51.688 INFO:teuthology.orchestra.run.smithi123.stdout: "request": 0, 2024-06-02T04:19:51.688 INFO:teuthology.orchestra.run.smithi123.stdout: "reply": 0, 2024-06-02T04:19:51.688 INFO:teuthology.orchestra.run.smithi123.stdout: "reply_latency": { 2024-06-02T04:19:51.688 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.688 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.688 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.688 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.688 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_reply": 0, 2024-06-02T04:19:51.689 INFO:teuthology.orchestra.run.smithi123.stdout: "forward": 0, 2024-06-02T04:19:51.689 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_complete": 0, 2024-06-02T04:19:51.689 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_fetch_keys": 0, 2024-06-02T04:19:51.689 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_commit": 0, 2024-06-02T04:19:51.689 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_split": 0, 2024-06-02T04:19:51.689 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_merge": 0, 2024-06-02T04:19:51.689 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes": 0, 2024-06-02T04:19:51.689 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_top": 0, 2024-06-02T04:19:51.689 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_bottom": 0, 2024-06-02T04:19:51.689 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pin_tail": 0, 2024-06-02T04:19:51.689 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_pinned": 0, 2024-06-02T04:19:51.689 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_expired": 0, 2024-06-02T04:19:51.690 INFO:teuthology.orchestra.run.smithi123.stdout: "inodes_with_caps": 0, 2024-06-02T04:19:51.690 INFO:teuthology.orchestra.run.smithi123.stdout: "caps": 0, 2024-06-02T04:19:51.690 INFO:teuthology.orchestra.run.smithi123.stdout: "subtrees": 1, 2024-06-02T04:19:51.690 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse": 0, 2024-06-02T04:19:51.690 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_hit": 0, 2024-06-02T04:19:51.690 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_forward": 0, 2024-06-02T04:19:51.691 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_discover": 0, 2024-06-02T04:19:51.691 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_dir_fetch": 0, 2024-06-02T04:19:51.691 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_remote_ino": 0, 2024-06-02T04:19:51.691 INFO:teuthology.orchestra.run.smithi123.stdout: "traverse_lock": 0, 2024-06-02T04:19:51.691 INFO:teuthology.orchestra.run.smithi123.stdout: "load_cent": 0, 2024-06-02T04:19:51.691 INFO:teuthology.orchestra.run.smithi123.stdout: "q": 0, 2024-06-02T04:19:51.691 INFO:teuthology.orchestra.run.smithi123.stdout: "exported": 0, 2024-06-02T04:19:51.691 INFO:teuthology.orchestra.run.smithi123.stdout: "exported_inodes": 0, 2024-06-02T04:19:51.691 INFO:teuthology.orchestra.run.smithi123.stdout: "imported": 0, 2024-06-02T04:19:51.691 INFO:teuthology.orchestra.run.smithi123.stdout: "imported_inodes": 0, 2024-06-02T04:19:51.691 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_dir_fetch": 0, 2024-06-02T04:19:51.691 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_backtrace_fetch": 0, 2024-06-02T04:19:51.692 INFO:teuthology.orchestra.run.smithi123.stdout: "openino_peer_discover": 0, 2024-06-02T04:19:51.692 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rfiles": 0, 2024-06-02T04:19:51.692 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rbytes": 0, 2024-06-02T04:19:51.692 INFO:teuthology.orchestra.run.smithi123.stdout: "root_rsnaps": 0, 2024-06-02T04:19:51.692 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_fetch": 0, 2024-06-02T04:19:51.692 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_set_tag": 0, 2024-06-02T04:19:51.692 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_backtrace_repaired": 0, 2024-06-02T04:19:51.692 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_inotable_repaired": 0, 2024-06-02T04:19:51.692 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_inodes": 0, 2024-06-02T04:19:51.692 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dir_base_inodes": 0, 2024-06-02T04:19:51.692 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_dirfrag_rstats": 0, 2024-06-02T04:19:51.692 INFO:teuthology.orchestra.run.smithi123.stdout: "scrub_file_inodes": 0, 2024-06-02T04:19:51.692 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_inode_file_caps": 0, 2024-06-02T04:19:51.693 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_revoke": 0, 2024-06-02T04:19:51.693 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_grant": 0, 2024-06-02T04:19:51.693 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_trunc": 0, 2024-06-02T04:19:51.693 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-02T04:19:51.693 INFO:teuthology.orchestra.run.smithi123.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-02T04:19:51.693 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps": 0, 2024-06-02T04:19:51.693 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_caps_dirty": 0, 2024-06-02T04:19:51.693 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_cap_release": 0, 2024-06-02T04:19:51.693 INFO:teuthology.orchestra.run.smithi123.stdout: "process_request_cap_release": 0 2024-06-02T04:19:51.693 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.693 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_cache": { 2024-06-02T04:19:51.693 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update": 0, 2024-06-02T04:19:51.693 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_update_receipt": 0, 2024-06-02T04:19:51.694 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_try_discover": 0, 2024-06-02T04:19:51.694 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_send_discover": 0, 2024-06-02T04:19:51.694 INFO:teuthology.orchestra.run.smithi123.stdout: "dir_handle_discover": 0, 2024-06-02T04:19:51.694 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays": 0, 2024-06-02T04:19:51.694 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_delayed": 0, 2024-06-02T04:19:51.694 INFO:teuthology.orchestra.run.smithi123.stdout: "num_strays_enqueuing": 0, 2024-06-02T04:19:51.694 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_created": 0, 2024-06-02T04:19:51.694 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_enqueued": 0, 2024-06-02T04:19:51.694 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_reintegrated": 0, 2024-06-02T04:19:51.694 INFO:teuthology.orchestra.run.smithi123.stdout: "strays_migrated": 0, 2024-06-02T04:19:51.694 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_processing": 0, 2024-06-02T04:19:51.694 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_enqueued": 0, 2024-06-02T04:19:51.694 INFO:teuthology.orchestra.run.smithi123.stdout: "num_recovering_prioritized": 0, 2024-06-02T04:19:51.695 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_started": 0, 2024-06-02T04:19:51.695 INFO:teuthology.orchestra.run.smithi123.stdout: "recovery_completed": 0, 2024-06-02T04:19:51.695 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_enqueue_scrub": 0, 2024-06-02T04:19:51.695 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_exportdir": 0, 2024-06-02T04:19:51.695 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_flush": 0, 2024-06-02T04:19:51.695 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragmentdir": 0, 2024-06-02T04:19:51.695 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_fragstats": 0, 2024-06-02T04:19:51.695 INFO:teuthology.orchestra.run.smithi123.stdout: "ireq_inodestats": 0 2024-06-02T04:19:51.696 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.696 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_log": { 2024-06-02T04:19:51.696 INFO:teuthology.orchestra.run.smithi123.stdout: "evadd": 0, 2024-06-02T04:19:51.696 INFO:teuthology.orchestra.run.smithi123.stdout: "evex": 0, 2024-06-02T04:19:51.696 INFO:teuthology.orchestra.run.smithi123.stdout: "evtrm": 0, 2024-06-02T04:19:51.696 INFO:teuthology.orchestra.run.smithi123.stdout: "ev": 1, 2024-06-02T04:19:51.696 INFO:teuthology.orchestra.run.smithi123.stdout: "evexg": 0, 2024-06-02T04:19:51.696 INFO:teuthology.orchestra.run.smithi123.stdout: "evexd": 0, 2024-06-02T04:19:51.697 INFO:teuthology.orchestra.run.smithi123.stdout: "segadd": 0, 2024-06-02T04:19:51.697 INFO:teuthology.orchestra.run.smithi123.stdout: "segex": 0, 2024-06-02T04:19:51.697 INFO:teuthology.orchestra.run.smithi123.stdout: "segtrm": 0, 2024-06-02T04:19:51.697 INFO:teuthology.orchestra.run.smithi123.stdout: "seg": 1, 2024-06-02T04:19:51.697 INFO:teuthology.orchestra.run.smithi123.stdout: "segexg": 0, 2024-06-02T04:19:51.697 INFO:teuthology.orchestra.run.smithi123.stdout: "segexd": 0, 2024-06-02T04:19:51.698 INFO:teuthology.orchestra.run.smithi123.stdout: "expos": 4194304, 2024-06-02T04:19:51.698 INFO:teuthology.orchestra.run.smithi123.stdout: "wrpos": 4194844, 2024-06-02T04:19:51.698 INFO:teuthology.orchestra.run.smithi123.stdout: "rdpos": 4194304, 2024-06-02T04:19:51.698 INFO:teuthology.orchestra.run.smithi123.stdout: "jlat": { 2024-06-02T04:19:51.698 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.698 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.698 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.698 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.698 INFO:teuthology.orchestra.run.smithi123.stdout: "replayed": 1 2024-06-02T04:19:51.698 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.699 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_mem": { 2024-06-02T04:19:51.699 INFO:teuthology.orchestra.run.smithi123.stdout: "ino": 3, 2024-06-02T04:19:51.699 INFO:teuthology.orchestra.run.smithi123.stdout: "ino+": 3, 2024-06-02T04:19:51.699 INFO:teuthology.orchestra.run.smithi123.stdout: "ino-": 0, 2024-06-02T04:19:51.699 INFO:teuthology.orchestra.run.smithi123.stdout: "dir": 1, 2024-06-02T04:19:51.699 INFO:teuthology.orchestra.run.smithi123.stdout: "dir+": 1, 2024-06-02T04:19:51.699 INFO:teuthology.orchestra.run.smithi123.stdout: "dir-": 0, 2024-06-02T04:19:51.699 INFO:teuthology.orchestra.run.smithi123.stdout: "dn": 0, 2024-06-02T04:19:51.700 INFO:teuthology.orchestra.run.smithi123.stdout: "dn+": 0, 2024-06-02T04:19:51.700 INFO:teuthology.orchestra.run.smithi123.stdout: "dn-": 0, 2024-06-02T04:19:51.700 INFO:teuthology.orchestra.run.smithi123.stdout: "cap": 0, 2024-06-02T04:19:51.700 INFO:teuthology.orchestra.run.smithi123.stdout: "cap+": 0, 2024-06-02T04:19:51.700 INFO:teuthology.orchestra.run.smithi123.stdout: "cap-": 0, 2024-06-02T04:19:51.700 INFO:teuthology.orchestra.run.smithi123.stdout: "rss": 47120, 2024-06-02T04:19:51.700 INFO:teuthology.orchestra.run.smithi123.stdout: "heap": 207156 2024-06-02T04:19:51.700 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.700 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_server": { 2024-06-02T04:19:51.701 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_client_request": 0, 2024-06-02T04:19:51.701 INFO:teuthology.orchestra.run.smithi123.stdout: "dispatch_server_request": 0, 2024-06-02T04:19:51.701 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_request": 0, 2024-06-02T04:19:51.701 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_client_session": 0, 2024-06-02T04:19:51.701 INFO:teuthology.orchestra.run.smithi123.stdout: "handle_peer_request": 0, 2024-06-02T04:19:51.701 INFO:teuthology.orchestra.run.smithi123.stdout: "req_create_latency": { 2024-06-02T04:19:51.701 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.701 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.702 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.702 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.702 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getattr_latency": { 2024-06-02T04:19:51.702 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.702 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.702 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.702 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.702 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getfilelock_latency": { 2024-06-02T04:19:51.703 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.703 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.703 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.703 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.703 INFO:teuthology.orchestra.run.smithi123.stdout: "req_link_latency": { 2024-06-02T04:19:51.703 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.703 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.703 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.704 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.704 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookup_latency": { 2024-06-02T04:19:51.704 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.704 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.704 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.704 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.704 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookuphash_latency": { 2024-06-02T04:19:51.704 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.705 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.705 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.705 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.705 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupino_latency": { 2024-06-02T04:19:51.705 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.705 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.706 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.706 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.706 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupname_latency": { 2024-06-02T04:19:51.706 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.706 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.706 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.706 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.706 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupparent_latency": { 2024-06-02T04:19:51.707 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.707 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.707 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.707 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.707 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lookupsnap_latency": { 2024-06-02T04:19:51.707 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.707 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.707 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.707 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.708 INFO:teuthology.orchestra.run.smithi123.stdout: "req_lssnap_latency": { 2024-06-02T04:19:51.708 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.708 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.708 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.708 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.708 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mkdir_latency": { 2024-06-02T04:19:51.708 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.708 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.709 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.709 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.709 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mknod_latency": { 2024-06-02T04:19:51.709 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.709 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.709 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.709 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.709 INFO:teuthology.orchestra.run.smithi123.stdout: "req_mksnap_latency": { 2024-06-02T04:19:51.710 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.710 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.710 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.710 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.710 INFO:teuthology.orchestra.run.smithi123.stdout: "req_open_latency": { 2024-06-02T04:19:51.710 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.710 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.710 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.711 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.711 INFO:teuthology.orchestra.run.smithi123.stdout: "req_readdir_latency": { 2024-06-02T04:19:51.711 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.711 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.711 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.711 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.711 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rename_latency": { 2024-06-02T04:19:51.711 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.711 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.711 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.712 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.712 INFO:teuthology.orchestra.run.smithi123.stdout: "req_renamesnap_latency": { 2024-06-02T04:19:51.712 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.712 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.712 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.712 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.712 INFO:teuthology.orchestra.run.smithi123.stdout: "req_snapdiff_latency": { 2024-06-02T04:19:51.712 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.712 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.713 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.713 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.713 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmdir_latency": { 2024-06-02T04:19:51.713 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.713 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.713 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.713 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.713 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmsnap_latency": { 2024-06-02T04:19:51.714 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.714 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.714 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.714 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.714 INFO:teuthology.orchestra.run.smithi123.stdout: "req_rmxattr_latency": { 2024-06-02T04:19:51.714 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.715 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.715 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.715 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.715 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setattr_latency": { 2024-06-02T04:19:51.715 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.716 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.716 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.716 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.716 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setdirlayout_latency": { 2024-06-02T04:19:51.716 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.716 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.717 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.717 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.717 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setfilelock_latency": { 2024-06-02T04:19:51.717 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.717 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.717 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.717 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.718 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setlayout_latency": { 2024-06-02T04:19:51.718 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.718 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.718 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.718 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.718 INFO:teuthology.orchestra.run.smithi123.stdout: "req_setxattr_latency": { 2024-06-02T04:19:51.718 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.718 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.718 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.718 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.718 INFO:teuthology.orchestra.run.smithi123.stdout: "req_symlink_latency": { 2024-06-02T04:19:51.719 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.719 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.719 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.719 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.719 INFO:teuthology.orchestra.run.smithi123.stdout: "req_unlink_latency": { 2024-06-02T04:19:51.719 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.719 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.719 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.719 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.719 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_revoke_eviction": 0, 2024-06-02T04:19:51.719 INFO:teuthology.orchestra.run.smithi123.stdout: "cap_acquisition_throttle": 0, 2024-06-02T04:19:51.719 INFO:teuthology.orchestra.run.smithi123.stdout: "req_getvxattr_latency": { 2024-06-02T04:19:51.720 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.720 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.720 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.720 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:51.720 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.720 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_sessions": { 2024-06-02T04:19:51.720 INFO:teuthology.orchestra.run.smithi123.stdout: "session_count": 0, 2024-06-02T04:19:51.720 INFO:teuthology.orchestra.run.smithi123.stdout: "session_add": 0, 2024-06-02T04:19:51.721 INFO:teuthology.orchestra.run.smithi123.stdout: "session_remove": 0, 2024-06-02T04:19:51.721 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_open": 0, 2024-06-02T04:19:51.721 INFO:teuthology.orchestra.run.smithi123.stdout: "sessions_stale": 0, 2024-06-02T04:19:51.721 INFO:teuthology.orchestra.run.smithi123.stdout: "total_load": 0, 2024-06-02T04:19:51.721 INFO:teuthology.orchestra.run.smithi123.stdout: "average_load": 0, 2024-06-02T04:19:51.721 INFO:teuthology.orchestra.run.smithi123.stdout: "avg_session_uptime": 0, 2024-06-02T04:19:51.721 INFO:teuthology.orchestra.run.smithi123.stdout: "mdthresh_evicted": 0 2024-06-02T04:19:51.721 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.721 INFO:teuthology.orchestra.run.smithi123.stdout: "mempool": { 2024-06-02T04:19:51.722 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_bytes": 0, 2024-06-02T04:19:51.722 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_items": 0, 2024-06-02T04:19:51.722 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T04:19:51.722 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_items": 0, 2024-06-02T04:19:51.722 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T04:19:51.722 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_items": 0, 2024-06-02T04:19:51.722 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T04:19:51.723 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T04:19:51.723 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T04:19:51.723 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T04:19:51.723 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T04:19:51.723 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_items": 0, 2024-06-02T04:19:51.723 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T04:19:51.723 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T04:19:51.723 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_bytes": 0, 2024-06-02T04:19:51.723 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_items": 0, 2024-06-02T04:19:51.723 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_bytes": 0, 2024-06-02T04:19:51.723 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_items": 0, 2024-06-02T04:19:51.724 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T04:19:51.724 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T04:19:51.724 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T04:19:51.724 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T04:19:51.724 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T04:19:51.724 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_items": 0, 2024-06-02T04:19:51.724 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_bytes": 0, 2024-06-02T04:19:51.724 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_items": 0, 2024-06-02T04:19:51.724 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T04:19:51.724 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T04:19:51.724 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_bytes": 0, 2024-06-02T04:19:51.725 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_items": 0, 2024-06-02T04:19:51.725 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_bytes": 0, 2024-06-02T04:19:51.725 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_items": 0, 2024-06-02T04:19:51.725 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T04:19:51.725 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_items": 0, 2024-06-02T04:19:51.725 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T04:19:51.725 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_items": 0, 2024-06-02T04:19:51.725 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_bytes": 197447, 2024-06-02T04:19:51.725 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_items": 53, 2024-06-02T04:19:51.725 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_bytes": 0, 2024-06-02T04:19:51.725 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_items": 0, 2024-06-02T04:19:51.725 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_bytes": 0, 2024-06-02T04:19:51.726 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_items": 0, 2024-06-02T04:19:51.726 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_bytes": 0, 2024-06-02T04:19:51.726 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_items": 0, 2024-06-02T04:19:51.726 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_bytes": 0, 2024-06-02T04:19:51.726 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_items": 0, 2024-06-02T04:19:51.726 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_bytes": 7240, 2024-06-02T04:19:51.726 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_items": 152, 2024-06-02T04:19:51.726 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T04:19:51.726 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_items": 0, 2024-06-02T04:19:51.727 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_bytes": 0, 2024-06-02T04:19:51.727 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_items": 0, 2024-06-02T04:19:51.727 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_bytes": 8320, 2024-06-02T04:19:51.727 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_items": 13, 2024-06-02T04:19:51.727 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_bytes": 0, 2024-06-02T04:19:51.727 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_items": 0, 2024-06-02T04:19:51.727 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_bytes": 0, 2024-06-02T04:19:51.727 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_items": 0 2024-06-02T04:19:51.727 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.727 INFO:teuthology.orchestra.run.smithi123.stdout: "objecter": { 2024-06-02T04:19:51.727 INFO:teuthology.orchestra.run.smithi123.stdout: "op_active": 0, 2024-06-02T04:19:51.728 INFO:teuthology.orchestra.run.smithi123.stdout: "op_laggy": 0, 2024-06-02T04:19:51.728 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send": 1992, 2024-06-02T04:19:51.728 INFO:teuthology.orchestra.run.smithi123.stdout: "op_send_bytes": 21, 2024-06-02T04:19:51.728 INFO:teuthology.orchestra.run.smithi123.stdout: "op_resend": 3, 2024-06-02T04:19:51.728 INFO:teuthology.orchestra.run.smithi123.stdout: "op_reply": 1992, 2024-06-02T04:19:51.728 INFO:teuthology.orchestra.run.smithi123.stdout: "op_latency": { 2024-06-02T04:19:51.728 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1992, 2024-06-02T04:19:51.728 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 4.793889382, 2024-06-02T04:19:51.728 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.002406570 2024-06-02T04:19:51.728 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.728 INFO:teuthology.orchestra.run.smithi123.stdout: "op_inflight": 0, 2024-06-02T04:19:51.729 INFO:teuthology.orchestra.run.smithi123.stdout: "oplen_avg": { 2024-06-02T04:19:51.729 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 1992, 2024-06-02T04:19:51.729 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 1993 2024-06-02T04:19:51.729 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.729 INFO:teuthology.orchestra.run.smithi123.stdout: "op": 1992, 2024-06-02T04:19:51.729 INFO:teuthology.orchestra.run.smithi123.stdout: "op_r": 1992, 2024-06-02T04:19:51.729 INFO:teuthology.orchestra.run.smithi123.stdout: "op_w": 0, 2024-06-02T04:19:51.729 INFO:teuthology.orchestra.run.smithi123.stdout: "op_rmw": 0, 2024-06-02T04:19:51.729 INFO:teuthology.orchestra.run.smithi123.stdout: "op_pg": 0, 2024-06-02T04:19:51.729 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_stat": 993, 2024-06-02T04:19:51.729 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_create": 0, 2024-06-02T04:19:51.730 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_read": 997, 2024-06-02T04:19:51.730 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_write": 0, 2024-06-02T04:19:51.730 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writefull": 0, 2024-06-02T04:19:51.730 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_writesame": 0, 2024-06-02T04:19:51.730 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_append": 0, 2024-06-02T04:19:51.730 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_zero": 0, 2024-06-02T04:19:51.730 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_truncate": 0, 2024-06-02T04:19:51.730 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_delete": 0, 2024-06-02T04:19:51.730 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_mapext": 0, 2024-06-02T04:19:51.730 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_sparse_read": 0, 2024-06-02T04:19:51.730 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_clonerange": 0, 2024-06-02T04:19:51.731 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_getxattr": 1, 2024-06-02T04:19:51.731 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_setxattr": 0, 2024-06-02T04:19:51.731 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_cmpxattr": 0, 2024-06-02T04:19:51.731 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_rmxattr": 0, 2024-06-02T04:19:51.731 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_resetxattrs": 0, 2024-06-02T04:19:51.731 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_call": 0, 2024-06-02T04:19:51.731 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_watch": 0, 2024-06-02T04:19:51.731 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_notify": 0, 2024-06-02T04:19:51.731 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_src_cmpxattr": 0, 2024-06-02T04:19:51.732 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls": 0, 2024-06-02T04:19:51.732 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_pgls_filter": 0, 2024-06-02T04:19:51.732 INFO:teuthology.orchestra.run.smithi123.stdout: "osdop_other": 0, 2024-06-02T04:19:51.732 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_active": 0, 2024-06-02T04:19:51.732 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_send": 0, 2024-06-02T04:19:51.733 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_resend": 0, 2024-06-02T04:19:51.733 INFO:teuthology.orchestra.run.smithi123.stdout: "linger_ping": 0, 2024-06-02T04:19:51.733 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_active": 0, 2024-06-02T04:19:51.733 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_send": 0, 2024-06-02T04:19:51.733 INFO:teuthology.orchestra.run.smithi123.stdout: "poolop_resend": 0, 2024-06-02T04:19:51.733 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_active": 0, 2024-06-02T04:19:51.733 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_send": 0, 2024-06-02T04:19:51.733 INFO:teuthology.orchestra.run.smithi123.stdout: "poolstat_resend": 0, 2024-06-02T04:19:51.733 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_active": 0, 2024-06-02T04:19:51.733 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_send": 0, 2024-06-02T04:19:51.733 INFO:teuthology.orchestra.run.smithi123.stdout: "statfs_resend": 0, 2024-06-02T04:19:51.733 INFO:teuthology.orchestra.run.smithi123.stdout: "command_active": 0, 2024-06-02T04:19:51.734 INFO:teuthology.orchestra.run.smithi123.stdout: "command_send": 0, 2024-06-02T04:19:51.734 INFO:teuthology.orchestra.run.smithi123.stdout: "command_resend": 0, 2024-06-02T04:19:51.734 INFO:teuthology.orchestra.run.smithi123.stdout: "map_epoch": 84, 2024-06-02T04:19:51.734 INFO:teuthology.orchestra.run.smithi123.stdout: "map_full": 0, 2024-06-02T04:19:51.734 INFO:teuthology.orchestra.run.smithi123.stdout: "map_inc": 2, 2024-06-02T04:19:51.734 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_sessions": 6, 2024-06-02T04:19:51.734 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_open": 10, 2024-06-02T04:19:51.734 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_session_close": 4, 2024-06-02T04:19:51.734 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_laggy": 0, 2024-06-02T04:19:51.734 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_wr": 0, 2024-06-02T04:19:51.734 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_rd": 2, 2024-06-02T04:19:51.734 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_del": 0 2024-06-02T04:19:51.735 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.735 INFO:teuthology.orchestra.run.smithi123.stdout: "oft": { 2024-06-02T04:19:51.735 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_objs": 0, 2024-06-02T04:19:51.735 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_kv_pairs": 0, 2024-06-02T04:19:51.735 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_updates": 0, 2024-06-02T04:19:51.735 INFO:teuthology.orchestra.run.smithi123.stdout: "omap_total_removes": 0 2024-06-02T04:19:51.735 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.735 INFO:teuthology.orchestra.run.smithi123.stdout: "osd-slow-ops": { 2024-06-02T04:19:51.735 INFO:teuthology.orchestra.run.smithi123.stdout: "slow_ops_count": 0 2024-06-02T04:19:51.735 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.735 INFO:teuthology.orchestra.run.smithi123.stdout: "purge_queue": { 2024-06-02T04:19:51.735 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops": 0, 2024-06-02T04:19:51.736 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_ops_high_water": 0, 2024-06-02T04:19:51.736 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing": 0, 2024-06-02T04:19:51.736 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executing_high_water": 0, 2024-06-02T04:19:51.736 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_executed": 0, 2024-06-02T04:19:51.736 INFO:teuthology.orchestra.run.smithi123.stdout: "pq_item_in_journal": 0 2024-06-02T04:19:51.736 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.736 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T04:19:51.736 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-06-02T04:19:51.736 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-06-02T04:19:51.736 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-06-02T04:19:51.736 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 2276, 2024-06-02T04:19:51.736 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 887089, 2024-06-02T04:19:51.736 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-06-02T04:19:51.737 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 2276, 2024-06-02T04:19:51.737 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-06-02T04:19:51.737 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-06-02T04:19:51.737 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 2276, 2024-06-02T04:19:51.737 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 887089, 2024-06-02T04:19:51.737 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-06-02T04:19:51.737 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.737 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.737 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.737 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:51.737 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.737 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_bytes": { 2024-06-02T04:19:51.737 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-06-02T04:19:51.738 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-06-02T04:19:51.738 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-06-02T04:19:51.738 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-06-02T04:19:51.738 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-06-02T04:19:51.738 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-06-02T04:19:51.738 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-06-02T04:19:51.738 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 1992, 2024-06-02T04:19:51.738 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 545, 2024-06-02T04:19:51.738 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 1992, 2024-06-02T04:19:51.738 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 545, 2024-06-02T04:19:51.739 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-06-02T04:19:51.739 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.739 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.739 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.739 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:51.739 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.739 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-objecter_ops": { 2024-06-02T04:19:51.739 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-06-02T04:19:51.739 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 1024, 2024-06-02T04:19:51.739 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-06-02T04:19:51.739 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-06-02T04:19:51.739 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-06-02T04:19:51.740 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-06-02T04:19:51.740 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-06-02T04:19:51.740 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 1992, 2024-06-02T04:19:51.740 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 1992, 2024-06-02T04:19:51.740 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 1992, 2024-06-02T04:19:51.740 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 1992, 2024-06-02T04:19:51.740 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-06-02T04:19:51.740 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.740 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.740 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.740 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:51.740 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.741 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle": { 2024-06-02T04:19:51.741 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-06-02T04:19:51.741 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-06-02T04:19:51.741 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-06-02T04:19:51.741 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-06-02T04:19:51.741 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-06-02T04:19:51.741 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-06-02T04:19:51.741 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-06-02T04:19:51.742 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-06-02T04:19:51.742 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-06-02T04:19:51.742 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 0, 2024-06-02T04:19:51.742 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 0, 2024-06-02T04:19:51.742 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-06-02T04:19:51.742 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.742 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.743 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.743 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:51.743 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:51.743 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-write_buf_throttle-0x55e21ec2a500": { 2024-06-02T04:19:51.743 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-06-02T04:19:51.744 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 3758096384, 2024-06-02T04:19:51.744 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-06-02T04:19:51.744 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 0, 2024-06-02T04:19:51.744 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 0, 2024-06-02T04:19:51.744 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-06-02T04:19:51.744 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 0, 2024-06-02T04:19:51.744 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-06-02T04:19:51.744 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-06-02T04:19:51.745 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 0, 2024-06-02T04:19:51.745 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 0, 2024-06-02T04:19:51.745 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-06-02T04:19:51.745 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:51.745 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:51.745 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:51.745 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:51.745 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:51.745 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-06-02T04:19:52.057 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-06-02T04:19:52.058 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-06-02T04:19:52.058 DEBUG:tasks.check_counter:Getting stats from j 2024-06-02T04:19:52.058 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph daemon mds.j perf dump 2024-06-02T04:19:52.283 INFO:teuthology.orchestra.run.smithi123.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.a/config 2024-06-02T04:19:52.693 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:52 smithi123 ceph-mon[42885]: pgmap v726: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.7 MiB/s wr, 636 op/s 2024-06-02T04:19:53.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:52 smithi162 ceph-mon[47009]: pgmap v726: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.7 MiB/s wr, 636 op/s 2024-06-02T04:19:53.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:52 smithi136 ceph-mon[47443]: pgmap v726: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.7 MiB/s wr, 636 op/s 2024-06-02T04:19:53.217 INFO:teuthology.orchestra.run.smithi123.stdout:{ 2024-06-02T04:19:53.217 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T04:19:53.217 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 0, 2024-06-02T04:19:53.217 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 2, 2024-06-02T04:19:53.218 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 0, 2024-06-02T04:19:53.218 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 0, 2024-06-02T04:19:53.218 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 4, 2024-06-02T04:19:53.218 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 0, 2024-06-02T04:19:53.218 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.001200138, 2024-06-02T04:19:53.218 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.000000000, 2024-06-02T04:19:53.218 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.000238817, 2024-06-02T04:19:53.218 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-02T04:19:53.218 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:19:53.218 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:53.218 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:53.218 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:53.219 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:53.219 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:19:53.219 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:53.219 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:53.219 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:53.219 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:53.219 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-02T04:19:53.219 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 0 2024-06-02T04:19:53.219 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:53.219 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T04:19:53.219 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 277, 2024-06-02T04:19:53.219 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 274, 2024-06-02T04:19:53.219 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 488800, 2024-06-02T04:19:53.219 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 156672, 2024-06-02T04:19:53.220 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 2, 2024-06-02T04:19:53.220 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 1, 2024-06-02T04:19:53.220 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.035670299, 2024-06-02T04:19:53.220 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.014201523, 2024-06-02T04:19:53.220 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.014806037, 2024-06-02T04:19:53.220 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.006083628, 2024-06-02T04:19:53.220 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:19:53.220 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 273, 2024-06-02T04:19:53.220 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.042642270, 2024-06-02T04:19:53.220 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000156198 2024-06-02T04:19:53.220 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:53.220 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:19:53.220 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:53.221 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:53.221 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:53.221 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:53.221 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 488800, 2024-06-02T04:19:53.221 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 156672 2024-06-02T04:19:53.221 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:53.221 INFO:teuthology.orchestra.run.smithi123.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T04:19:53.221 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_messages": 6, 2024-06-02T04:19:53.221 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages": 212, 2024-06-02T04:19:53.221 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_bytes": 3312, 2024-06-02T04:19:53.221 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_bytes": 190016, 2024-06-02T04:19:53.221 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_created_connections": 4, 2024-06-02T04:19:53.221 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_active_connections": 2, 2024-06-02T04:19:53.221 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_total_time": 0.013462533, 2024-06-02T04:19:53.222 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_send_time": 0.010239950, 2024-06-02T04:19:53.222 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_recv_time": 0.001635404, 2024-06-02T04:19:53.222 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-06-02T04:19:53.222 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:19:53.222 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 211, 2024-06-02T04:19:53.222 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.078838336, 2024-06-02T04:19:53.222 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000373641 2024-06-02T04:19:53.222 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:53.222 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:19:53.222 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:53.222 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:53.222 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:53.222 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:53.223 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-06-02T04:19:53.223 INFO:teuthology.orchestra.run.smithi123.stdout: "msgr_send_encrypted_bytes": 190016 2024-06-02T04:19:53.223 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:53.223 INFO:teuthology.orchestra.run.smithi123.stdout: "cct": { 2024-06-02T04:19:53.223 INFO:teuthology.orchestra.run.smithi123.stdout: "total_workers": 0, 2024-06-02T04:19:53.223 INFO:teuthology.orchestra.run.smithi123.stdout: "unhealthy_workers": 0 2024-06-02T04:19:53.223 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:53.223 INFO:teuthology.orchestra.run.smithi123.stdout: "mempool": { 2024-06-02T04:19:53.223 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_bytes": 0, 2024-06-02T04:19:53.223 INFO:teuthology.orchestra.run.smithi123.stdout: "bloom_filter_items": 0, 2024-06-02T04:19:53.223 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T04:19:53.223 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_alloc_items": 0, 2024-06-02T04:19:53.223 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T04:19:53.224 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_data_items": 0, 2024-06-02T04:19:53.224 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T04:19:53.224 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T04:19:53.224 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T04:19:53.224 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T04:19:53.224 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T04:19:53.224 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_other_items": 0, 2024-06-02T04:19:53.224 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T04:19:53.224 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T04:19:53.224 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_bytes": 0, 2024-06-02T04:19:53.224 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_extent_items": 0, 2024-06-02T04:19:53.224 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_bytes": 0, 2024-06-02T04:19:53.224 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_blob_items": 0, 2024-06-02T04:19:53.224 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T04:19:53.224 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T04:19:53.225 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T04:19:53.225 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T04:19:53.225 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T04:19:53.225 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_fsck_items": 0, 2024-06-02T04:19:53.225 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_bytes": 0, 2024-06-02T04:19:53.225 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_txc_items": 0, 2024-06-02T04:19:53.225 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T04:19:53.225 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T04:19:53.225 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_bytes": 0, 2024-06-02T04:19:53.225 INFO:teuthology.orchestra.run.smithi123.stdout: "bluestore_writing_items": 0, 2024-06-02T04:19:53.225 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_bytes": 0, 2024-06-02T04:19:53.225 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_items": 0, 2024-06-02T04:19:53.225 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T04:19:53.226 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_reader_items": 0, 2024-06-02T04:19:53.226 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T04:19:53.226 INFO:teuthology.orchestra.run.smithi123.stdout: "bluefs_file_writer_items": 0, 2024-06-02T04:19:53.226 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_bytes": 148721, 2024-06-02T04:19:53.226 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_anon_items": 30, 2024-06-02T04:19:53.226 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_bytes": 0, 2024-06-02T04:19:53.226 INFO:teuthology.orchestra.run.smithi123.stdout: "buffer_meta_items": 0, 2024-06-02T04:19:53.226 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_bytes": 0, 2024-06-02T04:19:53.226 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_items": 0, 2024-06-02T04:19:53.226 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_bytes": 0, 2024-06-02T04:19:53.226 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_mapbl_items": 0, 2024-06-02T04:19:53.226 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_bytes": 0, 2024-06-02T04:19:53.226 INFO:teuthology.orchestra.run.smithi123.stdout: "osd_pglog_items": 0, 2024-06-02T04:19:53.227 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_bytes": 0, 2024-06-02T04:19:53.227 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_items": 0, 2024-06-02T04:19:53.227 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T04:19:53.227 INFO:teuthology.orchestra.run.smithi123.stdout: "osdmap_mapping_items": 0, 2024-06-02T04:19:53.227 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_bytes": 0, 2024-06-02T04:19:53.227 INFO:teuthology.orchestra.run.smithi123.stdout: "pgmap_items": 0, 2024-06-02T04:19:53.227 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_bytes": 928, 2024-06-02T04:19:53.227 INFO:teuthology.orchestra.run.smithi123.stdout: "mds_co_items": 2, 2024-06-02T04:19:53.227 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_bytes": 0, 2024-06-02T04:19:53.227 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_1_items": 0, 2024-06-02T04:19:53.227 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_bytes": 0, 2024-06-02T04:19:53.227 INFO:teuthology.orchestra.run.smithi123.stdout: "unittest_2_items": 0 2024-06-02T04:19:53.227 INFO:teuthology.orchestra.run.smithi123.stdout: }, 2024-06-02T04:19:53.228 INFO:teuthology.orchestra.run.smithi123.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T04:19:53.228 INFO:teuthology.orchestra.run.smithi123.stdout: "val": 0, 2024-06-02T04:19:53.228 INFO:teuthology.orchestra.run.smithi123.stdout: "max": 104857600, 2024-06-02T04:19:53.228 INFO:teuthology.orchestra.run.smithi123.stdout: "get_started": 0, 2024-06-02T04:19:53.228 INFO:teuthology.orchestra.run.smithi123.stdout: "get": 279, 2024-06-02T04:19:53.228 INFO:teuthology.orchestra.run.smithi123.stdout: "get_sum": 449646, 2024-06-02T04:19:53.228 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_fail": 0, 2024-06-02T04:19:53.228 INFO:teuthology.orchestra.run.smithi123.stdout: "get_or_fail_success": 279, 2024-06-02T04:19:53.228 INFO:teuthology.orchestra.run.smithi123.stdout: "take": 0, 2024-06-02T04:19:53.228 INFO:teuthology.orchestra.run.smithi123.stdout: "take_sum": 0, 2024-06-02T04:19:53.228 INFO:teuthology.orchestra.run.smithi123.stdout: "put": 279, 2024-06-02T04:19:53.228 INFO:teuthology.orchestra.run.smithi123.stdout: "put_sum": 449646, 2024-06-02T04:19:53.228 INFO:teuthology.orchestra.run.smithi123.stdout: "wait": { 2024-06-02T04:19:53.228 INFO:teuthology.orchestra.run.smithi123.stdout: "avgcount": 0, 2024-06-02T04:19:53.229 INFO:teuthology.orchestra.run.smithi123.stdout: "sum": 0.000000000, 2024-06-02T04:19:53.229 INFO:teuthology.orchestra.run.smithi123.stdout: "avgtime": 0.000000000 2024-06-02T04:19:53.229 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:53.229 INFO:teuthology.orchestra.run.smithi123.stdout: } 2024-06-02T04:19:53.229 INFO:teuthology.orchestra.run.smithi123.stdout:} 2024-06-02T04:19:53.582 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-06-02T04:19:53.582 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-06-02T04:19:53.582 DEBUG:tasks.check_counter:Getting stats from b 2024-06-02T04:19:53.582 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph daemon mds.b perf dump 2024-06-02T04:19:53.834 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T04:19:54.829 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:54 smithi136 ceph-mon[47443]: pgmap v727: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 3.3 MiB/s wr, 381 op/s 2024-06-02T04:19:55.039 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-06-02T04:19:55.039 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T04:19:55.039 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 2444, 2024-06-02T04:19:55.039 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 1914, 2024-06-02T04:19:55.039 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 1128990, 2024-06-02T04:19:55.039 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 3559487, 2024-06-02T04:19:55.039 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 9, 2024-06-02T04:19:55.040 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 4, 2024-06-02T04:19:55.040 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.209322773, 2024-06-02T04:19:55.040 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.066852442, 2024-06-02T04:19:55.040 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.073520574, 2024-06-02T04:19:55.040 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.059066523, 2024-06-02T04:19:55.040 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:19:55.040 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1915, 2024-06-02T04:19:55.040 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.748769540, 2024-06-02T04:19:55.040 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000391002 2024-06-02T04:19:55.040 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.040 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:19:55.040 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1612, 2024-06-02T04:19:55.040 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000307072, 2024-06-02T04:19:55.041 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000190 2024-06-02T04:19:55.041 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.041 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 548704, 2024-06-02T04:19:55.041 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 161312 2024-06-02T04:19:55.041 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.041 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T04:19:55.041 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 17540, 2024-06-02T04:19:55.041 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 20549, 2024-06-02T04:19:55.041 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 5146582, 2024-06-02T04:19:55.041 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 17880694, 2024-06-02T04:19:55.041 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 14, 2024-06-02T04:19:55.041 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 5, 2024-06-02T04:19:55.042 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.954614432, 2024-06-02T04:19:55.042 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.364866432, 2024-06-02T04:19:55.042 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 1.965487848, 2024-06-02T04:19:55.042 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.111565547, 2024-06-02T04:19:55.042 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:19:55.042 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 20550, 2024-06-02T04:19:55.042 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 2.073125329, 2024-06-02T04:19:55.042 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000100882 2024-06-02T04:19:55.042 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.042 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:19:55.042 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 30411, 2024-06-02T04:19:55.042 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.004511528, 2024-06-02T04:19:55.042 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000148 2024-06-02T04:19:55.043 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.043 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-06-02T04:19:55.043 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 444944 2024-06-02T04:19:55.043 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.043 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T04:19:55.043 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 3293, 2024-06-02T04:19:55.043 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 2915, 2024-06-02T04:19:55.043 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 814993, 2024-06-02T04:19:55.043 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 13806317, 2024-06-02T04:19:55.043 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 11, 2024-06-02T04:19:55.043 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 8, 2024-06-02T04:19:55.043 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.261457287, 2024-06-02T04:19:55.043 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.089688850, 2024-06-02T04:19:55.044 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.073100284, 2024-06-02T04:19:55.044 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.081946890, 2024-06-02T04:19:55.044 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:19:55.044 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 2909, 2024-06-02T04:19:55.044 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 1.028325851, 2024-06-02T04:19:55.044 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000353498 2024-06-02T04:19:55.044 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.044 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:19:55.044 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1072, 2024-06-02T04:19:55.044 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000224037, 2024-06-02T04:19:55.044 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000208 2024-06-02T04:19:55.044 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.045 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 85616, 2024-06-02T04:19:55.045 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 33968 2024-06-02T04:19:55.045 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.045 INFO:teuthology.orchestra.run.smithi136.stdout: "cct": { 2024-06-02T04:19:55.045 INFO:teuthology.orchestra.run.smithi136.stdout: "total_workers": 1, 2024-06-02T04:19:55.045 INFO:teuthology.orchestra.run.smithi136.stdout: "unhealthy_workers": 0 2024-06-02T04:19:55.045 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.045 INFO:teuthology.orchestra.run.smithi136.stdout: "finisher-MDSRank": { 2024-06-02T04:19:55.045 INFO:teuthology.orchestra.run.smithi136.stdout: "queue_len": 0, 2024-06-02T04:19:55.045 INFO:teuthology.orchestra.run.smithi136.stdout: "complete_latency": { 2024-06-02T04:19:55.045 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 7184, 2024-06-02T04:19:55.045 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 4.476915369, 2024-06-02T04:19:55.045 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000623178 2024-06-02T04:19:55.046 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:19:55.046 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.046 INFO:teuthology.orchestra.run.smithi136.stdout: "finisher-PurgeQueue": { 2024-06-02T04:19:55.046 INFO:teuthology.orchestra.run.smithi136.stdout: "queue_len": 0, 2024-06-02T04:19:55.046 INFO:teuthology.orchestra.run.smithi136.stdout: "complete_latency": { 2024-06-02T04:19:55.046 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1050, 2024-06-02T04:19:55.046 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.037670074, 2024-06-02T04:19:55.046 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000035876 2024-06-02T04:19:55.046 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:19:55.046 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.046 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": { 2024-06-02T04:19:55.046 INFO:teuthology.orchestra.run.smithi136.stdout: "request": 7263, 2024-06-02T04:19:55.047 INFO:teuthology.orchestra.run.smithi136.stdout: "reply": 7263, 2024-06-02T04:19:55.047 INFO:teuthology.orchestra.run.smithi136.stdout: "reply_latency": { 2024-06-02T04:19:55.047 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 7263, 2024-06-02T04:19:55.047 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 13.563160581, 2024-06-02T04:19:55.047 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.001867432 2024-06-02T04:19:55.047 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.047 INFO:teuthology.orchestra.run.smithi136.stdout: "slow_reply": 0, 2024-06-02T04:19:55.047 INFO:teuthology.orchestra.run.smithi136.stdout: "forward": 0, 2024-06-02T04:19:55.047 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_fetch_complete": 0, 2024-06-02T04:19:55.047 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_fetch_keys": 0, 2024-06-02T04:19:55.047 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_commit": 39, 2024-06-02T04:19:55.047 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_split": 3, 2024-06-02T04:19:55.047 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_merge": 0, 2024-06-02T04:19:55.048 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes": 2246, 2024-06-02T04:19:55.048 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_top": 0, 2024-06-02T04:19:55.048 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_bottom": 2246, 2024-06-02T04:19:55.048 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_pin_tail": 0, 2024-06-02T04:19:55.048 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_pinned": 2246, 2024-06-02T04:19:55.048 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_expired": 0, 2024-06-02T04:19:55.048 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_with_caps": 1074, 2024-06-02T04:19:55.048 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": 1074, 2024-06-02T04:19:55.048 INFO:teuthology.orchestra.run.smithi136.stdout: "subtrees": 2, 2024-06-02T04:19:55.048 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse": 16243, 2024-06-02T04:19:55.048 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_hit": 13205, 2024-06-02T04:19:55.048 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_forward": 0, 2024-06-02T04:19:55.049 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_discover": 0, 2024-06-02T04:19:55.049 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_dir_fetch": 0, 2024-06-02T04:19:55.049 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_remote_ino": 0, 2024-06-02T04:19:55.049 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_lock": 1056, 2024-06-02T04:19:55.049 INFO:teuthology.orchestra.run.smithi136.stdout: "load_cent": 0, 2024-06-02T04:19:55.049 INFO:teuthology.orchestra.run.smithi136.stdout: "q": 0, 2024-06-02T04:19:55.049 INFO:teuthology.orchestra.run.smithi136.stdout: "exported": 0, 2024-06-02T04:19:55.049 INFO:teuthology.orchestra.run.smithi136.stdout: "exported_inodes": 0, 2024-06-02T04:19:55.049 INFO:teuthology.orchestra.run.smithi136.stdout: "imported": 0, 2024-06-02T04:19:55.049 INFO:teuthology.orchestra.run.smithi136.stdout: "imported_inodes": 0, 2024-06-02T04:19:55.049 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_dir_fetch": 0, 2024-06-02T04:19:55.049 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_backtrace_fetch": 0, 2024-06-02T04:19:55.049 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_peer_discover": 0, 2024-06-02T04:19:55.049 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rfiles": 1039, 2024-06-02T04:19:55.050 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rbytes": 1759851471, 2024-06-02T04:19:55.050 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rsnaps": 0, 2024-06-02T04:19:55.050 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_backtrace_fetch": 0, 2024-06-02T04:19:55.050 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_set_tag": 0, 2024-06-02T04:19:55.050 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_backtrace_repaired": 0, 2024-06-02T04:19:55.050 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_inotable_repaired": 0, 2024-06-02T04:19:55.050 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dir_inodes": 0, 2024-06-02T04:19:55.050 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dir_base_inodes": 0, 2024-06-02T04:19:55.050 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dirfrag_rstats": 0, 2024-06-02T04:19:55.050 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_file_inodes": 0, 2024-06-02T04:19:55.050 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_inode_file_caps": 0, 2024-06-02T04:19:55.050 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_revoke": 1540, 2024-06-02T04:19:55.051 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_grant": 3739, 2024-06-02T04:19:55.051 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_trunc": 0, 2024-06-02T04:19:55.051 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-02T04:19:55.051 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-02T04:19:55.051 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_caps": 5727, 2024-06-02T04:19:55.051 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_caps_dirty": 2612, 2024-06-02T04:19:55.051 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_cap_release": 174, 2024-06-02T04:19:55.051 INFO:teuthology.orchestra.run.smithi136.stdout: "process_request_cap_release": 2591 2024-06-02T04:19:55.051 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.051 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_cache": { 2024-06-02T04:19:55.051 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_update": 0, 2024-06-02T04:19:55.051 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_update_receipt": 0, 2024-06-02T04:19:55.051 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_try_discover": 0, 2024-06-02T04:19:55.052 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_send_discover": 0, 2024-06-02T04:19:55.052 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_handle_discover": 6, 2024-06-02T04:19:55.052 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays": 8, 2024-06-02T04:19:55.052 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays_delayed": 0, 2024-06-02T04:19:55.052 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays_enqueuing": 0, 2024-06-02T04:19:55.052 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_created": 948, 2024-06-02T04:19:55.052 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_enqueued": 277, 2024-06-02T04:19:55.052 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_reintegrated": 663, 2024-06-02T04:19:55.052 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_migrated": 0, 2024-06-02T04:19:55.052 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_processing": 0, 2024-06-02T04:19:55.052 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_enqueued": 0, 2024-06-02T04:19:55.052 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_prioritized": 0, 2024-06-02T04:19:55.052 INFO:teuthology.orchestra.run.smithi136.stdout: "recovery_started": 0, 2024-06-02T04:19:55.052 INFO:teuthology.orchestra.run.smithi136.stdout: "recovery_completed": 0, 2024-06-02T04:19:55.053 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_enqueue_scrub": 0, 2024-06-02T04:19:55.053 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_exportdir": 0, 2024-06-02T04:19:55.053 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_flush": 0, 2024-06-02T04:19:55.053 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_fragmentdir": 3, 2024-06-02T04:19:55.053 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_fragstats": 0, 2024-06-02T04:19:55.053 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_inodestats": 0 2024-06-02T04:19:55.053 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.053 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_log": { 2024-06-02T04:19:55.053 INFO:teuthology.orchestra.run.smithi136.stdout: "evadd": 8773, 2024-06-02T04:19:55.053 INFO:teuthology.orchestra.run.smithi136.stdout: "evex": 0, 2024-06-02T04:19:55.053 INFO:teuthology.orchestra.run.smithi136.stdout: "evtrm": 0, 2024-06-02T04:19:55.053 INFO:teuthology.orchestra.run.smithi136.stdout: "ev": 8773, 2024-06-02T04:19:55.053 INFO:teuthology.orchestra.run.smithi136.stdout: "evexg": 0, 2024-06-02T04:19:55.054 INFO:teuthology.orchestra.run.smithi136.stdout: "evexd": 0, 2024-06-02T04:19:55.054 INFO:teuthology.orchestra.run.smithi136.stdout: "segadd": 11, 2024-06-02T04:19:55.054 INFO:teuthology.orchestra.run.smithi136.stdout: "segex": 0, 2024-06-02T04:19:55.054 INFO:teuthology.orchestra.run.smithi136.stdout: "segtrm": 0, 2024-06-02T04:19:55.054 INFO:teuthology.orchestra.run.smithi136.stdout: "seg": 11, 2024-06-02T04:19:55.054 INFO:teuthology.orchestra.run.smithi136.stdout: "segexg": 0, 2024-06-02T04:19:55.054 INFO:teuthology.orchestra.run.smithi136.stdout: "segexd": 0, 2024-06-02T04:19:55.054 INFO:teuthology.orchestra.run.smithi136.stdout: "expos": 4194304, 2024-06-02T04:19:55.054 INFO:teuthology.orchestra.run.smithi136.stdout: "wrpos": 27784872, 2024-06-02T04:19:55.054 INFO:teuthology.orchestra.run.smithi136.stdout: "rdpos": 0, 2024-06-02T04:19:55.054 INFO:teuthology.orchestra.run.smithi136.stdout: "jlat": { 2024-06-02T04:19:55.054 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 4049, 2024-06-02T04:19:55.055 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 23.263274293, 2024-06-02T04:19:55.055 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.005745436 2024-06-02T04:19:55.055 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.055 INFO:teuthology.orchestra.run.smithi136.stdout: "replayed": 0 2024-06-02T04:19:55.055 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.055 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_mem": { 2024-06-02T04:19:55.055 INFO:teuthology.orchestra.run.smithi136.stdout: "ino": 1094, 2024-06-02T04:19:55.055 INFO:teuthology.orchestra.run.smithi136.stdout: "ino+": 1371, 2024-06-02T04:19:55.055 INFO:teuthology.orchestra.run.smithi136.stdout: "ino-": 277, 2024-06-02T04:19:55.055 INFO:teuthology.orchestra.run.smithi136.stdout: "dir": 68, 2024-06-02T04:19:55.055 INFO:teuthology.orchestra.run.smithi136.stdout: "dir+": 71, 2024-06-02T04:19:55.055 INFO:teuthology.orchestra.run.smithi136.stdout: "dir-": 3, 2024-06-02T04:19:55.055 INFO:teuthology.orchestra.run.smithi136.stdout: "dn": 2244, 2024-06-02T04:19:55.056 INFO:teuthology.orchestra.run.smithi136.stdout: "dn+": 2844, 2024-06-02T04:19:55.056 INFO:teuthology.orchestra.run.smithi136.stdout: "dn-": 600, 2024-06-02T04:19:55.056 INFO:teuthology.orchestra.run.smithi136.stdout: "cap": 1074, 2024-06-02T04:19:55.056 INFO:teuthology.orchestra.run.smithi136.stdout: "cap+": 1616, 2024-06-02T04:19:55.056 INFO:teuthology.orchestra.run.smithi136.stdout: "cap-": 542, 2024-06-02T04:19:55.056 INFO:teuthology.orchestra.run.smithi136.stdout: "rss": 67760, 2024-06-02T04:19:55.056 INFO:teuthology.orchestra.run.smithi136.stdout: "heap": 207156 2024-06-02T04:19:55.056 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.056 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_server": { 2024-06-02T04:19:55.056 INFO:teuthology.orchestra.run.smithi136.stdout: "dispatch_client_request": 10437, 2024-06-02T04:19:55.056 INFO:teuthology.orchestra.run.smithi136.stdout: "dispatch_server_request": 1, 2024-06-02T04:19:55.056 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_request": 7263, 2024-06-02T04:19:55.056 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_session": 1349, 2024-06-02T04:19:55.056 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_peer_request": 2, 2024-06-02T04:19:55.056 INFO:teuthology.orchestra.run.smithi136.stdout: "req_create_latency": { 2024-06-02T04:19:55.057 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1327, 2024-06-02T04:19:55.057 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 2.381685297, 2024-06-02T04:19:55.057 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.001794789 2024-06-02T04:19:55.057 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.057 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getattr_latency": { 2024-06-02T04:19:55.057 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 182, 2024-06-02T04:19:55.057 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.055559103, 2024-06-02T04:19:55.057 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000305269 2024-06-02T04:19:55.057 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.057 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getfilelock_latency": { 2024-06-02T04:19:55.057 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:55.057 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:55.057 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:55.058 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.058 INFO:teuthology.orchestra.run.smithi136.stdout: "req_link_latency": { 2024-06-02T04:19:55.058 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 663, 2024-06-02T04:19:55.058 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 1.386087118, 2024-06-02T04:19:55.058 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.002090629 2024-06-02T04:19:55.058 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.058 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookup_latency": { 2024-06-02T04:19:55.058 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 2748, 2024-06-02T04:19:55.058 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 2.795561036, 2024-06-02T04:19:55.058 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.001017307 2024-06-02T04:19:55.058 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.058 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookuphash_latency": { 2024-06-02T04:19:55.058 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:55.059 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:55.059 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:55.059 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.059 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupino_latency": { 2024-06-02T04:19:55.059 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 2, 2024-06-02T04:19:55.059 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000255604, 2024-06-02T04:19:55.059 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000127802 2024-06-02T04:19:55.059 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.059 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupname_latency": { 2024-06-02T04:19:55.059 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:55.059 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:55.059 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:55.059 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.060 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupparent_latency": { 2024-06-02T04:19:55.060 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:55.060 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:55.060 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:55.060 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.060 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupsnap_latency": { 2024-06-02T04:19:55.060 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:55.060 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:55.060 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:55.060 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.060 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lssnap_latency": { 2024-06-02T04:19:55.060 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:55.060 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:55.060 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:55.061 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.061 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mkdir_latency": { 2024-06-02T04:19:55.061 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 35, 2024-06-02T04:19:55.061 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.300897765, 2024-06-02T04:19:55.061 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.008597079 2024-06-02T04:19:55.061 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.061 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mknod_latency": { 2024-06-02T04:19:55.061 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:55.061 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:55.061 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:55.061 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.061 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mksnap_latency": { 2024-06-02T04:19:55.061 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:55.062 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:55.062 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:55.062 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.062 INFO:teuthology.orchestra.run.smithi136.stdout: "req_open_latency": { 2024-06-02T04:19:55.062 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 563, 2024-06-02T04:19:55.062 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.179114456, 2024-06-02T04:19:55.062 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000318142 2024-06-02T04:19:55.062 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.062 INFO:teuthology.orchestra.run.smithi136.stdout: "req_readdir_latency": { 2024-06-02T04:19:55.062 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 109, 2024-06-02T04:19:55.062 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.234724103, 2024-06-02T04:19:55.062 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.002153432 2024-06-02T04:19:55.063 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.063 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rename_latency": { 2024-06-02T04:19:55.063 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 907, 2024-06-02T04:19:55.063 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 5.060914347, 2024-06-02T04:19:55.063 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.005579839 2024-06-02T04:19:55.063 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.063 INFO:teuthology.orchestra.run.smithi136.stdout: "req_renamesnap_latency": { 2024-06-02T04:19:55.063 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:55.063 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:55.063 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:55.063 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.063 INFO:teuthology.orchestra.run.smithi136.stdout: "req_snapdiff_latency": { 2024-06-02T04:19:55.063 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:55.064 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:55.064 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:55.064 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.064 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmdir_latency": { 2024-06-02T04:19:55.064 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:55.064 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:55.064 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:55.064 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.064 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmsnap_latency": { 2024-06-02T04:19:55.064 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:55.064 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:55.064 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:55.064 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.065 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmxattr_latency": { 2024-06-02T04:19:55.065 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:55.065 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:55.065 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:55.065 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.065 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setattr_latency": { 2024-06-02T04:19:55.065 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1, 2024-06-02T04:19:55.065 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.001342738, 2024-06-02T04:19:55.065 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.001342738 2024-06-02T04:19:55.065 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.065 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setdirlayout_latency": { 2024-06-02T04:19:55.065 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:55.065 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:55.065 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:55.066 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.066 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setfilelock_latency": { 2024-06-02T04:19:55.066 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:55.066 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:55.066 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:55.066 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.066 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setlayout_latency": { 2024-06-02T04:19:55.066 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:55.066 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:55.066 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:55.066 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.066 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setxattr_latency": { 2024-06-02T04:19:55.067 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 8, 2024-06-02T04:19:55.067 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.021381119, 2024-06-02T04:19:55.067 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.002672639 2024-06-02T04:19:55.067 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.067 INFO:teuthology.orchestra.run.smithi136.stdout: "req_symlink_latency": { 2024-06-02T04:19:55.067 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:55.067 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:55.067 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:55.067 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.067 INFO:teuthology.orchestra.run.smithi136.stdout: "req_unlink_latency": { 2024-06-02T04:19:55.067 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 718, 2024-06-02T04:19:55.067 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 1.145637895, 2024-06-02T04:19:55.067 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.001595595 2024-06-02T04:19:55.068 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.068 INFO:teuthology.orchestra.run.smithi136.stdout: "cap_revoke_eviction": 0, 2024-06-02T04:19:55.068 INFO:teuthology.orchestra.run.smithi136.stdout: "cap_acquisition_throttle": 0, 2024-06-02T04:19:55.068 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getvxattr_latency": { 2024-06-02T04:19:55.068 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:55.068 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:55.068 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:55.068 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:19:55.068 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.068 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_sessions": { 2024-06-02T04:19:55.068 INFO:teuthology.orchestra.run.smithi136.stdout: "session_count": 1, 2024-06-02T04:19:55.068 INFO:teuthology.orchestra.run.smithi136.stdout: "session_add": 2, 2024-06-02T04:19:55.068 INFO:teuthology.orchestra.run.smithi136.stdout: "session_remove": 1, 2024-06-02T04:19:55.069 INFO:teuthology.orchestra.run.smithi136.stdout: "sessions_open": 1, 2024-06-02T04:19:55.069 INFO:teuthology.orchestra.run.smithi136.stdout: "sessions_stale": 0, 2024-06-02T04:19:55.069 INFO:teuthology.orchestra.run.smithi136.stdout: "total_load": 509, 2024-06-02T04:19:55.069 INFO:teuthology.orchestra.run.smithi136.stdout: "average_load": 509, 2024-06-02T04:19:55.069 INFO:teuthology.orchestra.run.smithi136.stdout: "avg_session_uptime": 932, 2024-06-02T04:19:55.069 INFO:teuthology.orchestra.run.smithi136.stdout: "mdthresh_evicted": 0 2024-06-02T04:19:55.069 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.069 INFO:teuthology.orchestra.run.smithi136.stdout: "mempool": { 2024-06-02T04:19:55.069 INFO:teuthology.orchestra.run.smithi136.stdout: "bloom_filter_bytes": 0, 2024-06-02T04:19:55.069 INFO:teuthology.orchestra.run.smithi136.stdout: "bloom_filter_items": 0, 2024-06-02T04:19:55.069 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T04:19:55.069 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_alloc_items": 0, 2024-06-02T04:19:55.069 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T04:19:55.070 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_data_items": 0, 2024-06-02T04:19:55.070 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T04:19:55.070 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T04:19:55.070 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T04:19:55.070 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T04:19:55.070 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T04:19:55.070 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_other_items": 0, 2024-06-02T04:19:55.070 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T04:19:55.070 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T04:19:55.070 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_extent_bytes": 0, 2024-06-02T04:19:55.070 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_extent_items": 0, 2024-06-02T04:19:55.070 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_blob_bytes": 0, 2024-06-02T04:19:55.071 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_blob_items": 0, 2024-06-02T04:19:55.071 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T04:19:55.071 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T04:19:55.071 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T04:19:55.071 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T04:19:55.071 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T04:19:55.071 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_fsck_items": 0, 2024-06-02T04:19:55.071 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_txc_bytes": 0, 2024-06-02T04:19:55.071 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_txc_items": 0, 2024-06-02T04:19:55.071 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T04:19:55.071 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T04:19:55.071 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_bytes": 0, 2024-06-02T04:19:55.071 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_items": 0, 2024-06-02T04:19:55.072 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_bytes": 0, 2024-06-02T04:19:55.072 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_items": 0, 2024-06-02T04:19:55.072 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T04:19:55.072 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_reader_items": 0, 2024-06-02T04:19:55.072 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T04:19:55.072 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_writer_items": 0, 2024-06-02T04:19:55.072 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_anon_bytes": 466913, 2024-06-02T04:19:55.072 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_anon_items": 1235, 2024-06-02T04:19:55.072 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_meta_bytes": 968, 2024-06-02T04:19:55.072 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_meta_items": 11, 2024-06-02T04:19:55.072 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_bytes": 0, 2024-06-02T04:19:55.072 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_items": 0, 2024-06-02T04:19:55.073 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_mapbl_bytes": 0, 2024-06-02T04:19:55.073 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_mapbl_items": 0, 2024-06-02T04:19:55.073 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_pglog_bytes": 0, 2024-06-02T04:19:55.073 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_pglog_items": 0, 2024-06-02T04:19:55.073 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_bytes": 7240, 2024-06-02T04:19:55.073 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_items": 152, 2024-06-02T04:19:55.073 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T04:19:55.073 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_mapping_items": 0, 2024-06-02T04:19:55.073 INFO:teuthology.orchestra.run.smithi136.stdout: "pgmap_bytes": 0, 2024-06-02T04:19:55.073 INFO:teuthology.orchestra.run.smithi136.stdout: "pgmap_items": 0, 2024-06-02T04:19:55.073 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_co_bytes": 4700727, 2024-06-02T04:19:55.073 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_co_items": 79440, 2024-06-02T04:19:55.074 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_1_bytes": 0, 2024-06-02T04:19:55.074 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_1_items": 0, 2024-06-02T04:19:55.074 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_2_bytes": 0, 2024-06-02T04:19:55.074 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_2_items": 0 2024-06-02T04:19:55.074 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.074 INFO:teuthology.orchestra.run.smithi136.stdout: "objecter": { 2024-06-02T04:19:55.074 INFO:teuthology.orchestra.run.smithi136.stdout: "op_active": 0, 2024-06-02T04:19:55.074 INFO:teuthology.orchestra.run.smithi136.stdout: "op_laggy": 0, 2024-06-02T04:19:55.074 INFO:teuthology.orchestra.run.smithi136.stdout: "op_send": 5520, 2024-06-02T04:19:55.074 INFO:teuthology.orchestra.run.smithi136.stdout: "op_send_bytes": 24133912, 2024-06-02T04:19:55.074 INFO:teuthology.orchestra.run.smithi136.stdout: "op_resend": 31, 2024-06-02T04:19:55.074 INFO:teuthology.orchestra.run.smithi136.stdout: "op_reply": 5520, 2024-06-02T04:19:55.074 INFO:teuthology.orchestra.run.smithi136.stdout: "op_latency": { 2024-06-02T04:19:55.075 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 5520, 2024-06-02T04:19:55.075 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 60.084669670, 2024-06-02T04:19:55.075 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.010884903 2024-06-02T04:19:55.075 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.075 INFO:teuthology.orchestra.run.smithi136.stdout: "op_inflight": 0, 2024-06-02T04:19:55.075 INFO:teuthology.orchestra.run.smithi136.stdout: "oplen_avg": { 2024-06-02T04:19:55.075 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 5520, 2024-06-02T04:19:55.075 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 5854 2024-06-02T04:19:55.075 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.075 INFO:teuthology.orchestra.run.smithi136.stdout: "op": 5520, 2024-06-02T04:19:55.075 INFO:teuthology.orchestra.run.smithi136.stdout: "op_r": 128, 2024-06-02T04:19:55.075 INFO:teuthology.orchestra.run.smithi136.stdout: "op_w": 5392, 2024-06-02T04:19:55.075 INFO:teuthology.orchestra.run.smithi136.stdout: "op_rmw": 0, 2024-06-02T04:19:55.076 INFO:teuthology.orchestra.run.smithi136.stdout: "op_pg": 0, 2024-06-02T04:19:55.076 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_stat": 0, 2024-06-02T04:19:55.076 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_create": 11, 2024-06-02T04:19:55.076 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_read": 128, 2024-06-02T04:19:55.076 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_write": 4177, 2024-06-02T04:19:55.076 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_writefull": 166, 2024-06-02T04:19:55.076 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_writesame": 0, 2024-06-02T04:19:55.076 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_append": 0, 2024-06-02T04:19:55.076 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_zero": 0, 2024-06-02T04:19:55.076 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_truncate": 3, 2024-06-02T04:19:55.076 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_delete": 809, 2024-06-02T04:19:55.076 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_mapext": 0, 2024-06-02T04:19:55.076 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_sparse_read": 0, 2024-06-02T04:19:55.077 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_clonerange": 0, 2024-06-02T04:19:55.077 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_getxattr": 0, 2024-06-02T04:19:55.077 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_setxattr": 22, 2024-06-02T04:19:55.077 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_cmpxattr": 0, 2024-06-02T04:19:55.077 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_rmxattr": 0, 2024-06-02T04:19:55.077 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_resetxattrs": 0, 2024-06-02T04:19:55.077 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_call": 0, 2024-06-02T04:19:55.077 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_watch": 0, 2024-06-02T04:19:55.077 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_notify": 0, 2024-06-02T04:19:55.077 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_src_cmpxattr": 0, 2024-06-02T04:19:55.077 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_pgls": 0, 2024-06-02T04:19:55.077 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_pgls_filter": 0, 2024-06-02T04:19:55.077 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_other": 0, 2024-06-02T04:19:55.078 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_active": 0, 2024-06-02T04:19:55.078 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_send": 0, 2024-06-02T04:19:55.078 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_resend": 0, 2024-06-02T04:19:55.078 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_ping": 0, 2024-06-02T04:19:55.078 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_active": 0, 2024-06-02T04:19:55.078 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_send": 0, 2024-06-02T04:19:55.078 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_resend": 0, 2024-06-02T04:19:55.078 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_active": 0, 2024-06-02T04:19:55.078 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_send": 0, 2024-06-02T04:19:55.078 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_resend": 0, 2024-06-02T04:19:55.078 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_active": 0, 2024-06-02T04:19:55.078 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_send": 0, 2024-06-02T04:19:55.078 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_resend": 0, 2024-06-02T04:19:55.079 INFO:teuthology.orchestra.run.smithi136.stdout: "command_active": 0, 2024-06-02T04:19:55.079 INFO:teuthology.orchestra.run.smithi136.stdout: "command_send": 0, 2024-06-02T04:19:55.079 INFO:teuthology.orchestra.run.smithi136.stdout: "command_resend": 0, 2024-06-02T04:19:55.079 INFO:teuthology.orchestra.run.smithi136.stdout: "map_epoch": 84, 2024-06-02T04:19:55.079 INFO:teuthology.orchestra.run.smithi136.stdout: "map_full": 0, 2024-06-02T04:19:55.079 INFO:teuthology.orchestra.run.smithi136.stdout: "map_inc": 3, 2024-06-02T04:19:55.079 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_sessions": 12, 2024-06-02T04:19:55.079 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_session_open": 12, 2024-06-02T04:19:55.079 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_session_close": 0, 2024-06-02T04:19:55.079 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_laggy": 0, 2024-06-02T04:19:55.079 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_wr": 373, 2024-06-02T04:19:55.079 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_rd": 0, 2024-06-02T04:19:55.079 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_del": 165 2024-06-02T04:19:55.080 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.080 INFO:teuthology.orchestra.run.smithi136.stdout: "oft": { 2024-06-02T04:19:55.080 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_objs": 1, 2024-06-02T04:19:55.080 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_kv_pairs": 0, 2024-06-02T04:19:55.080 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_updates": 0, 2024-06-02T04:19:55.080 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_removes": 0 2024-06-02T04:19:55.080 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.080 INFO:teuthology.orchestra.run.smithi136.stdout: "osd-slow-ops": { 2024-06-02T04:19:55.080 INFO:teuthology.orchestra.run.smithi136.stdout: "slow_ops_count": 0 2024-06-02T04:19:55.080 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.080 INFO:teuthology.orchestra.run.smithi136.stdout: "purge_queue": { 2024-06-02T04:19:55.080 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_ops": 0, 2024-06-02T04:19:55.081 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_ops_high_water": 17, 2024-06-02T04:19:55.081 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing": 0, 2024-06-02T04:19:55.081 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_high_water": 6, 2024-06-02T04:19:55.081 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executed": 277, 2024-06-02T04:19:55.081 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_item_in_journal": 0 2024-06-02T04:19:55.081 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.081 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T04:19:55.081 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-06-02T04:19:55.081 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 104857600, 2024-06-02T04:19:55.081 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-06-02T04:19:55.081 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 23273, 2024-06-02T04:19:55.081 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 4967335, 2024-06-02T04:19:55.081 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-06-02T04:19:55.082 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 23273, 2024-06-02T04:19:55.082 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-06-02T04:19:55.082 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-06-02T04:19:55.082 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 23273, 2024-06-02T04:19:55.082 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 4967335, 2024-06-02T04:19:55.082 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-06-02T04:19:55.082 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:55.082 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:55.082 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:55.082 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:19:55.082 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.082 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-objecter_bytes": { 2024-06-02T04:19:55.082 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-06-02T04:19:55.083 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 104857600, 2024-06-02T04:19:55.083 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-06-02T04:19:55.083 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-06-02T04:19:55.083 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-06-02T04:19:55.083 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-06-02T04:19:55.083 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-06-02T04:19:55.083 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 5520, 2024-06-02T04:19:55.083 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 24161889, 2024-06-02T04:19:55.083 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 5520, 2024-06-02T04:19:55.083 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 24161889, 2024-06-02T04:19:55.083 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-06-02T04:19:55.083 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:55.083 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:55.084 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:55.084 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:19:55.084 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.084 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-objecter_ops": { 2024-06-02T04:19:55.084 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-06-02T04:19:55.084 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 1024, 2024-06-02T04:19:55.084 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-06-02T04:19:55.084 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-06-02T04:19:55.084 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-06-02T04:19:55.084 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-06-02T04:19:55.084 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-06-02T04:19:55.084 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 5520, 2024-06-02T04:19:55.084 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 5520, 2024-06-02T04:19:55.084 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 5520, 2024-06-02T04:19:55.085 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 5520, 2024-06-02T04:19:55.085 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-06-02T04:19:55.085 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:55.085 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:55.085 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:55.085 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:19:55.085 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.085 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-write_buf_throttle": { 2024-06-02T04:19:55.085 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-06-02T04:19:55.085 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 3758096384, 2024-06-02T04:19:55.085 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-06-02T04:19:55.085 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 277, 2024-06-02T04:19:55.085 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 27977, 2024-06-02T04:19:55.085 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-06-02T04:19:55.086 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 277, 2024-06-02T04:19:55.086 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-06-02T04:19:55.086 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-06-02T04:19:55.086 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 128, 2024-06-02T04:19:55.086 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 27977, 2024-06-02T04:19:55.086 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-06-02T04:19:55.086 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:55.086 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:55.086 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:55.086 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:19:55.086 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:55.086 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-write_buf_throttle-0x55dafb6080a0": { 2024-06-02T04:19:55.087 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 6498, 2024-06-02T04:19:55.087 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 3758096384, 2024-06-02T04:19:55.087 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-06-02T04:19:55.087 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 8773, 2024-06-02T04:19:55.087 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 23590568, 2024-06-02T04:19:55.087 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-06-02T04:19:55.087 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 8773, 2024-06-02T04:19:55.087 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-06-02T04:19:55.087 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-06-02T04:19:55.087 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 4049, 2024-06-02T04:19:55.087 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 23584070, 2024-06-02T04:19:55.087 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-06-02T04:19:55.087 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:55.088 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:55.088 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:55.088 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:19:55.088 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:19:55.088 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-06-02T04:19:55.089 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:54 smithi123 ceph-mon[42885]: pgmap v727: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 3.3 MiB/s wr, 381 op/s 2024-06-02T04:19:55.089 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:54 smithi162 ceph-mon[47009]: pgmap v727: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 3.3 MiB/s wr, 381 op/s 2024-06-02T04:19:55.391 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-06-02T04:19:55.391 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-06-02T04:19:55.391 DEBUG:tasks.check_counter:Getting stats from e 2024-06-02T04:19:55.391 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph daemon mds.e perf dump 2024-06-02T04:19:55.614 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T04:19:56.577 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-06-02T04:19:56.577 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T04:19:56.577 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 1002, 2024-06-02T04:19:56.577 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 1004, 2024-06-02T04:19:56.577 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 264487, 2024-06-02T04:19:56.577 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 311686, 2024-06-02T04:19:56.577 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 7, 2024-06-02T04:19:56.577 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 2, 2024-06-02T04:19:56.577 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.076207707, 2024-06-02T04:19:56.578 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.026212022, 2024-06-02T04:19:56.578 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.018995356, 2024-06-02T04:19:56.578 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.023350208, 2024-06-02T04:19:56.578 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:19:56.578 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1002, 2024-06-02T04:19:56.578 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.122605761, 2024-06-02T04:19:56.578 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000122361 2024-06-02T04:19:56.578 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.578 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:19:56.578 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.578 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.578 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.579 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.579 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-02T04:19:56.579 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 0 2024-06-02T04:19:56.579 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.579 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T04:19:56.579 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 929, 2024-06-02T04:19:56.579 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 1137, 2024-06-02T04:19:56.579 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 228470, 2024-06-02T04:19:56.579 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 725637, 2024-06-02T04:19:56.579 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 5, 2024-06-02T04:19:56.579 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 4, 2024-06-02T04:19:56.579 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.080051972, 2024-06-02T04:19:56.579 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.023536173, 2024-06-02T04:19:56.579 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.017105002, 2024-06-02T04:19:56.580 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.031756987, 2024-06-02T04:19:56.580 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:19:56.580 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1135, 2024-06-02T04:19:56.580 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.172641331, 2024-06-02T04:19:56.580 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000152106 2024-06-02T04:19:56.580 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.580 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:19:56.580 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.580 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.580 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.580 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.580 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 160, 2024-06-02T04:19:56.581 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 437024 2024-06-02T04:19:56.581 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.581 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T04:19:56.581 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 1289, 2024-06-02T04:19:56.581 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 1278, 2024-06-02T04:19:56.581 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 870464, 2024-06-02T04:19:56.581 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 467749, 2024-06-02T04:19:56.581 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 3, 2024-06-02T04:19:56.581 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 2, 2024-06-02T04:19:56.581 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.129715638, 2024-06-02T04:19:56.581 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.039250078, 2024-06-02T04:19:56.581 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.041574818, 2024-06-02T04:19:56.581 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.040112913, 2024-06-02T04:19:56.582 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:19:56.582 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1278, 2024-06-02T04:19:56.582 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.222441225, 2024-06-02T04:19:56.582 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000174054 2024-06-02T04:19:56.582 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.582 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:19:56.582 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.582 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.582 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.582 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.582 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 536144, 2024-06-02T04:19:56.582 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 158304 2024-06-02T04:19:56.583 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.583 INFO:teuthology.orchestra.run.smithi136.stdout: "cct": { 2024-06-02T04:19:56.583 INFO:teuthology.orchestra.run.smithi136.stdout: "total_workers": 1, 2024-06-02T04:19:56.583 INFO:teuthology.orchestra.run.smithi136.stdout: "unhealthy_workers": 0 2024-06-02T04:19:56.583 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.583 INFO:teuthology.orchestra.run.smithi136.stdout: "finisher-MDSRank": { 2024-06-02T04:19:56.583 INFO:teuthology.orchestra.run.smithi136.stdout: "queue_len": 0, 2024-06-02T04:19:56.583 INFO:teuthology.orchestra.run.smithi136.stdout: "complete_latency": { 2024-06-02T04:19:56.583 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 4862, 2024-06-02T04:19:56.583 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.118638648, 2024-06-02T04:19:56.583 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000024401 2024-06-02T04:19:56.583 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:19:56.583 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.584 INFO:teuthology.orchestra.run.smithi136.stdout: "finisher-PurgeQueue": { 2024-06-02T04:19:56.584 INFO:teuthology.orchestra.run.smithi136.stdout: "queue_len": 0, 2024-06-02T04:19:56.584 INFO:teuthology.orchestra.run.smithi136.stdout: "complete_latency": { 2024-06-02T04:19:56.584 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.584 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.584 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.584 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:19:56.584 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.584 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": { 2024-06-02T04:19:56.584 INFO:teuthology.orchestra.run.smithi136.stdout: "request": 0, 2024-06-02T04:19:56.584 INFO:teuthology.orchestra.run.smithi136.stdout: "reply": 0, 2024-06-02T04:19:56.584 INFO:teuthology.orchestra.run.smithi136.stdout: "reply_latency": { 2024-06-02T04:19:56.584 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.585 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.585 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.585 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.585 INFO:teuthology.orchestra.run.smithi136.stdout: "slow_reply": 0, 2024-06-02T04:19:56.585 INFO:teuthology.orchestra.run.smithi136.stdout: "forward": 0, 2024-06-02T04:19:56.585 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_fetch_complete": 0, 2024-06-02T04:19:56.585 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_fetch_keys": 0, 2024-06-02T04:19:56.585 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_commit": 0, 2024-06-02T04:19:56.585 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_split": 0, 2024-06-02T04:19:56.585 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_merge": 0, 2024-06-02T04:19:56.585 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes": 0, 2024-06-02T04:19:56.585 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_top": 0, 2024-06-02T04:19:56.585 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_bottom": 0, 2024-06-02T04:19:56.586 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_pin_tail": 0, 2024-06-02T04:19:56.586 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_pinned": 0, 2024-06-02T04:19:56.586 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_expired": 0, 2024-06-02T04:19:56.586 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_with_caps": 0, 2024-06-02T04:19:56.586 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": 0, 2024-06-02T04:19:56.586 INFO:teuthology.orchestra.run.smithi136.stdout: "subtrees": 1, 2024-06-02T04:19:56.586 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse": 0, 2024-06-02T04:19:56.586 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_hit": 0, 2024-06-02T04:19:56.586 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_forward": 0, 2024-06-02T04:19:56.586 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_discover": 0, 2024-06-02T04:19:56.586 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_dir_fetch": 0, 2024-06-02T04:19:56.586 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_remote_ino": 0, 2024-06-02T04:19:56.586 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_lock": 0, 2024-06-02T04:19:56.587 INFO:teuthology.orchestra.run.smithi136.stdout: "load_cent": 0, 2024-06-02T04:19:56.587 INFO:teuthology.orchestra.run.smithi136.stdout: "q": 0, 2024-06-02T04:19:56.587 INFO:teuthology.orchestra.run.smithi136.stdout: "exported": 0, 2024-06-02T04:19:56.587 INFO:teuthology.orchestra.run.smithi136.stdout: "exported_inodes": 0, 2024-06-02T04:19:56.587 INFO:teuthology.orchestra.run.smithi136.stdout: "imported": 0, 2024-06-02T04:19:56.587 INFO:teuthology.orchestra.run.smithi136.stdout: "imported_inodes": 0, 2024-06-02T04:19:56.587 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_dir_fetch": 0, 2024-06-02T04:19:56.587 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_backtrace_fetch": 0, 2024-06-02T04:19:56.587 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_peer_discover": 0, 2024-06-02T04:19:56.587 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rfiles": 0, 2024-06-02T04:19:56.587 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rbytes": 0, 2024-06-02T04:19:56.587 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rsnaps": 0, 2024-06-02T04:19:56.587 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_backtrace_fetch": 0, 2024-06-02T04:19:56.587 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_set_tag": 0, 2024-06-02T04:19:56.588 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_backtrace_repaired": 0, 2024-06-02T04:19:56.588 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_inotable_repaired": 0, 2024-06-02T04:19:56.588 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dir_inodes": 0, 2024-06-02T04:19:56.588 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dir_base_inodes": 0, 2024-06-02T04:19:56.588 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dirfrag_rstats": 0, 2024-06-02T04:19:56.588 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_file_inodes": 0, 2024-06-02T04:19:56.588 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_inode_file_caps": 0, 2024-06-02T04:19:56.588 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_revoke": 0, 2024-06-02T04:19:56.588 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_grant": 0, 2024-06-02T04:19:56.588 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_trunc": 0, 2024-06-02T04:19:56.588 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-02T04:19:56.588 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-02T04:19:56.589 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_caps": 0, 2024-06-02T04:19:56.589 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_caps_dirty": 0, 2024-06-02T04:19:56.589 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_cap_release": 0, 2024-06-02T04:19:56.589 INFO:teuthology.orchestra.run.smithi136.stdout: "process_request_cap_release": 0 2024-06-02T04:19:56.589 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.589 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_cache": { 2024-06-02T04:19:56.589 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_update": 0, 2024-06-02T04:19:56.589 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_update_receipt": 0, 2024-06-02T04:19:56.589 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_try_discover": 0, 2024-06-02T04:19:56.589 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_send_discover": 0, 2024-06-02T04:19:56.589 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_handle_discover": 0, 2024-06-02T04:19:56.589 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays": 0, 2024-06-02T04:19:56.589 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays_delayed": 0, 2024-06-02T04:19:56.590 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays_enqueuing": 0, 2024-06-02T04:19:56.590 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_created": 0, 2024-06-02T04:19:56.590 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_enqueued": 0, 2024-06-02T04:19:56.590 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_reintegrated": 0, 2024-06-02T04:19:56.590 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_migrated": 0, 2024-06-02T04:19:56.590 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_processing": 0, 2024-06-02T04:19:56.590 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_enqueued": 0, 2024-06-02T04:19:56.590 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_prioritized": 0, 2024-06-02T04:19:56.590 INFO:teuthology.orchestra.run.smithi136.stdout: "recovery_started": 0, 2024-06-02T04:19:56.590 INFO:teuthology.orchestra.run.smithi136.stdout: "recovery_completed": 0, 2024-06-02T04:19:56.590 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_enqueue_scrub": 0, 2024-06-02T04:19:56.590 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_exportdir": 0, 2024-06-02T04:19:56.590 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_flush": 0, 2024-06-02T04:19:56.591 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_fragmentdir": 0, 2024-06-02T04:19:56.591 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_fragstats": 0, 2024-06-02T04:19:56.591 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_inodestats": 0 2024-06-02T04:19:56.591 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.591 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_log": { 2024-06-02T04:19:56.591 INFO:teuthology.orchestra.run.smithi136.stdout: "evadd": 0, 2024-06-02T04:19:56.591 INFO:teuthology.orchestra.run.smithi136.stdout: "evex": 0, 2024-06-02T04:19:56.591 INFO:teuthology.orchestra.run.smithi136.stdout: "evtrm": 0, 2024-06-02T04:19:56.591 INFO:teuthology.orchestra.run.smithi136.stdout: "ev": 4, 2024-06-02T04:19:56.591 INFO:teuthology.orchestra.run.smithi136.stdout: "evexg": 0, 2024-06-02T04:19:56.591 INFO:teuthology.orchestra.run.smithi136.stdout: "evexd": 0, 2024-06-02T04:19:56.591 INFO:teuthology.orchestra.run.smithi136.stdout: "segadd": 0, 2024-06-02T04:19:56.591 INFO:teuthology.orchestra.run.smithi136.stdout: "segex": 0, 2024-06-02T04:19:56.591 INFO:teuthology.orchestra.run.smithi136.stdout: "segtrm": 0, 2024-06-02T04:19:56.592 INFO:teuthology.orchestra.run.smithi136.stdout: "seg": 1, 2024-06-02T04:19:56.592 INFO:teuthology.orchestra.run.smithi136.stdout: "segexg": 0, 2024-06-02T04:19:56.592 INFO:teuthology.orchestra.run.smithi136.stdout: "segexd": 0, 2024-06-02T04:19:56.592 INFO:teuthology.orchestra.run.smithi136.stdout: "expos": 4194304, 2024-06-02T04:19:56.592 INFO:teuthology.orchestra.run.smithi136.stdout: "wrpos": 4195692, 2024-06-02T04:19:56.592 INFO:teuthology.orchestra.run.smithi136.stdout: "rdpos": 4195551, 2024-06-02T04:19:56.592 INFO:teuthology.orchestra.run.smithi136.stdout: "jlat": { 2024-06-02T04:19:56.592 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.592 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.592 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.592 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.592 INFO:teuthology.orchestra.run.smithi136.stdout: "replayed": 4 2024-06-02T04:19:56.592 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.592 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_mem": { 2024-06-02T04:19:56.593 INFO:teuthology.orchestra.run.smithi136.stdout: "ino": 3, 2024-06-02T04:19:56.593 INFO:teuthology.orchestra.run.smithi136.stdout: "ino+": 3, 2024-06-02T04:19:56.593 INFO:teuthology.orchestra.run.smithi136.stdout: "ino-": 0, 2024-06-02T04:19:56.593 INFO:teuthology.orchestra.run.smithi136.stdout: "dir": 1, 2024-06-02T04:19:56.593 INFO:teuthology.orchestra.run.smithi136.stdout: "dir+": 1, 2024-06-02T04:19:56.593 INFO:teuthology.orchestra.run.smithi136.stdout: "dir-": 0, 2024-06-02T04:19:56.593 INFO:teuthology.orchestra.run.smithi136.stdout: "dn": 0, 2024-06-02T04:19:56.593 INFO:teuthology.orchestra.run.smithi136.stdout: "dn+": 0, 2024-06-02T04:19:56.593 INFO:teuthology.orchestra.run.smithi136.stdout: "dn-": 0, 2024-06-02T04:19:56.593 INFO:teuthology.orchestra.run.smithi136.stdout: "cap": 0, 2024-06-02T04:19:56.593 INFO:teuthology.orchestra.run.smithi136.stdout: "cap+": 0, 2024-06-02T04:19:56.593 INFO:teuthology.orchestra.run.smithi136.stdout: "cap-": 0, 2024-06-02T04:19:56.593 INFO:teuthology.orchestra.run.smithi136.stdout: "rss": 46648, 2024-06-02T04:19:56.594 INFO:teuthology.orchestra.run.smithi136.stdout: "heap": 207156 2024-06-02T04:19:56.594 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.594 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_server": { 2024-06-02T04:19:56.594 INFO:teuthology.orchestra.run.smithi136.stdout: "dispatch_client_request": 0, 2024-06-02T04:19:56.594 INFO:teuthology.orchestra.run.smithi136.stdout: "dispatch_server_request": 0, 2024-06-02T04:19:56.594 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_request": 0, 2024-06-02T04:19:56.594 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_session": 0, 2024-06-02T04:19:56.594 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_peer_request": 0, 2024-06-02T04:19:56.594 INFO:teuthology.orchestra.run.smithi136.stdout: "req_create_latency": { 2024-06-02T04:19:56.594 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.594 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.594 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.594 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.595 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getattr_latency": { 2024-06-02T04:19:56.595 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.595 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.595 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.595 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.595 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getfilelock_latency": { 2024-06-02T04:19:56.595 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.595 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.595 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.595 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.595 INFO:teuthology.orchestra.run.smithi136.stdout: "req_link_latency": { 2024-06-02T04:19:56.595 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.595 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.595 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.596 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.596 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookup_latency": { 2024-06-02T04:19:56.596 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.596 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.596 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.596 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.596 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookuphash_latency": { 2024-06-02T04:19:56.596 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.596 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.596 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.596 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.596 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupino_latency": { 2024-06-02T04:19:56.596 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.597 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.597 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.597 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.597 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupname_latency": { 2024-06-02T04:19:56.597 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.597 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.597 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.597 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.597 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupparent_latency": { 2024-06-02T04:19:56.597 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.597 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.597 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.597 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.597 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupsnap_latency": { 2024-06-02T04:19:56.598 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.598 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.598 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.598 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.598 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lssnap_latency": { 2024-06-02T04:19:56.598 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.598 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.598 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.598 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.598 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mkdir_latency": { 2024-06-02T04:19:56.598 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.598 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.598 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.599 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.599 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mknod_latency": { 2024-06-02T04:19:56.599 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.599 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.599 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.599 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.599 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mksnap_latency": { 2024-06-02T04:19:56.599 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.599 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.599 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.599 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.599 INFO:teuthology.orchestra.run.smithi136.stdout: "req_open_latency": { 2024-06-02T04:19:56.599 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.600 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.600 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.600 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.600 INFO:teuthology.orchestra.run.smithi136.stdout: "req_readdir_latency": { 2024-06-02T04:19:56.600 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.600 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.600 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.600 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.600 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rename_latency": { 2024-06-02T04:19:56.600 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.600 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.600 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.600 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.600 INFO:teuthology.orchestra.run.smithi136.stdout: "req_renamesnap_latency": { 2024-06-02T04:19:56.601 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.601 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.601 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.601 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.601 INFO:teuthology.orchestra.run.smithi136.stdout: "req_snapdiff_latency": { 2024-06-02T04:19:56.601 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.601 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.601 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.601 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.601 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmdir_latency": { 2024-06-02T04:19:56.601 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.601 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.601 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.601 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.602 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmsnap_latency": { 2024-06-02T04:19:56.602 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.602 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.602 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.602 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.602 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmxattr_latency": { 2024-06-02T04:19:56.602 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.602 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.602 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.602 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.602 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setattr_latency": { 2024-06-02T04:19:56.602 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.602 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.602 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.603 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.603 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setdirlayout_latency": { 2024-06-02T04:19:56.603 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.603 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.603 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.603 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.603 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setfilelock_latency": { 2024-06-02T04:19:56.603 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.603 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.603 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.603 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.603 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setlayout_latency": { 2024-06-02T04:19:56.603 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.604 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.604 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.604 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.604 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setxattr_latency": { 2024-06-02T04:19:56.604 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.604 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.604 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.604 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.604 INFO:teuthology.orchestra.run.smithi136.stdout: "req_symlink_latency": { 2024-06-02T04:19:56.604 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.604 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.604 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.605 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.605 INFO:teuthology.orchestra.run.smithi136.stdout: "req_unlink_latency": { 2024-06-02T04:19:56.605 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.605 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.605 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.605 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.605 INFO:teuthology.orchestra.run.smithi136.stdout: "cap_revoke_eviction": 0, 2024-06-02T04:19:56.605 INFO:teuthology.orchestra.run.smithi136.stdout: "cap_acquisition_throttle": 0, 2024-06-02T04:19:56.605 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getvxattr_latency": { 2024-06-02T04:19:56.605 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.605 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.605 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.605 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:19:56.605 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.606 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_sessions": { 2024-06-02T04:19:56.606 INFO:teuthology.orchestra.run.smithi136.stdout: "session_count": 1, 2024-06-02T04:19:56.606 INFO:teuthology.orchestra.run.smithi136.stdout: "session_add": 2, 2024-06-02T04:19:56.606 INFO:teuthology.orchestra.run.smithi136.stdout: "session_remove": 1, 2024-06-02T04:19:56.606 INFO:teuthology.orchestra.run.smithi136.stdout: "sessions_open": 2, 2024-06-02T04:19:56.606 INFO:teuthology.orchestra.run.smithi136.stdout: "sessions_stale": 0, 2024-06-02T04:19:56.606 INFO:teuthology.orchestra.run.smithi136.stdout: "total_load": 0, 2024-06-02T04:19:56.606 INFO:teuthology.orchestra.run.smithi136.stdout: "average_load": 0, 2024-06-02T04:19:56.606 INFO:teuthology.orchestra.run.smithi136.stdout: "avg_session_uptime": 3690, 2024-06-02T04:19:56.606 INFO:teuthology.orchestra.run.smithi136.stdout: "mdthresh_evicted": 0 2024-06-02T04:19:56.606 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.606 INFO:teuthology.orchestra.run.smithi136.stdout: "mempool": { 2024-06-02T04:19:56.607 INFO:teuthology.orchestra.run.smithi136.stdout: "bloom_filter_bytes": 0, 2024-06-02T04:19:56.607 INFO:teuthology.orchestra.run.smithi136.stdout: "bloom_filter_items": 0, 2024-06-02T04:19:56.607 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T04:19:56.607 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_alloc_items": 0, 2024-06-02T04:19:56.607 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T04:19:56.607 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_data_items": 0, 2024-06-02T04:19:56.607 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T04:19:56.607 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T04:19:56.607 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T04:19:56.607 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T04:19:56.607 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T04:19:56.607 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_other_items": 0, 2024-06-02T04:19:56.607 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T04:19:56.608 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T04:19:56.608 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_extent_bytes": 0, 2024-06-02T04:19:56.608 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_extent_items": 0, 2024-06-02T04:19:56.608 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_blob_bytes": 0, 2024-06-02T04:19:56.608 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_blob_items": 0, 2024-06-02T04:19:56.608 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T04:19:56.608 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T04:19:56.608 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T04:19:56.608 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T04:19:56.608 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T04:19:56.608 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_fsck_items": 0, 2024-06-02T04:19:56.608 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_txc_bytes": 0, 2024-06-02T04:19:56.608 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_txc_items": 0, 2024-06-02T04:19:56.608 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T04:19:56.609 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T04:19:56.609 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_bytes": 0, 2024-06-02T04:19:56.609 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_items": 0, 2024-06-02T04:19:56.609 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_bytes": 0, 2024-06-02T04:19:56.609 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_items": 0, 2024-06-02T04:19:56.609 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T04:19:56.609 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_reader_items": 0, 2024-06-02T04:19:56.609 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T04:19:56.609 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_writer_items": 0, 2024-06-02T04:19:56.609 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_anon_bytes": 189463, 2024-06-02T04:19:56.609 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_anon_items": 52, 2024-06-02T04:19:56.609 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_meta_bytes": 0, 2024-06-02T04:19:56.609 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_meta_items": 0, 2024-06-02T04:19:56.610 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_bytes": 0, 2024-06-02T04:19:56.610 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_items": 0, 2024-06-02T04:19:56.610 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_mapbl_bytes": 0, 2024-06-02T04:19:56.610 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_mapbl_items": 0, 2024-06-02T04:19:56.610 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_pglog_bytes": 0, 2024-06-02T04:19:56.610 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_pglog_items": 0, 2024-06-02T04:19:56.610 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_bytes": 7240, 2024-06-02T04:19:56.610 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_items": 152, 2024-06-02T04:19:56.610 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T04:19:56.610 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_mapping_items": 0, 2024-06-02T04:19:56.610 INFO:teuthology.orchestra.run.smithi136.stdout: "pgmap_bytes": 0, 2024-06-02T04:19:56.610 INFO:teuthology.orchestra.run.smithi136.stdout: "pgmap_items": 0, 2024-06-02T04:19:56.611 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_co_bytes": 8320, 2024-06-02T04:19:56.611 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_co_items": 13, 2024-06-02T04:19:56.611 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_1_bytes": 0, 2024-06-02T04:19:56.611 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_1_items": 0, 2024-06-02T04:19:56.611 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_2_bytes": 0, 2024-06-02T04:19:56.611 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_2_items": 0 2024-06-02T04:19:56.611 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.611 INFO:teuthology.orchestra.run.smithi136.stdout: "objecter": { 2024-06-02T04:19:56.611 INFO:teuthology.orchestra.run.smithi136.stdout: "op_active": 0, 2024-06-02T04:19:56.611 INFO:teuthology.orchestra.run.smithi136.stdout: "op_laggy": 0, 2024-06-02T04:19:56.611 INFO:teuthology.orchestra.run.smithi136.stdout: "op_send": 2925, 2024-06-02T04:19:56.611 INFO:teuthology.orchestra.run.smithi136.stdout: "op_send_bytes": 21, 2024-06-02T04:19:56.611 INFO:teuthology.orchestra.run.smithi136.stdout: "op_resend": 3, 2024-06-02T04:19:56.612 INFO:teuthology.orchestra.run.smithi136.stdout: "op_reply": 2925, 2024-06-02T04:19:56.612 INFO:teuthology.orchestra.run.smithi136.stdout: "op_latency": { 2024-06-02T04:19:56.612 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 2925, 2024-06-02T04:19:56.612 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 11.032758165, 2024-06-02T04:19:56.612 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.003771883 2024-06-02T04:19:56.612 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.612 INFO:teuthology.orchestra.run.smithi136.stdout: "op_inflight": 0, 2024-06-02T04:19:56.612 INFO:teuthology.orchestra.run.smithi136.stdout: "oplen_avg": { 2024-06-02T04:19:56.612 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 2925, 2024-06-02T04:19:56.612 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 2926 2024-06-02T04:19:56.612 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.612 INFO:teuthology.orchestra.run.smithi136.stdout: "op": 2925, 2024-06-02T04:19:56.612 INFO:teuthology.orchestra.run.smithi136.stdout: "op_r": 2925, 2024-06-02T04:19:56.613 INFO:teuthology.orchestra.run.smithi136.stdout: "op_w": 0, 2024-06-02T04:19:56.613 INFO:teuthology.orchestra.run.smithi136.stdout: "op_rmw": 0, 2024-06-02T04:19:56.613 INFO:teuthology.orchestra.run.smithi136.stdout: "op_pg": 0, 2024-06-02T04:19:56.613 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_stat": 1921, 2024-06-02T04:19:56.613 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_create": 0, 2024-06-02T04:19:56.613 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_read": 1002, 2024-06-02T04:19:56.613 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_write": 0, 2024-06-02T04:19:56.613 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_writefull": 0, 2024-06-02T04:19:56.613 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_writesame": 0, 2024-06-02T04:19:56.613 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_append": 0, 2024-06-02T04:19:56.613 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_zero": 0, 2024-06-02T04:19:56.613 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_truncate": 0, 2024-06-02T04:19:56.613 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_delete": 0, 2024-06-02T04:19:56.614 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_mapext": 0, 2024-06-02T04:19:56.614 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_sparse_read": 0, 2024-06-02T04:19:56.614 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_clonerange": 0, 2024-06-02T04:19:56.614 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_getxattr": 1, 2024-06-02T04:19:56.614 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_setxattr": 0, 2024-06-02T04:19:56.614 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_cmpxattr": 0, 2024-06-02T04:19:56.614 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_rmxattr": 0, 2024-06-02T04:19:56.614 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_resetxattrs": 0, 2024-06-02T04:19:56.614 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_call": 0, 2024-06-02T04:19:56.614 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_watch": 0, 2024-06-02T04:19:56.615 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_notify": 0, 2024-06-02T04:19:56.615 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_src_cmpxattr": 0, 2024-06-02T04:19:56.615 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_pgls": 0, 2024-06-02T04:19:56.615 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_pgls_filter": 0, 2024-06-02T04:19:56.615 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_other": 0, 2024-06-02T04:19:56.615 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_active": 0, 2024-06-02T04:19:56.615 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_send": 0, 2024-06-02T04:19:56.615 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_resend": 0, 2024-06-02T04:19:56.615 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_ping": 0, 2024-06-02T04:19:56.615 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_active": 0, 2024-06-02T04:19:56.615 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_send": 0, 2024-06-02T04:19:56.615 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_resend": 0, 2024-06-02T04:19:56.616 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_active": 0, 2024-06-02T04:19:56.616 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_send": 0, 2024-06-02T04:19:56.616 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_resend": 0, 2024-06-02T04:19:56.616 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_active": 0, 2024-06-02T04:19:56.616 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_send": 0, 2024-06-02T04:19:56.616 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_resend": 0, 2024-06-02T04:19:56.616 INFO:teuthology.orchestra.run.smithi136.stdout: "command_active": 0, 2024-06-02T04:19:56.616 INFO:teuthology.orchestra.run.smithi136.stdout: "command_send": 0, 2024-06-02T04:19:56.616 INFO:teuthology.orchestra.run.smithi136.stdout: "command_resend": 0, 2024-06-02T04:19:56.616 INFO:teuthology.orchestra.run.smithi136.stdout: "map_epoch": 84, 2024-06-02T04:19:56.616 INFO:teuthology.orchestra.run.smithi136.stdout: "map_full": 0, 2024-06-02T04:19:56.616 INFO:teuthology.orchestra.run.smithi136.stdout: "map_inc": 2, 2024-06-02T04:19:56.616 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_sessions": 5, 2024-06-02T04:19:56.616 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_session_open": 6, 2024-06-02T04:19:56.617 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_session_close": 1, 2024-06-02T04:19:56.617 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_laggy": 0, 2024-06-02T04:19:56.617 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_wr": 0, 2024-06-02T04:19:56.617 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_rd": 2, 2024-06-02T04:19:56.617 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_del": 0 2024-06-02T04:19:56.617 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.617 INFO:teuthology.orchestra.run.smithi136.stdout: "oft": { 2024-06-02T04:19:56.617 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_objs": 0, 2024-06-02T04:19:56.617 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_kv_pairs": 0, 2024-06-02T04:19:56.617 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_updates": 0, 2024-06-02T04:19:56.617 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_removes": 0 2024-06-02T04:19:56.617 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.617 INFO:teuthology.orchestra.run.smithi136.stdout: "osd-slow-ops": { 2024-06-02T04:19:56.618 INFO:teuthology.orchestra.run.smithi136.stdout: "slow_ops_count": 0 2024-06-02T04:19:56.618 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.618 INFO:teuthology.orchestra.run.smithi136.stdout: "purge_queue": { 2024-06-02T04:19:56.618 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_ops": 0, 2024-06-02T04:19:56.618 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_ops_high_water": 0, 2024-06-02T04:19:56.618 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing": 0, 2024-06-02T04:19:56.618 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_high_water": 0, 2024-06-02T04:19:56.618 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executed": 0, 2024-06-02T04:19:56.618 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_item_in_journal": 0 2024-06-02T04:19:56.618 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.618 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T04:19:56.618 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-06-02T04:19:56.618 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 104857600, 2024-06-02T04:19:56.619 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-06-02T04:19:56.619 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 3216, 2024-06-02T04:19:56.619 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 1056095, 2024-06-02T04:19:56.619 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-06-02T04:19:56.619 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 3216, 2024-06-02T04:19:56.619 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-06-02T04:19:56.619 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-06-02T04:19:56.619 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 3216, 2024-06-02T04:19:56.619 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 1056095, 2024-06-02T04:19:56.619 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-06-02T04:19:56.619 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.619 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.619 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.619 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:19:56.620 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.620 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-objecter_bytes": { 2024-06-02T04:19:56.620 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-06-02T04:19:56.620 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 104857600, 2024-06-02T04:19:56.620 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-06-02T04:19:56.620 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-06-02T04:19:56.620 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-06-02T04:19:56.620 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-06-02T04:19:56.620 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-06-02T04:19:56.620 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 2925, 2024-06-02T04:19:56.620 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 1393, 2024-06-02T04:19:56.620 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 2925, 2024-06-02T04:19:56.620 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 1393, 2024-06-02T04:19:56.620 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-06-02T04:19:56.621 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.621 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.621 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.621 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:19:56.621 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.621 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-objecter_ops": { 2024-06-02T04:19:56.621 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-06-02T04:19:56.621 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 1024, 2024-06-02T04:19:56.621 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-06-02T04:19:56.621 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-06-02T04:19:56.621 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-06-02T04:19:56.621 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-06-02T04:19:56.621 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-06-02T04:19:56.622 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 2925, 2024-06-02T04:19:56.622 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 2925, 2024-06-02T04:19:56.622 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 2925, 2024-06-02T04:19:56.622 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 2925, 2024-06-02T04:19:56.622 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-06-02T04:19:56.622 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.622 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.622 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.622 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:19:56.622 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.622 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-write_buf_throttle": { 2024-06-02T04:19:56.622 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-06-02T04:19:56.623 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 3758096384, 2024-06-02T04:19:56.623 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-06-02T04:19:56.623 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-06-02T04:19:56.623 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-06-02T04:19:56.623 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-06-02T04:19:56.623 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-06-02T04:19:56.623 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-06-02T04:19:56.623 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-06-02T04:19:56.623 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 0, 2024-06-02T04:19:56.623 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 0, 2024-06-02T04:19:56.623 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-06-02T04:19:56.623 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.623 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.623 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.624 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:19:56.624 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:56.624 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-write_buf_throttle-0x5581b41da5a0": { 2024-06-02T04:19:56.624 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-06-02T04:19:56.624 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 3758096384, 2024-06-02T04:19:56.624 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-06-02T04:19:56.624 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-06-02T04:19:56.624 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-06-02T04:19:56.624 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-06-02T04:19:56.624 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-06-02T04:19:56.624 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-06-02T04:19:56.624 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-06-02T04:19:56.624 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 0, 2024-06-02T04:19:56.624 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 0, 2024-06-02T04:19:56.625 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-06-02T04:19:56.625 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:56.625 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:56.625 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:56.625 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:19:56.625 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:19:56.625 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-06-02T04:19:56.728 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:56 smithi136 ceph-mon[47443]: pgmap v728: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 2.2 MiB/s wr, 265 op/s 2024-06-02T04:19:56.933 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-06-02T04:19:56.933 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-06-02T04:19:56.933 DEBUG:tasks.check_counter:Getting stats from h 2024-06-02T04:19:56.933 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph daemon mds.h perf dump 2024-06-02T04:19:57.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:56 smithi162 ceph-mon[47009]: pgmap v728: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 2.2 MiB/s wr, 265 op/s 2024-06-02T04:19:57.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:56 smithi123 ceph-mon[42885]: pgmap v728: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 2.2 MiB/s wr, 265 op/s 2024-06-02T04:19:57.157 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T04:19:58.192 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-06-02T04:19:58.192 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T04:19:58.192 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 34, 2024-06-02T04:19:58.192 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 59, 2024-06-02T04:19:58.192 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 10838, 2024-06-02T04:19:58.192 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 141903, 2024-06-02T04:19:58.192 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 11, 2024-06-02T04:19:58.193 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 2, 2024-06-02T04:19:58.193 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.007447521, 2024-06-02T04:19:58.193 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.001575066, 2024-06-02T04:19:58.193 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.003601955, 2024-06-02T04:19:58.193 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.000446679, 2024-06-02T04:19:58.193 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:19:58.193 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 58, 2024-06-02T04:19:58.193 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.027955324, 2024-06-02T04:19:58.193 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000481988 2024-06-02T04:19:58.193 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.193 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:19:58.193 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 15, 2024-06-02T04:19:58.194 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000010226, 2024-06-02T04:19:58.194 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000681 2024-06-02T04:19:58.194 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.194 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 5248, 2024-06-02T04:19:58.194 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 131392 2024-06-02T04:19:58.194 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.194 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T04:19:58.194 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 38, 2024-06-02T04:19:58.194 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 220, 2024-06-02T04:19:58.194 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 7989, 2024-06-02T04:19:58.194 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 448584, 2024-06-02T04:19:58.194 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 12, 2024-06-02T04:19:58.195 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 4, 2024-06-02T04:19:58.195 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.018891733, 2024-06-02T04:19:58.195 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.009209356, 2024-06-02T04:19:58.195 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.007332383, 2024-06-02T04:19:58.195 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.000299629, 2024-06-02T04:19:58.195 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:19:58.195 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 218, 2024-06-02T04:19:58.195 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.048948821, 2024-06-02T04:19:58.195 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000224535 2024-06-02T04:19:58.195 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.195 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:19:58.195 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 37, 2024-06-02T04:19:58.195 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000008221, 2024-06-02T04:19:58.196 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000222 2024-06-02T04:19:58.196 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.196 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 160, 2024-06-02T04:19:58.196 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 393248 2024-06-02T04:19:58.196 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.196 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T04:19:58.196 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 1161, 2024-06-02T04:19:58.196 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 1036, 2024-06-02T04:19:58.196 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 738134, 2024-06-02T04:19:58.196 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 478015, 2024-06-02T04:19:58.196 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 7, 2024-06-02T04:19:58.196 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 4, 2024-06-02T04:19:58.196 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.107703555, 2024-06-02T04:19:58.197 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.046616605, 2024-06-02T04:19:58.197 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.055352394, 2024-06-02T04:19:58.197 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.010744272, 2024-06-02T04:19:58.197 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:19:58.197 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1035, 2024-06-02T04:19:58.197 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.168326276, 2024-06-02T04:19:58.197 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000162634 2024-06-02T04:19:58.197 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.197 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:19:58.197 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1528, 2024-06-02T04:19:58.197 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000297544, 2024-06-02T04:19:58.197 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000194 2024-06-02T04:19:58.197 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.198 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 539040, 2024-06-02T04:19:58.198 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 161104 2024-06-02T04:19:58.198 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.198 INFO:teuthology.orchestra.run.smithi136.stdout: "cct": { 2024-06-02T04:19:58.198 INFO:teuthology.orchestra.run.smithi136.stdout: "total_workers": 1, 2024-06-02T04:19:58.198 INFO:teuthology.orchestra.run.smithi136.stdout: "unhealthy_workers": 0 2024-06-02T04:19:58.198 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.198 INFO:teuthology.orchestra.run.smithi136.stdout: "finisher-MDSRank": { 2024-06-02T04:19:58.198 INFO:teuthology.orchestra.run.smithi136.stdout: "queue_len": 0, 2024-06-02T04:19:58.198 INFO:teuthology.orchestra.run.smithi136.stdout: "complete_latency": { 2024-06-02T04:19:58.198 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 54, 2024-06-02T04:19:58.199 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.001187135, 2024-06-02T04:19:58.199 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000021983 2024-06-02T04:19:58.199 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:19:58.199 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.199 INFO:teuthology.orchestra.run.smithi136.stdout: "finisher-PurgeQueue": { 2024-06-02T04:19:58.199 INFO:teuthology.orchestra.run.smithi136.stdout: "queue_len": 0, 2024-06-02T04:19:58.199 INFO:teuthology.orchestra.run.smithi136.stdout: "complete_latency": { 2024-06-02T04:19:58.199 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 2, 2024-06-02T04:19:58.199 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000013865, 2024-06-02T04:19:58.199 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000006932 2024-06-02T04:19:58.199 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:19:58.199 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.199 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": { 2024-06-02T04:19:58.200 INFO:teuthology.orchestra.run.smithi136.stdout: "request": 6, 2024-06-02T04:19:58.200 INFO:teuthology.orchestra.run.smithi136.stdout: "reply": 3, 2024-06-02T04:19:58.200 INFO:teuthology.orchestra.run.smithi136.stdout: "reply_latency": { 2024-06-02T04:19:58.200 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 3, 2024-06-02T04:19:58.200 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.002362305, 2024-06-02T04:19:58.200 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000787435 2024-06-02T04:19:58.200 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.200 INFO:teuthology.orchestra.run.smithi136.stdout: "slow_reply": 0, 2024-06-02T04:19:58.200 INFO:teuthology.orchestra.run.smithi136.stdout: "forward": 3, 2024-06-02T04:19:58.200 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_fetch_complete": 0, 2024-06-02T04:19:58.200 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_fetch_keys": 0, 2024-06-02T04:19:58.200 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_commit": 11, 2024-06-02T04:19:58.200 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_split": 0, 2024-06-02T04:19:58.201 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_merge": 0, 2024-06-02T04:19:58.201 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes": 14, 2024-06-02T04:19:58.201 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_top": 0, 2024-06-02T04:19:58.201 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_bottom": 14, 2024-06-02T04:19:58.201 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_pin_tail": 0, 2024-06-02T04:19:58.201 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_pinned": 14, 2024-06-02T04:19:58.201 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_expired": 0, 2024-06-02T04:19:58.201 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_with_caps": 1, 2024-06-02T04:19:58.201 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": 1, 2024-06-02T04:19:58.201 INFO:teuthology.orchestra.run.smithi136.stdout: "subtrees": 2, 2024-06-02T04:19:58.201 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse": 10, 2024-06-02T04:19:58.201 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_hit": 5, 2024-06-02T04:19:58.201 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_forward": 0, 2024-06-02T04:19:58.202 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_discover": 2, 2024-06-02T04:19:58.202 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_dir_fetch": 0, 2024-06-02T04:19:58.202 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_remote_ino": 0, 2024-06-02T04:19:58.202 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_lock": 0, 2024-06-02T04:19:58.202 INFO:teuthology.orchestra.run.smithi136.stdout: "load_cent": 0, 2024-06-02T04:19:58.202 INFO:teuthology.orchestra.run.smithi136.stdout: "q": 0, 2024-06-02T04:19:58.202 INFO:teuthology.orchestra.run.smithi136.stdout: "exported": 0, 2024-06-02T04:19:58.202 INFO:teuthology.orchestra.run.smithi136.stdout: "exported_inodes": 0, 2024-06-02T04:19:58.202 INFO:teuthology.orchestra.run.smithi136.stdout: "imported": 0, 2024-06-02T04:19:58.202 INFO:teuthology.orchestra.run.smithi136.stdout: "imported_inodes": 0, 2024-06-02T04:19:58.202 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_dir_fetch": 0, 2024-06-02T04:19:58.202 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_backtrace_fetch": 0, 2024-06-02T04:19:58.202 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_peer_discover": 0, 2024-06-02T04:19:58.203 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rfiles": 1041, 2024-06-02T04:19:58.203 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rbytes": 1756938698, 2024-06-02T04:19:58.203 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rsnaps": 0, 2024-06-02T04:19:58.203 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_backtrace_fetch": 0, 2024-06-02T04:19:58.203 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_set_tag": 0, 2024-06-02T04:19:58.203 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_backtrace_repaired": 0, 2024-06-02T04:19:58.203 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_inotable_repaired": 0, 2024-06-02T04:19:58.203 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dir_inodes": 0, 2024-06-02T04:19:58.203 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dir_base_inodes": 0, 2024-06-02T04:19:58.203 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dirfrag_rstats": 0, 2024-06-02T04:19:58.203 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_file_inodes": 0, 2024-06-02T04:19:58.203 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_inode_file_caps": 0, 2024-06-02T04:19:58.203 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_revoke": 2, 2024-06-02T04:19:58.204 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_grant": 0, 2024-06-02T04:19:58.204 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_trunc": 0, 2024-06-02T04:19:58.204 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-02T04:19:58.204 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-02T04:19:58.204 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_caps": 2, 2024-06-02T04:19:58.204 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_caps_dirty": 0, 2024-06-02T04:19:58.204 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_cap_release": 0, 2024-06-02T04:19:58.204 INFO:teuthology.orchestra.run.smithi136.stdout: "process_request_cap_release": 3 2024-06-02T04:19:58.204 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.204 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_cache": { 2024-06-02T04:19:58.204 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_update": 0, 2024-06-02T04:19:58.204 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_update_receipt": 0, 2024-06-02T04:19:58.205 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_try_discover": 0, 2024-06-02T04:19:58.205 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_send_discover": 3, 2024-06-02T04:19:58.205 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_handle_discover": 0, 2024-06-02T04:19:58.205 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays": 0, 2024-06-02T04:19:58.205 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays_delayed": 0, 2024-06-02T04:19:58.205 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays_enqueuing": 0, 2024-06-02T04:19:58.205 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_created": 0, 2024-06-02T04:19:58.205 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_enqueued": 0, 2024-06-02T04:19:58.205 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_reintegrated": 0, 2024-06-02T04:19:58.205 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_migrated": 0, 2024-06-02T04:19:58.205 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_processing": 0, 2024-06-02T04:19:58.205 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_enqueued": 0, 2024-06-02T04:19:58.206 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_prioritized": 0, 2024-06-02T04:19:58.206 INFO:teuthology.orchestra.run.smithi136.stdout: "recovery_started": 0, 2024-06-02T04:19:58.206 INFO:teuthology.orchestra.run.smithi136.stdout: "recovery_completed": 0, 2024-06-02T04:19:58.206 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_enqueue_scrub": 0, 2024-06-02T04:19:58.206 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_exportdir": 0, 2024-06-02T04:19:58.206 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_flush": 0, 2024-06-02T04:19:58.206 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_fragmentdir": 0, 2024-06-02T04:19:58.206 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_fragstats": 0, 2024-06-02T04:19:58.206 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_inodestats": 0 2024-06-02T04:19:58.206 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.206 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_log": { 2024-06-02T04:19:58.206 INFO:teuthology.orchestra.run.smithi136.stdout: "evadd": 4, 2024-06-02T04:19:58.206 INFO:teuthology.orchestra.run.smithi136.stdout: "evex": 0, 2024-06-02T04:19:58.207 INFO:teuthology.orchestra.run.smithi136.stdout: "evtrm": 0, 2024-06-02T04:19:58.207 INFO:teuthology.orchestra.run.smithi136.stdout: "ev": 4, 2024-06-02T04:19:58.207 INFO:teuthology.orchestra.run.smithi136.stdout: "evexg": 0, 2024-06-02T04:19:58.207 INFO:teuthology.orchestra.run.smithi136.stdout: "evexd": 0, 2024-06-02T04:19:58.207 INFO:teuthology.orchestra.run.smithi136.stdout: "segadd": 1, 2024-06-02T04:19:58.207 INFO:teuthology.orchestra.run.smithi136.stdout: "segex": 0, 2024-06-02T04:19:58.207 INFO:teuthology.orchestra.run.smithi136.stdout: "segtrm": 0, 2024-06-02T04:19:58.207 INFO:teuthology.orchestra.run.smithi136.stdout: "seg": 1, 2024-06-02T04:19:58.207 INFO:teuthology.orchestra.run.smithi136.stdout: "segexg": 0, 2024-06-02T04:19:58.207 INFO:teuthology.orchestra.run.smithi136.stdout: "segexd": 0, 2024-06-02T04:19:58.207 INFO:teuthology.orchestra.run.smithi136.stdout: "expos": 4194304, 2024-06-02T04:19:58.207 INFO:teuthology.orchestra.run.smithi136.stdout: "wrpos": 4195692, 2024-06-02T04:19:58.207 INFO:teuthology.orchestra.run.smithi136.stdout: "rdpos": 0, 2024-06-02T04:19:58.207 INFO:teuthology.orchestra.run.smithi136.stdout: "jlat": { 2024-06-02T04:19:58.208 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 4, 2024-06-02T04:19:58.208 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.006225110, 2024-06-02T04:19:58.208 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.001556277 2024-06-02T04:19:58.208 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.208 INFO:teuthology.orchestra.run.smithi136.stdout: "replayed": 0 2024-06-02T04:19:58.208 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.208 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_mem": { 2024-06-02T04:19:58.208 INFO:teuthology.orchestra.run.smithi136.stdout: "ino": 17, 2024-06-02T04:19:58.208 INFO:teuthology.orchestra.run.smithi136.stdout: "ino+": 17, 2024-06-02T04:19:58.208 INFO:teuthology.orchestra.run.smithi136.stdout: "ino-": 0, 2024-06-02T04:19:58.208 INFO:teuthology.orchestra.run.smithi136.stdout: "dir": 15, 2024-06-02T04:19:58.208 INFO:teuthology.orchestra.run.smithi136.stdout: "dir+": 16, 2024-06-02T04:19:58.208 INFO:teuthology.orchestra.run.smithi136.stdout: "dir-": 1, 2024-06-02T04:19:58.209 INFO:teuthology.orchestra.run.smithi136.stdout: "dn": 14, 2024-06-02T04:19:58.209 INFO:teuthology.orchestra.run.smithi136.stdout: "dn+": 14, 2024-06-02T04:19:58.209 INFO:teuthology.orchestra.run.smithi136.stdout: "dn-": 0, 2024-06-02T04:19:58.209 INFO:teuthology.orchestra.run.smithi136.stdout: "cap": 1, 2024-06-02T04:19:58.209 INFO:teuthology.orchestra.run.smithi136.stdout: "cap+": 2, 2024-06-02T04:19:58.209 INFO:teuthology.orchestra.run.smithi136.stdout: "cap-": 1, 2024-06-02T04:19:58.209 INFO:teuthology.orchestra.run.smithi136.stdout: "rss": 47708, 2024-06-02T04:19:58.209 INFO:teuthology.orchestra.run.smithi136.stdout: "heap": 198964 2024-06-02T04:19:58.209 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.209 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_server": { 2024-06-02T04:19:58.209 INFO:teuthology.orchestra.run.smithi136.stdout: "dispatch_client_request": 10, 2024-06-02T04:19:58.209 INFO:teuthology.orchestra.run.smithi136.stdout: "dispatch_server_request": 0, 2024-06-02T04:19:58.209 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_request": 6, 2024-06-02T04:19:58.210 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_session": 18, 2024-06-02T04:19:58.210 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_peer_request": 1, 2024-06-02T04:19:58.210 INFO:teuthology.orchestra.run.smithi136.stdout: "req_create_latency": { 2024-06-02T04:19:58.210 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.210 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.210 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.210 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.210 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getattr_latency": { 2024-06-02T04:19:58.210 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 3, 2024-06-02T04:19:58.210 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.002362305, 2024-06-02T04:19:58.210 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000787435 2024-06-02T04:19:58.210 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.210 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getfilelock_latency": { 2024-06-02T04:19:58.211 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.211 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.211 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.211 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.211 INFO:teuthology.orchestra.run.smithi136.stdout: "req_link_latency": { 2024-06-02T04:19:58.211 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.211 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.211 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.211 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.211 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookup_latency": { 2024-06-02T04:19:58.211 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.211 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.211 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.212 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.212 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookuphash_latency": { 2024-06-02T04:19:58.212 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.212 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.212 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.212 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.212 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupino_latency": { 2024-06-02T04:19:58.212 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.212 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.212 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.212 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.212 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupname_latency": { 2024-06-02T04:19:58.212 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.213 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.213 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.213 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.213 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupparent_latency": { 2024-06-02T04:19:58.213 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.213 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.213 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.213 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.213 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupsnap_latency": { 2024-06-02T04:19:58.213 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.213 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.213 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.214 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.214 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lssnap_latency": { 2024-06-02T04:19:58.214 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.214 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.214 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.214 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.214 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mkdir_latency": { 2024-06-02T04:19:58.214 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.214 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.214 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.214 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.214 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mknod_latency": { 2024-06-02T04:19:58.215 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.215 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.215 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.215 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.215 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mksnap_latency": { 2024-06-02T04:19:58.215 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.215 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.215 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.215 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.215 INFO:teuthology.orchestra.run.smithi136.stdout: "req_open_latency": { 2024-06-02T04:19:58.215 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.216 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.216 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.216 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.216 INFO:teuthology.orchestra.run.smithi136.stdout: "req_readdir_latency": { 2024-06-02T04:19:58.216 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.216 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.216 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.216 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.216 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rename_latency": { 2024-06-02T04:19:58.216 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.216 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.216 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.217 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.217 INFO:teuthology.orchestra.run.smithi136.stdout: "req_renamesnap_latency": { 2024-06-02T04:19:58.217 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.217 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.217 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.217 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.217 INFO:teuthology.orchestra.run.smithi136.stdout: "req_snapdiff_latency": { 2024-06-02T04:19:58.217 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.217 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.217 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.217 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.217 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmdir_latency": { 2024-06-02T04:19:58.218 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.218 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.218 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.218 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.218 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmsnap_latency": { 2024-06-02T04:19:58.218 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.218 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.218 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.218 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.218 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmxattr_latency": { 2024-06-02T04:19:58.218 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.218 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.218 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.219 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.219 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setattr_latency": { 2024-06-02T04:19:58.219 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.219 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.219 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.219 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.219 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setdirlayout_latency": { 2024-06-02T04:19:58.219 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.219 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.219 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.219 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.219 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setfilelock_latency": { 2024-06-02T04:19:58.220 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.220 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.220 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.220 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.220 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setlayout_latency": { 2024-06-02T04:19:58.220 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.220 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.220 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.220 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.220 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setxattr_latency": { 2024-06-02T04:19:58.220 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.220 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.220 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.221 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.221 INFO:teuthology.orchestra.run.smithi136.stdout: "req_symlink_latency": { 2024-06-02T04:19:58.221 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.221 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.221 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.221 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.221 INFO:teuthology.orchestra.run.smithi136.stdout: "req_unlink_latency": { 2024-06-02T04:19:58.221 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.221 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.221 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.221 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.221 INFO:teuthology.orchestra.run.smithi136.stdout: "cap_revoke_eviction": 0, 2024-06-02T04:19:58.221 INFO:teuthology.orchestra.run.smithi136.stdout: "cap_acquisition_throttle": 0, 2024-06-02T04:19:58.221 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getvxattr_latency": { 2024-06-02T04:19:58.222 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.222 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.222 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.222 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:19:58.222 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.222 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_sessions": { 2024-06-02T04:19:58.222 INFO:teuthology.orchestra.run.smithi136.stdout: "session_count": 1, 2024-06-02T04:19:58.222 INFO:teuthology.orchestra.run.smithi136.stdout: "session_add": 2, 2024-06-02T04:19:58.222 INFO:teuthology.orchestra.run.smithi136.stdout: "session_remove": 1, 2024-06-02T04:19:58.222 INFO:teuthology.orchestra.run.smithi136.stdout: "sessions_open": 1, 2024-06-02T04:19:58.222 INFO:teuthology.orchestra.run.smithi136.stdout: "sessions_stale": 0, 2024-06-02T04:19:58.222 INFO:teuthology.orchestra.run.smithi136.stdout: "total_load": 2, 2024-06-02T04:19:58.223 INFO:teuthology.orchestra.run.smithi136.stdout: "average_load": 1, 2024-06-02T04:19:58.223 INFO:teuthology.orchestra.run.smithi136.stdout: "avg_session_uptime": 935, 2024-06-02T04:19:58.223 INFO:teuthology.orchestra.run.smithi136.stdout: "mdthresh_evicted": 0 2024-06-02T04:19:58.223 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.223 INFO:teuthology.orchestra.run.smithi136.stdout: "mempool": { 2024-06-02T04:19:58.223 INFO:teuthology.orchestra.run.smithi136.stdout: "bloom_filter_bytes": 0, 2024-06-02T04:19:58.223 INFO:teuthology.orchestra.run.smithi136.stdout: "bloom_filter_items": 0, 2024-06-02T04:19:58.223 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T04:19:58.223 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_alloc_items": 0, 2024-06-02T04:19:58.223 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T04:19:58.223 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_data_items": 0, 2024-06-02T04:19:58.223 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T04:19:58.223 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T04:19:58.224 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T04:19:58.224 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T04:19:58.224 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T04:19:58.224 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_other_items": 0, 2024-06-02T04:19:58.224 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T04:19:58.224 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T04:19:58.224 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_extent_bytes": 0, 2024-06-02T04:19:58.224 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_extent_items": 0, 2024-06-02T04:19:58.224 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_blob_bytes": 0, 2024-06-02T04:19:58.224 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_blob_items": 0, 2024-06-02T04:19:58.224 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T04:19:58.225 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T04:19:58.225 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T04:19:58.225 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T04:19:58.225 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T04:19:58.225 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_fsck_items": 0, 2024-06-02T04:19:58.225 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_txc_bytes": 0, 2024-06-02T04:19:58.225 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_txc_items": 0, 2024-06-02T04:19:58.225 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T04:19:58.225 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T04:19:58.225 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_bytes": 0, 2024-06-02T04:19:58.225 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_items": 0, 2024-06-02T04:19:58.225 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_bytes": 0, 2024-06-02T04:19:58.225 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_items": 0, 2024-06-02T04:19:58.225 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T04:19:58.226 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_reader_items": 0, 2024-06-02T04:19:58.226 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T04:19:58.226 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_writer_items": 0, 2024-06-02T04:19:58.226 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_anon_bytes": 247991, 2024-06-02T04:19:58.226 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_anon_items": 83, 2024-06-02T04:19:58.226 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_meta_bytes": 0, 2024-06-02T04:19:58.226 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_meta_items": 0, 2024-06-02T04:19:58.226 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_bytes": 0, 2024-06-02T04:19:58.226 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_items": 0, 2024-06-02T04:19:58.226 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_mapbl_bytes": 0, 2024-06-02T04:19:58.226 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_mapbl_items": 0, 2024-06-02T04:19:58.226 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_pglog_bytes": 0, 2024-06-02T04:19:58.227 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_pglog_items": 0, 2024-06-02T04:19:58.227 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_bytes": 7240, 2024-06-02T04:19:58.227 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_items": 152, 2024-06-02T04:19:58.227 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T04:19:58.227 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_mapping_items": 0, 2024-06-02T04:19:58.227 INFO:teuthology.orchestra.run.smithi136.stdout: "pgmap_bytes": 0, 2024-06-02T04:19:58.227 INFO:teuthology.orchestra.run.smithi136.stdout: "pgmap_items": 0, 2024-06-02T04:19:58.227 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_co_bytes": 66989, 2024-06-02T04:19:58.227 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_co_items": 293, 2024-06-02T04:19:58.227 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_1_bytes": 0, 2024-06-02T04:19:58.227 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_1_items": 0, 2024-06-02T04:19:58.227 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_2_bytes": 0, 2024-06-02T04:19:58.227 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_2_items": 0 2024-06-02T04:19:58.228 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.228 INFO:teuthology.orchestra.run.smithi136.stdout: "objecter": { 2024-06-02T04:19:58.228 INFO:teuthology.orchestra.run.smithi136.stdout: "op_active": 0, 2024-06-02T04:19:58.228 INFO:teuthology.orchestra.run.smithi136.stdout: "op_laggy": 0, 2024-06-02T04:19:58.228 INFO:teuthology.orchestra.run.smithi136.stdout: "op_send": 41, 2024-06-02T04:19:58.228 INFO:teuthology.orchestra.run.smithi136.stdout: "op_send_bytes": 11959, 2024-06-02T04:19:58.228 INFO:teuthology.orchestra.run.smithi136.stdout: "op_resend": 27, 2024-06-02T04:19:58.228 INFO:teuthology.orchestra.run.smithi136.stdout: "op_reply": 41, 2024-06-02T04:19:58.228 INFO:teuthology.orchestra.run.smithi136.stdout: "op_latency": { 2024-06-02T04:19:58.228 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 41, 2024-06-02T04:19:58.228 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.214995155, 2024-06-02T04:19:58.228 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.005243784 2024-06-02T04:19:58.229 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.229 INFO:teuthology.orchestra.run.smithi136.stdout: "op_inflight": 0, 2024-06-02T04:19:58.229 INFO:teuthology.orchestra.run.smithi136.stdout: "oplen_avg": { 2024-06-02T04:19:58.229 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 41, 2024-06-02T04:19:58.229 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 64 2024-06-02T04:19:58.229 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.229 INFO:teuthology.orchestra.run.smithi136.stdout: "op": 41, 2024-06-02T04:19:58.229 INFO:teuthology.orchestra.run.smithi136.stdout: "op_r": 0, 2024-06-02T04:19:58.229 INFO:teuthology.orchestra.run.smithi136.stdout: "op_w": 41, 2024-06-02T04:19:58.229 INFO:teuthology.orchestra.run.smithi136.stdout: "op_rmw": 0, 2024-06-02T04:19:58.229 INFO:teuthology.orchestra.run.smithi136.stdout: "op_pg": 0, 2024-06-02T04:19:58.230 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_stat": 0, 2024-06-02T04:19:58.230 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_create": 10, 2024-06-02T04:19:58.230 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_read": 0, 2024-06-02T04:19:58.230 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_write": 4, 2024-06-02T04:19:58.230 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_writefull": 7, 2024-06-02T04:19:58.230 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_writesame": 0, 2024-06-02T04:19:58.230 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_append": 0, 2024-06-02T04:19:58.230 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_zero": 0, 2024-06-02T04:19:58.230 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_truncate": 0, 2024-06-02T04:19:58.230 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_delete": 6, 2024-06-02T04:19:58.230 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_mapext": 0, 2024-06-02T04:19:58.230 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_sparse_read": 0, 2024-06-02T04:19:58.231 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_clonerange": 0, 2024-06-02T04:19:58.231 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_getxattr": 0, 2024-06-02T04:19:58.231 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_setxattr": 20, 2024-06-02T04:19:58.231 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_cmpxattr": 0, 2024-06-02T04:19:58.231 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_rmxattr": 0, 2024-06-02T04:19:58.231 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_resetxattrs": 0, 2024-06-02T04:19:58.231 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_call": 0, 2024-06-02T04:19:58.231 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_watch": 0, 2024-06-02T04:19:58.231 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_notify": 0, 2024-06-02T04:19:58.231 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_src_cmpxattr": 0, 2024-06-02T04:19:58.231 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_pgls": 0, 2024-06-02T04:19:58.231 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_pgls_filter": 0, 2024-06-02T04:19:58.231 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_other": 0, 2024-06-02T04:19:58.232 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_active": 0, 2024-06-02T04:19:58.232 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_send": 0, 2024-06-02T04:19:58.232 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_resend": 0, 2024-06-02T04:19:58.232 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_ping": 0, 2024-06-02T04:19:58.232 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_active": 0, 2024-06-02T04:19:58.232 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_send": 0, 2024-06-02T04:19:58.232 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_resend": 0, 2024-06-02T04:19:58.232 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_active": 0, 2024-06-02T04:19:58.232 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_send": 0, 2024-06-02T04:19:58.232 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_resend": 0, 2024-06-02T04:19:58.232 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_active": 0, 2024-06-02T04:19:58.232 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_send": 0, 2024-06-02T04:19:58.232 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_resend": 0, 2024-06-02T04:19:58.233 INFO:teuthology.orchestra.run.smithi136.stdout: "command_active": 0, 2024-06-02T04:19:58.233 INFO:teuthology.orchestra.run.smithi136.stdout: "command_send": 0, 2024-06-02T04:19:58.233 INFO:teuthology.orchestra.run.smithi136.stdout: "command_resend": 0, 2024-06-02T04:19:58.233 INFO:teuthology.orchestra.run.smithi136.stdout: "map_epoch": 84, 2024-06-02T04:19:58.233 INFO:teuthology.orchestra.run.smithi136.stdout: "map_full": 0, 2024-06-02T04:19:58.233 INFO:teuthology.orchestra.run.smithi136.stdout: "map_inc": 2, 2024-06-02T04:19:58.233 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_sessions": 8, 2024-06-02T04:19:58.233 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_session_open": 12, 2024-06-02T04:19:58.233 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_session_close": 4, 2024-06-02T04:19:58.233 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_laggy": 0, 2024-06-02T04:19:58.233 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_wr": 16, 2024-06-02T04:19:58.233 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_rd": 0, 2024-06-02T04:19:58.233 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_del": 1 2024-06-02T04:19:58.234 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.234 INFO:teuthology.orchestra.run.smithi136.stdout: "oft": { 2024-06-02T04:19:58.234 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_objs": 1, 2024-06-02T04:19:58.234 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_kv_pairs": 0, 2024-06-02T04:19:58.234 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_updates": 0, 2024-06-02T04:19:58.234 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_removes": 0 2024-06-02T04:19:58.234 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.234 INFO:teuthology.orchestra.run.smithi136.stdout: "osd-slow-ops": { 2024-06-02T04:19:58.234 INFO:teuthology.orchestra.run.smithi136.stdout: "slow_ops_count": 0 2024-06-02T04:19:58.234 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.234 INFO:teuthology.orchestra.run.smithi136.stdout: "purge_queue": { 2024-06-02T04:19:58.234 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_ops": 0, 2024-06-02T04:19:58.234 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_ops_high_water": 0, 2024-06-02T04:19:58.235 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing": 0, 2024-06-02T04:19:58.235 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_high_water": 0, 2024-06-02T04:19:58.235 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executed": 0, 2024-06-02T04:19:58.235 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_item_in_journal": 0 2024-06-02T04:19:58.235 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.235 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T04:19:58.235 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-06-02T04:19:58.235 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 104857600, 2024-06-02T04:19:58.235 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-06-02T04:19:58.235 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 1229, 2024-06-02T04:19:58.235 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 626986, 2024-06-02T04:19:58.235 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-06-02T04:19:58.235 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 1229, 2024-06-02T04:19:58.235 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-06-02T04:19:58.236 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-06-02T04:19:58.236 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 1229, 2024-06-02T04:19:58.236 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 626986, 2024-06-02T04:19:58.236 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-06-02T04:19:58.236 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.236 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.236 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.236 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:19:58.236 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.236 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-objecter_bytes": { 2024-06-02T04:19:58.236 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-06-02T04:19:58.236 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 104857600, 2024-06-02T04:19:58.236 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-06-02T04:19:58.237 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-06-02T04:19:58.237 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-06-02T04:19:58.237 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-06-02T04:19:58.237 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-06-02T04:19:58.237 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 41, 2024-06-02T04:19:58.237 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 11959, 2024-06-02T04:19:58.237 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 41, 2024-06-02T04:19:58.237 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 11959, 2024-06-02T04:19:58.237 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-06-02T04:19:58.237 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.237 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.237 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.237 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:19:58.238 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.238 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-objecter_ops": { 2024-06-02T04:19:58.238 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-06-02T04:19:58.238 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 1024, 2024-06-02T04:19:58.238 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-06-02T04:19:58.238 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-06-02T04:19:58.238 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-06-02T04:19:58.238 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-06-02T04:19:58.238 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-06-02T04:19:58.238 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 41, 2024-06-02T04:19:58.238 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 41, 2024-06-02T04:19:58.238 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 41, 2024-06-02T04:19:58.238 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 41, 2024-06-02T04:19:58.239 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-06-02T04:19:58.239 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.239 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.239 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.239 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:19:58.239 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.239 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-write_buf_throttle": { 2024-06-02T04:19:58.239 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-06-02T04:19:58.239 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 3758096384, 2024-06-02T04:19:58.239 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-06-02T04:19:58.239 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-06-02T04:19:58.239 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-06-02T04:19:58.239 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-06-02T04:19:58.240 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-06-02T04:19:58.240 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-06-02T04:19:58.240 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-06-02T04:19:58.240 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 0, 2024-06-02T04:19:58.240 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 0, 2024-06-02T04:19:58.240 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-06-02T04:19:58.240 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.240 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.240 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.240 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:19:58.240 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:19:58.240 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-write_buf_throttle-0x55cc076780a0": { 2024-06-02T04:19:58.240 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-06-02T04:19:58.241 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 3758096384, 2024-06-02T04:19:58.241 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-06-02T04:19:58.241 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 4, 2024-06-02T04:19:58.241 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 1388, 2024-06-02T04:19:58.241 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-06-02T04:19:58.241 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 4, 2024-06-02T04:19:58.241 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-06-02T04:19:58.241 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-06-02T04:19:58.241 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 4, 2024-06-02T04:19:58.241 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 1388, 2024-06-02T04:19:58.241 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-06-02T04:19:58.241 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:19:58.241 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:19:58.241 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:19:58.242 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:19:58.242 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:19:58.242 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-06-02T04:19:58.575 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-06-02T04:19:58.575 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-06-02T04:19:58.575 DEBUG:tasks.check_counter:Getting stats from k 2024-06-02T04:19:58.575 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph daemon mds.k perf dump 2024-06-02T04:19:58.801 INFO:teuthology.orchestra.run.smithi136.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.b/config 2024-06-02T04:19:58.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:19:58 smithi136 ceph-mon[47443]: pgmap v729: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 516 KiB/s wr, 69 op/s 2024-06-02T04:19:59.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:19:58 smithi162 ceph-mon[47009]: pgmap v729: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 516 KiB/s wr, 69 op/s 2024-06-02T04:19:59.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:19:58 smithi123 ceph-mon[42885]: pgmap v729: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 516 KiB/s wr, 69 op/s 2024-06-02T04:20:01.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:00 smithi162 ceph-mon[47009]: pgmap v730: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.1 KiB/s wr, 12 op/s 2024-06-02T04:20:01.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:00 smithi162 ceph-mon[47009]: overall HEALTH_OK 2024-06-02T04:20:01.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:00 smithi123 ceph-mon[42885]: pgmap v730: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.1 KiB/s wr, 12 op/s 2024-06-02T04:20:01.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:00 smithi123 ceph-mon[42885]: overall HEALTH_OK 2024-06-02T04:20:01.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:00 smithi136 ceph-mon[47443]: pgmap v730: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.1 KiB/s wr, 12 op/s 2024-06-02T04:20:01.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:00 smithi136 ceph-mon[47443]: overall HEALTH_OK 2024-06-02T04:20:03.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:02 smithi162 ceph-mon[47009]: pgmap v731: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.7 KiB/s wr, 11 op/s 2024-06-02T04:20:03.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:02 smithi123 ceph-mon[42885]: pgmap v731: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.7 KiB/s wr, 11 op/s 2024-06-02T04:20:03.084 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-06-02T04:20:03.084 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T04:20:03.085 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 334, 2024-06-02T04:20:03.085 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 330, 2024-06-02T04:20:03.085 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 529326, 2024-06-02T04:20:03.085 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 208927, 2024-06-02T04:20:03.085 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 13, 2024-06-02T04:20:03.085 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 6, 2024-06-02T04:20:03.085 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.042439316, 2024-06-02T04:20:03.085 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.014237285, 2024-06-02T04:20:03.085 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.020023204, 2024-06-02T04:20:03.085 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.006745858, 2024-06-02T04:20:03.085 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:20:03.085 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 327, 2024-06-02T04:20:03.085 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.090614384, 2024-06-02T04:20:03.086 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000277108 2024-06-02T04:20:03.086 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.086 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:20:03.086 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 4, 2024-06-02T04:20:03.086 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000315, 2024-06-02T04:20:03.086 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000078 2024-06-02T04:20:03.086 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.086 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 526288, 2024-06-02T04:20:03.086 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 165024 2024-06-02T04:20:03.086 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.086 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T04:20:03.086 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 290, 2024-06-02T04:20:03.087 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 754, 2024-06-02T04:20:03.087 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 59501, 2024-06-02T04:20:03.087 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 528437, 2024-06-02T04:20:03.087 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 9, 2024-06-02T04:20:03.087 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 3, 2024-06-02T04:20:03.087 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.055347370, 2024-06-02T04:20:03.087 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.028441137, 2024-06-02T04:20:03.087 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.017035667, 2024-06-02T04:20:03.087 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.004660706, 2024-06-02T04:20:03.087 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:20:03.087 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 755, 2024-06-02T04:20:03.087 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.183470855, 2024-06-02T04:20:03.088 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000243007 2024-06-02T04:20:03.088 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.088 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:20:03.088 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 806, 2024-06-02T04:20:03.088 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000216673, 2024-06-02T04:20:03.088 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000268 2024-06-02T04:20:03.088 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.088 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-06-02T04:20:03.088 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 439392 2024-06-02T04:20:03.088 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.088 INFO:teuthology.orchestra.run.smithi136.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T04:20:03.088 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_messages": 17, 2024-06-02T04:20:03.088 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages": 19, 2024-06-02T04:20:03.089 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_bytes": 4573, 2024-06-02T04:20:03.089 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_bytes": 7972, 2024-06-02T04:20:03.089 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_created_connections": 8, 2024-06-02T04:20:03.089 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_active_connections": 4, 2024-06-02T04:20:03.089 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_total_time": 0.003128632, 2024-06-02T04:20:03.089 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_send_time": 0.000168452, 2024-06-02T04:20:03.089 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_recv_time": 0.002348598, 2024-06-02T04:20:03.089 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_running_fast_dispatch_time": 0.000398903, 2024-06-02T04:20:03.089 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:20:03.089 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 17, 2024-06-02T04:20:03.089 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.019796247, 2024-06-02T04:20:03.089 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.001164485 2024-06-02T04:20:03.089 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.090 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:20:03.090 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.090 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.090 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.090 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.090 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-02T04:20:03.090 INFO:teuthology.orchestra.run.smithi136.stdout: "msgr_send_encrypted_bytes": 0 2024-06-02T04:20:03.091 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.091 INFO:teuthology.orchestra.run.smithi136.stdout: "cct": { 2024-06-02T04:20:03.091 INFO:teuthology.orchestra.run.smithi136.stdout: "total_workers": 1, 2024-06-02T04:20:03.091 INFO:teuthology.orchestra.run.smithi136.stdout: "unhealthy_workers": 0 2024-06-02T04:20:03.091 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.091 INFO:teuthology.orchestra.run.smithi136.stdout: "finisher-MDSRank": { 2024-06-02T04:20:03.091 INFO:teuthology.orchestra.run.smithi136.stdout: "queue_len": 0, 2024-06-02T04:20:03.092 INFO:teuthology.orchestra.run.smithi136.stdout: "complete_latency": { 2024-06-02T04:20:03.092 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 22, 2024-06-02T04:20:03.092 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.001227429, 2024-06-02T04:20:03.092 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000055792 2024-06-02T04:20:03.092 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:20:03.092 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.092 INFO:teuthology.orchestra.run.smithi136.stdout: "finisher-PurgeQueue": { 2024-06-02T04:20:03.092 INFO:teuthology.orchestra.run.smithi136.stdout: "queue_len": 0, 2024-06-02T04:20:03.092 INFO:teuthology.orchestra.run.smithi136.stdout: "complete_latency": { 2024-06-02T04:20:03.092 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 2, 2024-06-02T04:20:03.092 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000019708, 2024-06-02T04:20:03.092 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000009854 2024-06-02T04:20:03.093 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:20:03.093 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.093 INFO:teuthology.orchestra.run.smithi136.stdout: "mds": { 2024-06-02T04:20:03.093 INFO:teuthology.orchestra.run.smithi136.stdout: "request": 0, 2024-06-02T04:20:03.093 INFO:teuthology.orchestra.run.smithi136.stdout: "reply": 0, 2024-06-02T04:20:03.093 INFO:teuthology.orchestra.run.smithi136.stdout: "reply_latency": { 2024-06-02T04:20:03.093 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.093 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.093 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.093 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.093 INFO:teuthology.orchestra.run.smithi136.stdout: "slow_reply": 0, 2024-06-02T04:20:03.093 INFO:teuthology.orchestra.run.smithi136.stdout: "forward": 0, 2024-06-02T04:20:03.093 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_fetch_complete": 0, 2024-06-02T04:20:03.094 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_fetch_keys": 0, 2024-06-02T04:20:03.094 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_commit": 11, 2024-06-02T04:20:03.094 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_split": 0, 2024-06-02T04:20:03.094 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_merge": 0, 2024-06-02T04:20:03.094 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes": 10, 2024-06-02T04:20:03.094 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_top": 0, 2024-06-02T04:20:03.094 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_bottom": 10, 2024-06-02T04:20:03.094 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_pin_tail": 0, 2024-06-02T04:20:03.094 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_pinned": 10, 2024-06-02T04:20:03.094 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_expired": 0, 2024-06-02T04:20:03.094 INFO:teuthology.orchestra.run.smithi136.stdout: "inodes_with_caps": 0, 2024-06-02T04:20:03.094 INFO:teuthology.orchestra.run.smithi136.stdout: "caps": 0, 2024-06-02T04:20:03.094 INFO:teuthology.orchestra.run.smithi136.stdout: "subtrees": 1, 2024-06-02T04:20:03.095 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse": 0, 2024-06-02T04:20:03.095 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_hit": 0, 2024-06-02T04:20:03.095 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_forward": 0, 2024-06-02T04:20:03.095 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_discover": 0, 2024-06-02T04:20:03.095 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_dir_fetch": 0, 2024-06-02T04:20:03.095 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_remote_ino": 0, 2024-06-02T04:20:03.095 INFO:teuthology.orchestra.run.smithi136.stdout: "traverse_lock": 0, 2024-06-02T04:20:03.095 INFO:teuthology.orchestra.run.smithi136.stdout: "load_cent": 0, 2024-06-02T04:20:03.095 INFO:teuthology.orchestra.run.smithi136.stdout: "q": 0, 2024-06-02T04:20:03.095 INFO:teuthology.orchestra.run.smithi136.stdout: "exported": 0, 2024-06-02T04:20:03.095 INFO:teuthology.orchestra.run.smithi136.stdout: "exported_inodes": 0, 2024-06-02T04:20:03.095 INFO:teuthology.orchestra.run.smithi136.stdout: "imported": 0, 2024-06-02T04:20:03.096 INFO:teuthology.orchestra.run.smithi136.stdout: "imported_inodes": 0, 2024-06-02T04:20:03.096 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_dir_fetch": 0, 2024-06-02T04:20:03.096 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_backtrace_fetch": 0, 2024-06-02T04:20:03.096 INFO:teuthology.orchestra.run.smithi136.stdout: "openino_peer_discover": 0, 2024-06-02T04:20:03.096 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rfiles": 1041, 2024-06-02T04:20:03.096 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rbytes": 1756938698, 2024-06-02T04:20:03.096 INFO:teuthology.orchestra.run.smithi136.stdout: "root_rsnaps": 0, 2024-06-02T04:20:03.096 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_backtrace_fetch": 0, 2024-06-02T04:20:03.096 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_set_tag": 0, 2024-06-02T04:20:03.096 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_backtrace_repaired": 0, 2024-06-02T04:20:03.096 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_inotable_repaired": 0, 2024-06-02T04:20:03.096 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dir_inodes": 0, 2024-06-02T04:20:03.096 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dir_base_inodes": 0, 2024-06-02T04:20:03.097 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_dirfrag_rstats": 0, 2024-06-02T04:20:03.097 INFO:teuthology.orchestra.run.smithi136.stdout: "scrub_file_inodes": 0, 2024-06-02T04:20:03.097 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_inode_file_caps": 0, 2024-06-02T04:20:03.097 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_revoke": 0, 2024-06-02T04:20:03.097 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_grant": 0, 2024-06-02T04:20:03.097 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_trunc": 0, 2024-06-02T04:20:03.097 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-02T04:20:03.097 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-02T04:20:03.097 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_caps": 0, 2024-06-02T04:20:03.098 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_caps_dirty": 0, 2024-06-02T04:20:03.098 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_cap_release": 0, 2024-06-02T04:20:03.098 INFO:teuthology.orchestra.run.smithi136.stdout: "process_request_cap_release": 0 2024-06-02T04:20:03.098 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.098 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_cache": { 2024-06-02T04:20:03.098 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_update": 0, 2024-06-02T04:20:03.098 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_update_receipt": 0, 2024-06-02T04:20:03.098 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_try_discover": 0, 2024-06-02T04:20:03.098 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_send_discover": 1, 2024-06-02T04:20:03.098 INFO:teuthology.orchestra.run.smithi136.stdout: "dir_handle_discover": 0, 2024-06-02T04:20:03.098 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays": 0, 2024-06-02T04:20:03.098 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays_delayed": 0, 2024-06-02T04:20:03.099 INFO:teuthology.orchestra.run.smithi136.stdout: "num_strays_enqueuing": 0, 2024-06-02T04:20:03.099 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_created": 0, 2024-06-02T04:20:03.099 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_enqueued": 0, 2024-06-02T04:20:03.099 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_reintegrated": 0, 2024-06-02T04:20:03.099 INFO:teuthology.orchestra.run.smithi136.stdout: "strays_migrated": 0, 2024-06-02T04:20:03.099 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_processing": 0, 2024-06-02T04:20:03.099 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_enqueued": 0, 2024-06-02T04:20:03.099 INFO:teuthology.orchestra.run.smithi136.stdout: "num_recovering_prioritized": 0, 2024-06-02T04:20:03.099 INFO:teuthology.orchestra.run.smithi136.stdout: "recovery_started": 0, 2024-06-02T04:20:03.099 INFO:teuthology.orchestra.run.smithi136.stdout: "recovery_completed": 0, 2024-06-02T04:20:03.099 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_enqueue_scrub": 0, 2024-06-02T04:20:03.100 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_exportdir": 0, 2024-06-02T04:20:03.100 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_flush": 0, 2024-06-02T04:20:03.100 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_fragmentdir": 0, 2024-06-02T04:20:03.101 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_fragstats": 0, 2024-06-02T04:20:03.101 INFO:teuthology.orchestra.run.smithi136.stdout: "ireq_inodestats": 0 2024-06-02T04:20:03.101 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.101 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_log": { 2024-06-02T04:20:03.101 INFO:teuthology.orchestra.run.smithi136.stdout: "evadd": 1, 2024-06-02T04:20:03.101 INFO:teuthology.orchestra.run.smithi136.stdout: "evex": 0, 2024-06-02T04:20:03.101 INFO:teuthology.orchestra.run.smithi136.stdout: "evtrm": 0, 2024-06-02T04:20:03.101 INFO:teuthology.orchestra.run.smithi136.stdout: "ev": 1, 2024-06-02T04:20:03.101 INFO:teuthology.orchestra.run.smithi136.stdout: "evexg": 0, 2024-06-02T04:20:03.101 INFO:teuthology.orchestra.run.smithi136.stdout: "evexd": 0, 2024-06-02T04:20:03.101 INFO:teuthology.orchestra.run.smithi136.stdout: "segadd": 1, 2024-06-02T04:20:03.101 INFO:teuthology.orchestra.run.smithi136.stdout: "segex": 0, 2024-06-02T04:20:03.101 INFO:teuthology.orchestra.run.smithi136.stdout: "segtrm": 0, 2024-06-02T04:20:03.101 INFO:teuthology.orchestra.run.smithi136.stdout: "seg": 1, 2024-06-02T04:20:03.102 INFO:teuthology.orchestra.run.smithi136.stdout: "segexg": 0, 2024-06-02T04:20:03.102 INFO:teuthology.orchestra.run.smithi136.stdout: "segexd": 0, 2024-06-02T04:20:03.102 INFO:teuthology.orchestra.run.smithi136.stdout: "expos": 4194304, 2024-06-02T04:20:03.102 INFO:teuthology.orchestra.run.smithi136.stdout: "wrpos": 4194844, 2024-06-02T04:20:03.102 INFO:teuthology.orchestra.run.smithi136.stdout: "rdpos": 0, 2024-06-02T04:20:03.102 INFO:teuthology.orchestra.run.smithi136.stdout: "jlat": { 2024-06-02T04:20:03.102 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 1, 2024-06-02T04:20:03.102 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.001605820, 2024-06-02T04:20:03.102 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.001605820 2024-06-02T04:20:03.102 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.103 INFO:teuthology.orchestra.run.smithi136.stdout: "replayed": 0 2024-06-02T04:20:03.103 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.103 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_mem": { 2024-06-02T04:20:03.103 INFO:teuthology.orchestra.run.smithi136.stdout: "ino": 13, 2024-06-02T04:20:03.103 INFO:teuthology.orchestra.run.smithi136.stdout: "ino+": 13, 2024-06-02T04:20:03.103 INFO:teuthology.orchestra.run.smithi136.stdout: "ino-": 0, 2024-06-02T04:20:03.103 INFO:teuthology.orchestra.run.smithi136.stdout: "dir": 11, 2024-06-02T04:20:03.103 INFO:teuthology.orchestra.run.smithi136.stdout: "dir+": 12, 2024-06-02T04:20:03.103 INFO:teuthology.orchestra.run.smithi136.stdout: "dir-": 1, 2024-06-02T04:20:03.103 INFO:teuthology.orchestra.run.smithi136.stdout: "dn": 10, 2024-06-02T04:20:03.103 INFO:teuthology.orchestra.run.smithi136.stdout: "dn+": 10, 2024-06-02T04:20:03.103 INFO:teuthology.orchestra.run.smithi136.stdout: "dn-": 0, 2024-06-02T04:20:03.103 INFO:teuthology.orchestra.run.smithi136.stdout: "cap": 0, 2024-06-02T04:20:03.103 INFO:teuthology.orchestra.run.smithi136.stdout: "cap+": 0, 2024-06-02T04:20:03.104 INFO:teuthology.orchestra.run.smithi136.stdout: "cap-": 0, 2024-06-02T04:20:03.104 INFO:teuthology.orchestra.run.smithi136.stdout: "rss": 48352, 2024-06-02T04:20:03.104 INFO:teuthology.orchestra.run.smithi136.stdout: "heap": 198964 2024-06-02T04:20:03.104 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.104 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_server": { 2024-06-02T04:20:03.104 INFO:teuthology.orchestra.run.smithi136.stdout: "dispatch_client_request": 0, 2024-06-02T04:20:03.104 INFO:teuthology.orchestra.run.smithi136.stdout: "dispatch_server_request": 0, 2024-06-02T04:20:03.104 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_request": 0, 2024-06-02T04:20:03.104 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_client_session": 0, 2024-06-02T04:20:03.104 INFO:teuthology.orchestra.run.smithi136.stdout: "handle_peer_request": 0, 2024-06-02T04:20:03.104 INFO:teuthology.orchestra.run.smithi136.stdout: "req_create_latency": { 2024-06-02T04:20:03.104 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.104 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.105 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.105 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.105 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getattr_latency": { 2024-06-02T04:20:03.105 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.105 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.105 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.105 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.105 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getfilelock_latency": { 2024-06-02T04:20:03.105 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.105 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.105 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.105 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.105 INFO:teuthology.orchestra.run.smithi136.stdout: "req_link_latency": { 2024-06-02T04:20:03.105 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.106 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.106 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.106 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.106 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookup_latency": { 2024-06-02T04:20:03.106 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.106 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.106 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.106 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.106 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookuphash_latency": { 2024-06-02T04:20:03.106 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.106 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.106 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.106 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.107 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupino_latency": { 2024-06-02T04:20:03.107 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.107 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.107 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.110 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.110 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupname_latency": { 2024-06-02T04:20:03.110 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.110 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.110 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.110 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.110 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupparent_latency": { 2024-06-02T04:20:03.110 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.110 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.110 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.111 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.111 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lookupsnap_latency": { 2024-06-02T04:20:03.111 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.111 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.111 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.111 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.111 INFO:teuthology.orchestra.run.smithi136.stdout: "req_lssnap_latency": { 2024-06-02T04:20:03.111 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.111 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.111 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.111 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.111 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mkdir_latency": { 2024-06-02T04:20:03.111 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.112 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.112 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.112 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.112 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mknod_latency": { 2024-06-02T04:20:03.112 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.112 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.112 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.112 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.112 INFO:teuthology.orchestra.run.smithi136.stdout: "req_mksnap_latency": { 2024-06-02T04:20:03.112 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.112 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.112 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.113 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.113 INFO:teuthology.orchestra.run.smithi136.stdout: "req_open_latency": { 2024-06-02T04:20:03.113 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.113 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.113 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.113 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.113 INFO:teuthology.orchestra.run.smithi136.stdout: "req_readdir_latency": { 2024-06-02T04:20:03.113 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.113 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.113 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.113 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.113 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rename_latency": { 2024-06-02T04:20:03.113 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.114 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.114 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.114 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.114 INFO:teuthology.orchestra.run.smithi136.stdout: "req_renamesnap_latency": { 2024-06-02T04:20:03.114 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.114 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.114 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.114 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.114 INFO:teuthology.orchestra.run.smithi136.stdout: "req_snapdiff_latency": { 2024-06-02T04:20:03.114 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.114 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.114 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.114 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.115 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmdir_latency": { 2024-06-02T04:20:03.115 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.115 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.115 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.115 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.115 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmsnap_latency": { 2024-06-02T04:20:03.115 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.115 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.115 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.115 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.115 INFO:teuthology.orchestra.run.smithi136.stdout: "req_rmxattr_latency": { 2024-06-02T04:20:03.115 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.115 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.116 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.116 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.116 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setattr_latency": { 2024-06-02T04:20:03.116 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.116 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.116 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.116 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.116 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setdirlayout_latency": { 2024-06-02T04:20:03.116 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.116 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.116 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.116 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.116 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setfilelock_latency": { 2024-06-02T04:20:03.117 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.117 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.117 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.117 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.117 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setlayout_latency": { 2024-06-02T04:20:03.117 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.117 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.117 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.117 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.117 INFO:teuthology.orchestra.run.smithi136.stdout: "req_setxattr_latency": { 2024-06-02T04:20:03.117 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.117 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.117 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.118 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.118 INFO:teuthology.orchestra.run.smithi136.stdout: "req_symlink_latency": { 2024-06-02T04:20:03.118 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.118 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.118 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.118 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.118 INFO:teuthology.orchestra.run.smithi136.stdout: "req_unlink_latency": { 2024-06-02T04:20:03.118 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.118 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.118 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.118 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.118 INFO:teuthology.orchestra.run.smithi136.stdout: "cap_revoke_eviction": 0, 2024-06-02T04:20:03.118 INFO:teuthology.orchestra.run.smithi136.stdout: "cap_acquisition_throttle": 0, 2024-06-02T04:20:03.119 INFO:teuthology.orchestra.run.smithi136.stdout: "req_getvxattr_latency": { 2024-06-02T04:20:03.119 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.119 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.119 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.119 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:20:03.119 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.119 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_sessions": { 2024-06-02T04:20:03.119 INFO:teuthology.orchestra.run.smithi136.stdout: "session_count": 0, 2024-06-02T04:20:03.119 INFO:teuthology.orchestra.run.smithi136.stdout: "session_add": 0, 2024-06-02T04:20:03.119 INFO:teuthology.orchestra.run.smithi136.stdout: "session_remove": 0, 2024-06-02T04:20:03.119 INFO:teuthology.orchestra.run.smithi136.stdout: "sessions_open": 0, 2024-06-02T04:20:03.119 INFO:teuthology.orchestra.run.smithi136.stdout: "sessions_stale": 0, 2024-06-02T04:20:03.119 INFO:teuthology.orchestra.run.smithi136.stdout: "total_load": 0, 2024-06-02T04:20:03.120 INFO:teuthology.orchestra.run.smithi136.stdout: "average_load": 0, 2024-06-02T04:20:03.120 INFO:teuthology.orchestra.run.smithi136.stdout: "avg_session_uptime": 0, 2024-06-02T04:20:03.120 INFO:teuthology.orchestra.run.smithi136.stdout: "mdthresh_evicted": 0 2024-06-02T04:20:03.120 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.120 INFO:teuthology.orchestra.run.smithi136.stdout: "mempool": { 2024-06-02T04:20:03.120 INFO:teuthology.orchestra.run.smithi136.stdout: "bloom_filter_bytes": 0, 2024-06-02T04:20:03.120 INFO:teuthology.orchestra.run.smithi136.stdout: "bloom_filter_items": 0, 2024-06-02T04:20:03.120 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T04:20:03.120 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_alloc_items": 0, 2024-06-02T04:20:03.120 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T04:20:03.120 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_data_items": 0, 2024-06-02T04:20:03.120 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T04:20:03.121 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T04:20:03.121 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T04:20:03.121 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T04:20:03.121 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T04:20:03.121 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_other_items": 0, 2024-06-02T04:20:03.121 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T04:20:03.121 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T04:20:03.121 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_extent_bytes": 0, 2024-06-02T04:20:03.121 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_extent_items": 0, 2024-06-02T04:20:03.121 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_blob_bytes": 0, 2024-06-02T04:20:03.121 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_blob_items": 0, 2024-06-02T04:20:03.121 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T04:20:03.122 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T04:20:03.122 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T04:20:03.122 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T04:20:03.122 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T04:20:03.122 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_fsck_items": 0, 2024-06-02T04:20:03.122 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_txc_bytes": 0, 2024-06-02T04:20:03.122 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_txc_items": 0, 2024-06-02T04:20:03.122 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T04:20:03.122 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T04:20:03.122 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_bytes": 0, 2024-06-02T04:20:03.122 INFO:teuthology.orchestra.run.smithi136.stdout: "bluestore_writing_items": 0, 2024-06-02T04:20:03.122 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_bytes": 0, 2024-06-02T04:20:03.122 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_items": 0, 2024-06-02T04:20:03.123 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T04:20:03.123 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_reader_items": 0, 2024-06-02T04:20:03.123 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T04:20:03.123 INFO:teuthology.orchestra.run.smithi136.stdout: "bluefs_file_writer_items": 0, 2024-06-02T04:20:03.123 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_anon_bytes": 229975, 2024-06-02T04:20:03.123 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_anon_items": 71, 2024-06-02T04:20:03.123 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_meta_bytes": 0, 2024-06-02T04:20:03.123 INFO:teuthology.orchestra.run.smithi136.stdout: "buffer_meta_items": 0, 2024-06-02T04:20:03.123 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_bytes": 0, 2024-06-02T04:20:03.123 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_items": 0, 2024-06-02T04:20:03.123 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_mapbl_bytes": 0, 2024-06-02T04:20:03.123 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_mapbl_items": 0, 2024-06-02T04:20:03.123 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_pglog_bytes": 0, 2024-06-02T04:20:03.124 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_pglog_items": 0, 2024-06-02T04:20:03.124 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_bytes": 7240, 2024-06-02T04:20:03.124 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_items": 152, 2024-06-02T04:20:03.124 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T04:20:03.124 INFO:teuthology.orchestra.run.smithi136.stdout: "osdmap_mapping_items": 0, 2024-06-02T04:20:03.124 INFO:teuthology.orchestra.run.smithi136.stdout: "pgmap_bytes": 0, 2024-06-02T04:20:03.124 INFO:teuthology.orchestra.run.smithi136.stdout: "pgmap_items": 0, 2024-06-02T04:20:03.124 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_co_bytes": 50032, 2024-06-02T04:20:03.124 INFO:teuthology.orchestra.run.smithi136.stdout: "mds_co_items": 197, 2024-06-02T04:20:03.124 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_1_bytes": 0, 2024-06-02T04:20:03.124 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_1_items": 0, 2024-06-02T04:20:03.124 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_2_bytes": 0, 2024-06-02T04:20:03.124 INFO:teuthology.orchestra.run.smithi136.stdout: "unittest_2_items": 0 2024-06-02T04:20:03.125 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.125 INFO:teuthology.orchestra.run.smithi136.stdout: "objecter": { 2024-06-02T04:20:03.125 INFO:teuthology.orchestra.run.smithi136.stdout: "op_active": 0, 2024-06-02T04:20:03.125 INFO:teuthology.orchestra.run.smithi136.stdout: "op_laggy": 0, 2024-06-02T04:20:03.125 INFO:teuthology.orchestra.run.smithi136.stdout: "op_send": 35, 2024-06-02T04:20:03.125 INFO:teuthology.orchestra.run.smithi136.stdout: "op_send_bytes": 10662, 2024-06-02T04:20:03.125 INFO:teuthology.orchestra.run.smithi136.stdout: "op_resend": 33, 2024-06-02T04:20:03.125 INFO:teuthology.orchestra.run.smithi136.stdout: "op_reply": 35, 2024-06-02T04:20:03.125 INFO:teuthology.orchestra.run.smithi136.stdout: "op_latency": { 2024-06-02T04:20:03.125 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 35, 2024-06-02T04:20:03.125 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.215995141, 2024-06-02T04:20:03.125 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.006171289 2024-06-02T04:20:03.125 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.126 INFO:teuthology.orchestra.run.smithi136.stdout: "op_inflight": 0, 2024-06-02T04:20:03.126 INFO:teuthology.orchestra.run.smithi136.stdout: "oplen_avg": { 2024-06-02T04:20:03.126 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 35, 2024-06-02T04:20:03.126 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 57 2024-06-02T04:20:03.126 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.126 INFO:teuthology.orchestra.run.smithi136.stdout: "op": 35, 2024-06-02T04:20:03.126 INFO:teuthology.orchestra.run.smithi136.stdout: "op_r": 0, 2024-06-02T04:20:03.126 INFO:teuthology.orchestra.run.smithi136.stdout: "op_w": 35, 2024-06-02T04:20:03.126 INFO:teuthology.orchestra.run.smithi136.stdout: "op_rmw": 0, 2024-06-02T04:20:03.126 INFO:teuthology.orchestra.run.smithi136.stdout: "op_pg": 0, 2024-06-02T04:20:03.126 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_stat": 0, 2024-06-02T04:20:03.126 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_create": 10, 2024-06-02T04:20:03.126 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_read": 0, 2024-06-02T04:20:03.127 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_write": 1, 2024-06-02T04:20:03.127 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_writefull": 5, 2024-06-02T04:20:03.127 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_writesame": 0, 2024-06-02T04:20:03.127 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_append": 0, 2024-06-02T04:20:03.127 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_zero": 0, 2024-06-02T04:20:03.127 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_truncate": 0, 2024-06-02T04:20:03.127 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_delete": 6, 2024-06-02T04:20:03.127 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_mapext": 0, 2024-06-02T04:20:03.127 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_sparse_read": 0, 2024-06-02T04:20:03.127 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_clonerange": 0, 2024-06-02T04:20:03.127 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_getxattr": 0, 2024-06-02T04:20:03.127 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_setxattr": 20, 2024-06-02T04:20:03.127 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_cmpxattr": 0, 2024-06-02T04:20:03.127 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_rmxattr": 0, 2024-06-02T04:20:03.128 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_resetxattrs": 0, 2024-06-02T04:20:03.128 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_call": 0, 2024-06-02T04:20:03.128 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_watch": 0, 2024-06-02T04:20:03.128 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_notify": 0, 2024-06-02T04:20:03.128 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_src_cmpxattr": 0, 2024-06-02T04:20:03.128 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_pgls": 0, 2024-06-02T04:20:03.128 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_pgls_filter": 0, 2024-06-02T04:20:03.128 INFO:teuthology.orchestra.run.smithi136.stdout: "osdop_other": 0, 2024-06-02T04:20:03.128 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_active": 0, 2024-06-02T04:20:03.128 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_send": 0, 2024-06-02T04:20:03.128 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_resend": 0, 2024-06-02T04:20:03.128 INFO:teuthology.orchestra.run.smithi136.stdout: "linger_ping": 0, 2024-06-02T04:20:03.128 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_active": 0, 2024-06-02T04:20:03.129 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_send": 0, 2024-06-02T04:20:03.129 INFO:teuthology.orchestra.run.smithi136.stdout: "poolop_resend": 0, 2024-06-02T04:20:03.129 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_active": 0, 2024-06-02T04:20:03.129 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_send": 0, 2024-06-02T04:20:03.129 INFO:teuthology.orchestra.run.smithi136.stdout: "poolstat_resend": 0, 2024-06-02T04:20:03.129 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_active": 0, 2024-06-02T04:20:03.129 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_send": 0, 2024-06-02T04:20:03.129 INFO:teuthology.orchestra.run.smithi136.stdout: "statfs_resend": 0, 2024-06-02T04:20:03.129 INFO:teuthology.orchestra.run.smithi136.stdout: "command_active": 0, 2024-06-02T04:20:03.129 INFO:teuthology.orchestra.run.smithi136.stdout: "command_send": 0, 2024-06-02T04:20:03.129 INFO:teuthology.orchestra.run.smithi136.stdout: "command_resend": 0, 2024-06-02T04:20:03.129 INFO:teuthology.orchestra.run.smithi136.stdout: "map_epoch": 84, 2024-06-02T04:20:03.129 INFO:teuthology.orchestra.run.smithi136.stdout: "map_full": 0, 2024-06-02T04:20:03.130 INFO:teuthology.orchestra.run.smithi136.stdout: "map_inc": 2, 2024-06-02T04:20:03.130 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_sessions": 9, 2024-06-02T04:20:03.130 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_session_open": 15, 2024-06-02T04:20:03.130 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_session_close": 6, 2024-06-02T04:20:03.130 INFO:teuthology.orchestra.run.smithi136.stdout: "osd_laggy": 0, 2024-06-02T04:20:03.130 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_wr": 14, 2024-06-02T04:20:03.130 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_rd": 0, 2024-06-02T04:20:03.130 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_del": 1 2024-06-02T04:20:03.130 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.130 INFO:teuthology.orchestra.run.smithi136.stdout: "oft": { 2024-06-02T04:20:03.130 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_objs": 1, 2024-06-02T04:20:03.130 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_kv_pairs": 0, 2024-06-02T04:20:03.130 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_updates": 0, 2024-06-02T04:20:03.131 INFO:teuthology.orchestra.run.smithi136.stdout: "omap_total_removes": 0 2024-06-02T04:20:03.131 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.131 INFO:teuthology.orchestra.run.smithi136.stdout: "osd-slow-ops": { 2024-06-02T04:20:03.131 INFO:teuthology.orchestra.run.smithi136.stdout: "slow_ops_count": 0 2024-06-02T04:20:03.131 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.131 INFO:teuthology.orchestra.run.smithi136.stdout: "purge_queue": { 2024-06-02T04:20:03.131 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_ops": 0, 2024-06-02T04:20:03.131 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_ops_high_water": 0, 2024-06-02T04:20:03.131 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing": 0, 2024-06-02T04:20:03.131 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executing_high_water": 0, 2024-06-02T04:20:03.131 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_executed": 0, 2024-06-02T04:20:03.131 INFO:teuthology.orchestra.run.smithi136.stdout: "pq_item_in_journal": 0 2024-06-02T04:20:03.132 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.132 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T04:20:03.132 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-06-02T04:20:03.132 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 104857600, 2024-06-02T04:20:03.132 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-06-02T04:20:03.132 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 637, 2024-06-02T04:20:03.132 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 516729, 2024-06-02T04:20:03.132 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-06-02T04:20:03.132 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 637, 2024-06-02T04:20:03.132 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-06-02T04:20:03.132 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-06-02T04:20:03.132 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 637, 2024-06-02T04:20:03.132 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 516729, 2024-06-02T04:20:03.133 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-06-02T04:20:03.133 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.133 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.133 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.133 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:20:03.133 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.133 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-objecter_bytes": { 2024-06-02T04:20:03.133 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-06-02T04:20:03.133 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 104857600, 2024-06-02T04:20:03.133 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-06-02T04:20:03.133 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-06-02T04:20:03.133 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-06-02T04:20:03.133 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-06-02T04:20:03.134 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-06-02T04:20:03.134 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 35, 2024-06-02T04:20:03.134 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 10662, 2024-06-02T04:20:03.134 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 35, 2024-06-02T04:20:03.134 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 10662, 2024-06-02T04:20:03.134 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-06-02T04:20:03.134 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.134 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.134 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.134 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:20:03.134 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.134 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-objecter_ops": { 2024-06-02T04:20:03.135 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-06-02T04:20:03.135 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 1024, 2024-06-02T04:20:03.135 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-06-02T04:20:03.135 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-06-02T04:20:03.135 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-06-02T04:20:03.135 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-06-02T04:20:03.135 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-06-02T04:20:03.135 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 35, 2024-06-02T04:20:03.135 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 35, 2024-06-02T04:20:03.135 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 35, 2024-06-02T04:20:03.135 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 35, 2024-06-02T04:20:03.135 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-06-02T04:20:03.135 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.136 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.136 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.136 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:20:03.136 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.136 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-write_buf_throttle": { 2024-06-02T04:20:03.136 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-06-02T04:20:03.136 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 3758096384, 2024-06-02T04:20:03.136 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-06-02T04:20:03.136 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 0, 2024-06-02T04:20:03.136 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 0, 2024-06-02T04:20:03.136 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-06-02T04:20:03.136 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 0, 2024-06-02T04:20:03.137 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-06-02T04:20:03.137 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-06-02T04:20:03.137 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 0, 2024-06-02T04:20:03.137 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 0, 2024-06-02T04:20:03.137 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-06-02T04:20:03.137 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.137 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.137 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.137 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:20:03.137 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2024-06-02T04:20:03.137 INFO:teuthology.orchestra.run.smithi136.stdout: "throttle-write_buf_throttle-0x562bf0a7e0a0": { 2024-06-02T04:20:03.137 INFO:teuthology.orchestra.run.smithi136.stdout: "val": 0, 2024-06-02T04:20:03.137 INFO:teuthology.orchestra.run.smithi136.stdout: "max": 3758096384, 2024-06-02T04:20:03.138 INFO:teuthology.orchestra.run.smithi136.stdout: "get_started": 0, 2024-06-02T04:20:03.138 INFO:teuthology.orchestra.run.smithi136.stdout: "get": 1, 2024-06-02T04:20:03.138 INFO:teuthology.orchestra.run.smithi136.stdout: "get_sum": 540, 2024-06-02T04:20:03.138 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_fail": 0, 2024-06-02T04:20:03.138 INFO:teuthology.orchestra.run.smithi136.stdout: "get_or_fail_success": 1, 2024-06-02T04:20:03.138 INFO:teuthology.orchestra.run.smithi136.stdout: "take": 0, 2024-06-02T04:20:03.138 INFO:teuthology.orchestra.run.smithi136.stdout: "take_sum": 0, 2024-06-02T04:20:03.138 INFO:teuthology.orchestra.run.smithi136.stdout: "put": 1, 2024-06-02T04:20:03.138 INFO:teuthology.orchestra.run.smithi136.stdout: "put_sum": 540, 2024-06-02T04:20:03.138 INFO:teuthology.orchestra.run.smithi136.stdout: "wait": { 2024-06-02T04:20:03.138 INFO:teuthology.orchestra.run.smithi136.stdout: "avgcount": 0, 2024-06-02T04:20:03.139 INFO:teuthology.orchestra.run.smithi136.stdout: "sum": 0.000000000, 2024-06-02T04:20:03.139 INFO:teuthology.orchestra.run.smithi136.stdout: "avgtime": 0.000000000 2024-06-02T04:20:03.139 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:20:03.139 INFO:teuthology.orchestra.run.smithi136.stdout: } 2024-06-02T04:20:03.139 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-06-02T04:20:03.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:02 smithi136 ceph-mon[47443]: pgmap v731: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.7 KiB/s wr, 11 op/s 2024-06-02T04:20:03.439 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-06-02T04:20:03.486 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-06-02T04:20:03.487 DEBUG:tasks.check_counter:Getting stats from c 2024-06-02T04:20:03.488 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph daemon mds.c perf dump 2024-06-02T04:20:04.114 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T04:20:04.952 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:04 smithi162 ceph-mon[47009]: pgmap v732: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.4 KiB/s wr, 12 op/s 2024-06-02T04:20:05.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:04 smithi123 ceph-mon[42885]: pgmap v732: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.4 KiB/s wr, 12 op/s 2024-06-02T04:20:05.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:04 smithi136 ceph-mon[47443]: pgmap v732: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.4 KiB/s wr, 12 op/s 2024-06-02T04:20:05.160 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-06-02T04:20:05.160 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T04:20:05.160 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 1921, 2024-06-02T04:20:05.160 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 1923, 2024-06-02T04:20:05.160 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 8967309, 2024-06-02T04:20:05.160 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 597441, 2024-06-02T04:20:05.160 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 8, 2024-06-02T04:20:05.160 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 3, 2024-06-02T04:20:05.161 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.174488979, 2024-06-02T04:20:05.161 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.043834070, 2024-06-02T04:20:05.161 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.051226099, 2024-06-02T04:20:05.161 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.064747319, 2024-06-02T04:20:05.161 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:20:05.161 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1921, 2024-06-02T04:20:05.161 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.528129747, 2024-06-02T04:20:05.161 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000274924 2024-06-02T04:20:05.161 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.161 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:20:05.161 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.162 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.162 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.162 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.162 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-02T04:20:05.162 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 0 2024-06-02T04:20:05.162 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.162 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T04:20:05.162 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 731, 2024-06-02T04:20:05.162 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 940, 2024-06-02T04:20:05.162 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 8581083, 2024-06-02T04:20:05.162 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 752721, 2024-06-02T04:20:05.162 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 6, 2024-06-02T04:20:05.163 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 4, 2024-06-02T04:20:05.163 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.069475280, 2024-06-02T04:20:05.163 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.022222047, 2024-06-02T04:20:05.163 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.022082956, 2024-06-02T04:20:05.163 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.019214367, 2024-06-02T04:20:05.163 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:20:05.163 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 938, 2024-06-02T04:20:05.163 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.272829149, 2024-06-02T04:20:05.163 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000290862 2024-06-02T04:20:05.163 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.163 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:20:05.163 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.163 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.164 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.164 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.164 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 320, 2024-06-02T04:20:05.164 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 525936 2024-06-02T04:20:05.164 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.164 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T04:20:05.164 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 998, 2024-06-02T04:20:05.164 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 987, 2024-06-02T04:20:05.164 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 7563934, 2024-06-02T04:20:05.164 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 377379, 2024-06-02T04:20:05.165 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 4, 2024-06-02T04:20:05.165 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 3, 2024-06-02T04:20:05.165 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.098361887, 2024-06-02T04:20:05.165 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.029149191, 2024-06-02T04:20:05.165 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.034674959, 2024-06-02T04:20:05.165 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.028705690, 2024-06-02T04:20:05.165 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:20:05.165 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 987, 2024-06-02T04:20:05.165 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.317242791, 2024-06-02T04:20:05.166 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000321421 2024-06-02T04:20:05.166 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.166 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:20:05.166 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.166 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.166 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.166 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.166 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 536576, 2024-06-02T04:20:05.167 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 159056 2024-06-02T04:20:05.167 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.167 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-06-02T04:20:05.167 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 1, 2024-06-02T04:20:05.167 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-06-02T04:20:05.167 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.167 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-MDSRank": { 2024-06-02T04:20:05.167 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-06-02T04:20:05.168 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-06-02T04:20:05.168 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 5618, 2024-06-02T04:20:05.168 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.133778856, 2024-06-02T04:20:05.168 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000023812 2024-06-02T04:20:05.168 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:05.168 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.168 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-PurgeQueue": { 2024-06-02T04:20:05.168 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-06-02T04:20:05.168 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-06-02T04:20:05.168 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.168 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.169 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.169 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:05.169 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.169 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": { 2024-06-02T04:20:05.169 INFO:teuthology.orchestra.run.smithi162.stdout: "request": 0, 2024-06-02T04:20:05.169 INFO:teuthology.orchestra.run.smithi162.stdout: "reply": 0, 2024-06-02T04:20:05.169 INFO:teuthology.orchestra.run.smithi162.stdout: "reply_latency": { 2024-06-02T04:20:05.169 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.169 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.169 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.169 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.169 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_reply": 0, 2024-06-02T04:20:05.169 INFO:teuthology.orchestra.run.smithi162.stdout: "forward": 0, 2024-06-02T04:20:05.170 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_complete": 0, 2024-06-02T04:20:05.170 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_keys": 0, 2024-06-02T04:20:05.170 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_commit": 0, 2024-06-02T04:20:05.170 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_split": 0, 2024-06-02T04:20:05.170 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_merge": 0, 2024-06-02T04:20:05.170 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes": 2520, 2024-06-02T04:20:05.170 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_top": 0, 2024-06-02T04:20:05.170 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_bottom": 2520, 2024-06-02T04:20:05.170 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pin_tail": 0, 2024-06-02T04:20:05.170 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pinned": 2520, 2024-06-02T04:20:05.170 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_expired": 0, 2024-06-02T04:20:05.170 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_with_caps": 0, 2024-06-02T04:20:05.170 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": 0, 2024-06-02T04:20:05.171 INFO:teuthology.orchestra.run.smithi162.stdout: "subtrees": 2, 2024-06-02T04:20:05.171 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse": 0, 2024-06-02T04:20:05.171 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_hit": 0, 2024-06-02T04:20:05.171 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_forward": 0, 2024-06-02T04:20:05.171 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_discover": 0, 2024-06-02T04:20:05.171 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_dir_fetch": 0, 2024-06-02T04:20:05.171 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_remote_ino": 0, 2024-06-02T04:20:05.171 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_lock": 0, 2024-06-02T04:20:05.171 INFO:teuthology.orchestra.run.smithi162.stdout: "load_cent": 0, 2024-06-02T04:20:05.171 INFO:teuthology.orchestra.run.smithi162.stdout: "q": 0, 2024-06-02T04:20:05.171 INFO:teuthology.orchestra.run.smithi162.stdout: "exported": 0, 2024-06-02T04:20:05.171 INFO:teuthology.orchestra.run.smithi162.stdout: "exported_inodes": 0, 2024-06-02T04:20:05.171 INFO:teuthology.orchestra.run.smithi162.stdout: "imported": 0, 2024-06-02T04:20:05.171 INFO:teuthology.orchestra.run.smithi162.stdout: "imported_inodes": 0, 2024-06-02T04:20:05.172 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_dir_fetch": 0, 2024-06-02T04:20:05.172 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_backtrace_fetch": 0, 2024-06-02T04:20:05.172 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_peer_discover": 0, 2024-06-02T04:20:05.172 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rfiles": 1038, 2024-06-02T04:20:05.172 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rbytes": 1759851363, 2024-06-02T04:20:05.172 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rsnaps": 0, 2024-06-02T04:20:05.172 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_fetch": 0, 2024-06-02T04:20:05.172 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_set_tag": 0, 2024-06-02T04:20:05.172 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_repaired": 0, 2024-06-02T04:20:05.172 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_inotable_repaired": 0, 2024-06-02T04:20:05.172 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_inodes": 0, 2024-06-02T04:20:05.172 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_base_inodes": 0, 2024-06-02T04:20:05.172 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dirfrag_rstats": 0, 2024-06-02T04:20:05.172 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_file_inodes": 0, 2024-06-02T04:20:05.173 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_inode_file_caps": 0, 2024-06-02T04:20:05.173 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_revoke": 0, 2024-06-02T04:20:05.173 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_grant": 0, 2024-06-02T04:20:05.173 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_trunc": 0, 2024-06-02T04:20:05.173 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-02T04:20:05.173 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-02T04:20:05.173 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps": 0, 2024-06-02T04:20:05.173 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps_dirty": 0, 2024-06-02T04:20:05.173 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_cap_release": 0, 2024-06-02T04:20:05.173 INFO:teuthology.orchestra.run.smithi162.stdout: "process_request_cap_release": 0 2024-06-02T04:20:05.173 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.173 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_cache": { 2024-06-02T04:20:05.173 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update": 0, 2024-06-02T04:20:05.173 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update_receipt": 0, 2024-06-02T04:20:05.173 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_try_discover": 0, 2024-06-02T04:20:05.174 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_send_discover": 0, 2024-06-02T04:20:05.174 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_handle_discover": 0, 2024-06-02T04:20:05.174 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays": 0, 2024-06-02T04:20:05.174 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_delayed": 0, 2024-06-02T04:20:05.174 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_enqueuing": 0, 2024-06-02T04:20:05.174 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_created": 0, 2024-06-02T04:20:05.174 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_enqueued": 0, 2024-06-02T04:20:05.174 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_reintegrated": 0, 2024-06-02T04:20:05.174 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_migrated": 0, 2024-06-02T04:20:05.174 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_processing": 0, 2024-06-02T04:20:05.174 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_enqueued": 0, 2024-06-02T04:20:05.174 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_prioritized": 0, 2024-06-02T04:20:05.174 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_started": 0, 2024-06-02T04:20:05.175 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_completed": 0, 2024-06-02T04:20:05.175 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_enqueue_scrub": 0, 2024-06-02T04:20:05.175 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_exportdir": 0, 2024-06-02T04:20:05.175 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_flush": 0, 2024-06-02T04:20:05.175 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragmentdir": 0, 2024-06-02T04:20:05.175 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragstats": 0, 2024-06-02T04:20:05.175 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_inodestats": 0 2024-06-02T04:20:05.175 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.175 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_log": { 2024-06-02T04:20:05.175 INFO:teuthology.orchestra.run.smithi162.stdout: "evadd": 0, 2024-06-02T04:20:05.175 INFO:teuthology.orchestra.run.smithi162.stdout: "evex": 0, 2024-06-02T04:20:05.176 INFO:teuthology.orchestra.run.smithi162.stdout: "evtrm": 0, 2024-06-02T04:20:05.176 INFO:teuthology.orchestra.run.smithi162.stdout: "ev": 8787, 2024-06-02T04:20:05.176 INFO:teuthology.orchestra.run.smithi162.stdout: "evexg": 0, 2024-06-02T04:20:05.176 INFO:teuthology.orchestra.run.smithi162.stdout: "evexd": 0, 2024-06-02T04:20:05.176 INFO:teuthology.orchestra.run.smithi162.stdout: "segadd": 0, 2024-06-02T04:20:05.177 INFO:teuthology.orchestra.run.smithi162.stdout: "segex": 0, 2024-06-02T04:20:05.177 INFO:teuthology.orchestra.run.smithi162.stdout: "segtrm": 0, 2024-06-02T04:20:05.177 INFO:teuthology.orchestra.run.smithi162.stdout: "seg": 11, 2024-06-02T04:20:05.178 INFO:teuthology.orchestra.run.smithi162.stdout: "segexg": 0, 2024-06-02T04:20:05.178 INFO:teuthology.orchestra.run.smithi162.stdout: "segexd": 0, 2024-06-02T04:20:05.178 INFO:teuthology.orchestra.run.smithi162.stdout: "expos": 4194304, 2024-06-02T04:20:05.178 INFO:teuthology.orchestra.run.smithi162.stdout: "wrpos": 27822435, 2024-06-02T04:20:05.178 INFO:teuthology.orchestra.run.smithi162.stdout: "rdpos": 27820062, 2024-06-02T04:20:05.178 INFO:teuthology.orchestra.run.smithi162.stdout: "jlat": { 2024-06-02T04:20:05.178 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.178 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.178 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.179 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.179 INFO:teuthology.orchestra.run.smithi162.stdout: "replayed": 8787 2024-06-02T04:20:05.179 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.179 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_mem": { 2024-06-02T04:20:05.179 INFO:teuthology.orchestra.run.smithi162.stdout: "ino": 1093, 2024-06-02T04:20:05.179 INFO:teuthology.orchestra.run.smithi162.stdout: "ino+": 1370, 2024-06-02T04:20:05.179 INFO:teuthology.orchestra.run.smithi162.stdout: "ino-": 277, 2024-06-02T04:20:05.179 INFO:teuthology.orchestra.run.smithi162.stdout: "dir": 67, 2024-06-02T04:20:05.179 INFO:teuthology.orchestra.run.smithi162.stdout: "dir+": 70, 2024-06-02T04:20:05.179 INFO:teuthology.orchestra.run.smithi162.stdout: "dir-": 3, 2024-06-02T04:20:05.179 INFO:teuthology.orchestra.run.smithi162.stdout: "dn": 2520, 2024-06-02T04:20:05.179 INFO:teuthology.orchestra.run.smithi162.stdout: "dn+": 2520, 2024-06-02T04:20:05.179 INFO:teuthology.orchestra.run.smithi162.stdout: "dn-": 0, 2024-06-02T04:20:05.180 INFO:teuthology.orchestra.run.smithi162.stdout: "cap": 0, 2024-06-02T04:20:05.180 INFO:teuthology.orchestra.run.smithi162.stdout: "cap+": 0, 2024-06-02T04:20:05.180 INFO:teuthology.orchestra.run.smithi162.stdout: "cap-": 0, 2024-06-02T04:20:05.180 INFO:teuthology.orchestra.run.smithi162.stdout: "rss": 55012, 2024-06-02T04:20:05.180 INFO:teuthology.orchestra.run.smithi162.stdout: "heap": 207156 2024-06-02T04:20:05.180 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.180 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_server": { 2024-06-02T04:20:05.180 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_client_request": 0, 2024-06-02T04:20:05.180 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_server_request": 0, 2024-06-02T04:20:05.180 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_request": 0, 2024-06-02T04:20:05.180 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_session": 0, 2024-06-02T04:20:05.180 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_peer_request": 0, 2024-06-02T04:20:05.181 INFO:teuthology.orchestra.run.smithi162.stdout: "req_create_latency": { 2024-06-02T04:20:05.181 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.182 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.182 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.182 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.182 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getattr_latency": { 2024-06-02T04:20:05.182 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.183 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.183 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.183 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.183 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getfilelock_latency": { 2024-06-02T04:20:05.183 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.183 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.183 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.183 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.183 INFO:teuthology.orchestra.run.smithi162.stdout: "req_link_latency": { 2024-06-02T04:20:05.183 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.183 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.183 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.183 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.183 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookup_latency": { 2024-06-02T04:20:05.184 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.184 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.184 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.184 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.184 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookuphash_latency": { 2024-06-02T04:20:05.184 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.184 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.184 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.184 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.184 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupino_latency": { 2024-06-02T04:20:05.184 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.184 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.184 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.185 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.185 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupname_latency": { 2024-06-02T04:20:05.185 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.185 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.185 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.185 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.185 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupparent_latency": { 2024-06-02T04:20:05.185 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.185 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.185 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.185 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.185 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupsnap_latency": { 2024-06-02T04:20:05.185 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.185 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.186 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.186 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.186 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lssnap_latency": { 2024-06-02T04:20:05.186 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.186 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.186 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.186 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.186 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mkdir_latency": { 2024-06-02T04:20:05.186 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.186 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.186 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.186 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.187 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mknod_latency": { 2024-06-02T04:20:05.187 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.187 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.187 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.187 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.187 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mksnap_latency": { 2024-06-02T04:20:05.187 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.187 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.187 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.187 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.187 INFO:teuthology.orchestra.run.smithi162.stdout: "req_open_latency": { 2024-06-02T04:20:05.187 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.187 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.188 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.188 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.188 INFO:teuthology.orchestra.run.smithi162.stdout: "req_readdir_latency": { 2024-06-02T04:20:05.188 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.188 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.188 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.188 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.188 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rename_latency": { 2024-06-02T04:20:05.188 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.188 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.188 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.188 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.188 INFO:teuthology.orchestra.run.smithi162.stdout: "req_renamesnap_latency": { 2024-06-02T04:20:05.188 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.189 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.189 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.189 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.189 INFO:teuthology.orchestra.run.smithi162.stdout: "req_snapdiff_latency": { 2024-06-02T04:20:05.189 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.189 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.189 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.189 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.189 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmdir_latency": { 2024-06-02T04:20:05.189 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.189 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.189 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.189 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.190 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmsnap_latency": { 2024-06-02T04:20:05.190 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.190 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.190 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.190 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.190 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmxattr_latency": { 2024-06-02T04:20:05.190 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.190 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.190 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.190 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.190 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setattr_latency": { 2024-06-02T04:20:05.190 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.190 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.191 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.191 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.191 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setdirlayout_latency": { 2024-06-02T04:20:05.191 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.191 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.191 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.191 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.191 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setfilelock_latency": { 2024-06-02T04:20:05.191 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.191 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.191 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.191 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.191 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setlayout_latency": { 2024-06-02T04:20:05.191 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.192 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.192 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.192 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.192 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setxattr_latency": { 2024-06-02T04:20:05.192 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.192 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.192 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.192 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.192 INFO:teuthology.orchestra.run.smithi162.stdout: "req_symlink_latency": { 2024-06-02T04:20:05.192 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.192 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.192 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.192 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.193 INFO:teuthology.orchestra.run.smithi162.stdout: "req_unlink_latency": { 2024-06-02T04:20:05.193 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.193 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.193 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.193 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.193 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_revoke_eviction": 0, 2024-06-02T04:20:05.193 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_acquisition_throttle": 0, 2024-06-02T04:20:05.193 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getvxattr_latency": { 2024-06-02T04:20:05.193 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.193 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.193 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.193 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:05.193 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.193 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_sessions": { 2024-06-02T04:20:05.194 INFO:teuthology.orchestra.run.smithi162.stdout: "session_count": 1, 2024-06-02T04:20:05.194 INFO:teuthology.orchestra.run.smithi162.stdout: "session_add": 2, 2024-06-02T04:20:05.194 INFO:teuthology.orchestra.run.smithi162.stdout: "session_remove": 1, 2024-06-02T04:20:05.194 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_open": 2, 2024-06-02T04:20:05.194 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_stale": 0, 2024-06-02T04:20:05.194 INFO:teuthology.orchestra.run.smithi162.stdout: "total_load": 0, 2024-06-02T04:20:05.194 INFO:teuthology.orchestra.run.smithi162.stdout: "average_load": 0, 2024-06-02T04:20:05.194 INFO:teuthology.orchestra.run.smithi162.stdout: "avg_session_uptime": 3665, 2024-06-02T04:20:05.194 INFO:teuthology.orchestra.run.smithi162.stdout: "mdthresh_evicted": 0 2024-06-02T04:20:05.194 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.194 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-06-02T04:20:05.195 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-06-02T04:20:05.195 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-06-02T04:20:05.195 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T04:20:05.195 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-06-02T04:20:05.195 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T04:20:05.195 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-06-02T04:20:05.195 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T04:20:05.195 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T04:20:05.195 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T04:20:05.195 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T04:20:05.195 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T04:20:05.195 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-06-02T04:20:05.195 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T04:20:05.196 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T04:20:05.196 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-06-02T04:20:05.196 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-06-02T04:20:05.196 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-06-02T04:20:05.196 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-06-02T04:20:05.196 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T04:20:05.196 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T04:20:05.196 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T04:20:05.196 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T04:20:05.196 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T04:20:05.196 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-06-02T04:20:05.196 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-06-02T04:20:05.196 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-06-02T04:20:05.197 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T04:20:05.197 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T04:20:05.197 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-06-02T04:20:05.197 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-06-02T04:20:05.197 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-06-02T04:20:05.197 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-06-02T04:20:05.197 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T04:20:05.197 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-06-02T04:20:05.197 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T04:20:05.197 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-06-02T04:20:05.197 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 246762, 2024-06-02T04:20:05.197 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 1133, 2024-06-02T04:20:05.197 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-06-02T04:20:05.198 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-06-02T04:20:05.198 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-06-02T04:20:05.198 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-06-02T04:20:05.198 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-06-02T04:20:05.198 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-06-02T04:20:05.198 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-06-02T04:20:05.198 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-06-02T04:20:05.198 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 7240, 2024-06-02T04:20:05.198 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 152, 2024-06-02T04:20:05.198 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T04:20:05.198 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-06-02T04:20:05.198 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-06-02T04:20:05.198 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-06-02T04:20:05.199 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 4319893, 2024-06-02T04:20:05.199 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 59274, 2024-06-02T04:20:05.199 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-06-02T04:20:05.199 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-06-02T04:20:05.199 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-06-02T04:20:05.199 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-06-02T04:20:05.199 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.199 INFO:teuthology.orchestra.run.smithi162.stdout: "objecter": { 2024-06-02T04:20:05.199 INFO:teuthology.orchestra.run.smithi162.stdout: "op_active": 0, 2024-06-02T04:20:05.199 INFO:teuthology.orchestra.run.smithi162.stdout: "op_laggy": 0, 2024-06-02T04:20:05.199 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send": 3352, 2024-06-02T04:20:05.199 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send_bytes": 26, 2024-06-02T04:20:05.199 INFO:teuthology.orchestra.run.smithi162.stdout: "op_resend": 4, 2024-06-02T04:20:05.200 INFO:teuthology.orchestra.run.smithi162.stdout: "op_reply": 3352, 2024-06-02T04:20:05.200 INFO:teuthology.orchestra.run.smithi162.stdout: "op_latency": { 2024-06-02T04:20:05.200 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 3352, 2024-06-02T04:20:05.200 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 11.110779017, 2024-06-02T04:20:05.200 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.003314671 2024-06-02T04:20:05.200 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.200 INFO:teuthology.orchestra.run.smithi162.stdout: "op_inflight": 0, 2024-06-02T04:20:05.200 INFO:teuthology.orchestra.run.smithi162.stdout: "oplen_avg": { 2024-06-02T04:20:05.201 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 3352, 2024-06-02T04:20:05.201 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 3353 2024-06-02T04:20:05.201 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.201 INFO:teuthology.orchestra.run.smithi162.stdout: "op": 3352, 2024-06-02T04:20:05.201 INFO:teuthology.orchestra.run.smithi162.stdout: "op_r": 3352, 2024-06-02T04:20:05.201 INFO:teuthology.orchestra.run.smithi162.stdout: "op_w": 0, 2024-06-02T04:20:05.201 INFO:teuthology.orchestra.run.smithi162.stdout: "op_rmw": 0, 2024-06-02T04:20:05.201 INFO:teuthology.orchestra.run.smithi162.stdout: "op_pg": 0, 2024-06-02T04:20:05.201 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_stat": 1994, 2024-06-02T04:20:05.201 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_create": 0, 2024-06-02T04:20:05.202 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_read": 1355, 2024-06-02T04:20:05.202 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_write": 0, 2024-06-02T04:20:05.202 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writefull": 0, 2024-06-02T04:20:05.202 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writesame": 0, 2024-06-02T04:20:05.202 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_append": 0, 2024-06-02T04:20:05.202 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_zero": 0, 2024-06-02T04:20:05.202 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_truncate": 0, 2024-06-02T04:20:05.202 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_delete": 0, 2024-06-02T04:20:05.203 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_mapext": 0, 2024-06-02T04:20:05.203 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_sparse_read": 0, 2024-06-02T04:20:05.203 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_clonerange": 0, 2024-06-02T04:20:05.203 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_getxattr": 2, 2024-06-02T04:20:05.203 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_setxattr": 0, 2024-06-02T04:20:05.203 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_cmpxattr": 0, 2024-06-02T04:20:05.203 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_rmxattr": 0, 2024-06-02T04:20:05.203 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_resetxattrs": 0, 2024-06-02T04:20:05.203 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_call": 0, 2024-06-02T04:20:05.203 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_watch": 0, 2024-06-02T04:20:05.203 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_notify": 0, 2024-06-02T04:20:05.203 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_src_cmpxattr": 0, 2024-06-02T04:20:05.203 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls": 0, 2024-06-02T04:20:05.204 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls_filter": 0, 2024-06-02T04:20:05.204 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_other": 0, 2024-06-02T04:20:05.204 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_active": 0, 2024-06-02T04:20:05.204 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_send": 0, 2024-06-02T04:20:05.204 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_resend": 0, 2024-06-02T04:20:05.204 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_ping": 0, 2024-06-02T04:20:05.204 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_active": 0, 2024-06-02T04:20:05.204 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_send": 0, 2024-06-02T04:20:05.204 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_resend": 0, 2024-06-02T04:20:05.204 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_active": 0, 2024-06-02T04:20:05.204 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_send": 0, 2024-06-02T04:20:05.204 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_resend": 0, 2024-06-02T04:20:05.204 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_active": 0, 2024-06-02T04:20:05.205 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_send": 0, 2024-06-02T04:20:05.205 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_resend": 0, 2024-06-02T04:20:05.205 INFO:teuthology.orchestra.run.smithi162.stdout: "command_active": 0, 2024-06-02T04:20:05.205 INFO:teuthology.orchestra.run.smithi162.stdout: "command_send": 0, 2024-06-02T04:20:05.205 INFO:teuthology.orchestra.run.smithi162.stdout: "command_resend": 0, 2024-06-02T04:20:05.205 INFO:teuthology.orchestra.run.smithi162.stdout: "map_epoch": 84, 2024-06-02T04:20:05.205 INFO:teuthology.orchestra.run.smithi162.stdout: "map_full": 0, 2024-06-02T04:20:05.205 INFO:teuthology.orchestra.run.smithi162.stdout: "map_inc": 2, 2024-06-02T04:20:05.205 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_sessions": 7, 2024-06-02T04:20:05.205 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_open": 8, 2024-06-02T04:20:05.205 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_close": 1, 2024-06-02T04:20:05.205 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_laggy": 0, 2024-06-02T04:20:05.205 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_wr": 0, 2024-06-02T04:20:05.206 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_rd": 2, 2024-06-02T04:20:05.206 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_del": 0 2024-06-02T04:20:05.206 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.206 INFO:teuthology.orchestra.run.smithi162.stdout: "oft": { 2024-06-02T04:20:05.206 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_objs": 0, 2024-06-02T04:20:05.206 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_kv_pairs": 0, 2024-06-02T04:20:05.206 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_updates": 0, 2024-06-02T04:20:05.206 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_removes": 0 2024-06-02T04:20:05.206 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.206 INFO:teuthology.orchestra.run.smithi162.stdout: "osd-slow-ops": { 2024-06-02T04:20:05.206 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_ops_count": 0 2024-06-02T04:20:05.206 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.207 INFO:teuthology.orchestra.run.smithi162.stdout: "purge_queue": { 2024-06-02T04:20:05.207 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops": 0, 2024-06-02T04:20:05.207 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops_high_water": 0, 2024-06-02T04:20:05.207 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing": 0, 2024-06-02T04:20:05.207 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_high_water": 0, 2024-06-02T04:20:05.207 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed": 0, 2024-06-02T04:20:05.207 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_item_in_journal": 0 2024-06-02T04:20:05.207 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.207 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T04:20:05.207 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-06-02T04:20:05.207 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-06-02T04:20:05.207 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-06-02T04:20:05.207 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 3646, 2024-06-02T04:20:05.208 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 24766159, 2024-06-02T04:20:05.208 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-06-02T04:20:05.208 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 3646, 2024-06-02T04:20:05.208 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-06-02T04:20:05.208 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-06-02T04:20:05.208 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 3646, 2024-06-02T04:20:05.208 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 24766159, 2024-06-02T04:20:05.208 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-06-02T04:20:05.208 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.208 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.208 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.208 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:05.208 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.208 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_bytes": { 2024-06-02T04:20:05.209 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-06-02T04:20:05.209 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-06-02T04:20:05.209 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-06-02T04:20:05.209 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-06-02T04:20:05.209 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-06-02T04:20:05.209 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-06-02T04:20:05.209 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-06-02T04:20:05.209 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 3352, 2024-06-02T04:20:05.209 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 23642734, 2024-06-02T04:20:05.209 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 3352, 2024-06-02T04:20:05.209 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 23642734, 2024-06-02T04:20:05.209 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-06-02T04:20:05.209 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.210 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.210 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.210 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:05.210 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.210 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_ops": { 2024-06-02T04:20:05.210 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-06-02T04:20:05.210 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 1024, 2024-06-02T04:20:05.210 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-06-02T04:20:05.210 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-06-02T04:20:05.210 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-06-02T04:20:05.210 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-06-02T04:20:05.210 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-06-02T04:20:05.211 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 3352, 2024-06-02T04:20:05.211 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 3352, 2024-06-02T04:20:05.211 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 3352, 2024-06-02T04:20:05.211 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 3352, 2024-06-02T04:20:05.211 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-06-02T04:20:05.211 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.211 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.211 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.211 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:05.211 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.211 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle": { 2024-06-02T04:20:05.211 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-06-02T04:20:05.211 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-06-02T04:20:05.212 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-06-02T04:20:05.212 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-06-02T04:20:05.212 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-06-02T04:20:05.212 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-06-02T04:20:05.212 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-06-02T04:20:05.212 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-06-02T04:20:05.212 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-06-02T04:20:05.212 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 0, 2024-06-02T04:20:05.212 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 0, 2024-06-02T04:20:05.212 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-06-02T04:20:05.212 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.212 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.212 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.212 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:05.213 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:05.213 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle-0x55ba08c04500": { 2024-06-02T04:20:05.213 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-06-02T04:20:05.213 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-06-02T04:20:05.213 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-06-02T04:20:05.213 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-06-02T04:20:05.213 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-06-02T04:20:05.213 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-06-02T04:20:05.213 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-06-02T04:20:05.213 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-06-02T04:20:05.213 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-06-02T04:20:05.213 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 0, 2024-06-02T04:20:05.213 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 0, 2024-06-02T04:20:05.214 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-06-02T04:20:05.214 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:05.214 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:05.214 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:05.214 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:05.214 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:05.214 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-06-02T04:20:05.523 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-06-02T04:20:05.523 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-06-02T04:20:05.523 DEBUG:tasks.check_counter:Getting stats from f 2024-06-02T04:20:05.523 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph daemon mds.f perf dump 2024-06-02T04:20:05.749 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T04:20:06.727 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-06-02T04:20:06.727 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T04:20:06.727 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 1295, 2024-06-02T04:20:06.727 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 1286, 2024-06-02T04:20:06.727 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 870704, 2024-06-02T04:20:06.727 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 470973, 2024-06-02T04:20:06.727 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 5, 2024-06-02T04:20:06.727 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 1, 2024-06-02T04:20:06.727 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.136336331, 2024-06-02T04:20:06.727 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.041574789, 2024-06-02T04:20:06.728 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.041966067, 2024-06-02T04:20:06.728 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.041831262, 2024-06-02T04:20:06.728 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:20:06.728 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1285, 2024-06-02T04:20:06.728 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.471178968, 2024-06-02T04:20:06.728 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000366676 2024-06-02T04:20:06.728 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.728 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:20:06.728 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.729 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.729 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.729 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.729 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 533696, 2024-06-02T04:20:06.729 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 159040 2024-06-02T04:20:06.729 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.729 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T04:20:06.729 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 8, 2024-06-02T04:20:06.729 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 215, 2024-06-02T04:20:06.729 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 3868, 2024-06-02T04:20:06.729 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 527068, 2024-06-02T04:20:06.730 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 5, 2024-06-02T04:20:06.730 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 3, 2024-06-02T04:20:06.730 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.011321073, 2024-06-02T04:20:06.730 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.007564432, 2024-06-02T04:20:06.730 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.001949413, 2024-06-02T04:20:06.730 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000082072, 2024-06-02T04:20:06.730 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:20:06.730 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 214, 2024-06-02T04:20:06.730 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.092670358, 2024-06-02T04:20:06.730 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000433039 2024-06-02T04:20:06.730 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.730 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:20:06.731 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.731 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.731 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.731 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.731 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-06-02T04:20:06.731 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 526384 2024-06-02T04:20:06.731 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.731 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T04:20:06.731 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 1940, 2024-06-02T04:20:06.731 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 1942, 2024-06-02T04:20:06.731 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 494787, 2024-06-02T04:20:06.731 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 603347, 2024-06-02T04:20:06.731 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 5, 2024-06-02T04:20:06.732 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 3, 2024-06-02T04:20:06.732 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.119799146, 2024-06-02T04:20:06.732 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.032214108, 2024-06-02T04:20:06.732 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.030444845, 2024-06-02T04:20:06.732 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.049423987, 2024-06-02T04:20:06.732 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:20:06.732 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1940, 2024-06-02T04:20:06.732 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.404931915, 2024-06-02T04:20:06.732 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000208727 2024-06-02T04:20:06.732 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.732 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:20:06.732 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.733 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.733 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.733 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.733 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-02T04:20:06.733 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 0 2024-06-02T04:20:06.733 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.733 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-06-02T04:20:06.733 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 1, 2024-06-02T04:20:06.733 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-06-02T04:20:06.733 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.733 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-MDSRank": { 2024-06-02T04:20:06.733 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-06-02T04:20:06.734 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-06-02T04:20:06.734 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 4704, 2024-06-02T04:20:06.734 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.117072175, 2024-06-02T04:20:06.734 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000024887 2024-06-02T04:20:06.734 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:06.734 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.734 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-PurgeQueue": { 2024-06-02T04:20:06.734 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-06-02T04:20:06.734 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-06-02T04:20:06.734 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.734 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.735 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.735 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:06.735 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.735 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": { 2024-06-02T04:20:06.735 INFO:teuthology.orchestra.run.smithi162.stdout: "request": 0, 2024-06-02T04:20:06.735 INFO:teuthology.orchestra.run.smithi162.stdout: "reply": 0, 2024-06-02T04:20:06.735 INFO:teuthology.orchestra.run.smithi162.stdout: "reply_latency": { 2024-06-02T04:20:06.735 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.735 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.735 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.735 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.735 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_reply": 0, 2024-06-02T04:20:06.735 INFO:teuthology.orchestra.run.smithi162.stdout: "forward": 0, 2024-06-02T04:20:06.736 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_complete": 0, 2024-06-02T04:20:06.736 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_keys": 0, 2024-06-02T04:20:06.736 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_commit": 0, 2024-06-02T04:20:06.736 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_split": 0, 2024-06-02T04:20:06.736 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_merge": 0, 2024-06-02T04:20:06.736 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes": 0, 2024-06-02T04:20:06.736 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_top": 0, 2024-06-02T04:20:06.736 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_bottom": 0, 2024-06-02T04:20:06.736 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pin_tail": 0, 2024-06-02T04:20:06.736 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pinned": 0, 2024-06-02T04:20:06.736 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_expired": 0, 2024-06-02T04:20:06.736 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_with_caps": 0, 2024-06-02T04:20:06.737 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": 0, 2024-06-02T04:20:06.737 INFO:teuthology.orchestra.run.smithi162.stdout: "subtrees": 1, 2024-06-02T04:20:06.737 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse": 0, 2024-06-02T04:20:06.737 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_hit": 0, 2024-06-02T04:20:06.737 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_forward": 0, 2024-06-02T04:20:06.737 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_discover": 0, 2024-06-02T04:20:06.737 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_dir_fetch": 0, 2024-06-02T04:20:06.737 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_remote_ino": 0, 2024-06-02T04:20:06.737 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_lock": 0, 2024-06-02T04:20:06.738 INFO:teuthology.orchestra.run.smithi162.stdout: "load_cent": 0, 2024-06-02T04:20:06.738 INFO:teuthology.orchestra.run.smithi162.stdout: "q": 0, 2024-06-02T04:20:06.738 INFO:teuthology.orchestra.run.smithi162.stdout: "exported": 0, 2024-06-02T04:20:06.738 INFO:teuthology.orchestra.run.smithi162.stdout: "exported_inodes": 0, 2024-06-02T04:20:06.738 INFO:teuthology.orchestra.run.smithi162.stdout: "imported": 0, 2024-06-02T04:20:06.739 INFO:teuthology.orchestra.run.smithi162.stdout: "imported_inodes": 0, 2024-06-02T04:20:06.739 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_dir_fetch": 0, 2024-06-02T04:20:06.739 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_backtrace_fetch": 0, 2024-06-02T04:20:06.740 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_peer_discover": 0, 2024-06-02T04:20:06.740 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rfiles": 0, 2024-06-02T04:20:06.740 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rbytes": 0, 2024-06-02T04:20:06.740 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rsnaps": 0, 2024-06-02T04:20:06.740 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_fetch": 0, 2024-06-02T04:20:06.740 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_set_tag": 0, 2024-06-02T04:20:06.740 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_repaired": 0, 2024-06-02T04:20:06.740 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_inotable_repaired": 0, 2024-06-02T04:20:06.740 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_inodes": 0, 2024-06-02T04:20:06.740 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_base_inodes": 0, 2024-06-02T04:20:06.740 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dirfrag_rstats": 0, 2024-06-02T04:20:06.741 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_file_inodes": 0, 2024-06-02T04:20:06.741 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_inode_file_caps": 0, 2024-06-02T04:20:06.741 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_revoke": 0, 2024-06-02T04:20:06.741 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_grant": 0, 2024-06-02T04:20:06.741 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_trunc": 0, 2024-06-02T04:20:06.741 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-02T04:20:06.741 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-02T04:20:06.741 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps": 0, 2024-06-02T04:20:06.741 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps_dirty": 0, 2024-06-02T04:20:06.741 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_cap_release": 0, 2024-06-02T04:20:06.741 INFO:teuthology.orchestra.run.smithi162.stdout: "process_request_cap_release": 0 2024-06-02T04:20:06.741 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.741 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_cache": { 2024-06-02T04:20:06.742 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update": 0, 2024-06-02T04:20:06.742 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update_receipt": 0, 2024-06-02T04:20:06.742 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_try_discover": 0, 2024-06-02T04:20:06.742 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_send_discover": 0, 2024-06-02T04:20:06.742 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_handle_discover": 0, 2024-06-02T04:20:06.742 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays": 0, 2024-06-02T04:20:06.742 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_delayed": 0, 2024-06-02T04:20:06.742 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_enqueuing": 0, 2024-06-02T04:20:06.742 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_created": 0, 2024-06-02T04:20:06.742 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_enqueued": 0, 2024-06-02T04:20:06.742 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_reintegrated": 0, 2024-06-02T04:20:06.743 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_migrated": 0, 2024-06-02T04:20:06.743 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_processing": 0, 2024-06-02T04:20:06.743 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_enqueued": 0, 2024-06-02T04:20:06.743 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_prioritized": 0, 2024-06-02T04:20:06.743 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_started": 0, 2024-06-02T04:20:06.743 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_completed": 0, 2024-06-02T04:20:06.743 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_enqueue_scrub": 0, 2024-06-02T04:20:06.743 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_exportdir": 0, 2024-06-02T04:20:06.743 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_flush": 0, 2024-06-02T04:20:06.743 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragmentdir": 0, 2024-06-02T04:20:06.743 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragstats": 0, 2024-06-02T04:20:06.743 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_inodestats": 0 2024-06-02T04:20:06.744 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.744 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_log": { 2024-06-02T04:20:06.744 INFO:teuthology.orchestra.run.smithi162.stdout: "evadd": 0, 2024-06-02T04:20:06.744 INFO:teuthology.orchestra.run.smithi162.stdout: "evex": 0, 2024-06-02T04:20:06.744 INFO:teuthology.orchestra.run.smithi162.stdout: "evtrm": 0, 2024-06-02T04:20:06.744 INFO:teuthology.orchestra.run.smithi162.stdout: "ev": 2, 2024-06-02T04:20:06.744 INFO:teuthology.orchestra.run.smithi162.stdout: "evexg": 0, 2024-06-02T04:20:06.744 INFO:teuthology.orchestra.run.smithi162.stdout: "evexd": 0, 2024-06-02T04:20:06.744 INFO:teuthology.orchestra.run.smithi162.stdout: "segadd": 0, 2024-06-02T04:20:06.744 INFO:teuthology.orchestra.run.smithi162.stdout: "segex": 0, 2024-06-02T04:20:06.744 INFO:teuthology.orchestra.run.smithi162.stdout: "segtrm": 0, 2024-06-02T04:20:06.744 INFO:teuthology.orchestra.run.smithi162.stdout: "seg": 1, 2024-06-02T04:20:06.744 INFO:teuthology.orchestra.run.smithi162.stdout: "segexg": 0, 2024-06-02T04:20:06.745 INFO:teuthology.orchestra.run.smithi162.stdout: "segexd": 0, 2024-06-02T04:20:06.745 INFO:teuthology.orchestra.run.smithi162.stdout: "expos": 4194304, 2024-06-02T04:20:06.745 INFO:teuthology.orchestra.run.smithi162.stdout: "wrpos": 4195158, 2024-06-02T04:20:06.745 INFO:teuthology.orchestra.run.smithi162.stdout: "rdpos": 4194844, 2024-06-02T04:20:06.745 INFO:teuthology.orchestra.run.smithi162.stdout: "jlat": { 2024-06-02T04:20:06.745 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.745 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.745 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.745 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.745 INFO:teuthology.orchestra.run.smithi162.stdout: "replayed": 2 2024-06-02T04:20:06.745 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.745 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_mem": { 2024-06-02T04:20:06.745 INFO:teuthology.orchestra.run.smithi162.stdout: "ino": 3, 2024-06-02T04:20:06.746 INFO:teuthology.orchestra.run.smithi162.stdout: "ino+": 3, 2024-06-02T04:20:06.746 INFO:teuthology.orchestra.run.smithi162.stdout: "ino-": 0, 2024-06-02T04:20:06.746 INFO:teuthology.orchestra.run.smithi162.stdout: "dir": 1, 2024-06-02T04:20:06.746 INFO:teuthology.orchestra.run.smithi162.stdout: "dir+": 1, 2024-06-02T04:20:06.746 INFO:teuthology.orchestra.run.smithi162.stdout: "dir-": 0, 2024-06-02T04:20:06.746 INFO:teuthology.orchestra.run.smithi162.stdout: "dn": 0, 2024-06-02T04:20:06.746 INFO:teuthology.orchestra.run.smithi162.stdout: "dn+": 0, 2024-06-02T04:20:06.746 INFO:teuthology.orchestra.run.smithi162.stdout: "dn-": 0, 2024-06-02T04:20:06.746 INFO:teuthology.orchestra.run.smithi162.stdout: "cap": 0, 2024-06-02T04:20:06.746 INFO:teuthology.orchestra.run.smithi162.stdout: "cap+": 0, 2024-06-02T04:20:06.746 INFO:teuthology.orchestra.run.smithi162.stdout: "cap-": 0, 2024-06-02T04:20:06.746 INFO:teuthology.orchestra.run.smithi162.stdout: "rss": 47632, 2024-06-02T04:20:06.746 INFO:teuthology.orchestra.run.smithi162.stdout: "heap": 207156 2024-06-02T04:20:06.747 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.747 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_server": { 2024-06-02T04:20:06.747 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_client_request": 0, 2024-06-02T04:20:06.747 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_server_request": 0, 2024-06-02T04:20:06.747 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_request": 0, 2024-06-02T04:20:06.747 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_session": 0, 2024-06-02T04:20:06.747 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_peer_request": 0, 2024-06-02T04:20:06.747 INFO:teuthology.orchestra.run.smithi162.stdout: "req_create_latency": { 2024-06-02T04:20:06.747 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.747 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.747 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.747 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.747 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getattr_latency": { 2024-06-02T04:20:06.748 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.748 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.748 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.748 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.748 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getfilelock_latency": { 2024-06-02T04:20:06.748 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.748 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.748 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.748 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.748 INFO:teuthology.orchestra.run.smithi162.stdout: "req_link_latency": { 2024-06-02T04:20:06.748 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.748 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.748 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.749 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.749 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookup_latency": { 2024-06-02T04:20:06.749 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.749 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.749 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.749 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.749 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookuphash_latency": { 2024-06-02T04:20:06.749 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.749 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.749 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.749 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.749 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupino_latency": { 2024-06-02T04:20:06.750 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.750 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.750 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.750 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.750 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupname_latency": { 2024-06-02T04:20:06.750 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.750 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.751 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.751 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.751 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupparent_latency": { 2024-06-02T04:20:06.751 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.751 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.751 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.751 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.751 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupsnap_latency": { 2024-06-02T04:20:06.751 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.751 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.751 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.751 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.752 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lssnap_latency": { 2024-06-02T04:20:06.752 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.752 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.752 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.752 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.752 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mkdir_latency": { 2024-06-02T04:20:06.752 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.752 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.752 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.752 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.752 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mknod_latency": { 2024-06-02T04:20:06.752 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.753 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.753 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.753 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.753 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mksnap_latency": { 2024-06-02T04:20:06.753 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.753 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.753 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.753 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.753 INFO:teuthology.orchestra.run.smithi162.stdout: "req_open_latency": { 2024-06-02T04:20:06.753 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.753 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.753 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.753 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.754 INFO:teuthology.orchestra.run.smithi162.stdout: "req_readdir_latency": { 2024-06-02T04:20:06.754 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.754 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.754 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.754 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.754 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rename_latency": { 2024-06-02T04:20:06.754 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.754 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.754 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.755 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.755 INFO:teuthology.orchestra.run.smithi162.stdout: "req_renamesnap_latency": { 2024-06-02T04:20:06.755 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.755 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.755 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.755 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.755 INFO:teuthology.orchestra.run.smithi162.stdout: "req_snapdiff_latency": { 2024-06-02T04:20:06.755 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.755 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.755 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.755 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.755 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmdir_latency": { 2024-06-02T04:20:06.756 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.756 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.756 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.756 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.756 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmsnap_latency": { 2024-06-02T04:20:06.756 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.756 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.756 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.756 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.756 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmxattr_latency": { 2024-06-02T04:20:06.756 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.756 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.756 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.757 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.757 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setattr_latency": { 2024-06-02T04:20:06.757 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.757 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.757 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.757 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.757 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setdirlayout_latency": { 2024-06-02T04:20:06.757 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.757 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.757 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.757 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.757 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setfilelock_latency": { 2024-06-02T04:20:06.757 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.757 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.758 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.758 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.758 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setlayout_latency": { 2024-06-02T04:20:06.758 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.758 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.758 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.758 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.758 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setxattr_latency": { 2024-06-02T04:20:06.758 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.758 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.758 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.758 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.759 INFO:teuthology.orchestra.run.smithi162.stdout: "req_symlink_latency": { 2024-06-02T04:20:06.759 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.759 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.759 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.759 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.759 INFO:teuthology.orchestra.run.smithi162.stdout: "req_unlink_latency": { 2024-06-02T04:20:06.759 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.759 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.759 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.759 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.759 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_revoke_eviction": 0, 2024-06-02T04:20:06.759 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_acquisition_throttle": 0, 2024-06-02T04:20:06.759 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getvxattr_latency": { 2024-06-02T04:20:06.760 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.760 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.760 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.760 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:06.760 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.760 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_sessions": { 2024-06-02T04:20:06.760 INFO:teuthology.orchestra.run.smithi162.stdout: "session_count": 1, 2024-06-02T04:20:06.760 INFO:teuthology.orchestra.run.smithi162.stdout: "session_add": 1, 2024-06-02T04:20:06.760 INFO:teuthology.orchestra.run.smithi162.stdout: "session_remove": 0, 2024-06-02T04:20:06.760 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_open": 1, 2024-06-02T04:20:06.760 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_stale": 0, 2024-06-02T04:20:06.761 INFO:teuthology.orchestra.run.smithi162.stdout: "total_load": 0, 2024-06-02T04:20:06.761 INFO:teuthology.orchestra.run.smithi162.stdout: "average_load": 0, 2024-06-02T04:20:06.761 INFO:teuthology.orchestra.run.smithi162.stdout: "avg_session_uptime": 2340, 2024-06-02T04:20:06.761 INFO:teuthology.orchestra.run.smithi162.stdout: "mdthresh_evicted": 0 2024-06-02T04:20:06.761 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.761 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-06-02T04:20:06.761 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-06-02T04:20:06.761 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-06-02T04:20:06.761 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T04:20:06.762 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-06-02T04:20:06.762 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T04:20:06.762 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-06-02T04:20:06.762 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T04:20:06.762 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T04:20:06.762 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T04:20:06.762 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T04:20:06.762 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T04:20:06.762 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-06-02T04:20:06.762 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T04:20:06.762 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T04:20:06.762 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-06-02T04:20:06.763 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-06-02T04:20:06.763 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-06-02T04:20:06.763 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-06-02T04:20:06.763 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T04:20:06.763 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T04:20:06.763 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T04:20:06.763 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T04:20:06.763 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T04:20:06.763 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-06-02T04:20:06.764 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-06-02T04:20:06.764 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-06-02T04:20:06.764 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T04:20:06.764 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T04:20:06.764 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-06-02T04:20:06.764 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-06-02T04:20:06.764 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-06-02T04:20:06.764 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-06-02T04:20:06.764 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T04:20:06.764 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-06-02T04:20:06.764 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T04:20:06.764 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-06-02T04:20:06.764 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 181265, 2024-06-02T04:20:06.765 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 45, 2024-06-02T04:20:06.765 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-06-02T04:20:06.765 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-06-02T04:20:06.765 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-06-02T04:20:06.765 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-06-02T04:20:06.765 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-06-02T04:20:06.765 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-06-02T04:20:06.765 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-06-02T04:20:06.765 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-06-02T04:20:06.765 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 7240, 2024-06-02T04:20:06.765 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 152, 2024-06-02T04:20:06.765 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T04:20:06.765 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-06-02T04:20:06.766 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-06-02T04:20:06.766 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-06-02T04:20:06.766 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 8320, 2024-06-02T04:20:06.766 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 13, 2024-06-02T04:20:06.766 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-06-02T04:20:06.766 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-06-02T04:20:06.766 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-06-02T04:20:06.766 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-06-02T04:20:06.766 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.766 INFO:teuthology.orchestra.run.smithi162.stdout: "objecter": { 2024-06-02T04:20:06.766 INFO:teuthology.orchestra.run.smithi162.stdout: "op_active": 0, 2024-06-02T04:20:06.766 INFO:teuthology.orchestra.run.smithi162.stdout: "op_laggy": 0, 2024-06-02T04:20:06.767 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send": 2945, 2024-06-02T04:20:06.767 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send_bytes": 21, 2024-06-02T04:20:06.767 INFO:teuthology.orchestra.run.smithi162.stdout: "op_resend": 3, 2024-06-02T04:20:06.767 INFO:teuthology.orchestra.run.smithi162.stdout: "op_reply": 2945, 2024-06-02T04:20:06.767 INFO:teuthology.orchestra.run.smithi162.stdout: "op_latency": { 2024-06-02T04:20:06.767 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2945, 2024-06-02T04:20:06.767 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 22.488551661, 2024-06-02T04:20:06.767 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.007636180 2024-06-02T04:20:06.767 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.767 INFO:teuthology.orchestra.run.smithi162.stdout: "op_inflight": 0, 2024-06-02T04:20:06.767 INFO:teuthology.orchestra.run.smithi162.stdout: "oplen_avg": { 2024-06-02T04:20:06.767 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2945, 2024-06-02T04:20:06.767 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 2946 2024-06-02T04:20:06.768 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.768 INFO:teuthology.orchestra.run.smithi162.stdout: "op": 2945, 2024-06-02T04:20:06.768 INFO:teuthology.orchestra.run.smithi162.stdout: "op_r": 2945, 2024-06-02T04:20:06.768 INFO:teuthology.orchestra.run.smithi162.stdout: "op_w": 0, 2024-06-02T04:20:06.768 INFO:teuthology.orchestra.run.smithi162.stdout: "op_rmw": 0, 2024-06-02T04:20:06.768 INFO:teuthology.orchestra.run.smithi162.stdout: "op_pg": 0, 2024-06-02T04:20:06.768 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_stat": 1935, 2024-06-02T04:20:06.768 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_create": 0, 2024-06-02T04:20:06.768 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_read": 1008, 2024-06-02T04:20:06.768 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_write": 0, 2024-06-02T04:20:06.768 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writefull": 0, 2024-06-02T04:20:06.768 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writesame": 0, 2024-06-02T04:20:06.768 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_append": 0, 2024-06-02T04:20:06.769 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_zero": 0, 2024-06-02T04:20:06.769 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_truncate": 0, 2024-06-02T04:20:06.769 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_delete": 0, 2024-06-02T04:20:06.769 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_mapext": 0, 2024-06-02T04:20:06.769 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_sparse_read": 0, 2024-06-02T04:20:06.769 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_clonerange": 0, 2024-06-02T04:20:06.769 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_getxattr": 1, 2024-06-02T04:20:06.769 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_setxattr": 0, 2024-06-02T04:20:06.769 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_cmpxattr": 0, 2024-06-02T04:20:06.769 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_rmxattr": 0, 2024-06-02T04:20:06.769 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_resetxattrs": 0, 2024-06-02T04:20:06.769 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_call": 0, 2024-06-02T04:20:06.770 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_watch": 0, 2024-06-02T04:20:06.770 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_notify": 0, 2024-06-02T04:20:06.770 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_src_cmpxattr": 0, 2024-06-02T04:20:06.770 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls": 0, 2024-06-02T04:20:06.770 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls_filter": 0, 2024-06-02T04:20:06.770 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_other": 0, 2024-06-02T04:20:06.770 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_active": 0, 2024-06-02T04:20:06.770 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_send": 0, 2024-06-02T04:20:06.770 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_resend": 0, 2024-06-02T04:20:06.770 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_ping": 0, 2024-06-02T04:20:06.770 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_active": 0, 2024-06-02T04:20:06.770 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_send": 0, 2024-06-02T04:20:06.770 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_resend": 0, 2024-06-02T04:20:06.771 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_active": 0, 2024-06-02T04:20:06.771 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_send": 0, 2024-06-02T04:20:06.771 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_resend": 0, 2024-06-02T04:20:06.771 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_active": 0, 2024-06-02T04:20:06.771 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_send": 0, 2024-06-02T04:20:06.771 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_resend": 0, 2024-06-02T04:20:06.771 INFO:teuthology.orchestra.run.smithi162.stdout: "command_active": 0, 2024-06-02T04:20:06.771 INFO:teuthology.orchestra.run.smithi162.stdout: "command_send": 0, 2024-06-02T04:20:06.772 INFO:teuthology.orchestra.run.smithi162.stdout: "command_resend": 0, 2024-06-02T04:20:06.772 INFO:teuthology.orchestra.run.smithi162.stdout: "map_epoch": 84, 2024-06-02T04:20:06.772 INFO:teuthology.orchestra.run.smithi162.stdout: "map_full": 0, 2024-06-02T04:20:06.772 INFO:teuthology.orchestra.run.smithi162.stdout: "map_inc": 2, 2024-06-02T04:20:06.772 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_sessions": 4, 2024-06-02T04:20:06.772 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_open": 5, 2024-06-02T04:20:06.772 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_close": 1, 2024-06-02T04:20:06.772 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_laggy": 0, 2024-06-02T04:20:06.773 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_wr": 0, 2024-06-02T04:20:06.773 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_rd": 2, 2024-06-02T04:20:06.773 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_del": 0 2024-06-02T04:20:06.773 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.773 INFO:teuthology.orchestra.run.smithi162.stdout: "oft": { 2024-06-02T04:20:06.773 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_objs": 0, 2024-06-02T04:20:06.773 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_kv_pairs": 0, 2024-06-02T04:20:06.773 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_updates": 0, 2024-06-02T04:20:06.773 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_removes": 0 2024-06-02T04:20:06.773 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.773 INFO:teuthology.orchestra.run.smithi162.stdout: "osd-slow-ops": { 2024-06-02T04:20:06.773 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_ops_count": 0 2024-06-02T04:20:06.773 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.774 INFO:teuthology.orchestra.run.smithi162.stdout: "purge_queue": { 2024-06-02T04:20:06.774 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops": 0, 2024-06-02T04:20:06.774 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops_high_water": 0, 2024-06-02T04:20:06.774 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing": 0, 2024-06-02T04:20:06.774 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_high_water": 0, 2024-06-02T04:20:06.774 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed": 0, 2024-06-02T04:20:06.774 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_item_in_journal": 0 2024-06-02T04:20:06.774 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.774 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T04:20:06.774 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-06-02T04:20:06.774 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-06-02T04:20:06.774 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-06-02T04:20:06.774 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 3239, 2024-06-02T04:20:06.775 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 1059816, 2024-06-02T04:20:06.775 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-06-02T04:20:06.775 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 3239, 2024-06-02T04:20:06.775 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-06-02T04:20:06.775 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-06-02T04:20:06.775 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 3239, 2024-06-02T04:20:06.775 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 1059816, 2024-06-02T04:20:06.775 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-06-02T04:20:06.775 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.775 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.775 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.775 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:06.775 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.776 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_bytes": { 2024-06-02T04:20:06.776 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-06-02T04:20:06.776 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-06-02T04:20:06.776 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-06-02T04:20:06.776 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-06-02T04:20:06.776 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-06-02T04:20:06.776 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-06-02T04:20:06.776 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-06-02T04:20:06.776 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 2945, 2024-06-02T04:20:06.776 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 859, 2024-06-02T04:20:06.776 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 2945, 2024-06-02T04:20:06.777 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 859, 2024-06-02T04:20:06.777 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-06-02T04:20:06.777 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.777 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.777 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.777 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:06.777 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.777 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_ops": { 2024-06-02T04:20:06.777 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-06-02T04:20:06.777 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 1024, 2024-06-02T04:20:06.777 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-06-02T04:20:06.777 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-06-02T04:20:06.778 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-06-02T04:20:06.778 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-06-02T04:20:06.778 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-06-02T04:20:06.778 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 2945, 2024-06-02T04:20:06.778 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 2945, 2024-06-02T04:20:06.778 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 2945, 2024-06-02T04:20:06.778 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 2945, 2024-06-02T04:20:06.778 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-06-02T04:20:06.778 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.778 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.778 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.778 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:06.778 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.779 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle": { 2024-06-02T04:20:06.779 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-06-02T04:20:06.779 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-06-02T04:20:06.779 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-06-02T04:20:06.779 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-06-02T04:20:06.779 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-06-02T04:20:06.779 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-06-02T04:20:06.779 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-06-02T04:20:06.779 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-06-02T04:20:06.779 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-06-02T04:20:06.780 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 0, 2024-06-02T04:20:06.780 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 0, 2024-06-02T04:20:06.780 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-06-02T04:20:06.780 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.780 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.780 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.780 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:06.780 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:06.780 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle-0x55e9c3be0500": { 2024-06-02T04:20:06.780 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-06-02T04:20:06.780 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-06-02T04:20:06.780 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-06-02T04:20:06.780 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-06-02T04:20:06.781 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-06-02T04:20:06.781 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-06-02T04:20:06.781 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-06-02T04:20:06.781 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-06-02T04:20:06.781 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-06-02T04:20:06.781 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 0, 2024-06-02T04:20:06.781 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 0, 2024-06-02T04:20:06.781 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-06-02T04:20:06.781 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:06.781 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:06.781 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:06.781 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:06.781 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:06.782 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-06-02T04:20:06.798 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:06 smithi162 ceph-mon[47009]: pgmap v733: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.8 KiB/s wr, 12 op/s 2024-06-02T04:20:07.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:06 smithi123 ceph-mon[42885]: pgmap v733: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.8 KiB/s wr, 12 op/s 2024-06-02T04:20:07.088 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-06-02T04:20:07.088 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-06-02T04:20:07.088 DEBUG:tasks.check_counter:Getting stats from i 2024-06-02T04:20:07.089 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph daemon mds.i perf dump 2024-06-02T04:20:07.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:06 smithi136 ceph-mon[47443]: pgmap v733: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.8 KiB/s wr, 12 op/s 2024-06-02T04:20:07.314 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T04:20:08.303 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-06-02T04:20:08.303 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T04:20:08.304 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 303, 2024-06-02T04:20:08.304 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 564, 2024-06-02T04:20:08.304 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 62073, 2024-06-02T04:20:08.304 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 252347, 2024-06-02T04:20:08.304 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 9, 2024-06-02T04:20:08.304 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 3, 2024-06-02T04:20:08.304 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.050011597, 2024-06-02T04:20:08.304 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.018031951, 2024-06-02T04:20:08.304 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.020384480, 2024-06-02T04:20:08.304 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.006096905, 2024-06-02T04:20:08.304 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:20:08.304 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 562, 2024-06-02T04:20:08.305 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.163050346, 2024-06-02T04:20:08.305 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000290125 2024-06-02T04:20:08.305 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.305 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:20:08.305 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 822, 2024-06-02T04:20:08.305 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000245908, 2024-06-02T04:20:08.305 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000299 2024-06-02T04:20:08.305 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.305 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 0, 2024-06-02T04:20:08.305 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 0 2024-06-02T04:20:08.305 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.305 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T04:20:08.305 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 347, 2024-06-02T04:20:08.306 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 335, 2024-06-02T04:20:08.306 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 548735, 2024-06-02T04:20:08.306 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 208748, 2024-06-02T04:20:08.306 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 14, 2024-06-02T04:20:08.306 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 6, 2024-06-02T04:20:08.306 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.049537833, 2024-06-02T04:20:08.306 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.016931951, 2024-06-02T04:20:08.306 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.024406431, 2024-06-02T04:20:08.306 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.006725430, 2024-06-02T04:20:08.306 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:20:08.307 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 334, 2024-06-02T04:20:08.307 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.067028887, 2024-06-02T04:20:08.307 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000200685 2024-06-02T04:20:08.307 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.307 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:20:08.307 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 31, 2024-06-02T04:20:08.307 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000008018, 2024-06-02T04:20:08.307 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000258 2024-06-02T04:20:08.307 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.307 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 543408, 2024-06-02T04:20:08.307 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 162880 2024-06-02T04:20:08.307 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.307 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T04:20:08.308 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 14, 2024-06-02T04:20:08.308 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 221, 2024-06-02T04:20:08.308 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 5539, 2024-06-02T04:20:08.308 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 536955, 2024-06-02T04:20:08.308 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 8, 2024-06-02T04:20:08.308 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 4, 2024-06-02T04:20:08.308 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.012952766, 2024-06-02T04:20:08.308 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.008005691, 2024-06-02T04:20:08.308 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.002891178, 2024-06-02T04:20:08.308 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000205330, 2024-06-02T04:20:08.308 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:20:08.308 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 220, 2024-06-02T04:20:08.308 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.109569102, 2024-06-02T04:20:08.309 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000498041 2024-06-02T04:20:08.309 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.309 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:20:08.309 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.309 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.309 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.309 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.309 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-06-02T04:20:08.309 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 527952 2024-06-02T04:20:08.309 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.309 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-06-02T04:20:08.309 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 1, 2024-06-02T04:20:08.309 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-06-02T04:20:08.310 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.310 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-MDSRank": { 2024-06-02T04:20:08.310 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-06-02T04:20:08.310 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-06-02T04:20:08.310 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 48, 2024-06-02T04:20:08.311 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.001367970, 2024-06-02T04:20:08.311 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000028499 2024-06-02T04:20:08.311 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:08.311 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.311 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-PurgeQueue": { 2024-06-02T04:20:08.311 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-06-02T04:20:08.311 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-06-02T04:20:08.312 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2, 2024-06-02T04:20:08.312 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000017437, 2024-06-02T04:20:08.312 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000008718 2024-06-02T04:20:08.312 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:08.312 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.312 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": { 2024-06-02T04:20:08.312 INFO:teuthology.orchestra.run.smithi162.stdout: "request": 1, 2024-06-02T04:20:08.312 INFO:teuthology.orchestra.run.smithi162.stdout: "reply": 0, 2024-06-02T04:20:08.312 INFO:teuthology.orchestra.run.smithi162.stdout: "reply_latency": { 2024-06-02T04:20:08.312 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.312 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.312 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.313 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.313 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_reply": 0, 2024-06-02T04:20:08.313 INFO:teuthology.orchestra.run.smithi162.stdout: "forward": 1, 2024-06-02T04:20:08.313 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_complete": 0, 2024-06-02T04:20:08.313 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_keys": 0, 2024-06-02T04:20:08.313 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_commit": 11, 2024-06-02T04:20:08.313 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_split": 0, 2024-06-02T04:20:08.313 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_merge": 0, 2024-06-02T04:20:08.313 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes": 10, 2024-06-02T04:20:08.313 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_top": 0, 2024-06-02T04:20:08.313 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_bottom": 10, 2024-06-02T04:20:08.313 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pin_tail": 0, 2024-06-02T04:20:08.313 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pinned": 10, 2024-06-02T04:20:08.314 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_expired": 0, 2024-06-02T04:20:08.314 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_with_caps": 0, 2024-06-02T04:20:08.314 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": 0, 2024-06-02T04:20:08.314 INFO:teuthology.orchestra.run.smithi162.stdout: "subtrees": 1, 2024-06-02T04:20:08.314 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse": 0, 2024-06-02T04:20:08.314 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_hit": 0, 2024-06-02T04:20:08.314 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_forward": 0, 2024-06-02T04:20:08.314 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_discover": 0, 2024-06-02T04:20:08.314 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_dir_fetch": 0, 2024-06-02T04:20:08.314 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_remote_ino": 0, 2024-06-02T04:20:08.314 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_lock": 0, 2024-06-02T04:20:08.314 INFO:teuthology.orchestra.run.smithi162.stdout: "load_cent": 0, 2024-06-02T04:20:08.314 INFO:teuthology.orchestra.run.smithi162.stdout: "q": 0, 2024-06-02T04:20:08.315 INFO:teuthology.orchestra.run.smithi162.stdout: "exported": 0, 2024-06-02T04:20:08.315 INFO:teuthology.orchestra.run.smithi162.stdout: "exported_inodes": 0, 2024-06-02T04:20:08.315 INFO:teuthology.orchestra.run.smithi162.stdout: "imported": 0, 2024-06-02T04:20:08.315 INFO:teuthology.orchestra.run.smithi162.stdout: "imported_inodes": 0, 2024-06-02T04:20:08.315 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_dir_fetch": 0, 2024-06-02T04:20:08.315 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_backtrace_fetch": 0, 2024-06-02T04:20:08.315 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_peer_discover": 1, 2024-06-02T04:20:08.315 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rfiles": 1041, 2024-06-02T04:20:08.315 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rbytes": 1756938698, 2024-06-02T04:20:08.315 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rsnaps": 0, 2024-06-02T04:20:08.315 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_fetch": 0, 2024-06-02T04:20:08.315 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_set_tag": 0, 2024-06-02T04:20:08.316 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_repaired": 0, 2024-06-02T04:20:08.316 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_inotable_repaired": 0, 2024-06-02T04:20:08.316 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_inodes": 0, 2024-06-02T04:20:08.316 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_base_inodes": 0, 2024-06-02T04:20:08.316 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dirfrag_rstats": 0, 2024-06-02T04:20:08.316 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_file_inodes": 0, 2024-06-02T04:20:08.316 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_inode_file_caps": 0, 2024-06-02T04:20:08.316 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_revoke": 0, 2024-06-02T04:20:08.316 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_grant": 0, 2024-06-02T04:20:08.316 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_trunc": 0, 2024-06-02T04:20:08.316 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-02T04:20:08.316 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-02T04:20:08.316 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps": 0, 2024-06-02T04:20:08.317 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps_dirty": 0, 2024-06-02T04:20:08.317 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_cap_release": 0, 2024-06-02T04:20:08.317 INFO:teuthology.orchestra.run.smithi162.stdout: "process_request_cap_release": 0 2024-06-02T04:20:08.317 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.317 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_cache": { 2024-06-02T04:20:08.317 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update": 0, 2024-06-02T04:20:08.317 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update_receipt": 0, 2024-06-02T04:20:08.317 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_try_discover": 0, 2024-06-02T04:20:08.317 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_send_discover": 1, 2024-06-02T04:20:08.317 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_handle_discover": 0, 2024-06-02T04:20:08.317 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays": 0, 2024-06-02T04:20:08.317 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_delayed": 0, 2024-06-02T04:20:08.317 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_enqueuing": 0, 2024-06-02T04:20:08.318 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_created": 0, 2024-06-02T04:20:08.318 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_enqueued": 0, 2024-06-02T04:20:08.318 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_reintegrated": 0, 2024-06-02T04:20:08.318 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_migrated": 0, 2024-06-02T04:20:08.318 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_processing": 0, 2024-06-02T04:20:08.318 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_enqueued": 0, 2024-06-02T04:20:08.318 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_prioritized": 0, 2024-06-02T04:20:08.318 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_started": 0, 2024-06-02T04:20:08.318 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_completed": 0, 2024-06-02T04:20:08.318 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_enqueue_scrub": 0, 2024-06-02T04:20:08.318 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_exportdir": 0, 2024-06-02T04:20:08.318 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_flush": 0, 2024-06-02T04:20:08.319 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragmentdir": 0, 2024-06-02T04:20:08.319 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragstats": 0, 2024-06-02T04:20:08.319 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_inodestats": 0 2024-06-02T04:20:08.319 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.319 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_log": { 2024-06-02T04:20:08.319 INFO:teuthology.orchestra.run.smithi162.stdout: "evadd": 2, 2024-06-02T04:20:08.319 INFO:teuthology.orchestra.run.smithi162.stdout: "evex": 0, 2024-06-02T04:20:08.319 INFO:teuthology.orchestra.run.smithi162.stdout: "evtrm": 0, 2024-06-02T04:20:08.319 INFO:teuthology.orchestra.run.smithi162.stdout: "ev": 2, 2024-06-02T04:20:08.319 INFO:teuthology.orchestra.run.smithi162.stdout: "evexg": 0, 2024-06-02T04:20:08.319 INFO:teuthology.orchestra.run.smithi162.stdout: "evexd": 0, 2024-06-02T04:20:08.319 INFO:teuthology.orchestra.run.smithi162.stdout: "segadd": 1, 2024-06-02T04:20:08.319 INFO:teuthology.orchestra.run.smithi162.stdout: "segex": 0, 2024-06-02T04:20:08.319 INFO:teuthology.orchestra.run.smithi162.stdout: "segtrm": 0, 2024-06-02T04:20:08.320 INFO:teuthology.orchestra.run.smithi162.stdout: "seg": 1, 2024-06-02T04:20:08.320 INFO:teuthology.orchestra.run.smithi162.stdout: "segexg": 0, 2024-06-02T04:20:08.320 INFO:teuthology.orchestra.run.smithi162.stdout: "segexd": 0, 2024-06-02T04:20:08.320 INFO:teuthology.orchestra.run.smithi162.stdout: "expos": 4194304, 2024-06-02T04:20:08.320 INFO:teuthology.orchestra.run.smithi162.stdout: "wrpos": 4195158, 2024-06-02T04:20:08.320 INFO:teuthology.orchestra.run.smithi162.stdout: "rdpos": 0, 2024-06-02T04:20:08.320 INFO:teuthology.orchestra.run.smithi162.stdout: "jlat": { 2024-06-02T04:20:08.320 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2, 2024-06-02T04:20:08.320 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.003015942, 2024-06-02T04:20:08.320 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.001507971 2024-06-02T04:20:08.320 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.320 INFO:teuthology.orchestra.run.smithi162.stdout: "replayed": 0 2024-06-02T04:20:08.321 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.321 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_mem": { 2024-06-02T04:20:08.321 INFO:teuthology.orchestra.run.smithi162.stdout: "ino": 13, 2024-06-02T04:20:08.321 INFO:teuthology.orchestra.run.smithi162.stdout: "ino+": 13, 2024-06-02T04:20:08.321 INFO:teuthology.orchestra.run.smithi162.stdout: "ino-": 0, 2024-06-02T04:20:08.321 INFO:teuthology.orchestra.run.smithi162.stdout: "dir": 11, 2024-06-02T04:20:08.321 INFO:teuthology.orchestra.run.smithi162.stdout: "dir+": 12, 2024-06-02T04:20:08.321 INFO:teuthology.orchestra.run.smithi162.stdout: "dir-": 1, 2024-06-02T04:20:08.321 INFO:teuthology.orchestra.run.smithi162.stdout: "dn": 10, 2024-06-02T04:20:08.321 INFO:teuthology.orchestra.run.smithi162.stdout: "dn+": 10, 2024-06-02T04:20:08.321 INFO:teuthology.orchestra.run.smithi162.stdout: "dn-": 0, 2024-06-02T04:20:08.321 INFO:teuthology.orchestra.run.smithi162.stdout: "cap": 0, 2024-06-02T04:20:08.321 INFO:teuthology.orchestra.run.smithi162.stdout: "cap+": 0, 2024-06-02T04:20:08.322 INFO:teuthology.orchestra.run.smithi162.stdout: "cap-": 0, 2024-06-02T04:20:08.322 INFO:teuthology.orchestra.run.smithi162.stdout: "rss": 48480, 2024-06-02T04:20:08.322 INFO:teuthology.orchestra.run.smithi162.stdout: "heap": 198964 2024-06-02T04:20:08.322 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.322 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_server": { 2024-06-02T04:20:08.322 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_client_request": 1, 2024-06-02T04:20:08.322 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_server_request": 0, 2024-06-02T04:20:08.322 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_request": 1, 2024-06-02T04:20:08.322 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_session": 13, 2024-06-02T04:20:08.322 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_peer_request": 0, 2024-06-02T04:20:08.322 INFO:teuthology.orchestra.run.smithi162.stdout: "req_create_latency": { 2024-06-02T04:20:08.322 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.322 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.323 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.323 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.323 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getattr_latency": { 2024-06-02T04:20:08.323 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.323 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.323 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.323 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.323 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getfilelock_latency": { 2024-06-02T04:20:08.323 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.323 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.323 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.323 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.323 INFO:teuthology.orchestra.run.smithi162.stdout: "req_link_latency": { 2024-06-02T04:20:08.324 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.324 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.324 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.324 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.324 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookup_latency": { 2024-06-02T04:20:08.324 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.324 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.324 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.324 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.324 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookuphash_latency": { 2024-06-02T04:20:08.324 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.324 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.324 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.325 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.325 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupino_latency": { 2024-06-02T04:20:08.325 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.325 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.325 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.325 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.325 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupname_latency": { 2024-06-02T04:20:08.325 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.325 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.325 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.325 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.325 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupparent_latency": { 2024-06-02T04:20:08.325 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.326 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.326 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.326 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.326 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupsnap_latency": { 2024-06-02T04:20:08.326 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.326 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.326 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.326 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.326 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lssnap_latency": { 2024-06-02T04:20:08.326 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.326 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.326 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.327 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.327 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mkdir_latency": { 2024-06-02T04:20:08.327 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.327 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.327 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.327 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.327 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mknod_latency": { 2024-06-02T04:20:08.327 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.327 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.327 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.327 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.327 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mksnap_latency": { 2024-06-02T04:20:08.328 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.328 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.328 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.328 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.328 INFO:teuthology.orchestra.run.smithi162.stdout: "req_open_latency": { 2024-06-02T04:20:08.328 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.328 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.328 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.328 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.328 INFO:teuthology.orchestra.run.smithi162.stdout: "req_readdir_latency": { 2024-06-02T04:20:08.328 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.328 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.328 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.329 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.329 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rename_latency": { 2024-06-02T04:20:08.329 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.329 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.329 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.329 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.329 INFO:teuthology.orchestra.run.smithi162.stdout: "req_renamesnap_latency": { 2024-06-02T04:20:08.329 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.329 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.329 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.329 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.329 INFO:teuthology.orchestra.run.smithi162.stdout: "req_snapdiff_latency": { 2024-06-02T04:20:08.329 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.329 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.330 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.330 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.330 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmdir_latency": { 2024-06-02T04:20:08.330 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.330 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.330 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.330 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.330 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmsnap_latency": { 2024-06-02T04:20:08.330 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.330 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.330 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.330 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.331 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmxattr_latency": { 2024-06-02T04:20:08.331 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.331 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.331 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.331 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.331 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setattr_latency": { 2024-06-02T04:20:08.331 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.331 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.331 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.331 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.331 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setdirlayout_latency": { 2024-06-02T04:20:08.331 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.331 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.331 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.332 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.332 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setfilelock_latency": { 2024-06-02T04:20:08.332 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.332 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.332 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.332 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.332 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setlayout_latency": { 2024-06-02T04:20:08.332 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.332 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.332 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.332 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.332 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setxattr_latency": { 2024-06-02T04:20:08.332 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.333 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.333 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.333 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.333 INFO:teuthology.orchestra.run.smithi162.stdout: "req_symlink_latency": { 2024-06-02T04:20:08.333 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.333 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.333 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.333 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.333 INFO:teuthology.orchestra.run.smithi162.stdout: "req_unlink_latency": { 2024-06-02T04:20:08.333 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.333 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.333 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.334 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.334 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_revoke_eviction": 0, 2024-06-02T04:20:08.334 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_acquisition_throttle": 0, 2024-06-02T04:20:08.334 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getvxattr_latency": { 2024-06-02T04:20:08.334 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.334 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.334 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.334 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:08.334 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.334 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_sessions": { 2024-06-02T04:20:08.334 INFO:teuthology.orchestra.run.smithi162.stdout: "session_count": 1, 2024-06-02T04:20:08.334 INFO:teuthology.orchestra.run.smithi162.stdout: "session_add": 1, 2024-06-02T04:20:08.335 INFO:teuthology.orchestra.run.smithi162.stdout: "session_remove": 0, 2024-06-02T04:20:08.335 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_open": 1, 2024-06-02T04:20:08.335 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_stale": 0, 2024-06-02T04:20:08.335 INFO:teuthology.orchestra.run.smithi162.stdout: "total_load": 0, 2024-06-02T04:20:08.335 INFO:teuthology.orchestra.run.smithi162.stdout: "average_load": 0, 2024-06-02T04:20:08.335 INFO:teuthology.orchestra.run.smithi162.stdout: "avg_session_uptime": 945, 2024-06-02T04:20:08.335 INFO:teuthology.orchestra.run.smithi162.stdout: "mdthresh_evicted": 0 2024-06-02T04:20:08.335 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.335 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-06-02T04:20:08.335 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-06-02T04:20:08.335 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-06-02T04:20:08.335 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T04:20:08.335 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-06-02T04:20:08.336 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T04:20:08.336 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-06-02T04:20:08.336 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T04:20:08.336 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T04:20:08.336 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T04:20:08.336 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T04:20:08.336 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T04:20:08.336 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-06-02T04:20:08.336 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T04:20:08.336 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T04:20:08.336 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-06-02T04:20:08.336 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-06-02T04:20:08.336 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-06-02T04:20:08.337 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-06-02T04:20:08.337 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T04:20:08.337 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T04:20:08.337 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T04:20:08.337 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T04:20:08.337 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T04:20:08.337 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-06-02T04:20:08.337 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-06-02T04:20:08.337 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-06-02T04:20:08.337 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T04:20:08.337 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T04:20:08.337 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-06-02T04:20:08.337 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-06-02T04:20:08.337 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-06-02T04:20:08.338 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-06-02T04:20:08.338 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T04:20:08.338 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-06-02T04:20:08.338 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T04:20:08.338 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-06-02T04:20:08.338 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 239111, 2024-06-02T04:20:08.338 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 80, 2024-06-02T04:20:08.338 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-06-02T04:20:08.338 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-06-02T04:20:08.338 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-06-02T04:20:08.338 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-06-02T04:20:08.338 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-06-02T04:20:08.339 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-06-02T04:20:08.339 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-06-02T04:20:08.339 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-06-02T04:20:08.339 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 7240, 2024-06-02T04:20:08.339 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 152, 2024-06-02T04:20:08.339 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T04:20:08.339 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-06-02T04:20:08.339 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-06-02T04:20:08.339 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-06-02T04:20:08.339 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 50032, 2024-06-02T04:20:08.339 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 197, 2024-06-02T04:20:08.339 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-06-02T04:20:08.340 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-06-02T04:20:08.340 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-06-02T04:20:08.340 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-06-02T04:20:08.340 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.340 INFO:teuthology.orchestra.run.smithi162.stdout: "objecter": { 2024-06-02T04:20:08.340 INFO:teuthology.orchestra.run.smithi162.stdout: "op_active": 0, 2024-06-02T04:20:08.340 INFO:teuthology.orchestra.run.smithi162.stdout: "op_laggy": 0, 2024-06-02T04:20:08.340 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send": 37, 2024-06-02T04:20:08.340 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send_bytes": 11066, 2024-06-02T04:20:08.340 INFO:teuthology.orchestra.run.smithi162.stdout: "op_resend": 27, 2024-06-02T04:20:08.340 INFO:teuthology.orchestra.run.smithi162.stdout: "op_reply": 37, 2024-06-02T04:20:08.340 INFO:teuthology.orchestra.run.smithi162.stdout: "op_latency": { 2024-06-02T04:20:08.340 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 37, 2024-06-02T04:20:08.341 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.262994702, 2024-06-02T04:20:08.341 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.007107964 2024-06-02T04:20:08.341 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.341 INFO:teuthology.orchestra.run.smithi162.stdout: "op_inflight": 0, 2024-06-02T04:20:08.341 INFO:teuthology.orchestra.run.smithi162.stdout: "oplen_avg": { 2024-06-02T04:20:08.341 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 37, 2024-06-02T04:20:08.341 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 59 2024-06-02T04:20:08.341 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.341 INFO:teuthology.orchestra.run.smithi162.stdout: "op": 37, 2024-06-02T04:20:08.341 INFO:teuthology.orchestra.run.smithi162.stdout: "op_r": 0, 2024-06-02T04:20:08.341 INFO:teuthology.orchestra.run.smithi162.stdout: "op_w": 37, 2024-06-02T04:20:08.341 INFO:teuthology.orchestra.run.smithi162.stdout: "op_rmw": 0, 2024-06-02T04:20:08.341 INFO:teuthology.orchestra.run.smithi162.stdout: "op_pg": 0, 2024-06-02T04:20:08.342 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_stat": 0, 2024-06-02T04:20:08.342 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_create": 10, 2024-06-02T04:20:08.342 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_read": 0, 2024-06-02T04:20:08.342 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_write": 2, 2024-06-02T04:20:08.342 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writefull": 6, 2024-06-02T04:20:08.342 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writesame": 0, 2024-06-02T04:20:08.342 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_append": 0, 2024-06-02T04:20:08.342 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_zero": 0, 2024-06-02T04:20:08.342 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_truncate": 0, 2024-06-02T04:20:08.342 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_delete": 6, 2024-06-02T04:20:08.342 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_mapext": 0, 2024-06-02T04:20:08.342 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_sparse_read": 0, 2024-06-02T04:20:08.342 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_clonerange": 0, 2024-06-02T04:20:08.343 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_getxattr": 0, 2024-06-02T04:20:08.343 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_setxattr": 20, 2024-06-02T04:20:08.343 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_cmpxattr": 0, 2024-06-02T04:20:08.343 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_rmxattr": 0, 2024-06-02T04:20:08.343 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_resetxattrs": 0, 2024-06-02T04:20:08.343 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_call": 0, 2024-06-02T04:20:08.343 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_watch": 0, 2024-06-02T04:20:08.343 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_notify": 0, 2024-06-02T04:20:08.343 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_src_cmpxattr": 0, 2024-06-02T04:20:08.343 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls": 0, 2024-06-02T04:20:08.343 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls_filter": 0, 2024-06-02T04:20:08.343 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_other": 0, 2024-06-02T04:20:08.343 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_active": 0, 2024-06-02T04:20:08.344 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_send": 0, 2024-06-02T04:20:08.344 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_resend": 0, 2024-06-02T04:20:08.344 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_ping": 0, 2024-06-02T04:20:08.344 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_active": 0, 2024-06-02T04:20:08.344 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_send": 0, 2024-06-02T04:20:08.344 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_resend": 0, 2024-06-02T04:20:08.344 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_active": 0, 2024-06-02T04:20:08.344 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_send": 0, 2024-06-02T04:20:08.344 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_resend": 0, 2024-06-02T04:20:08.344 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_active": 0, 2024-06-02T04:20:08.344 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_send": 0, 2024-06-02T04:20:08.344 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_resend": 0, 2024-06-02T04:20:08.344 INFO:teuthology.orchestra.run.smithi162.stdout: "command_active": 0, 2024-06-02T04:20:08.345 INFO:teuthology.orchestra.run.smithi162.stdout: "command_send": 0, 2024-06-02T04:20:08.345 INFO:teuthology.orchestra.run.smithi162.stdout: "command_resend": 0, 2024-06-02T04:20:08.345 INFO:teuthology.orchestra.run.smithi162.stdout: "map_epoch": 84, 2024-06-02T04:20:08.345 INFO:teuthology.orchestra.run.smithi162.stdout: "map_full": 0, 2024-06-02T04:20:08.345 INFO:teuthology.orchestra.run.smithi162.stdout: "map_inc": 2, 2024-06-02T04:20:08.345 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_sessions": 9, 2024-06-02T04:20:08.345 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_open": 14, 2024-06-02T04:20:08.345 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_close": 5, 2024-06-02T04:20:08.345 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_laggy": 0, 2024-06-02T04:20:08.345 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_wr": 14, 2024-06-02T04:20:08.345 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_rd": 0, 2024-06-02T04:20:08.345 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_del": 1 2024-06-02T04:20:08.345 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.345 INFO:teuthology.orchestra.run.smithi162.stdout: "oft": { 2024-06-02T04:20:08.346 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_objs": 1, 2024-06-02T04:20:08.346 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_kv_pairs": 0, 2024-06-02T04:20:08.346 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_updates": 0, 2024-06-02T04:20:08.346 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_removes": 0 2024-06-02T04:20:08.346 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.346 INFO:teuthology.orchestra.run.smithi162.stdout: "osd-slow-ops": { 2024-06-02T04:20:08.346 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_ops_count": 0 2024-06-02T04:20:08.346 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.346 INFO:teuthology.orchestra.run.smithi162.stdout: "purge_queue": { 2024-06-02T04:20:08.346 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops": 0, 2024-06-02T04:20:08.346 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops_high_water": 0, 2024-06-02T04:20:08.346 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing": 0, 2024-06-02T04:20:08.346 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_high_water": 0, 2024-06-02T04:20:08.347 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed": 0, 2024-06-02T04:20:08.347 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_item_in_journal": 0 2024-06-02T04:20:08.347 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.347 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T04:20:08.347 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-06-02T04:20:08.347 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-06-02T04:20:08.347 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-06-02T04:20:08.347 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 660, 2024-06-02T04:20:08.347 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 537688, 2024-06-02T04:20:08.347 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-06-02T04:20:08.347 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 660, 2024-06-02T04:20:08.347 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-06-02T04:20:08.347 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-06-02T04:20:08.348 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 660, 2024-06-02T04:20:08.348 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 537688, 2024-06-02T04:20:08.348 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-06-02T04:20:08.348 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.348 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.348 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.348 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:08.348 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.348 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_bytes": { 2024-06-02T04:20:08.348 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-06-02T04:20:08.348 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-06-02T04:20:08.348 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-06-02T04:20:08.348 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-06-02T04:20:08.348 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-06-02T04:20:08.349 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-06-02T04:20:08.349 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-06-02T04:20:08.349 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 37, 2024-06-02T04:20:08.349 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 11066, 2024-06-02T04:20:08.349 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 37, 2024-06-02T04:20:08.349 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 11066, 2024-06-02T04:20:08.349 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-06-02T04:20:08.349 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.349 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.349 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.349 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:08.349 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.349 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_ops": { 2024-06-02T04:20:08.350 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-06-02T04:20:08.350 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 1024, 2024-06-02T04:20:08.350 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-06-02T04:20:08.350 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-06-02T04:20:08.350 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-06-02T04:20:08.350 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-06-02T04:20:08.350 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-06-02T04:20:08.350 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 37, 2024-06-02T04:20:08.350 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 37, 2024-06-02T04:20:08.350 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 37, 2024-06-02T04:20:08.350 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 37, 2024-06-02T04:20:08.350 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-06-02T04:20:08.350 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.351 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.351 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.351 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:08.351 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.351 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle": { 2024-06-02T04:20:08.351 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-06-02T04:20:08.351 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-06-02T04:20:08.351 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-06-02T04:20:08.351 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-06-02T04:20:08.351 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-06-02T04:20:08.351 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-06-02T04:20:08.351 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-06-02T04:20:08.351 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-06-02T04:20:08.352 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-06-02T04:20:08.352 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 0, 2024-06-02T04:20:08.352 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 0, 2024-06-02T04:20:08.352 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-06-02T04:20:08.352 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.352 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.352 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.352 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:08.352 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:08.352 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle-0x56115c58a0a0": { 2024-06-02T04:20:08.352 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-06-02T04:20:08.352 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-06-02T04:20:08.352 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-06-02T04:20:08.353 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 2, 2024-06-02T04:20:08.353 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 854, 2024-06-02T04:20:08.353 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-06-02T04:20:08.353 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 2, 2024-06-02T04:20:08.353 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-06-02T04:20:08.353 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-06-02T04:20:08.353 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 2, 2024-06-02T04:20:08.353 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 854, 2024-06-02T04:20:08.353 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-06-02T04:20:08.353 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:08.353 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:08.353 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:08.353 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:08.354 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:08.354 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-06-02T04:20:08.690 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-06-02T04:20:08.690 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-06-02T04:20:08.690 DEBUG:tasks.check_counter:Getting stats from l 2024-06-02T04:20:08.690 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:3bb45379356e8aa965152e0b8c663715c5df9bda shell --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 -- ceph daemon mds.l perf dump 2024-06-02T04:20:08.915 INFO:teuthology.orchestra.run.smithi162.stderr:Inferring config /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/mon.c/config 2024-06-02T04:20:09.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:08 smithi162 ceph-mon[47009]: pgmap v734: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.7 KiB/s wr, 12 op/s 2024-06-02T04:20:09.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:08 smithi123 ceph-mon[42885]: pgmap v734: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.7 KiB/s wr, 12 op/s 2024-06-02T04:20:09.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:08 smithi136 ceph-mon[47443]: pgmap v734: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.7 KiB/s wr, 12 op/s 2024-06-02T04:20:10.376 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-06-02T04:20:10.376 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-0": { 2024-06-02T04:20:10.376 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 25, 2024-06-02T04:20:10.376 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 25, 2024-06-02T04:20:10.377 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 8213, 2024-06-02T04:20:10.377 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 47956, 2024-06-02T04:20:10.377 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 12, 2024-06-02T04:20:10.377 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 3, 2024-06-02T04:20:10.377 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.005688962, 2024-06-02T04:20:10.377 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.000425372, 2024-06-02T04:20:10.377 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.003606996, 2024-06-02T04:20:10.377 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000351539, 2024-06-02T04:20:10.377 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:20:10.377 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 24, 2024-06-02T04:20:10.377 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.023134313, 2024-06-02T04:20:10.377 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000963929 2024-06-02T04:20:10.377 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.378 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:20:10.378 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 4, 2024-06-02T04:20:10.378 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000352, 2024-06-02T04:20:10.378 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000088 2024-06-02T04:20:10.378 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.378 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-06-02T04:20:10.378 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 448 2024-06-02T04:20:10.378 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.378 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-1": { 2024-06-02T04:20:10.378 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 14, 2024-06-02T04:20:10.378 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 226, 2024-06-02T04:20:10.378 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 3611, 2024-06-02T04:20:10.379 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 533619, 2024-06-02T04:20:10.379 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 10, 2024-06-02T04:20:10.379 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 4, 2024-06-02T04:20:10.379 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.013673126, 2024-06-02T04:20:10.379 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.007700750, 2024-06-02T04:20:10.379 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.003725063, 2024-06-02T04:20:10.379 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.000257365, 2024-06-02T04:20:10.379 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:20:10.379 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 224, 2024-06-02T04:20:10.379 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.119323984, 2024-06-02T04:20:10.379 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000532696 2024-06-02T04:20:10.379 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.380 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:20:10.380 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.380 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.380 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.380 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.380 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 320, 2024-06-02T04:20:10.380 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 528032 2024-06-02T04:20:10.380 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.380 INFO:teuthology.orchestra.run.smithi162.stdout: "AsyncMessenger::Worker-2": { 2024-06-02T04:20:10.380 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_messages": 613, 2024-06-02T04:20:10.380 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages": 864, 2024-06-02T04:20:10.380 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_bytes": 592424, 2024-06-02T04:20:10.380 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_bytes": 259187, 2024-06-02T04:20:10.381 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_created_connections": 7, 2024-06-02T04:20:10.381 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_active_connections": 4, 2024-06-02T04:20:10.381 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_total_time": 0.085153354, 2024-06-02T04:20:10.381 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_send_time": 0.031397582, 2024-06-02T04:20:10.381 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_recv_time": 0.038410913, 2024-06-02T04:20:10.381 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_running_fast_dispatch_time": 0.012169120, 2024-06-02T04:20:10.381 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_messages_queue_lat": { 2024-06-02T04:20:10.381 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 863, 2024-06-02T04:20:10.381 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.283200360, 2024-06-02T04:20:10.381 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000328158 2024-06-02T04:20:10.381 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.381 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_handle_ack_lat": { 2024-06-02T04:20:10.381 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 819, 2024-06-02T04:20:10.382 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000260885, 2024-06-02T04:20:10.382 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000318 2024-06-02T04:20:10.382 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.382 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_recv_encrypted_bytes": 535696, 2024-06-02T04:20:10.382 INFO:teuthology.orchestra.run.smithi162.stdout: "msgr_send_encrypted_bytes": 166208 2024-06-02T04:20:10.382 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.382 INFO:teuthology.orchestra.run.smithi162.stdout: "cct": { 2024-06-02T04:20:10.382 INFO:teuthology.orchestra.run.smithi162.stdout: "total_workers": 1, 2024-06-02T04:20:10.382 INFO:teuthology.orchestra.run.smithi162.stdout: "unhealthy_workers": 0 2024-06-02T04:20:10.382 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.383 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-MDSRank": { 2024-06-02T04:20:10.383 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-06-02T04:20:10.383 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-06-02T04:20:10.383 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 27, 2024-06-02T04:20:10.383 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.001524720, 2024-06-02T04:20:10.383 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000056471 2024-06-02T04:20:10.383 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:10.383 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.383 INFO:teuthology.orchestra.run.smithi162.stdout: "finisher-PurgeQueue": { 2024-06-02T04:20:10.383 INFO:teuthology.orchestra.run.smithi162.stdout: "queue_len": 0, 2024-06-02T04:20:10.383 INFO:teuthology.orchestra.run.smithi162.stdout: "complete_latency": { 2024-06-02T04:20:10.384 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 2, 2024-06-02T04:20:10.384 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000007338, 2024-06-02T04:20:10.384 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000003669 2024-06-02T04:20:10.384 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:10.384 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.384 INFO:teuthology.orchestra.run.smithi162.stdout: "mds": { 2024-06-02T04:20:10.384 INFO:teuthology.orchestra.run.smithi162.stdout: "request": 0, 2024-06-02T04:20:10.384 INFO:teuthology.orchestra.run.smithi162.stdout: "reply": 0, 2024-06-02T04:20:10.384 INFO:teuthology.orchestra.run.smithi162.stdout: "reply_latency": { 2024-06-02T04:20:10.384 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.384 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.384 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.384 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.385 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_reply": 0, 2024-06-02T04:20:10.385 INFO:teuthology.orchestra.run.smithi162.stdout: "forward": 0, 2024-06-02T04:20:10.385 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_complete": 0, 2024-06-02T04:20:10.385 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_fetch_keys": 0, 2024-06-02T04:20:10.385 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_commit": 11, 2024-06-02T04:20:10.385 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_split": 0, 2024-06-02T04:20:10.385 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_merge": 0, 2024-06-02T04:20:10.385 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes": 10, 2024-06-02T04:20:10.385 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_top": 0, 2024-06-02T04:20:10.385 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_bottom": 10, 2024-06-02T04:20:10.386 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pin_tail": 0, 2024-06-02T04:20:10.386 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_pinned": 10, 2024-06-02T04:20:10.386 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_expired": 0, 2024-06-02T04:20:10.386 INFO:teuthology.orchestra.run.smithi162.stdout: "inodes_with_caps": 0, 2024-06-02T04:20:10.386 INFO:teuthology.orchestra.run.smithi162.stdout: "caps": 0, 2024-06-02T04:20:10.386 INFO:teuthology.orchestra.run.smithi162.stdout: "subtrees": 1, 2024-06-02T04:20:10.386 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse": 0, 2024-06-02T04:20:10.386 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_hit": 0, 2024-06-02T04:20:10.386 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_forward": 0, 2024-06-02T04:20:10.386 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_discover": 0, 2024-06-02T04:20:10.386 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_dir_fetch": 0, 2024-06-02T04:20:10.386 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_remote_ino": 0, 2024-06-02T04:20:10.387 INFO:teuthology.orchestra.run.smithi162.stdout: "traverse_lock": 0, 2024-06-02T04:20:10.387 INFO:teuthology.orchestra.run.smithi162.stdout: "load_cent": 0, 2024-06-02T04:20:10.387 INFO:teuthology.orchestra.run.smithi162.stdout: "q": 0, 2024-06-02T04:20:10.387 INFO:teuthology.orchestra.run.smithi162.stdout: "exported": 0, 2024-06-02T04:20:10.387 INFO:teuthology.orchestra.run.smithi162.stdout: "exported_inodes": 0, 2024-06-02T04:20:10.387 INFO:teuthology.orchestra.run.smithi162.stdout: "imported": 0, 2024-06-02T04:20:10.387 INFO:teuthology.orchestra.run.smithi162.stdout: "imported_inodes": 0, 2024-06-02T04:20:10.387 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_dir_fetch": 0, 2024-06-02T04:20:10.387 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_backtrace_fetch": 0, 2024-06-02T04:20:10.387 INFO:teuthology.orchestra.run.smithi162.stdout: "openino_peer_discover": 0, 2024-06-02T04:20:10.387 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rfiles": 1041, 2024-06-02T04:20:10.387 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rbytes": 1756938698, 2024-06-02T04:20:10.387 INFO:teuthology.orchestra.run.smithi162.stdout: "root_rsnaps": 0, 2024-06-02T04:20:10.388 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_fetch": 0, 2024-06-02T04:20:10.388 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_set_tag": 0, 2024-06-02T04:20:10.388 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_backtrace_repaired": 0, 2024-06-02T04:20:10.388 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_inotable_repaired": 0, 2024-06-02T04:20:10.388 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_inodes": 0, 2024-06-02T04:20:10.388 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dir_base_inodes": 0, 2024-06-02T04:20:10.388 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_dirfrag_rstats": 0, 2024-06-02T04:20:10.388 INFO:teuthology.orchestra.run.smithi162.stdout: "scrub_file_inodes": 0, 2024-06-02T04:20:10.388 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_inode_file_caps": 0, 2024-06-02T04:20:10.388 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_revoke": 0, 2024-06-02T04:20:10.388 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_grant": 0, 2024-06-02T04:20:10.388 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_trunc": 0, 2024-06-02T04:20:10.389 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-06-02T04:20:10.389 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_cap_op_flush_ack": 0, 2024-06-02T04:20:10.389 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps": 0, 2024-06-02T04:20:10.389 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_caps_dirty": 0, 2024-06-02T04:20:10.389 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_cap_release": 0, 2024-06-02T04:20:10.389 INFO:teuthology.orchestra.run.smithi162.stdout: "process_request_cap_release": 0 2024-06-02T04:20:10.389 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.389 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_cache": { 2024-06-02T04:20:10.389 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update": 0, 2024-06-02T04:20:10.389 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_update_receipt": 0, 2024-06-02T04:20:10.389 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_try_discover": 0, 2024-06-02T04:20:10.389 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_send_discover": 1, 2024-06-02T04:20:10.389 INFO:teuthology.orchestra.run.smithi162.stdout: "dir_handle_discover": 0, 2024-06-02T04:20:10.390 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays": 0, 2024-06-02T04:20:10.390 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_delayed": 0, 2024-06-02T04:20:10.390 INFO:teuthology.orchestra.run.smithi162.stdout: "num_strays_enqueuing": 0, 2024-06-02T04:20:10.390 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_created": 0, 2024-06-02T04:20:10.390 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_enqueued": 0, 2024-06-02T04:20:10.390 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_reintegrated": 0, 2024-06-02T04:20:10.390 INFO:teuthology.orchestra.run.smithi162.stdout: "strays_migrated": 0, 2024-06-02T04:20:10.390 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_processing": 0, 2024-06-02T04:20:10.390 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_enqueued": 0, 2024-06-02T04:20:10.390 INFO:teuthology.orchestra.run.smithi162.stdout: "num_recovering_prioritized": 0, 2024-06-02T04:20:10.390 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_started": 0, 2024-06-02T04:20:10.390 INFO:teuthology.orchestra.run.smithi162.stdout: "recovery_completed": 0, 2024-06-02T04:20:10.391 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_enqueue_scrub": 0, 2024-06-02T04:20:10.391 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_exportdir": 0, 2024-06-02T04:20:10.391 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_flush": 0, 2024-06-02T04:20:10.391 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragmentdir": 0, 2024-06-02T04:20:10.391 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_fragstats": 0, 2024-06-02T04:20:10.391 INFO:teuthology.orchestra.run.smithi162.stdout: "ireq_inodestats": 0 2024-06-02T04:20:10.391 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.391 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_log": { 2024-06-02T04:20:10.391 INFO:teuthology.orchestra.run.smithi162.stdout: "evadd": 1, 2024-06-02T04:20:10.391 INFO:teuthology.orchestra.run.smithi162.stdout: "evex": 0, 2024-06-02T04:20:10.391 INFO:teuthology.orchestra.run.smithi162.stdout: "evtrm": 0, 2024-06-02T04:20:10.391 INFO:teuthology.orchestra.run.smithi162.stdout: "ev": 1, 2024-06-02T04:20:10.391 INFO:teuthology.orchestra.run.smithi162.stdout: "evexg": 0, 2024-06-02T04:20:10.392 INFO:teuthology.orchestra.run.smithi162.stdout: "evexd": 0, 2024-06-02T04:20:10.392 INFO:teuthology.orchestra.run.smithi162.stdout: "segadd": 1, 2024-06-02T04:20:10.392 INFO:teuthology.orchestra.run.smithi162.stdout: "segex": 0, 2024-06-02T04:20:10.392 INFO:teuthology.orchestra.run.smithi162.stdout: "segtrm": 0, 2024-06-02T04:20:10.392 INFO:teuthology.orchestra.run.smithi162.stdout: "seg": 1, 2024-06-02T04:20:10.392 INFO:teuthology.orchestra.run.smithi162.stdout: "segexg": 0, 2024-06-02T04:20:10.392 INFO:teuthology.orchestra.run.smithi162.stdout: "segexd": 0, 2024-06-02T04:20:10.392 INFO:teuthology.orchestra.run.smithi162.stdout: "expos": 4194304, 2024-06-02T04:20:10.392 INFO:teuthology.orchestra.run.smithi162.stdout: "wrpos": 4194844, 2024-06-02T04:20:10.392 INFO:teuthology.orchestra.run.smithi162.stdout: "rdpos": 0, 2024-06-02T04:20:10.392 INFO:teuthology.orchestra.run.smithi162.stdout: "jlat": { 2024-06-02T04:20:10.392 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 1, 2024-06-02T04:20:10.392 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.001860104, 2024-06-02T04:20:10.392 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.001860104 2024-06-02T04:20:10.393 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.393 INFO:teuthology.orchestra.run.smithi162.stdout: "replayed": 0 2024-06-02T04:20:10.393 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.393 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_mem": { 2024-06-02T04:20:10.393 INFO:teuthology.orchestra.run.smithi162.stdout: "ino": 13, 2024-06-02T04:20:10.393 INFO:teuthology.orchestra.run.smithi162.stdout: "ino+": 13, 2024-06-02T04:20:10.393 INFO:teuthology.orchestra.run.smithi162.stdout: "ino-": 0, 2024-06-02T04:20:10.393 INFO:teuthology.orchestra.run.smithi162.stdout: "dir": 11, 2024-06-02T04:20:10.393 INFO:teuthology.orchestra.run.smithi162.stdout: "dir+": 12, 2024-06-02T04:20:10.393 INFO:teuthology.orchestra.run.smithi162.stdout: "dir-": 1, 2024-06-02T04:20:10.393 INFO:teuthology.orchestra.run.smithi162.stdout: "dn": 10, 2024-06-02T04:20:10.393 INFO:teuthology.orchestra.run.smithi162.stdout: "dn+": 10, 2024-06-02T04:20:10.393 INFO:teuthology.orchestra.run.smithi162.stdout: "dn-": 0, 2024-06-02T04:20:10.394 INFO:teuthology.orchestra.run.smithi162.stdout: "cap": 0, 2024-06-02T04:20:10.394 INFO:teuthology.orchestra.run.smithi162.stdout: "cap+": 0, 2024-06-02T04:20:10.394 INFO:teuthology.orchestra.run.smithi162.stdout: "cap-": 0, 2024-06-02T04:20:10.394 INFO:teuthology.orchestra.run.smithi162.stdout: "rss": 50220, 2024-06-02T04:20:10.394 INFO:teuthology.orchestra.run.smithi162.stdout: "heap": 198964 2024-06-02T04:20:10.394 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.394 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_server": { 2024-06-02T04:20:10.394 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_client_request": 0, 2024-06-02T04:20:10.394 INFO:teuthology.orchestra.run.smithi162.stdout: "dispatch_server_request": 0, 2024-06-02T04:20:10.394 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_request": 0, 2024-06-02T04:20:10.394 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_client_session": 0, 2024-06-02T04:20:10.394 INFO:teuthology.orchestra.run.smithi162.stdout: "handle_peer_request": 0, 2024-06-02T04:20:10.394 INFO:teuthology.orchestra.run.smithi162.stdout: "req_create_latency": { 2024-06-02T04:20:10.395 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.395 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.395 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.395 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.395 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getattr_latency": { 2024-06-02T04:20:10.395 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.395 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.395 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.395 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.395 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getfilelock_latency": { 2024-06-02T04:20:10.395 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.396 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.396 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.396 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.396 INFO:teuthology.orchestra.run.smithi162.stdout: "req_link_latency": { 2024-06-02T04:20:10.396 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.396 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.396 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.396 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.396 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookup_latency": { 2024-06-02T04:20:10.396 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.396 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.397 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.397 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.397 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookuphash_latency": { 2024-06-02T04:20:10.397 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.397 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.397 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.397 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.397 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupino_latency": { 2024-06-02T04:20:10.397 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.397 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.397 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.397 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.397 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupname_latency": { 2024-06-02T04:20:10.398 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.398 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.398 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.398 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.398 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupparent_latency": { 2024-06-02T04:20:10.398 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.398 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.398 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.398 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.398 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lookupsnap_latency": { 2024-06-02T04:20:10.398 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.398 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.399 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.399 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.399 INFO:teuthology.orchestra.run.smithi162.stdout: "req_lssnap_latency": { 2024-06-02T04:20:10.399 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.399 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.399 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.399 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.399 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mkdir_latency": { 2024-06-02T04:20:10.399 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.399 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.399 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.399 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.399 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mknod_latency": { 2024-06-02T04:20:10.399 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.400 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.400 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.400 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.400 INFO:teuthology.orchestra.run.smithi162.stdout: "req_mksnap_latency": { 2024-06-02T04:20:10.400 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.400 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.400 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.400 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.400 INFO:teuthology.orchestra.run.smithi162.stdout: "req_open_latency": { 2024-06-02T04:20:10.400 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.400 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.400 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.400 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.401 INFO:teuthology.orchestra.run.smithi162.stdout: "req_readdir_latency": { 2024-06-02T04:20:10.401 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.401 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.401 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.401 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.401 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rename_latency": { 2024-06-02T04:20:10.401 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.401 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.401 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.401 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.401 INFO:teuthology.orchestra.run.smithi162.stdout: "req_renamesnap_latency": { 2024-06-02T04:20:10.401 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.401 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.402 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.402 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.402 INFO:teuthology.orchestra.run.smithi162.stdout: "req_snapdiff_latency": { 2024-06-02T04:20:10.402 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.402 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.402 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.402 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.402 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmdir_latency": { 2024-06-02T04:20:10.402 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.402 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.402 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.402 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.403 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmsnap_latency": { 2024-06-02T04:20:10.403 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.403 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.403 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.403 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.403 INFO:teuthology.orchestra.run.smithi162.stdout: "req_rmxattr_latency": { 2024-06-02T04:20:10.403 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.403 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.403 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.403 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.403 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setattr_latency": { 2024-06-02T04:20:10.403 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.403 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.404 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.404 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.404 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setdirlayout_latency": { 2024-06-02T04:20:10.404 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.404 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.404 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.404 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.404 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setfilelock_latency": { 2024-06-02T04:20:10.404 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.404 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.404 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.404 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.404 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setlayout_latency": { 2024-06-02T04:20:10.405 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.405 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.405 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.405 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.405 INFO:teuthology.orchestra.run.smithi162.stdout: "req_setxattr_latency": { 2024-06-02T04:20:10.405 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.405 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.405 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.405 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.405 INFO:teuthology.orchestra.run.smithi162.stdout: "req_symlink_latency": { 2024-06-02T04:20:10.405 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.405 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.405 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.406 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.406 INFO:teuthology.orchestra.run.smithi162.stdout: "req_unlink_latency": { 2024-06-02T04:20:10.406 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.406 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.406 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.406 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.406 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_revoke_eviction": 0, 2024-06-02T04:20:10.406 INFO:teuthology.orchestra.run.smithi162.stdout: "cap_acquisition_throttle": 0, 2024-06-02T04:20:10.406 INFO:teuthology.orchestra.run.smithi162.stdout: "req_getvxattr_latency": { 2024-06-02T04:20:10.406 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.406 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.406 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.407 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:10.407 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.407 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_sessions": { 2024-06-02T04:20:10.407 INFO:teuthology.orchestra.run.smithi162.stdout: "session_count": 0, 2024-06-02T04:20:10.407 INFO:teuthology.orchestra.run.smithi162.stdout: "session_add": 0, 2024-06-02T04:20:10.407 INFO:teuthology.orchestra.run.smithi162.stdout: "session_remove": 0, 2024-06-02T04:20:10.407 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_open": 0, 2024-06-02T04:20:10.407 INFO:teuthology.orchestra.run.smithi162.stdout: "sessions_stale": 0, 2024-06-02T04:20:10.407 INFO:teuthology.orchestra.run.smithi162.stdout: "total_load": 0, 2024-06-02T04:20:10.407 INFO:teuthology.orchestra.run.smithi162.stdout: "average_load": 0, 2024-06-02T04:20:10.407 INFO:teuthology.orchestra.run.smithi162.stdout: "avg_session_uptime": 0, 2024-06-02T04:20:10.407 INFO:teuthology.orchestra.run.smithi162.stdout: "mdthresh_evicted": 0 2024-06-02T04:20:10.407 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.408 INFO:teuthology.orchestra.run.smithi162.stdout: "mempool": { 2024-06-02T04:20:10.408 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_bytes": 0, 2024-06-02T04:20:10.408 INFO:teuthology.orchestra.run.smithi162.stdout: "bloom_filter_items": 0, 2024-06-02T04:20:10.408 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_bytes": 0, 2024-06-02T04:20:10.408 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_alloc_items": 0, 2024-06-02T04:20:10.408 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_bytes": 0, 2024-06-02T04:20:10.408 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_data_items": 0, 2024-06-02T04:20:10.408 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_bytes": 0, 2024-06-02T04:20:10.408 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_onode_items": 0, 2024-06-02T04:20:10.408 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_bytes": 0, 2024-06-02T04:20:10.408 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_meta_items": 0, 2024-06-02T04:20:10.408 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_bytes": 0, 2024-06-02T04:20:10.408 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_other_items": 0, 2024-06-02T04:20:10.409 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_bytes": 0, 2024-06-02T04:20:10.409 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_cache_buffer_items": 0, 2024-06-02T04:20:10.409 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_bytes": 0, 2024-06-02T04:20:10.409 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_extent_items": 0, 2024-06-02T04:20:10.409 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_bytes": 0, 2024-06-02T04:20:10.409 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_blob_items": 0, 2024-06-02T04:20:10.409 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_bytes": 0, 2024-06-02T04:20:10.409 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_shared_blob_items": 0, 2024-06-02T04:20:10.409 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_bytes": 0, 2024-06-02T04:20:10.409 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_inline_bl_items": 0, 2024-06-02T04:20:10.409 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_bytes": 0, 2024-06-02T04:20:10.409 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_fsck_items": 0, 2024-06-02T04:20:10.409 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_bytes": 0, 2024-06-02T04:20:10.410 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_txc_items": 0, 2024-06-02T04:20:10.410 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_bytes": 0, 2024-06-02T04:20:10.410 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_deferred_items": 0, 2024-06-02T04:20:10.410 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_bytes": 0, 2024-06-02T04:20:10.410 INFO:teuthology.orchestra.run.smithi162.stdout: "bluestore_writing_items": 0, 2024-06-02T04:20:10.410 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_bytes": 0, 2024-06-02T04:20:10.410 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_items": 0, 2024-06-02T04:20:10.410 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_bytes": 0, 2024-06-02T04:20:10.410 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_reader_items": 0, 2024-06-02T04:20:10.410 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_bytes": 0, 2024-06-02T04:20:10.410 INFO:teuthology.orchestra.run.smithi162.stdout: "bluefs_file_writer_items": 0, 2024-06-02T04:20:10.410 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_bytes": 230583, 2024-06-02T04:20:10.411 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_anon_items": 70, 2024-06-02T04:20:10.411 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_bytes": 0, 2024-06-02T04:20:10.411 INFO:teuthology.orchestra.run.smithi162.stdout: "buffer_meta_items": 0, 2024-06-02T04:20:10.411 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_bytes": 0, 2024-06-02T04:20:10.411 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_items": 0, 2024-06-02T04:20:10.411 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_bytes": 0, 2024-06-02T04:20:10.411 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_mapbl_items": 0, 2024-06-02T04:20:10.411 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_bytes": 0, 2024-06-02T04:20:10.411 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_pglog_items": 0, 2024-06-02T04:20:10.411 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_bytes": 7240, 2024-06-02T04:20:10.411 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_items": 152, 2024-06-02T04:20:10.411 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_bytes": 0, 2024-06-02T04:20:10.411 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_mapping_items": 0, 2024-06-02T04:20:10.412 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_bytes": 0, 2024-06-02T04:20:10.412 INFO:teuthology.orchestra.run.smithi162.stdout: "pgmap_items": 0, 2024-06-02T04:20:10.412 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_bytes": 50032, 2024-06-02T04:20:10.412 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_co_items": 197, 2024-06-02T04:20:10.412 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_bytes": 0, 2024-06-02T04:20:10.412 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_1_items": 0, 2024-06-02T04:20:10.412 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_bytes": 0, 2024-06-02T04:20:10.412 INFO:teuthology.orchestra.run.smithi162.stdout: "unittest_2_items": 0 2024-06-02T04:20:10.412 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.412 INFO:teuthology.orchestra.run.smithi162.stdout: "objecter": { 2024-06-02T04:20:10.413 INFO:teuthology.orchestra.run.smithi162.stdout: "op_active": 0, 2024-06-02T04:20:10.413 INFO:teuthology.orchestra.run.smithi162.stdout: "op_laggy": 0, 2024-06-02T04:20:10.413 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send": 35, 2024-06-02T04:20:10.413 INFO:teuthology.orchestra.run.smithi162.stdout: "op_send_bytes": 10662, 2024-06-02T04:20:10.413 INFO:teuthology.orchestra.run.smithi162.stdout: "op_resend": 33, 2024-06-02T04:20:10.413 INFO:teuthology.orchestra.run.smithi162.stdout: "op_reply": 35, 2024-06-02T04:20:10.413 INFO:teuthology.orchestra.run.smithi162.stdout: "op_latency": { 2024-06-02T04:20:10.413 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 35, 2024-06-02T04:20:10.413 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.217995616, 2024-06-02T04:20:10.413 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.006228446 2024-06-02T04:20:10.413 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.413 INFO:teuthology.orchestra.run.smithi162.stdout: "op_inflight": 0, 2024-06-02T04:20:10.413 INFO:teuthology.orchestra.run.smithi162.stdout: "oplen_avg": { 2024-06-02T04:20:10.413 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 35, 2024-06-02T04:20:10.414 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 57 2024-06-02T04:20:10.414 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.414 INFO:teuthology.orchestra.run.smithi162.stdout: "op": 35, 2024-06-02T04:20:10.414 INFO:teuthology.orchestra.run.smithi162.stdout: "op_r": 0, 2024-06-02T04:20:10.414 INFO:teuthology.orchestra.run.smithi162.stdout: "op_w": 35, 2024-06-02T04:20:10.414 INFO:teuthology.orchestra.run.smithi162.stdout: "op_rmw": 0, 2024-06-02T04:20:10.414 INFO:teuthology.orchestra.run.smithi162.stdout: "op_pg": 0, 2024-06-02T04:20:10.414 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_stat": 0, 2024-06-02T04:20:10.414 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_create": 10, 2024-06-02T04:20:10.414 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_read": 0, 2024-06-02T04:20:10.414 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_write": 1, 2024-06-02T04:20:10.414 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writefull": 5, 2024-06-02T04:20:10.415 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_writesame": 0, 2024-06-02T04:20:10.415 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_append": 0, 2024-06-02T04:20:10.415 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_zero": 0, 2024-06-02T04:20:10.415 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_truncate": 0, 2024-06-02T04:20:10.415 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_delete": 6, 2024-06-02T04:20:10.415 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_mapext": 0, 2024-06-02T04:20:10.415 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_sparse_read": 0, 2024-06-02T04:20:10.415 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_clonerange": 0, 2024-06-02T04:20:10.415 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_getxattr": 0, 2024-06-02T04:20:10.415 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_setxattr": 20, 2024-06-02T04:20:10.415 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_cmpxattr": 0, 2024-06-02T04:20:10.415 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_rmxattr": 0, 2024-06-02T04:20:10.416 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_resetxattrs": 0, 2024-06-02T04:20:10.416 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_call": 0, 2024-06-02T04:20:10.416 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_watch": 0, 2024-06-02T04:20:10.416 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_notify": 0, 2024-06-02T04:20:10.416 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_src_cmpxattr": 0, 2024-06-02T04:20:10.416 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls": 0, 2024-06-02T04:20:10.416 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_pgls_filter": 0, 2024-06-02T04:20:10.416 INFO:teuthology.orchestra.run.smithi162.stdout: "osdop_other": 0, 2024-06-02T04:20:10.416 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_active": 0, 2024-06-02T04:20:10.416 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_send": 0, 2024-06-02T04:20:10.416 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_resend": 0, 2024-06-02T04:20:10.416 INFO:teuthology.orchestra.run.smithi162.stdout: "linger_ping": 0, 2024-06-02T04:20:10.416 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_active": 0, 2024-06-02T04:20:10.416 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_send": 0, 2024-06-02T04:20:10.417 INFO:teuthology.orchestra.run.smithi162.stdout: "poolop_resend": 0, 2024-06-02T04:20:10.417 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_active": 0, 2024-06-02T04:20:10.417 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_send": 0, 2024-06-02T04:20:10.417 INFO:teuthology.orchestra.run.smithi162.stdout: "poolstat_resend": 0, 2024-06-02T04:20:10.417 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_active": 0, 2024-06-02T04:20:10.417 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_send": 0, 2024-06-02T04:20:10.417 INFO:teuthology.orchestra.run.smithi162.stdout: "statfs_resend": 0, 2024-06-02T04:20:10.417 INFO:teuthology.orchestra.run.smithi162.stdout: "command_active": 0, 2024-06-02T04:20:10.417 INFO:teuthology.orchestra.run.smithi162.stdout: "command_send": 0, 2024-06-02T04:20:10.417 INFO:teuthology.orchestra.run.smithi162.stdout: "command_resend": 0, 2024-06-02T04:20:10.417 INFO:teuthology.orchestra.run.smithi162.stdout: "map_epoch": 84, 2024-06-02T04:20:10.417 INFO:teuthology.orchestra.run.smithi162.stdout: "map_full": 0, 2024-06-02T04:20:10.417 INFO:teuthology.orchestra.run.smithi162.stdout: "map_inc": 2, 2024-06-02T04:20:10.418 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_sessions": 8, 2024-06-02T04:20:10.418 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_open": 14, 2024-06-02T04:20:10.418 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_session_close": 6, 2024-06-02T04:20:10.418 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_laggy": 0, 2024-06-02T04:20:10.418 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_wr": 14, 2024-06-02T04:20:10.418 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_rd": 0, 2024-06-02T04:20:10.418 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_del": 1 2024-06-02T04:20:10.418 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.418 INFO:teuthology.orchestra.run.smithi162.stdout: "oft": { 2024-06-02T04:20:10.418 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_objs": 1, 2024-06-02T04:20:10.418 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_kv_pairs": 0, 2024-06-02T04:20:10.419 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_updates": 0, 2024-06-02T04:20:10.419 INFO:teuthology.orchestra.run.smithi162.stdout: "omap_total_removes": 0 2024-06-02T04:20:10.419 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.419 INFO:teuthology.orchestra.run.smithi162.stdout: "osd-slow-ops": { 2024-06-02T04:20:10.419 INFO:teuthology.orchestra.run.smithi162.stdout: "slow_ops_count": 0 2024-06-02T04:20:10.419 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.419 INFO:teuthology.orchestra.run.smithi162.stdout: "purge_queue": { 2024-06-02T04:20:10.419 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops": 0, 2024-06-02T04:20:10.419 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_ops_high_water": 0, 2024-06-02T04:20:10.419 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing": 0, 2024-06-02T04:20:10.419 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executing_high_water": 0, 2024-06-02T04:20:10.419 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_executed": 0, 2024-06-02T04:20:10.419 INFO:teuthology.orchestra.run.smithi162.stdout: "pq_item_in_journal": 0 2024-06-02T04:20:10.420 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.420 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-06-02T04:20:10.420 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-06-02T04:20:10.420 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-06-02T04:20:10.420 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-06-02T04:20:10.420 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 648, 2024-06-02T04:20:10.420 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 526352, 2024-06-02T04:20:10.420 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-06-02T04:20:10.420 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 648, 2024-06-02T04:20:10.420 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-06-02T04:20:10.420 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-06-02T04:20:10.420 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 648, 2024-06-02T04:20:10.421 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 526352, 2024-06-02T04:20:10.421 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-06-02T04:20:10.421 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.421 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.421 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.421 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:10.421 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.421 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_bytes": { 2024-06-02T04:20:10.421 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-06-02T04:20:10.421 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 104857600, 2024-06-02T04:20:10.421 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-06-02T04:20:10.421 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-06-02T04:20:10.421 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-06-02T04:20:10.422 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-06-02T04:20:10.422 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-06-02T04:20:10.422 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 35, 2024-06-02T04:20:10.422 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 10662, 2024-06-02T04:20:10.422 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 35, 2024-06-02T04:20:10.422 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 10662, 2024-06-02T04:20:10.422 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-06-02T04:20:10.422 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.422 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.422 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.422 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:10.422 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.422 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-objecter_ops": { 2024-06-02T04:20:10.423 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-06-02T04:20:10.423 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 1024, 2024-06-02T04:20:10.423 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-06-02T04:20:10.423 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-06-02T04:20:10.423 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-06-02T04:20:10.423 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-06-02T04:20:10.423 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-06-02T04:20:10.423 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 35, 2024-06-02T04:20:10.423 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 35, 2024-06-02T04:20:10.423 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 35, 2024-06-02T04:20:10.423 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 35, 2024-06-02T04:20:10.423 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-06-02T04:20:10.424 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.424 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.424 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.424 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:10.424 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.424 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle": { 2024-06-02T04:20:10.424 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-06-02T04:20:10.424 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-06-02T04:20:10.424 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-06-02T04:20:10.424 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 0, 2024-06-02T04:20:10.424 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 0, 2024-06-02T04:20:10.424 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-06-02T04:20:10.424 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 0, 2024-06-02T04:20:10.425 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-06-02T04:20:10.425 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-06-02T04:20:10.425 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 0, 2024-06-02T04:20:10.425 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 0, 2024-06-02T04:20:10.425 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-06-02T04:20:10.425 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.425 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.425 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.425 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:10.425 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-06-02T04:20:10.425 INFO:teuthology.orchestra.run.smithi162.stdout: "throttle-write_buf_throttle-0x55dcd81480a0": { 2024-06-02T04:20:10.425 INFO:teuthology.orchestra.run.smithi162.stdout: "val": 0, 2024-06-02T04:20:10.425 INFO:teuthology.orchestra.run.smithi162.stdout: "max": 3758096384, 2024-06-02T04:20:10.425 INFO:teuthology.orchestra.run.smithi162.stdout: "get_started": 0, 2024-06-02T04:20:10.426 INFO:teuthology.orchestra.run.smithi162.stdout: "get": 1, 2024-06-02T04:20:10.426 INFO:teuthology.orchestra.run.smithi162.stdout: "get_sum": 540, 2024-06-02T04:20:10.426 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_fail": 0, 2024-06-02T04:20:10.426 INFO:teuthology.orchestra.run.smithi162.stdout: "get_or_fail_success": 1, 2024-06-02T04:20:10.426 INFO:teuthology.orchestra.run.smithi162.stdout: "take": 0, 2024-06-02T04:20:10.426 INFO:teuthology.orchestra.run.smithi162.stdout: "take_sum": 0, 2024-06-02T04:20:10.426 INFO:teuthology.orchestra.run.smithi162.stdout: "put": 1, 2024-06-02T04:20:10.426 INFO:teuthology.orchestra.run.smithi162.stdout: "put_sum": 540, 2024-06-02T04:20:10.426 INFO:teuthology.orchestra.run.smithi162.stdout: "wait": { 2024-06-02T04:20:10.426 INFO:teuthology.orchestra.run.smithi162.stdout: "avgcount": 0, 2024-06-02T04:20:10.426 INFO:teuthology.orchestra.run.smithi162.stdout: "sum": 0.000000000, 2024-06-02T04:20:10.426 INFO:teuthology.orchestra.run.smithi162.stdout: "avgtime": 0.000000000 2024-06-02T04:20:10.426 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:10.427 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-06-02T04:20:10.427 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-06-02T04:20:10.747 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-06-02T04:20:10.747 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-06-02T04:20:10.748 ERROR:teuthology.run_tasks:Manager failed: check-counter Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e1979f064b0becde2020282c7e87cf3c5e98026c/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_e1979f064b0becde2020282c7e87cf3c5e98026c/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph_111a617aaeda17ec8908c7a46e47c4a09ebf905d/qa/tasks/check_counter.py", line 125, in end raise RuntimeError("The following counters failed to be set " RuntimeError: The following counters failed to be set on mds daemons: {'mds.imported', 'mds.exported'} 2024-06-02T04:20:10.749 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-06-02T04:20:10.760 INFO:tasks.kclient:Unmounting kernel clients... 2024-06-02T04:20:10.760 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-06-02T04:20:10.760 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T04:20:10.786 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-06-02T04:20:10.786 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T04:20:10.797 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:10 smithi162 ceph-mon[47009]: pgmap v735: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.7 KiB/s wr, 13 op/s 2024-06-02T04:20:10.849 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:20:10.920 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:10 smithi123 ceph-mon[42885]: pgmap v735: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.7 KiB/s wr, 13 op/s 2024-06-02T04:20:11.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.051+0000 7f49169fb700 1 -- 172.21.15.123:0/3042179454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4910102980 msgr2=0x7f49101092a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:11.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.051+0000 7f49169fb700 1 --2- 172.21.15.123:0/3042179454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4910102980 0x7f49101092a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f490800b0a0 tx=0x7f490800b3b0 comp rx=0 tx=0).stop 2024-06-02T04:20:11.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.051+0000 7f49169fb700 1 -- 172.21.15.123:0/3042179454 shutdown_connections 2024-06-02T04:20:11.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.051+0000 7f49169fb700 1 --2- 172.21.15.123:0/3042179454 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4910102980 0x7f49101092a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:11.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.051+0000 7f49169fb700 1 --2- 172.21.15.123:0/3042179454 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4910100e70 0x7f4910101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:11.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.051+0000 7f49169fb700 1 --2- 172.21.15.123:0/3042179454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4910101fc0 0x7f4910102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:11.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.051+0000 7f49169fb700 1 -- 172.21.15.123:0/3042179454 >> 172.21.15.123:0/3042179454 conn(0x7f49100fc400 msgr2=0x7f49100fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:20:11.051 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.051+0000 7f49169fb700 1 -- 172.21.15.123:0/3042179454 shutdown_connections 2024-06-02T04:20:11.052 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.051+0000 7f49169fb700 1 -- 172.21.15.123:0/3042179454 wait complete. 2024-06-02T04:20:11.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.052+0000 7f49169fb700 1 Processor -- start 2024-06-02T04:20:11.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.052+0000 7f49169fb700 1 -- start start 2024-06-02T04:20:11.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.053+0000 7f49169fb700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4910100e70 0x7f4910196ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:11.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.053+0000 7f49169fb700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4910101fc0 0x7f4910197410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:11.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.053+0000 7f49169fb700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4910102980 0x7f491019e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:11.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.053+0000 7f49169fb700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491019ea00 con 0x7f4910100e70 2024-06-02T04:20:11.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.053+0000 7f49169fb700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491019eb40 con 0x7f4910102980 2024-06-02T04:20:11.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.053+0000 7f49169fb700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491019ecd0 con 0x7f4910101fc0 2024-06-02T04:20:11.054 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.053+0000 7f490ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4910100e70 0x7f4910196ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:11.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.053+0000 7f490ffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4910100e70 0x7f4910196ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38284/0 (socket says 172.21.15.123:38284) 2024-06-02T04:20:11.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.053+0000 7f490ffff700 1 -- 172.21.15.123:0/2107000000 learned_addr learned my addr 172.21.15.123:0/2107000000 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:20:11.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.053+0000 7f490f7fe700 1 --2- 172.21.15.123:0/2107000000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4910101fc0 0x7f4910197410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:11.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.053+0000 7f4914f98700 1 --2- 172.21.15.123:0/2107000000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4910102980 0x7f491019e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:11.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.053+0000 7f490ffff700 1 -- 172.21.15.123:0/2107000000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4910101fc0 msgr2=0x7f4910197410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:11.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.053+0000 7f490ffff700 1 --2- 172.21.15.123:0/2107000000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4910101fc0 0x7f4910197410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:11.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.053+0000 7f490ffff700 1 -- 172.21.15.123:0/2107000000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4910102980 msgr2=0x7f491019e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:11.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.053+0000 7f490ffff700 1 --2- 172.21.15.123:0/2107000000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4910102980 0x7f491019e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:11.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.053+0000 7f490ffff700 1 -- 172.21.15.123:0/2107000000 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4908009d00 con 0x7f4910100e70 2024-06-02T04:20:11.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.053+0000 7f490f7fe700 1 --2- 172.21.15.123:0/2107000000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4910101fc0 0x7f4910197410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:20:11.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.053+0000 7f4914f98700 1 --2- 172.21.15.123:0/2107000000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4910102980 0x7f491019e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:20:11.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.053+0000 7f490ffff700 1 --2- 172.21.15.123:0/2107000000 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4910100e70 0x7f4910196ed0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f490000d950 tx=0x7f490000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:20:11.055 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.053+0000 7f490d7fa700 1 -- 172.21.15.123:0/2107000000 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4900009940 con 0x7f4910100e70 2024-06-02T04:20:11.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.054+0000 7f490d7fa700 1 -- 172.21.15.123:0/2107000000 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4900010460 con 0x7f4910100e70 2024-06-02T04:20:11.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.054+0000 7f49169fb700 1 -- 172.21.15.123:0/2107000000 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f491019efb0 con 0x7f4910100e70 2024-06-02T04:20:11.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.054+0000 7f490d7fa700 1 -- 172.21.15.123:0/2107000000 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490000f620 con 0x7f4910100e70 2024-06-02T04:20:11.056 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.054+0000 7f49169fb700 1 -- 172.21.15.123:0/2107000000 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f491019f3d0 con 0x7f4910100e70 2024-06-02T04:20:11.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.055+0000 7f49169fb700 1 -- 172.21.15.123:0/2107000000 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4910108260 con 0x7f4910100e70 2024-06-02T04:20:11.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.056+0000 7f490d7fa700 1 -- 172.21.15.123:0/2107000000 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f49000108d0 con 0x7f4910100e70 2024-06-02T04:20:11.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.057+0000 7f490d7fa700 1 --2- 172.21.15.123:0/2107000000 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f48f80a1120 0x7f48f80a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:11.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.057+0000 7f490d7fa700 1 -- 172.21.15.123:0/2107000000 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f49000cc690 con 0x7f4910100e70 2024-06-02T04:20:11.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.057+0000 7f490f7fe700 1 --2- 172.21.15.123:0/2107000000 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f48f80a1120 0x7f48f80a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:11.057 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.058+0000 7f490f7fe700 1 --2- 172.21.15.123:0/2107000000 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f48f80a1120 0x7f48f80a35e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4904011490 tx=0x7f4904009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:20:11.061 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.061+0000 7f490d7fa700 1 -- 172.21.15.123:0/2107000000 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4900095ee0 con 0x7f4910100e70 2024-06-02T04:20:11.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:10 smithi136 ceph-mon[47443]: pgmap v735: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.7 KiB/s wr, 13 op/s 2024-06-02T04:20:11.270 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.270+0000 7f49169fb700 1 -- 172.21.15.123:0/2107000000 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f491010c6f0 con 0x7f4910100e70 2024-06-02T04:20:11.271 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.271+0000 7f490d7fa700 1 -- 172.21.15.123:0/2107000000 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22468 (secure 0 0 0) 0x7f4900016090 con 0x7f4910100e70 2024-06-02T04:20:11.271 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:20:11.272 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":84,"fsid":"1b432ae0-2094-11ef-bc9b-c7b262605968","created":"2024-06-02T03:57:17.383774+0000","modified":"2024-06-02T04:04:08.620765+0000","last_up_change":"2024-06-02T04:02:34.535591+0000","last_in_change":"2024-06-02T04:02:18.346560+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T03:59:57.079448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:03:05.199881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:03:05.853741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d9d8fb5a-dac5-4b14-98e5-665bdbc696ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6803","nonce":2763421276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6805","nonce":2763421276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6809","nonce":2763421276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6807","nonce":2763421276}]},"public_addr":"172.21.15.123:6803/2763421276","cluster_addr":"172.21.15.123:6805/2763421276","heartbeat_back_addr":"172.21.15.123:6809/2763421276","heartbeat_front_addr":"172.21.15.123:6807/2763421276","state":["exists","up"]},{"osd":1,"uuid":"121bbe3c-bb76-4ec4-9596-37db68fbf1ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6801","nonce":956325510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6803","nonce":956325510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6807","nonce":956325510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6805","nonce":956325510}]},"public_addr":"172.21.15.136:6801/956325510","cluster_addr":"172.21.15.136:6803/956325510","heartbeat_back_addr":"172.21.15.136:6807/956325510","heartbeat_front_addr":"172.21.15.136:6805/956325510","state":["exists","up"]},{"osd":2,"uuid":"df9edf0d-f9f0-4699-a6ed-bbcf2dfb1b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6801","nonce":2915749676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6803","nonce":2915749676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6807","nonce":2915749676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6805","nonce":2915749676}]},"public_addr":"172.21.15.162:6801/2915749676","cluster_addr":"172.21.15.162:6803/2915749676","heartbeat_back_addr":"172.21.15.162:6807/2915749676","heartbeat_front_addr":"172.21.15.162:6805/2915749676","state":["exists","up"]},{"osd":3,"uuid":"3e070364-12c6-4780-b2be-f6e933e65773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6811","nonce":1403773143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6813","nonce":1403773143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6817","nonce":1403773143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6815","nonce":1403773143}]},"public_addr":"172.21.15.123:6811/1403773143","cluster_addr":"172.21.15.123:6813/1403773143","heartbeat_back_addr":"172.21.15.123:6817/1403773143","heartbeat_front_addr":"172.21.15.123:6815/1403773143","state":["exists","up"]},{"osd":4,"uuid":"87dd92dd-73c8-4785-bf8a-3756d79dee90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6809","nonce":1403526782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6811","nonce":1403526782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6815","nonce":1403526782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6813","nonce":1403526782}]},"public_addr":"172.21.15.136:6809/1403526782","cluster_addr":"172.21.15.136:6811/1403526782","heartbeat_back_addr":"172.21.15.136:6815/1403526782","heartbeat_front_addr":"172.21.15.136:6813/1403526782","state":["exists","up"]},{"osd":5,"uuid":"1a730863-6b56-43b7-a115-c80d3c8f3ee3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6809","nonce":3094256489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6811","nonce":3094256489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6815","nonce":3094256489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6813","nonce":3094256489}]},"public_addr":"172.21.15.162:6809/3094256489","cluster_addr":"172.21.15.162:6811/3094256489","heartbeat_back_addr":"172.21.15.162:6815/3094256489","heartbeat_front_addr":"172.21.15.162:6813/3094256489","state":["exists","up"]},{"osd":6,"uuid":"6f170b85-6c47-49ff-ba5b-7fe0596a4ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6819","nonce":3025820432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6821","nonce":3025820432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6825","nonce":3025820432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6823","nonce":3025820432}]},"public_addr":"172.21.15.123:6819/3025820432","cluster_addr":"172.21.15.123:6821/3025820432","heartbeat_back_addr":"172.21.15.123:6825/3025820432","heartbeat_front_addr":"172.21.15.123:6823/3025820432","state":["exists","up"]},{"osd":7,"uuid":"ee66bb7a-6c0d-4e5a-b717-258a39f93a87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6817","nonce":1948829505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6819","nonce":1948829505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6823","nonce":1948829505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6821","nonce":1948829505}]},"public_addr":"172.21.15.136:6817/1948829505","cluster_addr":"172.21.15.136:6819/1948829505","heartbeat_back_addr":"172.21.15.136:6823/1948829505","heartbeat_front_addr":"172.21.15.136:6821/1948829505","state":["exists","up"]},{"osd":8,"uuid":"0ff77e33-53a5-43ef-85da-2036a1fcdb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6817","nonce":1590839230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6819","nonce":1590839230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6823","nonce":1590839230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6821","nonce":1590839230}]},"public_addr":"172.21.15.162:6817/1590839230","cluster_addr":"172.21.15.162:6819/1590839230","heartbeat_back_addr":"172.21.15.162:6823/1590839230","heartbeat_front_addr":"172.21.15.162:6821/1590839230","state":["exists","up"]},{"osd":9,"uuid":"1670731c-5e8f-4cbc-8f35-6aeb14ea3075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6827","nonce":608720685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6829","nonce":608720685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6833","nonce":608720685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6831","nonce":608720685}]},"public_addr":"172.21.15.123:6827/608720685","cluster_addr":"172.21.15.123:6829/608720685","heartbeat_back_addr":"172.21.15.123:6833/608720685","heartbeat_front_addr":"172.21.15.123:6831/608720685","state":["exists","up"]},{"osd":10,"uuid":"ae138b96-13e7-46ac-9d4d-48308132465d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6825","nonce":3777263126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6827","nonce":3777263126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6831","nonce":3777263126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6829","nonce":3777263126}]},"public_addr":"172.21.15.136:6825/3777263126","cluster_addr":"172.21.15.136:6827/3777263126","heartbeat_back_addr":"172.21.15.136:6831/3777263126","heartbeat_front_addr":"172.21.15.136:6829/3777263126","state":["exists","up"]},{"osd":11,"uuid":"69f4ede0-7e9b-4edb-be54-01f74f002a06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6825","nonce":704809754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6827","nonce":704809754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6831","nonce":704809754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6829","nonce":704809754}]},"public_addr":"172.21.15.162:6825/704809754","cluster_addr":"172.21.15.162:6827/704809754","heartbeat_back_addr":"172.21.15.162:6831/704809754","heartbeat_front_addr":"172.21.15.162:6829/704809754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:19.188506+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:36.535261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:54.242294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:11.815314+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:29.512086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:46.874319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:04.437358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:22.312520+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:39.917998+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:57.340043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:15.252797+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:32.898924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:0/69783025":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/10165744":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/2081407856":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/4026642298":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/1442330765":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/1595718606":"2024-06-03T03:57:45.611046+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:20:11.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.274+0000 7f49169fb700 1 -- 172.21.15.123:0/2107000000 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f48f80a1120 msgr2=0x7f48f80a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:11.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.274+0000 7f49169fb700 1 --2- 172.21.15.123:0/2107000000 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f48f80a1120 0x7f48f80a35e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4904011490 tx=0x7f4904009260 comp rx=0 tx=0).stop 2024-06-02T04:20:11.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.274+0000 7f49169fb700 1 -- 172.21.15.123:0/2107000000 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4910100e70 msgr2=0x7f4910196ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:11.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.274+0000 7f49169fb700 1 --2- 172.21.15.123:0/2107000000 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4910100e70 0x7f4910196ed0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f490000d950 tx=0x7f490000dc60 comp rx=0 tx=0).stop 2024-06-02T04:20:11.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.274+0000 7f49169fb700 1 -- 172.21.15.123:0/2107000000 shutdown_connections 2024-06-02T04:20:11.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.274+0000 7f49169fb700 1 --2- 172.21.15.123:0/2107000000 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f48f80a1120 0x7f48f80a35e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:11.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.274+0000 7f49169fb700 1 --2- 172.21.15.123:0/2107000000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4910102980 0x7f491019e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:11.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.274+0000 7f49169fb700 1 --2- 172.21.15.123:0/2107000000 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f4910100e70 0x7f4910196ed0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:11.274 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.274+0000 7f49169fb700 1 --2- 172.21.15.123:0/2107000000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4910101fc0 0x7f4910197410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:11.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.274+0000 7f49169fb700 1 -- 172.21.15.123:0/2107000000 >> 172.21.15.123:0/2107000000 conn(0x7f49100fc400 msgr2=0x7f49101053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:20:11.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.274+0000 7f49169fb700 1 -- 172.21.15.123:0/2107000000 shutdown_connections 2024-06-02T04:20:11.275 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.274+0000 7f49169fb700 1 -- 172.21.15.123:0/2107000000 wait complete. 2024-06-02T04:20:11.287 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-06-02T03:59:57.079448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-06-02T04:03:05.199881+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-06-02T04:03:05.853741+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-06-02T04:20:11.288 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-06-02T04:20:11.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.453+0000 7ff2e5680700 1 -- 172.21.15.123:0/4103290211 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2e0102c80 msgr2=0x7ff2e0109530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:11.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.453+0000 7ff2e5680700 1 --2- 172.21.15.123:0/4103290211 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2e0102c80 0x7ff2e0109530 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff2d800b0a0 tx=0x7ff2d800b3b0 comp rx=0 tx=0).stop 2024-06-02T04:20:11.455 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.453+0000 7ff2e5680700 1 -- 172.21.15.123:0/4103290211 shutdown_connections 2024-06-02T04:20:11.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.453+0000 7ff2e5680700 1 --2- 172.21.15.123:0/4103290211 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2e0102c80 0x7ff2e0109530 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:11.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.453+0000 7ff2e5680700 1 --2- 172.21.15.123:0/4103290211 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2e00ff270 0x7ff2e00ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:11.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.453+0000 7ff2e5680700 1 --2- 172.21.15.123:0/4103290211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2e01022e0 0x7ff2e0102740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:11.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.453+0000 7ff2e5680700 1 -- 172.21.15.123:0/4103290211 >> 172.21.15.123:0/4103290211 conn(0x7ff2e00fab80 msgr2=0x7ff2e00fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:20:11.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.453+0000 7ff2e5680700 1 -- 172.21.15.123:0/4103290211 shutdown_connections 2024-06-02T04:20:11.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.454+0000 7ff2e5680700 1 -- 172.21.15.123:0/4103290211 wait complete. 2024-06-02T04:20:11.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.454+0000 7ff2e5680700 1 Processor -- start 2024-06-02T04:20:11.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.454+0000 7ff2e5680700 1 -- start start 2024-06-02T04:20:11.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.454+0000 7ff2e5680700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2e00ff270 0x7ff2e0101c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:11.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.454+0000 7ff2e5680700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2e01022e0 0x7ff2e0100290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:11.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.454+0000 7ff2e5680700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2e0102c80 0x7ff2e01007d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:11.456 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.454+0000 7ff2e5680700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e0100f70 con 0x7ff2e00ff270 2024-06-02T04:20:11.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.454+0000 7ff2e5680700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e01010e0 con 0x7ff2e0102c80 2024-06-02T04:20:11.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.454+0000 7ff2e5680700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e01a10b0 con 0x7ff2e01022e0 2024-06-02T04:20:11.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.455+0000 7ff2deffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2e00ff270 0x7ff2e0101c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:11.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.455+0000 7ff2deffd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2e00ff270 0x7ff2e0101c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38304/0 (socket says 172.21.15.123:38304) 2024-06-02T04:20:11.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.455+0000 7ff2deffd700 1 -- 172.21.15.123:0/1450764593 learned_addr learned my addr 172.21.15.123:0/1450764593 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:20:11.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.455+0000 7ff2de7fc700 1 --2- 172.21.15.123:0/1450764593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2e01022e0 0x7ff2e0100290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:11.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.455+0000 7ff2deffd700 1 -- 172.21.15.123:0/1450764593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2e01022e0 msgr2=0x7ff2e0100290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:11.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.455+0000 7ff2df7fe700 1 --2- 172.21.15.123:0/1450764593 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2e0102c80 0x7ff2e01007d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:11.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.455+0000 7ff2deffd700 1 --2- 172.21.15.123:0/1450764593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2e01022e0 0x7ff2e0100290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:11.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.455+0000 7ff2deffd700 1 -- 172.21.15.123:0/1450764593 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2e0102c80 msgr2=0x7ff2e01007d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:11.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.455+0000 7ff2deffd700 1 --2- 172.21.15.123:0/1450764593 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2e0102c80 0x7ff2e01007d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:11.457 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.455+0000 7ff2deffd700 1 -- 172.21.15.123:0/1450764593 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d8009d00 con 0x7ff2e00ff270 2024-06-02T04:20:11.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.455+0000 7ff2deffd700 1 --2- 172.21.15.123:0/1450764593 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2e00ff270 0x7ff2e0101c00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff2d000b500 tx=0x7ff2d000b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:20:11.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.455+0000 7ff2c7fff700 1 -- 172.21.15.123:0/1450764593 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0011830 con 0x7ff2e00ff270 2024-06-02T04:20:11.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.455+0000 7ff2e5680700 1 -- 172.21.15.123:0/1450764593 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e01a1340 con 0x7ff2e00ff270 2024-06-02T04:20:11.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.455+0000 7ff2c7fff700 1 -- 172.21.15.123:0/1450764593 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff2d0011e50 con 0x7ff2e00ff270 2024-06-02T04:20:11.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.455+0000 7ff2c7fff700 1 -- 172.21.15.123:0/1450764593 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0010e40 con 0x7ff2e00ff270 2024-06-02T04:20:11.458 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.455+0000 7ff2e5680700 1 -- 172.21.15.123:0/1450764593 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e01a1850 con 0x7ff2e00ff270 2024-06-02T04:20:11.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.456+0000 7ff2e5680700 1 -- 172.21.15.123:0/1450764593 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e0108520 con 0x7ff2e00ff270 2024-06-02T04:20:11.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.457+0000 7ff2c7fff700 1 -- 172.21.15.123:0/1450764593 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7ff2d0011990 con 0x7ff2e00ff270 2024-06-02T04:20:11.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.458+0000 7ff2c7fff700 1 --2- 172.21.15.123:0/1450764593 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff2c80a1120 0x7ff2c80a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:11.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.458+0000 7ff2de7fc700 1 --2- 172.21.15.123:0/1450764593 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff2c80a1120 0x7ff2c80a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:11.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.458+0000 7ff2c7fff700 1 -- 172.21.15.123:0/1450764593 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7ff2d00cc2f0 con 0x7ff2e00ff270 2024-06-02T04:20:11.459 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.458+0000 7ff2de7fc700 1 --2- 172.21.15.123:0/1450764593 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff2c80a1120 0x7ff2c80a35e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4005950 tx=0x7ff2d400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:20:11.462 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.462+0000 7ff2c7fff700 1 -- 172.21.15.123:0/1450764593 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff2d0095b40 con 0x7ff2e00ff270 2024-06-02T04:20:11.659 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.659+0000 7ff2e5680700 1 -- 172.21.15.123:0/1450764593 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff2e010c930 con 0x7ff2e00ff270 2024-06-02T04:20:11.660 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.660+0000 7ff2c7fff700 1 -- 172.21.15.123:0/1450764593 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff2d0099160 con 0x7ff2e00ff270 2024-06-02T04:20:11.660 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 1 2024-06-02T04:20:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.662+0000 7ff2e5680700 1 -- 172.21.15.123:0/1450764593 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff2c80a1120 msgr2=0x7ff2c80a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.662+0000 7ff2e5680700 1 --2- 172.21.15.123:0/1450764593 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff2c80a1120 0x7ff2c80a35e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4005950 tx=0x7ff2d400b410 comp rx=0 tx=0).stop 2024-06-02T04:20:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.662+0000 7ff2e5680700 1 -- 172.21.15.123:0/1450764593 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2e00ff270 msgr2=0x7ff2e0101c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.662+0000 7ff2e5680700 1 --2- 172.21.15.123:0/1450764593 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2e00ff270 0x7ff2e0101c00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff2d000b500 tx=0x7ff2d000b810 comp rx=0 tx=0).stop 2024-06-02T04:20:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.662+0000 7ff2e5680700 1 -- 172.21.15.123:0/1450764593 shutdown_connections 2024-06-02T04:20:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.662+0000 7ff2e5680700 1 --2- 172.21.15.123:0/1450764593 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7ff2c80a1120 0x7ff2c80a35e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.662+0000 7ff2e5680700 1 --2- 172.21.15.123:0/1450764593 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2e0102c80 0x7ff2e01007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:11.662 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.662+0000 7ff2e5680700 1 --2- 172.21.15.123:0/1450764593 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7ff2e00ff270 0x7ff2e0101c00 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:11.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.662+0000 7ff2e5680700 1 --2- 172.21.15.123:0/1450764593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff2e01022e0 0x7ff2e0100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:11.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.662+0000 7ff2e5680700 1 -- 172.21.15.123:0/1450764593 >> 172.21.15.123:0/1450764593 conn(0x7ff2e00fab80 msgr2=0x7ff2e0105660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:20:11.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.662+0000 7ff2e5680700 1 -- 172.21.15.123:0/1450764593 shutdown_connections 2024-06-02T04:20:11.663 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.662+0000 7ff2e5680700 1 -- 172.21.15.123:0/1450764593 wait complete. 2024-06-02T04:20:11.674 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-06-02T04:20:11.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.799+0000 7fd6b46c7700 1 -- 172.21.15.123:0/2534682370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6ac101980 msgr2=0x7fd6ac1082a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:11.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.800+0000 7fd6b46c7700 1 --2- 172.21.15.123:0/2534682370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6ac101980 0x7fd6ac1082a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd6a400b0a0 tx=0x7fd6a400b3b0 comp rx=0 tx=0).stop 2024-06-02T04:20:11.801 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.800+0000 7fd6b46c7700 1 -- 172.21.15.123:0/2534682370 shutdown_connections 2024-06-02T04:20:11.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.800+0000 7fd6b46c7700 1 --2- 172.21.15.123:0/2534682370 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6ac101980 0x7fd6ac1082a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:11.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.800+0000 7fd6b46c7700 1 --2- 172.21.15.123:0/2534682370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6ac0ffe70 0x7fd6ac100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:11.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.800+0000 7fd6b46c7700 1 --2- 172.21.15.123:0/2534682370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6ac100fc0 0x7fd6ac101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:11.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.800+0000 7fd6b46c7700 1 -- 172.21.15.123:0/2534682370 >> 172.21.15.123:0/2534682370 conn(0x7fd6ac0fb3e0 msgr2=0x7fd6ac0fd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:20:11.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.800+0000 7fd6b46c7700 1 -- 172.21.15.123:0/2534682370 shutdown_connections 2024-06-02T04:20:11.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.800+0000 7fd6b46c7700 1 -- 172.21.15.123:0/2534682370 wait complete. 2024-06-02T04:20:11.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.800+0000 7fd6b46c7700 1 Processor -- start 2024-06-02T04:20:11.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.800+0000 7fd6b46c7700 1 -- start start 2024-06-02T04:20:11.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.800+0000 7fd6b46c7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6ac0ffe70 0x7fd6ac196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:11.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.800+0000 7fd6b46c7700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6ac100fc0 0x7fd6ac197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:11.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.800+0000 7fd6b46c7700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6ac101980 0x7fd6ac19e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:11.802 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.800+0000 7fd6b46c7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac19eb00 con 0x7fd6ac0ffe70 2024-06-02T04:20:11.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.800+0000 7fd6b46c7700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac19ec40 con 0x7fd6ac100fc0 2024-06-02T04:20:11.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.800+0000 7fd6b46c7700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac19edd0 con 0x7fd6ac101980 2024-06-02T04:20:11.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.800+0000 7fd6b2463700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6ac0ffe70 0x7fd6ac196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:11.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.800+0000 7fd6b2463700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6ac0ffe70 0x7fd6ac196fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38332/0 (socket says 172.21.15.123:38332) 2024-06-02T04:20:11.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.800+0000 7fd6b2463700 1 -- 172.21.15.123:0/3246652946 learned_addr learned my addr 172.21.15.123:0/3246652946 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:20:11.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.801+0000 7fd6b2c64700 1 --2- 172.21.15.123:0/3246652946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6ac101980 0x7fd6ac19e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:11.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.801+0000 7fd6b2463700 1 -- 172.21.15.123:0/3246652946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6ac101980 msgr2=0x7fd6ac19e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:11.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.801+0000 7fd6b2463700 1 --2- 172.21.15.123:0/3246652946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6ac101980 0x7fd6ac19e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:11.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.801+0000 7fd6b2463700 1 -- 172.21.15.123:0/3246652946 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6ac100fc0 msgr2=0x7fd6ac197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:11.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.801+0000 7fd6b1c62700 1 --2- 172.21.15.123:0/3246652946 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6ac100fc0 0x7fd6ac197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:11.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.801+0000 7fd6b2463700 1 --2- 172.21.15.123:0/3246652946 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6ac100fc0 0x7fd6ac197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:11.803 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.801+0000 7fd6b2463700 1 -- 172.21.15.123:0/3246652946 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a4009d00 con 0x7fd6ac0ffe70 2024-06-02T04:20:11.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.801+0000 7fd6b2463700 1 --2- 172.21.15.123:0/3246652946 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6ac0ffe70 0x7fd6ac196fd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd6a800d950 tx=0x7fd6a800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:20:11.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.801+0000 7fd6a37fe700 1 -- 172.21.15.123:0/3246652946 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8009940 con 0x7fd6ac0ffe70 2024-06-02T04:20:11.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.801+0000 7fd6b46c7700 1 -- 172.21.15.123:0/3246652946 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6ac19f0b0 con 0x7fd6ac0ffe70 2024-06-02T04:20:11.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.801+0000 7fd6a37fe700 1 -- 172.21.15.123:0/3246652946 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd6a8010460 con 0x7fd6ac0ffe70 2024-06-02T04:20:11.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.801+0000 7fd6a37fe700 1 -- 172.21.15.123:0/3246652946 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a800f620 con 0x7fd6ac0ffe70 2024-06-02T04:20:11.804 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.801+0000 7fd6b46c7700 1 -- 172.21.15.123:0/3246652946 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6ac19f610 con 0x7fd6ac0ffe70 2024-06-02T04:20:11.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.802+0000 7fd6b46c7700 1 -- 172.21.15.123:0/3246652946 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6ac068140 con 0x7fd6ac0ffe70 2024-06-02T04:20:11.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.803+0000 7fd6a37fe700 1 -- 172.21.15.123:0/3246652946 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fd6a80108d0 con 0x7fd6ac0ffe70 2024-06-02T04:20:11.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.804+0000 7fd6a37fe700 1 --2- 172.21.15.123:0/3246652946 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd6980a1120 0x7fd6980a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:11.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.804+0000 7fd6b1c62700 1 --2- 172.21.15.123:0/3246652946 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd6980a1120 0x7fd6980a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:11.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.804+0000 7fd6a37fe700 1 -- 172.21.15.123:0/3246652946 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fd6a80cc760 con 0x7fd6ac0ffe70 2024-06-02T04:20:11.805 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.804+0000 7fd6b1c62700 1 --2- 172.21.15.123:0/3246652946 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd6980a1120 0x7fd6980a35e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd69c005950 tx=0x7fd69c005cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:20:11.808 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:11.808+0000 7fd6a37fe700 1 -- 172.21.15.123:0/3246652946 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd6a8095f10 con 0x7fd6ac0ffe70 2024-06-02T04:20:12.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.008+0000 7fd6b46c7700 1 -- 172.21.15.123:0/3246652946 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd6ac19f930 con 0x7fd6ac0ffe70 2024-06-02T04:20:12.008 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.008+0000 7fd6a37fe700 1 -- 172.21.15.123:0/3246652946 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd6a8099530 con 0x7fd6ac0ffe70 2024-06-02T04:20:12.008 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 32 2024-06-02T04:20:12.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.010+0000 7fd6b46c7700 1 -- 172.21.15.123:0/3246652946 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd6980a1120 msgr2=0x7fd6980a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:12.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.010+0000 7fd6b46c7700 1 --2- 172.21.15.123:0/3246652946 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd6980a1120 0x7fd6980a35e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd69c005950 tx=0x7fd69c005cf0 comp rx=0 tx=0).stop 2024-06-02T04:20:12.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.010+0000 7fd6b46c7700 1 -- 172.21.15.123:0/3246652946 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6ac0ffe70 msgr2=0x7fd6ac196fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:12.010 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.010+0000 7fd6b46c7700 1 --2- 172.21.15.123:0/3246652946 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6ac0ffe70 0x7fd6ac196fd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd6a800d950 tx=0x7fd6a800dc60 comp rx=0 tx=0).stop 2024-06-02T04:20:12.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.010+0000 7fd6b46c7700 1 -- 172.21.15.123:0/3246652946 shutdown_connections 2024-06-02T04:20:12.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.010+0000 7fd6b46c7700 1 --2- 172.21.15.123:0/3246652946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6ac101980 0x7fd6ac19e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:12.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.010+0000 7fd6b46c7700 1 --2- 172.21.15.123:0/3246652946 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd6ac0ffe70 0x7fd6ac196fd0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:12.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.010+0000 7fd6b46c7700 1 --2- 172.21.15.123:0/3246652946 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd6980a1120 0x7fd6980a35e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:12.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.010+0000 7fd6b46c7700 1 --2- 172.21.15.123:0/3246652946 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6ac100fc0 0x7fd6ac197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:12.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.010+0000 7fd6b46c7700 1 -- 172.21.15.123:0/3246652946 >> 172.21.15.123:0/3246652946 conn(0x7fd6ac0fb3e0 msgr2=0x7fd6ac0694d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:20:12.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.010+0000 7fd6b46c7700 1 -- 172.21.15.123:0/3246652946 shutdown_connections 2024-06-02T04:20:12.011 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.010+0000 7fd6b46c7700 1 -- 172.21.15.123:0/3246652946 wait complete. 2024-06-02T04:20:12.021 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:11 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2107000000' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:20:12.022 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-06-02T04:20:12.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:11 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/2107000000' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:20:12.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:11 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/2107000000' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:20:12.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.148+0000 7f362b3ed700 1 -- 172.21.15.123:0/2512708531 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3624101970 msgr2=0x7f3624108290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:12.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.148+0000 7f362b3ed700 1 --2- 172.21.15.123:0/2512708531 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3624101970 0x7f3624108290 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f361c00b0a0 tx=0x7f361c00b3b0 comp rx=0 tx=0).stop 2024-06-02T04:20:12.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.148+0000 7f362b3ed700 1 -- 172.21.15.123:0/2512708531 shutdown_connections 2024-06-02T04:20:12.150 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.148+0000 7f362b3ed700 1 --2- 172.21.15.123:0/2512708531 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3624101970 0x7f3624108290 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:12.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.148+0000 7f362b3ed700 1 --2- 172.21.15.123:0/2512708531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36240ffe60 0x7f3624100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:12.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.148+0000 7f362b3ed700 1 --2- 172.21.15.123:0/2512708531 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3624100fb0 0x7f3624101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:12.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.148+0000 7f362b3ed700 1 -- 172.21.15.123:0/2512708531 >> 172.21.15.123:0/2512708531 conn(0x7f36240fb3f0 msgr2=0x7f36240fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:20:12.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.148+0000 7f362b3ed700 1 -- 172.21.15.123:0/2512708531 shutdown_connections 2024-06-02T04:20:12.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.148+0000 7f362b3ed700 1 -- 172.21.15.123:0/2512708531 wait complete. 2024-06-02T04:20:12.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.149+0000 7f362b3ed700 1 Processor -- start 2024-06-02T04:20:12.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.149+0000 7f362b3ed700 1 -- start start 2024-06-02T04:20:12.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.149+0000 7f362b3ed700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36240ffe60 0x7f3624195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:12.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.149+0000 7f362b3ed700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3624100fb0 0x7f3624196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:12.151 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.149+0000 7f362b3ed700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3624101970 0x7f362419d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:12.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.149+0000 7f362b3ed700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362419da20 con 0x7f3624100fb0 2024-06-02T04:20:12.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.149+0000 7f362b3ed700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362419db60 con 0x7f3624101970 2024-06-02T04:20:12.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.149+0000 7f362b3ed700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362419dcf0 con 0x7f36240ffe60 2024-06-02T04:20:12.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.149+0000 7f3628988700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3624100fb0 0x7f3624196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:12.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.149+0000 7f3628988700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3624100fb0 0x7f3624196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38356/0 (socket says 172.21.15.123:38356) 2024-06-02T04:20:12.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.149+0000 7f3628988700 1 -- 172.21.15.123:0/4040807610 learned_addr learned my addr 172.21.15.123:0/4040807610 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:20:12.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.149+0000 7f3629189700 1 --2- 172.21.15.123:0/4040807610 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36240ffe60 0x7f3624195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:12.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.149+0000 7f3628988700 1 -- 172.21.15.123:0/4040807610 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36240ffe60 msgr2=0x7f3624195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:12.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.149+0000 7f3628988700 1 --2- 172.21.15.123:0/4040807610 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36240ffe60 0x7f3624195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:12.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.149+0000 7f3628988700 1 -- 172.21.15.123:0/4040807610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3624101970 msgr2=0x7f362419d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:12.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.149+0000 7f3628988700 1 --2- 172.21.15.123:0/4040807610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3624101970 0x7f362419d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:12.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.149+0000 7f3628988700 1 -- 172.21.15.123:0/4040807610 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3614009520 con 0x7f3624100fb0 2024-06-02T04:20:12.152 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.149+0000 7f3629189700 1 --2- 172.21.15.123:0/4040807610 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36240ffe60 0x7f3624195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:20:12.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.149+0000 7f3628988700 1 --2- 172.21.15.123:0/4040807610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3624100fb0 0x7f3624196430 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f362000d980 tx=0x7f362000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:20:12.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.150+0000 7f361a7fc700 1 -- 172.21.15.123:0/4040807610 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3620009b40 con 0x7f3624100fb0 2024-06-02T04:20:12.153 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.150+0000 7f361a7fc700 1 -- 172.21.15.123:0/4040807610 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f362000de60 con 0x7f3624100fb0 2024-06-02T04:20:12.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.150+0000 7f362b3ed700 1 -- 172.21.15.123:0/4040807610 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f361c009d00 con 0x7f3624100fb0 2024-06-02T04:20:12.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.150+0000 7f361a7fc700 1 -- 172.21.15.123:0/4040807610 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3620005580 con 0x7f3624100fb0 2024-06-02T04:20:12.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.150+0000 7f362b3ed700 1 -- 172.21.15.123:0/4040807610 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f362419e270 con 0x7f3624100fb0 2024-06-02T04:20:12.154 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.150+0000 7f362b3ed700 1 -- 172.21.15.123:0/4040807610 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3624107200 con 0x7f3624100fb0 2024-06-02T04:20:12.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.152+0000 7f361a7fc700 1 -- 172.21.15.123:0/4040807610 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f3620004750 con 0x7f3624100fb0 2024-06-02T04:20:12.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.152+0000 7f361a7fc700 1 --2- 172.21.15.123:0/4040807610 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f36100a1120 0x7f36100a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:12.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.152+0000 7f3629189700 1 --2- 172.21.15.123:0/4040807610 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f36100a1120 0x7f36100a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:12.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.152+0000 7f361a7fc700 1 -- 172.21.15.123:0/4040807610 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f36200ccc00 con 0x7f3624100fb0 2024-06-02T04:20:12.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.153+0000 7f3629189700 1 --2- 172.21.15.123:0/4040807610 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f36100a1120 0x7f36100a35e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3614009d70 tx=0x7f3614009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:20:12.155 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.156+0000 7f361a7fc700 1 -- 172.21.15.123:0/4040807610 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3620096450 con 0x7f3624100fb0 2024-06-02T04:20:12.357 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.357+0000 7f362b3ed700 1 -- 172.21.15.123:0/4040807610 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f362402cda0 con 0x7f3624100fb0 2024-06-02T04:20:12.358 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.357+0000 7f361a7fc700 1 -- 172.21.15.123:0/4040807610 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3620017070 con 0x7f3624100fb0 2024-06-02T04:20:12.358 INFO:teuthology.orchestra.run.smithi123.stdout:pg_num: 64 2024-06-02T04:20:12.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.360+0000 7f362b3ed700 1 -- 172.21.15.123:0/4040807610 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f36100a1120 msgr2=0x7f36100a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:12.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.360+0000 7f362b3ed700 1 --2- 172.21.15.123:0/4040807610 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f36100a1120 0x7f36100a35e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3614009d70 tx=0x7f3614009260 comp rx=0 tx=0).stop 2024-06-02T04:20:12.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.360+0000 7f362b3ed700 1 -- 172.21.15.123:0/4040807610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3624100fb0 msgr2=0x7f3624196430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:12.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.360+0000 7f362b3ed700 1 --2- 172.21.15.123:0/4040807610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3624100fb0 0x7f3624196430 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f362000d980 tx=0x7f362000dd40 comp rx=0 tx=0).stop 2024-06-02T04:20:12.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.360+0000 7f362b3ed700 1 -- 172.21.15.123:0/4040807610 shutdown_connections 2024-06-02T04:20:12.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.360+0000 7f362b3ed700 1 --2- 172.21.15.123:0/4040807610 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f36100a1120 0x7f36100a35e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:12.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.360+0000 7f362b3ed700 1 --2- 172.21.15.123:0/4040807610 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3624101970 0x7f362419d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:12.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.360+0000 7f362b3ed700 1 --2- 172.21.15.123:0/4040807610 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36240ffe60 0x7f3624195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:12.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.360+0000 7f362b3ed700 1 --2- 172.21.15.123:0/4040807610 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3624100fb0 0x7f3624196430 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:12.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.360+0000 7f362b3ed700 1 -- 172.21.15.123:0/4040807610 >> 172.21.15.123:0/4040807610 conn(0x7f36240fb3f0 msgr2=0x7f3624104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:20:12.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.360+0000 7f362b3ed700 1 -- 172.21.15.123:0/4040807610 shutdown_connections 2024-06-02T04:20:12.360 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.360+0000 7f362b3ed700 1 -- 172.21.15.123:0/4040807610 wait complete. 2024-06-02T04:20:12.372 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-06-02T04:20:12.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.495+0000 7fab14694700 1 -- 172.21.15.123:0/98513542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab0c106cc0 msgr2=0x7fab0c1090d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:12.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.495+0000 7fab14694700 1 --2- 172.21.15.123:0/98513542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab0c106cc0 0x7fab0c1090d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fab0400b0a0 tx=0x7fab0400b3b0 comp rx=0 tx=0).stop 2024-06-02T04:20:12.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.495+0000 7fab14694700 1 -- 172.21.15.123:0/98513542 shutdown_connections 2024-06-02T04:20:12.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.495+0000 7fab14694700 1 --2- 172.21.15.123:0/98513542 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab0c106cc0 0x7fab0c1090d0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:12.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.495+0000 7fab14694700 1 --2- 172.21.15.123:0/98513542 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab0c101a60 0x7fab0c103e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:12.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.495+0000 7fab14694700 1 --2- 172.21.15.123:0/98513542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab0c104390 0x7fab0c106780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:12.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.495+0000 7fab14694700 1 -- 172.21.15.123:0/98513542 >> 172.21.15.123:0/98513542 conn(0x7fab0c0fb3f0 msgr2=0x7fab0c0fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:20:12.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.495+0000 7fab14694700 1 -- 172.21.15.123:0/98513542 shutdown_connections 2024-06-02T04:20:12.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.495+0000 7fab14694700 1 -- 172.21.15.123:0/98513542 wait complete. 2024-06-02T04:20:12.497 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.495+0000 7fab14694700 1 Processor -- start 2024-06-02T04:20:12.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.495+0000 7fab14694700 1 -- start start 2024-06-02T04:20:12.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.496+0000 7fab14694700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab0c101a60 0x7fab0c196fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:12.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.496+0000 7fab14694700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab0c104390 0x7fab0c1974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:12.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.496+0000 7fab14694700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab0c106cc0 0x7fab0c19e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:12.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.496+0000 7fab14694700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0c19ea80 con 0x7fab0c106cc0 2024-06-02T04:20:12.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.496+0000 7fab14694700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0c19ebc0 con 0x7fab0c104390 2024-06-02T04:20:12.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.496+0000 7fab14694700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab0c19ed50 con 0x7fab0c101a60 2024-06-02T04:20:12.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.496+0000 7fab12c31700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab0c106cc0 0x7fab0c19e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:12.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.496+0000 7fab12c31700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab0c106cc0 0x7fab0c19e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38376/0 (socket says 172.21.15.123:38376) 2024-06-02T04:20:12.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.496+0000 7fab12c31700 1 -- 172.21.15.123:0/1762256769 learned_addr learned my addr 172.21.15.123:0/1762256769 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:20:12.498 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.496+0000 7fab12430700 1 --2- 172.21.15.123:0/1762256769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab0c101a60 0x7fab0c196fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:12.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.496+0000 7fab11c2f700 1 --2- 172.21.15.123:0/1762256769 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab0c104390 0x7fab0c1974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:12.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.496+0000 7fab12c31700 1 -- 172.21.15.123:0/1762256769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab0c101a60 msgr2=0x7fab0c196fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:12.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.496+0000 7fab12c31700 1 --2- 172.21.15.123:0/1762256769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab0c101a60 0x7fab0c196fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:12.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.496+0000 7fab12c31700 1 -- 172.21.15.123:0/1762256769 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab0c104390 msgr2=0x7fab0c1974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:12.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.496+0000 7fab12c31700 1 --2- 172.21.15.123:0/1762256769 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab0c104390 0x7fab0c1974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:12.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.496+0000 7fab12c31700 1 -- 172.21.15.123:0/1762256769 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab04009d00 con 0x7fab0c106cc0 2024-06-02T04:20:12.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.496+0000 7fab12430700 1 --2- 172.21.15.123:0/1762256769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab0c101a60 0x7fab0c196fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:20:12.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.496+0000 7fab12c31700 1 --2- 172.21.15.123:0/1762256769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab0c106cc0 0x7fab0c19e4b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fab04004d00 tx=0x7fab04004de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:20:12.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.496+0000 7fab037fe700 1 -- 172.21.15.123:0/1762256769 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0400e040 con 0x7fab0c106cc0 2024-06-02T04:20:12.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.496+0000 7fab037fe700 1 -- 172.21.15.123:0/1762256769 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fab0401db50 con 0x7fab0c106cc0 2024-06-02T04:20:12.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.496+0000 7fab14694700 1 -- 172.21.15.123:0/1762256769 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab0c19efd0 con 0x7fab0c106cc0 2024-06-02T04:20:12.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.496+0000 7fab037fe700 1 -- 172.21.15.123:0/1762256769 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0401bbe0 con 0x7fab0c106cc0 2024-06-02T04:20:12.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.496+0000 7fab14694700 1 -- 172.21.15.123:0/1762256769 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab0c19f3f0 con 0x7fab0c106cc0 2024-06-02T04:20:12.499 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.497+0000 7fab14694700 1 -- 172.21.15.123:0/1762256769 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab0c0fcf70 con 0x7fab0c106cc0 2024-06-02T04:20:12.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.498+0000 7fab037fe700 1 -- 172.21.15.123:0/1762256769 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fab0401bd40 con 0x7fab0c106cc0 2024-06-02T04:20:12.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.499+0000 7fab037fe700 1 --2- 172.21.15.123:0/1762256769 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7faaf80a1120 0x7faaf80a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:12.500 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.499+0000 7fab037fe700 1 -- 172.21.15.123:0/1762256769 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fab040ce980 con 0x7fab0c106cc0 2024-06-02T04:20:12.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.499+0000 7fab12430700 1 --2- 172.21.15.123:0/1762256769 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7faaf80a1120 0x7faaf80a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:12.501 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.499+0000 7fab12430700 1 --2- 172.21.15.123:0/1762256769 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7faaf80a1120 0x7faaf80a35e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7faafc005fd0 tx=0x7faafc005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:20:12.502 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.502+0000 7fab037fe700 1 -- 172.21.15.123:0/1762256769 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fab04098260 con 0x7fab0c106cc0 2024-06-02T04:20:12.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.717+0000 7fab14694700 1 -- 172.21.15.123:0/1762256769 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fab0c10c870 con 0x7fab0c106cc0 2024-06-02T04:20:12.717 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.717+0000 7fab037fe700 1 -- 172.21.15.123:0/1762256769 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v84) v1 ==== 81+0+598 (secure 0 0 0) 0x7fab0409b880 con 0x7fab0c106cc0 2024-06-02T04:20:12.717 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/69783025 2024-06-03T03:58:06.766197+0000 2024-06-02T04:20:12.717 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6801/3555101542 2024-06-03T03:58:06.766197+0000 2024-06-02T04:20:12.717 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6801/3442784869 2024-06-03T03:57:45.611046+0000 2024-06-02T04:20:12.718 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6800/3442784869 2024-06-03T03:57:45.611046+0000 2024-06-02T04:20:12.718 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/10165744 2024-06-03T03:58:06.766197+0000 2024-06-02T04:20:12.718 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/2081407856 2024-06-03T03:58:06.766197+0000 2024-06-02T04:20:12.718 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/4026642298 2024-06-03T03:57:45.611046+0000 2024-06-02T04:20:12.718 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:6800/3555101542 2024-06-03T03:58:06.766197+0000 2024-06-02T04:20:12.718 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/1442330765 2024-06-03T03:57:45.611046+0000 2024-06-02T04:20:12.718 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123:0/1595718606 2024-06-03T03:57:45.611046+0000 2024-06-02T04:20:12.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.719+0000 7fab14694700 1 -- 172.21.15.123:0/1762256769 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7faaf80a1120 msgr2=0x7faaf80a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:12.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.719+0000 7fab14694700 1 --2- 172.21.15.123:0/1762256769 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7faaf80a1120 0x7faaf80a35e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7faafc005fd0 tx=0x7faafc005f60 comp rx=0 tx=0).stop 2024-06-02T04:20:12.719 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.719+0000 7fab14694700 1 -- 172.21.15.123:0/1762256769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab0c106cc0 msgr2=0x7fab0c19e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:12.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.719+0000 7fab14694700 1 --2- 172.21.15.123:0/1762256769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab0c106cc0 0x7fab0c19e4b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fab04004d00 tx=0x7fab04004de0 comp rx=0 tx=0).stop 2024-06-02T04:20:12.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.719+0000 7fab14694700 1 -- 172.21.15.123:0/1762256769 shutdown_connections 2024-06-02T04:20:12.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.719+0000 7fab14694700 1 --2- 172.21.15.123:0/1762256769 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fab0c106cc0 0x7fab0c19e4b0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:12.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.719+0000 7fab14694700 1 --2- 172.21.15.123:0/1762256769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab0c101a60 0x7fab0c196fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:12.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.719+0000 7fab14694700 1 --2- 172.21.15.123:0/1762256769 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7faaf80a1120 0x7faaf80a35e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:12.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.719+0000 7fab14694700 1 --2- 172.21.15.123:0/1762256769 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab0c104390 0x7fab0c1974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:12.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.719+0000 7fab14694700 1 -- 172.21.15.123:0/1762256769 >> 172.21.15.123:0/1762256769 conn(0x7fab0c0fb3f0 msgr2=0x7fab0c1023a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:20:12.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.720+0000 7fab14694700 1 -- 172.21.15.123:0/1762256769 shutdown_connections 2024-06-02T04:20:12.720 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:12.720+0000 7fab14694700 1 -- 172.21.15.123:0/1762256769 wait complete. 2024-06-02T04:20:12.721 INFO:teuthology.orchestra.run.smithi123.stderr:listed 10 entries 2024-06-02T04:20:12.731 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-06-02T04:20:12.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:20:12.732 DEBUG:teuthology.orchestra.run.smithi123:> sudo umount /tmp/cephfs 2024-06-02T04:20:12.980 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi123.front.sepia.ceph.com 2024-06-02T04:20:12.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:20:12.980 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2024-06-02T04:20:12.998 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:12 smithi123 ceph-mon[42885]: pgmap v736: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.9 KiB/s wr, 12 op/s 2024-06-02T04:20:12.998 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:12 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1450764593' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:20:12.998 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:12 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/3246652946' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:20:12.999 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:12 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/4040807610' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:20:13.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:12 smithi162 ceph-mon[47009]: pgmap v736: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.9 KiB/s wr, 12 op/s 2024-06-02T04:20:13.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:12 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/1450764593' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:20:13.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:12 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/3246652946' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:20:13.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:12 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/4040807610' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:20:13.090 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:12 smithi136 ceph-mon[47443]: pgmap v736: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.9 KiB/s wr, 12 op/s 2024-06-02T04:20:13.090 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:12 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/1450764593' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-06-02T04:20:13.090 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:12 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/3246652946' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-06-02T04:20:13.090 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:12 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/4040807610' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-06-02T04:20:13.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:20:13.108 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-06-02T04:20:13.166 INFO:teuthology.orchestra.run.smithi123.stdout:ceph-ns--tmp-cephfs (id: 0) 2024-06-02T04:20:13.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:20:13.166 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip netns delete ceph-ns--tmp-cephfs 2024-06-02T04:20:13.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:20:13.241 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link delete ceph-brx 2024-06-02T04:20:13.340 INFO:tasks.kclient:Unmounting kernel clients... 2024-06-02T04:20:13.340 DEBUG:teuthology.orchestra.run.smithi123:> set -ex 2024-06-02T04:20:13.340 DEBUG:teuthology.orchestra.run.smithi123:> dd if=/proc/self/mounts of=/dev/stdout 2024-06-02T04:20:13.359 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16244172k,nr_inodes=4061043,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=39,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=5785 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3252520k,mode=700,uid=1000,gid=1304 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/3276a87a625af1ebbe40b65d0f48fef40f533813446169b9d928b4bf21e15ba2/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/HHMZBRJHTZBBLJ3HGGNQ6OKSPZ:/var/lib/containers/storage/overlay/l/R2CUS3C6NZ5REOQT3C3YKZZTMH,upperdir=/var/lib/containers/storage/overlay/3276a87a625af1ebbe40b65d0f48fef40f533813446169b9d928b4bf21e15ba2/diff,workdir=/var/lib/containers/storage/overlay/3276a87a625af1ebbe40b65d0f48fef40f533813446169b9d928b4bf21e15ba2/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/29707f20b43fe5ab648253e1540711cb944c45f0dade3880715595af32b54cdf/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/HHMZBRJHTZBBLJ3HGGNQ6OKSPZ:/var/lib/containers/storage/overlay/l/R2CUS3C6NZ5REOQT3C3YKZZTMH,upperdir=/var/lib/containers/storage/overlay/29707f20b43fe5ab648253e1540711cb944c45f0dade3880715595af32b54cdf/diff,workdir=/var/lib/containers/storage/overlay/29707f20b43fe5ab648253e1540711cb944c45f0dade3880715595af32b54cdf/work,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3252520k,mode=700 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,relatime 0 0 overlay /var/lib/containers/storage/overlay/59fa12a5870693e32910c721d354a9080baff7d10d650bdccec95c98f3314ed1/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/HHMZBRJHTZBBLJ3HGGNQ6OKSPZ:/var/lib/containers/storage/overlay/l/R2CUS3C6NZ5REOQT3C3YKZZTMH,upperdir=/var/lib/containers/storage/overlay/59fa12a5870693e32910c721d354a9080baff7d10d650bdccec95c98f3314ed1/diff,workdir=/var/lib/containers/storage/overlay/59fa12a5870693e32910c721d354a9080baff7d10d650bdccec95c98f3314ed1/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/8eb0b91e36f220d6f2787e8f3b418327b6e59a7d8456860aa87df07756db0d7d/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/HHMZBRJHTZBBLJ3HGGNQ6OKSPZ:/var/lib/containers/storage/overlay/l/R2CUS3C6NZ5REOQT3C3YKZZTMH,upperdir=/var/lib/containers/storage/overlay/8eb0b91e36f220d6f2787e8f3b418327b6e59a7d8456860aa87df07756db0d7d/diff,workdir=/var/lib/containers/storage/overlay/8eb0b91e36f220d6f2787e8f3b418327b6e59a7d8456860aa87df07756db0d7d/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/02d0775365cc38bdb8efa03050ef1d97df85e453242140914e4d150d167c9061/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/HHMZBRJHTZBBLJ3HGGNQ6OKSPZ:/var/lib/containers/storage/overlay/l/R2CUS3C6NZ5REOQT3C3YKZZTMH,upperdir=/var/lib/containers/storage/overlay/02d0775365cc38bdb8efa03050ef1d97df85e453242140914e4d150d167c9061/diff,workdir=/var/lib/containers/storage/overlay/02d0775365cc38bdb8efa03050ef1d97df85e453242140914e4d150d167c9061/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/9cc52d17f4eea70c61ada56203ba831be9119e90b49840e75b83074069b16f45/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/HHMZBRJHTZBBLJ3HGGNQ6OKSPZ:/var/lib/containers/storage/overlay/l/R2CUS3C6NZ5REOQT3C3YKZZTMH,upperdir=/var/lib/containers/storage/overlay/9cc52d17f4eea70c61ada56203ba831be9119e90b49840e75b83074069b16f45/diff,workdir=/var/lib/containers/storage/overlay/9cc52d17f4eea70c61ada56203ba831be9119e90b49840e75b83074069b16f45/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/9cff4fb0543a8ae5a4c9b6f0d5bc2bdde0396f86e06150a24382b35d94fdd047/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/HHMZBRJHTZBBLJ3HGGNQ6OKSPZ:/var/lib/containers/storage/overlay/l/R2CUS3C6NZ5REOQT3C3YKZZTMH,upperdir=/var/lib/containers/storage/overlay/9cff4fb0543a8ae5a4c9b6f0d5bc2bdde0396f86e06150a24382b35d94fdd047/diff,workdir=/var/lib/containers/storage/overlay/9cff4fb0543a8ae5a4c9b6f0d5bc2bdde0396f86e06150a24382b35d94fdd047/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/e17443b429f94114e0cd9741f4d01a42a3313264ec09a3726988091ee5e813c4/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/HHMZBRJHTZBBLJ3HGGNQ6OKSPZ:/var/lib/containers/storage/overlay/l/R2CUS3C6NZ5REOQT3C3YKZZTMH,upperdir=/var/lib/containers/storage/overlay/e17443b429f94114e0cd9741f4d01a42a3313264ec09a3726988091ee5e813c4/diff,workdir=/var/lib/containers/storage/overlay/e17443b429f94114e0cd9741f4d01a42a3313264ec09a3726988091ee5e813c4/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/d2866c85058bb8e387f6bc399c52a635e077a03568899d49f5010775b733a3af/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/HHMZBRJHTZBBLJ3HGGNQ6OKSPZ:/var/lib/containers/storage/overlay/l/R2CUS3C6NZ5REOQT3C3YKZZTMH,upperdir=/var/lib/containers/storage/overlay/d2866c85058bb8e387f6bc399c52a635e077a03568899d49f5010775b733a3af/diff,workdir=/var/lib/containers/storage/overlay/d2866c85058bb8e387f6bc399c52a635e077a03568899d49f5010775b733a3af/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/3cc51079cb93623675b66745311d7764c936afa9e4c4e2cef101afd831af1dd0/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/HHMZBRJHTZBBLJ3HGGNQ6OKSPZ:/var/lib/containers/storage/overlay/l/R2CUS3C6NZ5REOQT3C3YKZZTMH,upperdir=/var/lib/containers/storage/overlay/3cc51079cb93623675b66745311d7764c936afa9e4c4e2cef101afd831af1dd0/diff,workdir=/var/lib/containers/storage/overlay/3cc51079cb93623675b66745311d7764c936afa9e4c4e2cef101afd831af1dd0/work,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 2024-06-02T04:20:13.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:20:13.359 DEBUG:teuthology.orchestra.run.smithi123:> ip netns list 2024-06-02T04:20:13.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-06-02T04:20:13.419 DEBUG:teuthology.orchestra.run.smithi123:> sudo ip link delete ceph-brx 2024-06-02T04:20:13.554 INFO:teuthology.orchestra.run.smithi123.stderr:Cannot find device "ceph-brx" 2024-06-02T04:20:13.555 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T04:20:13.556 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-06-02T04:20:13.565 INFO:tasks.cephadm:Teardown begin 2024-06-02T04:20:13.565 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-06-02T04:20:13.565 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:20:13.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.689+0000 7fa205312700 1 -- 172.21.15.123:0/3584699849 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa200100e90 msgr2=0x7fa2001012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:13.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.689+0000 7fa205312700 1 --2- 172.21.15.123:0/3584699849 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa200100e90 0x7fa2001012b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0009990 tx=0x7fa1f0009ca0 comp rx=0 tx=0).stop 2024-06-02T04:20:13.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.689+0000 7fa205312700 1 -- 172.21.15.123:0/3584699849 shutdown_connections 2024-06-02T04:20:13.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.689+0000 7fa205312700 1 --2- 172.21.15.123:0/3584699849 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa2001029a0 0x7fa2001092c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:13.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.689+0000 7fa205312700 1 --2- 172.21.15.123:0/3584699849 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa200100e90 0x7fa2001012b0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:13.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.689+0000 7fa205312700 1 --2- 172.21.15.123:0/3584699849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa200101fe0 0x7fa200102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:13.692 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.689+0000 7fa205312700 1 -- 172.21.15.123:0/3584699849 >> 172.21.15.123:0/3584699849 conn(0x7fa2000fc400 msgr2=0x7fa2000fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:20:13.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.689+0000 7fa205312700 1 -- 172.21.15.123:0/3584699849 shutdown_connections 2024-06-02T04:20:13.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.689+0000 7fa205312700 1 -- 172.21.15.123:0/3584699849 wait complete. 2024-06-02T04:20:13.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.690+0000 7fa205312700 1 Processor -- start 2024-06-02T04:20:13.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.690+0000 7fa205312700 1 -- start start 2024-06-02T04:20:13.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.690+0000 7fa205312700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa200100e90 0x7fa200196e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:13.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.690+0000 7fa205312700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa200101fe0 0x7fa200197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:13.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.690+0000 7fa205312700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2001029a0 0x7fa20019e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:13.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.690+0000 7fa205312700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20019e950 con 0x7fa200101fe0 2024-06-02T04:20:13.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.690+0000 7fa205312700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20019ea90 con 0x7fa200100e90 2024-06-02T04:20:13.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.690+0000 7fa205312700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20019ec20 con 0x7fa2001029a0 2024-06-02T04:20:13.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.691+0000 7fa1fe7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa200101fe0 0x7fa200197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:13.693 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.691+0000 7fa1fe7fc700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa200101fe0 0x7fa200197360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38392/0 (socket says 172.21.15.123:38392) 2024-06-02T04:20:13.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.691+0000 7fa1fe7fc700 1 -- 172.21.15.123:0/2102975678 learned_addr learned my addr 172.21.15.123:0/2102975678 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:20:13.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.691+0000 7fa1feffd700 1 --2- 172.21.15.123:0/2102975678 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa200100e90 0x7fa200196e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:13.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.691+0000 7fa1ff7fe700 1 --2- 172.21.15.123:0/2102975678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2001029a0 0x7fa20019e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:13.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.691+0000 7fa1fe7fc700 1 -- 172.21.15.123:0/2102975678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2001029a0 msgr2=0x7fa20019e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:13.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.691+0000 7fa1fe7fc700 1 --2- 172.21.15.123:0/2102975678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2001029a0 0x7fa20019e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:13.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.691+0000 7fa1fe7fc700 1 -- 172.21.15.123:0/2102975678 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa200100e90 msgr2=0x7fa200196e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:13.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.691+0000 7fa1fe7fc700 1 --2- 172.21.15.123:0/2102975678 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa200100e90 0x7fa200196e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:13.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.691+0000 7fa1fe7fc700 1 -- 172.21.15.123:0/2102975678 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f00095f0 con 0x7fa200101fe0 2024-06-02T04:20:13.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.691+0000 7fa1feffd700 1 --2- 172.21.15.123:0/2102975678 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa200100e90 0x7fa200196e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:20:13.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.691+0000 7fa1fe7fc700 1 --2- 172.21.15.123:0/2102975678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa200101fe0 0x7fa200197360 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa1f400b530 tx=0x7fa1f400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:20:13.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.691+0000 7fa1e7fff700 1 -- 172.21.15.123:0/2102975678 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4011830 con 0x7fa200101fe0 2024-06-02T04:20:13.694 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.691+0000 7fa1e7fff700 1 -- 172.21.15.123:0/2102975678 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa1f4011e50 con 0x7fa200101fe0 2024-06-02T04:20:13.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.691+0000 7fa205312700 1 -- 172.21.15.123:0/2102975678 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa20019ef00 con 0x7fa200101fe0 2024-06-02T04:20:13.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.691+0000 7fa1e7fff700 1 -- 172.21.15.123:0/2102975678 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f400f2e0 con 0x7fa200101fe0 2024-06-02T04:20:13.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.691+0000 7fa205312700 1 -- 172.21.15.123:0/2102975678 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa20019f400 con 0x7fa200101fe0 2024-06-02T04:20:13.695 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.692+0000 7fa205312700 1 -- 172.21.15.123:0/2102975678 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2001082a0 con 0x7fa200101fe0 2024-06-02T04:20:13.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.694+0000 7fa1e7fff700 1 -- 172.21.15.123:0/2102975678 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fa1f4010580 con 0x7fa200101fe0 2024-06-02T04:20:13.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.694+0000 7fa1e7fff700 1 --2- 172.21.15.123:0/2102975678 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa1e80a1120 0x7fa1e80a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:13.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.694+0000 7fa1e7fff700 1 -- 172.21.15.123:0/2102975678 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7fa1f40cc890 con 0x7fa200101fe0 2024-06-02T04:20:13.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.694+0000 7fa1feffd700 1 --2- 172.21.15.123:0/2102975678 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa1e80a1120 0x7fa1e80a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:13.696 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.695+0000 7fa1feffd700 1 --2- 172.21.15.123:0/2102975678 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa1e80a1120 0x7fa1e80a35e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0006010 tx=0x7fa1f000b560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:20:13.697 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.698+0000 7fa1e7fff700 1 -- 172.21.15.123:0/2102975678 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa1f40960c0 con 0x7fa200101fe0 2024-06-02T04:20:13.822 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:13 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/1762256769' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-02T04:20:13.942 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.943+0000 7fa205312700 1 -- 172.21.15.123:0/2102975678 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa200068060 con 0x7fa200101fe0 2024-06-02T04:20:13.943 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.943+0000 7fa1e7fff700 1 -- 172.21.15.123:0/2102975678 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+10930 (secure 0 0 0) 0x7fa1f40996e0 con 0x7fa200101fe0 2024-06-02T04:20:13.943 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:20:13.943 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1940848601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1940848601},{"type":"v1","addr":"172.21.15.123:6835","nonce":1940848601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/54447879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":54447879},{"type":"v1","addr":"172.21.15.123:6837","nonce":54447879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T04:03:06.667888+0000","modified":"2024-06-02T04:04:21.015497+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24490,"mds_2":24473,"mds_3":24439,"mds_4":24437},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6839/3806973328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":3806973328},{"type":"v1","addr":"172.21.15.123:6839","nonce":3806973328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14619":{"gid":14619,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6841/4032992994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":4032992994},{"type":"v1","addr":"172.21.15.123:6841","nonce":4032992994}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24437":{"gid":24437,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6833/2006585076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2006585076},{"type":"v1","addr":"172.21.15.136:6833","nonce":2006585076}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.162:6833/3583622784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3583622784},{"type":"v1","addr":"172.21.15.162:6833","nonce":3583622784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/2894031422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2894031422},{"type":"v1","addr":"172.21.15.136:6835","nonce":2894031422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24463":{"gid":24463,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2478943987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2478943987},{"type":"v1","addr":"172.21.15.162:6835","nonce":2478943987}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3402138468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3402138468},{"type":"v1","addr":"172.21.15.162:6837","nonce":3402138468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.136:6837/2572418263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2572418263},{"type":"v1","addr":"172.21.15.136:6837","nonce":2572418263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/2588884232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2588884232},{"type":"v1","addr":"172.21.15.162:6839","nonce":2588884232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6839/952830191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":952830191},{"type":"v1","addr":"172.21.15.136:6839","nonce":952830191}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-06-02T04:20:13.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.947+0000 7fa205312700 1 -- 172.21.15.123:0/2102975678 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa1e80a1120 msgr2=0x7fa1e80a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:13.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.947+0000 7fa205312700 1 --2- 172.21.15.123:0/2102975678 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa1e80a1120 0x7fa1e80a35e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0006010 tx=0x7fa1f000b560 comp rx=0 tx=0).stop 2024-06-02T04:20:13.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.947+0000 7fa205312700 1 -- 172.21.15.123:0/2102975678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa200101fe0 msgr2=0x7fa200197360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:13.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.947+0000 7fa205312700 1 --2- 172.21.15.123:0/2102975678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa200101fe0 0x7fa200197360 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa1f400b530 tx=0x7fa1f400b8f0 comp rx=0 tx=0).stop 2024-06-02T04:20:13.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.947+0000 7fa205312700 1 -- 172.21.15.123:0/2102975678 shutdown_connections 2024-06-02T04:20:13.946 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.947+0000 7fa205312700 1 --2- 172.21.15.123:0/2102975678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2001029a0 0x7fa20019e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:13.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.947+0000 7fa205312700 1 --2- 172.21.15.123:0/2102975678 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fa1e80a1120 0x7fa1e80a35e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:13.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.947+0000 7fa205312700 1 --2- 172.21.15.123:0/2102975678 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa200100e90 0x7fa200196e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:13.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.947+0000 7fa205312700 1 --2- 172.21.15.123:0/2102975678 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fa200101fe0 0x7fa200197360 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:13.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.947+0000 7fa205312700 1 -- 172.21.15.123:0/2102975678 >> 172.21.15.123:0/2102975678 conn(0x7fa2000fc400 msgr2=0x7fa2001053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:20:13.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.947+0000 7fa205312700 1 -- 172.21.15.123:0/2102975678 shutdown_connections 2024-06-02T04:20:13.947 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:13.947+0000 7fa205312700 1 -- 172.21.15.123:0/2102975678 wait complete. 2024-06-02T04:20:13.947 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 28 2024-06-02T04:20:13.959 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-06-02T04:20:14.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:13 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/1762256769' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-02T04:20:14.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.083+0000 7f61c8fd0700 1 -- 172.21.15.123:0/3586210627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61c4100f80 msgr2=0x7f61c41013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:14.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.083+0000 7f61c8fd0700 1 --2- 172.21.15.123:0/3586210627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61c4100f80 0x7f61c41013e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f61b40099c0 tx=0x7f61b4009cd0 comp rx=0 tx=0).stop 2024-06-02T04:20:14.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.083+0000 7f61c8fd0700 1 -- 172.21.15.123:0/3586210627 shutdown_connections 2024-06-02T04:20:14.082 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.083+0000 7f61c8fd0700 1 --2- 172.21.15.123:0/3586210627 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61c4101920 0x7f61c41081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:14.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.083+0000 7f61c8fd0700 1 --2- 172.21.15.123:0/3586210627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61c40ffd90 0x7f61c41001b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:14.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.083+0000 7f61c8fd0700 1 --2- 172.21.15.123:0/3586210627 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61c4100f80 0x7f61c41013e0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:14.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.083+0000 7f61c8fd0700 1 -- 172.21.15.123:0/3586210627 >> 172.21.15.123:0/3586210627 conn(0x7f61c40fb300 msgr2=0x7f61c40fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:20:14.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.083+0000 7f61c8fd0700 1 -- 172.21.15.123:0/3586210627 shutdown_connections 2024-06-02T04:20:14.083 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.083+0000 7f61c8fd0700 1 -- 172.21.15.123:0/3586210627 wait complete. 2024-06-02T04:20:14.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.084+0000 7f61c8fd0700 1 Processor -- start 2024-06-02T04:20:14.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.084+0000 7f61c8fd0700 1 -- start start 2024-06-02T04:20:14.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.084+0000 7f61c8fd0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61c40ffd90 0x7f61c4196e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:14.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.084+0000 7f61c8fd0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61c4100f80 0x7f61c41973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:14.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.084+0000 7f61c8fd0700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61c4101920 0x7f61c419e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:14.085 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.084+0000 7f61c8fd0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c419e940 con 0x7f61c40ffd90 2024-06-02T04:20:14.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.084+0000 7f61c8fd0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c419ea80 con 0x7f61c4100f80 2024-06-02T04:20:14.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.084+0000 7f61c8fd0700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c419ec10 con 0x7f61c4101920 2024-06-02T04:20:14.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.084+0000 7f61c259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61c40ffd90 0x7f61c4196e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:14.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.084+0000 7f61c259c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61c40ffd90 0x7f61c4196e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:38410/0 (socket says 172.21.15.123:38410) 2024-06-02T04:20:14.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.084+0000 7f61c259c700 1 -- 172.21.15.123:0/394926477 learned_addr learned my addr 172.21.15.123:0/394926477 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:20:14.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.084+0000 7f61c2d9d700 1 --2- 172.21.15.123:0/394926477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61c4101920 0x7f61c419e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:14.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.084+0000 7f61c1d9b700 1 --2- 172.21.15.123:0/394926477 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61c4100f80 0x7f61c41973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:14.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.084+0000 7f61c259c700 1 -- 172.21.15.123:0/394926477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61c4101920 msgr2=0x7f61c419e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:14.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.084+0000 7f61c259c700 1 --2- 172.21.15.123:0/394926477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61c4101920 0x7f61c419e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:14.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.084+0000 7f61c259c700 1 -- 172.21.15.123:0/394926477 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61c4100f80 msgr2=0x7f61c41973a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:14.086 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.084+0000 7f61c259c700 1 --2- 172.21.15.123:0/394926477 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61c4100f80 0x7f61c41973a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:14.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.084+0000 7f61c259c700 1 -- 172.21.15.123:0/394926477 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b40095f0 con 0x7f61c40ffd90 2024-06-02T04:20:14.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.084+0000 7f61c259c700 1 --2- 172.21.15.123:0/394926477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61c40ffd90 0x7f61c4196e60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f61b800d980 tx=0x7f61b800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:20:14.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.085+0000 7f61b37fe700 1 -- 172.21.15.123:0/394926477 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b800de60 con 0x7f61c40ffd90 2024-06-02T04:20:14.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.085+0000 7f61b37fe700 1 -- 172.21.15.123:0/394926477 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61b80044e0 con 0x7f61c40ffd90 2024-06-02T04:20:14.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.085+0000 7f61c8fd0700 1 -- 172.21.15.123:0/394926477 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c419eef0 con 0x7f61c40ffd90 2024-06-02T04:20:14.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.085+0000 7f61b37fe700 1 -- 172.21.15.123:0/394926477 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8003be0 con 0x7f61c40ffd90 2024-06-02T04:20:14.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.085+0000 7f61c8fd0700 1 -- 172.21.15.123:0/394926477 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c419f320 con 0x7f61c40ffd90 2024-06-02T04:20:14.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.086+0000 7f61c8fd0700 1 -- 172.21.15.123:0/394926477 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c4068060 con 0x7f61c40ffd90 2024-06-02T04:20:14.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.087+0000 7f61b37fe700 1 -- 172.21.15.123:0/394926477 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f61b8009bb0 con 0x7f61c40ffd90 2024-06-02T04:20:14.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.087+0000 7f61b37fe700 1 --2- 172.21.15.123:0/394926477 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f61ac0a11a0 0x7f61ac0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:14.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.087+0000 7f61c1d9b700 1 --2- 172.21.15.123:0/394926477 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f61ac0a11a0 0x7f61ac0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:14.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.087+0000 7f61b37fe700 1 -- 172.21.15.123:0/394926477 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f61b80cc520 con 0x7f61c40ffd90 2024-06-02T04:20:14.088 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.088+0000 7f61c1d9b700 1 --2- 172.21.15.123:0/394926477 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f61ac0a11a0 0x7f61ac0a3660 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f61b4000c00 tx=0x7f61b4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:20:14.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:13 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/1762256769' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-06-02T04:20:14.090 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.092+0000 7f61b37fe700 1 -- 172.21.15.123:0/394926477 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f61b8095d70 con 0x7f61c40ffd90 2024-06-02T04:20:14.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.337+0000 7f61c8fd0700 1 -- 172.21.15.123:0/394926477 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61c419f5a0 con 0x7f61c40ffd90 2024-06-02T04:20:14.336 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.338+0000 7f61b37fe700 1 -- 172.21.15.123:0/394926477 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+10930 (secure 0 0 0) 0x7f61b8009940 con 0x7f61c40ffd90 2024-06-02T04:20:14.337 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:20:14.337 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14553,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6835/1940848601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6834","nonce":1940848601},{"type":"v1","addr":"172.21.15.123:6835","nonce":1940848601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14565,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.123:6837/54447879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6836","nonce":54447879},{"type":"v1","addr":"172.21.15.123:6837","nonce":54447879}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-06-02T04:03:06.667888+0000","modified":"2024-06-02T04:04:21.015497+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24509,"mds_1":24490,"mds_2":24473,"mds_3":24439,"mds_4":24437},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14613":{"gid":14613,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6839/3806973328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6838","nonce":3806973328},{"type":"v1","addr":"172.21.15.123:6839","nonce":3806973328}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14619":{"gid":14619,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.123:6841/4032992994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6840","nonce":4032992994},{"type":"v1","addr":"172.21.15.123:6841","nonce":4032992994}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24437":{"gid":24437,"name":"k","rank":4,"incarnation":25,"state":"up:active","state_seq":9,"addr":"172.21.15.136:6833/2006585076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2006585076},{"type":"v1","addr":"172.21.15.136:6833","nonce":2006585076}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24439":{"gid":24439,"name":"l","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.162:6833/3583622784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":3583622784},{"type":"v1","addr":"172.21.15.162:6833","nonce":3583622784}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24455":{"gid":24455,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.136:6835/2894031422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2894031422},{"type":"v1","addr":"172.21.15.136:6835","nonce":2894031422}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24463":{"gid":24463,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6835/2478943987","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2478943987},{"type":"v1","addr":"172.21.15.162:6835","nonce":2478943987}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24469":{"gid":24469,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.162:6837/3402138468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3402138468},{"type":"v1","addr":"172.21.15.162:6837","nonce":3402138468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24473":{"gid":24473,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":5,"addr":"172.21.15.136:6837/2572418263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":2572418263},{"type":"v1","addr":"172.21.15.136:6837","nonce":2572418263}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.162:6839/2588884232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2588884232},{"type":"v1","addr":"172.21.15.162:6839","nonce":2588884232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6839/952830191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6838","nonce":952830191},{"type":"v1","addr":"172.21.15.136:6839","nonce":952830191}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-06-02T04:20:14.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.340+0000 7f61c8fd0700 1 -- 172.21.15.123:0/394926477 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f61ac0a11a0 msgr2=0x7f61ac0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:14.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.340+0000 7f61c8fd0700 1 --2- 172.21.15.123:0/394926477 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f61ac0a11a0 0x7f61ac0a3660 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f61b4000c00 tx=0x7f61b4005fb0 comp rx=0 tx=0).stop 2024-06-02T04:20:14.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.340+0000 7f61c8fd0700 1 -- 172.21.15.123:0/394926477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61c40ffd90 msgr2=0x7f61c4196e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:14.339 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.340+0000 7f61c8fd0700 1 --2- 172.21.15.123:0/394926477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61c40ffd90 0x7f61c4196e60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f61b800d980 tx=0x7f61b800dd40 comp rx=0 tx=0).stop 2024-06-02T04:20:14.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.340+0000 7f61c8fd0700 1 -- 172.21.15.123:0/394926477 shutdown_connections 2024-06-02T04:20:14.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.340+0000 7f61c8fd0700 1 --2- 172.21.15.123:0/394926477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61c4101920 0x7f61c419e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:14.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.340+0000 7f61c8fd0700 1 --2- 172.21.15.123:0/394926477 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f61c40ffd90 0x7f61c4196e60 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:14.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.340+0000 7f61c8fd0700 1 --2- 172.21.15.123:0/394926477 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f61ac0a11a0 0x7f61ac0a3660 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:14.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.340+0000 7f61c8fd0700 1 --2- 172.21.15.123:0/394926477 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61c4100f80 0x7f61c41973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:14.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.340+0000 7f61c8fd0700 1 -- 172.21.15.123:0/394926477 >> 172.21.15.123:0/394926477 conn(0x7f61c40fb300 msgr2=0x7f61c40fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:20:14.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.340+0000 7f61c8fd0700 1 -- 172.21.15.123:0/394926477 shutdown_connections 2024-06-02T04:20:14.340 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.340+0000 7f61c8fd0700 1 -- 172.21.15.123:0/394926477 wait complete. 2024-06-02T04:20:14.340 INFO:teuthology.orchestra.run.smithi123.stderr:dumped fsmap epoch 28 2024-06-02T04:20:14.353 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-06-02T04:20:14.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.476+0000 7f9ec49c7700 1 -- 172.21.15.123:0/3284566142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ec0100a50 msgr2=0x7f9ec0100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:14.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.476+0000 7f9ec49c7700 1 --2- 172.21.15.123:0/3284566142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ec0100a50 0x7f9ec0100ed0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800b0d0 tx=0x7f9eb800b3e0 comp rx=0 tx=0).stop 2024-06-02T04:20:14.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.476+0000 7f9ec49c7700 1 -- 172.21.15.123:0/3284566142 shutdown_connections 2024-06-02T04:20:14.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.476+0000 7f9ec49c7700 1 --2- 172.21.15.123:0/3284566142 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ec0100a50 0x7f9ec0100ed0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:14.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.476+0000 7f9ec49c7700 1 --2- 172.21.15.123:0/3284566142 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ec00ff730 0x7f9ec00ffb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:14.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.476+0000 7f9ec49c7700 1 --2- 172.21.15.123:0/3284566142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ec0100090 0x7f9ec0100510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:14.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.476+0000 7f9ec49c7700 1 -- 172.21.15.123:0/3284566142 >> 172.21.15.123:0/3284566142 conn(0x7f9ec00fb2f0 msgr2=0x7f9ec00fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:20:14.477 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.476+0000 7f9ec49c7700 1 -- 172.21.15.123:0/3284566142 shutdown_connections 2024-06-02T04:20:14.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.476+0000 7f9ec49c7700 1 -- 172.21.15.123:0/3284566142 wait complete. 2024-06-02T04:20:14.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.477+0000 7f9ec49c7700 1 Processor -- start 2024-06-02T04:20:14.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.477+0000 7f9ec49c7700 1 -- start start 2024-06-02T04:20:14.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.477+0000 7f9ec49c7700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ec00ff730 0x7f9ec01990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:14.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.477+0000 7f9ec49c7700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ec0100090 0x7f9ec0199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:14.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.477+0000 7f9ec49c7700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ec0100a50 0x7f9ec01a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:14.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.477+0000 7f9ec49c7700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec01a0c00 con 0x7f9ec0100a50 2024-06-02T04:20:14.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.477+0000 7f9ec49c7700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec01a0d40 con 0x7f9ec0100090 2024-06-02T04:20:14.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.477+0000 7f9ec49c7700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec01a0ed0 con 0x7f9ec00ff730 2024-06-02T04:20:14.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.477+0000 7f9ebed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ec0100a50 0x7f9ec01a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:14.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.477+0000 7f9ebed9d700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ec0100a50 0x7f9ec01a0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45716/0 (socket says 172.21.15.123:45716) 2024-06-02T04:20:14.478 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.477+0000 7f9ebed9d700 1 -- 172.21.15.123:0/3666978661 learned_addr learned my addr 172.21.15.123:0/3666978661 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:20:14.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.477+0000 7f9ebe59c700 1 --2- 172.21.15.123:0/3666978661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ec00ff730 0x7f9ec01990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:14.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.477+0000 7f9ebdd9b700 1 --2- 172.21.15.123:0/3666978661 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ec0100090 0x7f9ec0199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:14.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.477+0000 7f9ebed9d700 1 -- 172.21.15.123:0/3666978661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ec00ff730 msgr2=0x7f9ec01990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:14.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.477+0000 7f9ebed9d700 1 --2- 172.21.15.123:0/3666978661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ec00ff730 0x7f9ec01990d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:14.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.477+0000 7f9ebed9d700 1 -- 172.21.15.123:0/3666978661 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ec0100090 msgr2=0x7f9ec0199610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:14.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.477+0000 7f9ebed9d700 1 --2- 172.21.15.123:0/3666978661 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ec0100090 0x7f9ec0199610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:14.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.477+0000 7f9ebed9d700 1 -- 172.21.15.123:0/3666978661 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb8009d00 con 0x7f9ec0100a50 2024-06-02T04:20:14.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.477+0000 7f9ebed9d700 1 --2- 172.21.15.123:0/3666978661 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ec0100a50 0x7f9ec01a0630 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8007bd0 tx=0x7f9eb8009440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:20:14.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.478+0000 7f9eb77fe700 1 -- 172.21.15.123:0/3666978661 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb800e040 con 0x7f9ec0100a50 2024-06-02T04:20:14.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.478+0000 7f9ec49c7700 1 -- 172.21.15.123:0/3666978661 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec01a1150 con 0x7f9ec0100a50 2024-06-02T04:20:14.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.478+0000 7f9eb77fe700 1 -- 172.21.15.123:0/3666978661 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9eb801dd50 con 0x7f9ec0100a50 2024-06-02T04:20:14.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.478+0000 7f9eb77fe700 1 -- 172.21.15.123:0/3666978661 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb80123f0 con 0x7f9ec0100a50 2024-06-02T04:20:14.479 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.478+0000 7f9ec49c7700 1 -- 172.21.15.123:0/3666978661 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec01a15d0 con 0x7f9ec0100a50 2024-06-02T04:20:14.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.478+0000 7f9ec49c7700 1 -- 172.21.15.123:0/3666978661 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec010a690 con 0x7f9ec0100a50 2024-06-02T04:20:14.480 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.480+0000 7f9eb77fe700 1 -- 172.21.15.123:0/3666978661 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f9eb801b550 con 0x7f9ec0100a50 2024-06-02T04:20:14.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.481+0000 7f9eb77fe700 1 --2- 172.21.15.123:0/3666978661 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9eac0a1120 0x7f9eac0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:14.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.481+0000 7f9ebe59c700 1 --2- 172.21.15.123:0/3666978661 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9eac0a1120 0x7f9eac0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:14.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.481+0000 7f9eb77fe700 1 -- 172.21.15.123:0/3666978661 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f9eb80cee30 con 0x7f9ec0100a50 2024-06-02T04:20:14.481 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.481+0000 7f9ebe59c700 1 --2- 172.21.15.123:0/3666978661 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9eac0a1120 0x7f9eac0a35e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8007c60 tx=0x7f9ea80073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:20:14.483 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.484+0000 7f9eb77fe700 1 -- 172.21.15.123:0/3666978661 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9eb8098710 con 0x7f9ec0100a50 2024-06-02T04:20:14.682 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.683+0000 7f9ec49c7700 1 -- 172.21.15.123:0/3666978661 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ec0067c10 con 0x7f9ec0100a50 2024-06-02T04:20:14.683 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.684+0000 7f9eb77fe700 1 -- 172.21.15.123:0/3666978661 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22468 (secure 0 0 0) 0x7f9eb809bd30 con 0x7f9ec0100a50 2024-06-02T04:20:14.683 INFO:teuthology.orchestra.run.smithi123.stdout: 2024-06-02T04:20:14.684 INFO:teuthology.orchestra.run.smithi123.stdout:{"epoch":84,"fsid":"1b432ae0-2094-11ef-bc9b-c7b262605968","created":"2024-06-02T03:57:17.383774+0000","modified":"2024-06-02T04:04:08.620765+0000","last_up_change":"2024-06-02T04:02:34.535591+0000","last_in_change":"2024-06-02T04:02:18.346560+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-06-02T03:59:57.079448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-06-02T04:03:05.199881+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-06-02T04:03:05.853741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d9d8fb5a-dac5-4b14-98e5-665bdbc696ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6802","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6803","nonce":2763421276}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6804","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6805","nonce":2763421276}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6808","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6809","nonce":2763421276}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6806","nonce":2763421276},{"type":"v1","addr":"172.21.15.123:6807","nonce":2763421276}]},"public_addr":"172.21.15.123:6803/2763421276","cluster_addr":"172.21.15.123:6805/2763421276","heartbeat_back_addr":"172.21.15.123:6809/2763421276","heartbeat_front_addr":"172.21.15.123:6807/2763421276","state":["exists","up"]},{"osd":1,"uuid":"121bbe3c-bb76-4ec4-9596-37db68fbf1ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6801","nonce":956325510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6803","nonce":956325510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6807","nonce":956325510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":956325510},{"type":"v1","addr":"172.21.15.136:6805","nonce":956325510}]},"public_addr":"172.21.15.136:6801/956325510","cluster_addr":"172.21.15.136:6803/956325510","heartbeat_back_addr":"172.21.15.136:6807/956325510","heartbeat_front_addr":"172.21.15.136:6805/956325510","state":["exists","up"]},{"osd":2,"uuid":"df9edf0d-f9f0-4699-a6ed-bbcf2dfb1b76","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6801","nonce":2915749676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6803","nonce":2915749676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6807","nonce":2915749676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2915749676},{"type":"v1","addr":"172.21.15.162:6805","nonce":2915749676}]},"public_addr":"172.21.15.162:6801/2915749676","cluster_addr":"172.21.15.162:6803/2915749676","heartbeat_back_addr":"172.21.15.162:6807/2915749676","heartbeat_front_addr":"172.21.15.162:6805/2915749676","state":["exists","up"]},{"osd":3,"uuid":"3e070364-12c6-4780-b2be-f6e933e65773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6810","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6811","nonce":1403773143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6812","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6813","nonce":1403773143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6816","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6817","nonce":1403773143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6814","nonce":1403773143},{"type":"v1","addr":"172.21.15.123:6815","nonce":1403773143}]},"public_addr":"172.21.15.123:6811/1403773143","cluster_addr":"172.21.15.123:6813/1403773143","heartbeat_back_addr":"172.21.15.123:6817/1403773143","heartbeat_front_addr":"172.21.15.123:6815/1403773143","state":["exists","up"]},{"osd":4,"uuid":"87dd92dd-73c8-4785-bf8a-3756d79dee90","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6809","nonce":1403526782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6811","nonce":1403526782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6815","nonce":1403526782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":1403526782},{"type":"v1","addr":"172.21.15.136:6813","nonce":1403526782}]},"public_addr":"172.21.15.136:6809/1403526782","cluster_addr":"172.21.15.136:6811/1403526782","heartbeat_back_addr":"172.21.15.136:6815/1403526782","heartbeat_front_addr":"172.21.15.136:6813/1403526782","state":["exists","up"]},{"osd":5,"uuid":"1a730863-6b56-43b7-a115-c80d3c8f3ee3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6809","nonce":3094256489}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6811","nonce":3094256489}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6815","nonce":3094256489}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":3094256489},{"type":"v1","addr":"172.21.15.162:6813","nonce":3094256489}]},"public_addr":"172.21.15.162:6809/3094256489","cluster_addr":"172.21.15.162:6811/3094256489","heartbeat_back_addr":"172.21.15.162:6815/3094256489","heartbeat_front_addr":"172.21.15.162:6813/3094256489","state":["exists","up"]},{"osd":6,"uuid":"6f170b85-6c47-49ff-ba5b-7fe0596a4ce6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6818","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6819","nonce":3025820432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6820","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6821","nonce":3025820432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6824","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6825","nonce":3025820432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6822","nonce":3025820432},{"type":"v1","addr":"172.21.15.123:6823","nonce":3025820432}]},"public_addr":"172.21.15.123:6819/3025820432","cluster_addr":"172.21.15.123:6821/3025820432","heartbeat_back_addr":"172.21.15.123:6825/3025820432","heartbeat_front_addr":"172.21.15.123:6823/3025820432","state":["exists","up"]},{"osd":7,"uuid":"ee66bb7a-6c0d-4e5a-b717-258a39f93a87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6817","nonce":1948829505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6819","nonce":1948829505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6823","nonce":1948829505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":1948829505},{"type":"v1","addr":"172.21.15.136:6821","nonce":1948829505}]},"public_addr":"172.21.15.136:6817/1948829505","cluster_addr":"172.21.15.136:6819/1948829505","heartbeat_back_addr":"172.21.15.136:6823/1948829505","heartbeat_front_addr":"172.21.15.136:6821/1948829505","state":["exists","up"]},{"osd":8,"uuid":"0ff77e33-53a5-43ef-85da-2036a1fcdb09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6817","nonce":1590839230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6819","nonce":1590839230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6823","nonce":1590839230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1590839230},{"type":"v1","addr":"172.21.15.162:6821","nonce":1590839230}]},"public_addr":"172.21.15.162:6817/1590839230","cluster_addr":"172.21.15.162:6819/1590839230","heartbeat_back_addr":"172.21.15.162:6823/1590839230","heartbeat_front_addr":"172.21.15.162:6821/1590839230","state":["exists","up"]},{"osd":9,"uuid":"1670731c-5e8f-4cbc-8f35-6aeb14ea3075","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6826","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6827","nonce":608720685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6828","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6829","nonce":608720685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6832","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6833","nonce":608720685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.123:6830","nonce":608720685},{"type":"v1","addr":"172.21.15.123:6831","nonce":608720685}]},"public_addr":"172.21.15.123:6827/608720685","cluster_addr":"172.21.15.123:6829/608720685","heartbeat_back_addr":"172.21.15.123:6833/608720685","heartbeat_front_addr":"172.21.15.123:6831/608720685","state":["exists","up"]},{"osd":10,"uuid":"ae138b96-13e7-46ac-9d4d-48308132465d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6825","nonce":3777263126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6827","nonce":3777263126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6831","nonce":3777263126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":3777263126},{"type":"v1","addr":"172.21.15.136:6829","nonce":3777263126}]},"public_addr":"172.21.15.136:6825/3777263126","cluster_addr":"172.21.15.136:6827/3777263126","heartbeat_back_addr":"172.21.15.136:6831/3777263126","heartbeat_front_addr":"172.21.15.136:6829/3777263126","state":["exists","up"]},{"osd":11,"uuid":"69f4ede0-7e9b-4edb-be54-01f74f002a06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6825","nonce":704809754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6827","nonce":704809754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6831","nonce":704809754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":704809754},{"type":"v1","addr":"172.21.15.162:6829","nonce":704809754}]},"public_addr":"172.21.15.162:6825/704809754","cluster_addr":"172.21.15.162:6827/704809754","heartbeat_back_addr":"172.21.15.162:6831/704809754","heartbeat_front_addr":"172.21.15.162:6829/704809754","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:19.188506+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:36.535261+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T03:59:54.242294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:11.815314+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:29.512086+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:00:46.874319+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:04.437358+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:22.312520+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:39.917998+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:01:57.340043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:15.252797+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-06-02T04:02:32.898924+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.123:0/69783025":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:6801/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3442784869":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/10165744":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/2081407856":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/4026642298":"2024-06-03T03:57:45.611046+0000","172.21.15.123:6800/3555101542":"2024-06-03T03:58:06.766197+0000","172.21.15.123:0/1442330765":"2024-06-03T03:57:45.611046+0000","172.21.15.123:0/1595718606":"2024-06-03T03:57:45.611046+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-06-02T04:20:14.685 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.686+0000 7f9ec49c7700 1 -- 172.21.15.123:0/3666978661 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9eac0a1120 msgr2=0x7f9eac0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:14.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.686+0000 7f9ec49c7700 1 --2- 172.21.15.123:0/3666978661 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9eac0a1120 0x7f9eac0a35e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8007c60 tx=0x7f9ea80073d0 comp rx=0 tx=0).stop 2024-06-02T04:20:14.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.686+0000 7f9ec49c7700 1 -- 172.21.15.123:0/3666978661 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ec0100a50 msgr2=0x7f9ec01a0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:14.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.686+0000 7f9ec49c7700 1 --2- 172.21.15.123:0/3666978661 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ec0100a50 0x7f9ec01a0630 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8007bd0 tx=0x7f9eb8009440 comp rx=0 tx=0).stop 2024-06-02T04:20:14.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.687+0000 7f9ec49c7700 1 -- 172.21.15.123:0/3666978661 shutdown_connections 2024-06-02T04:20:14.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.687+0000 7f9ec49c7700 1 --2- 172.21.15.123:0/3666978661 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f9ec0100a50 0x7f9ec01a0630 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:14.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.687+0000 7f9ec49c7700 1 --2- 172.21.15.123:0/3666978661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ec00ff730 0x7f9ec01990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:14.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.687+0000 7f9ec49c7700 1 --2- 172.21.15.123:0/3666978661 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f9eac0a1120 0x7f9eac0a35e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:14.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.687+0000 7f9ec49c7700 1 --2- 172.21.15.123:0/3666978661 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ec0100090 0x7f9ec0199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:14.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.687+0000 7f9ec49c7700 1 -- 172.21.15.123:0/3666978661 >> 172.21.15.123:0/3666978661 conn(0x7f9ec00fb2f0 msgr2=0x7f9ec00fc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:20:14.686 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.687+0000 7f9ec49c7700 1 -- 172.21.15.123:0/3666978661 shutdown_connections 2024-06-02T04:20:14.687 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.687+0000 7f9ec49c7700 1 -- 172.21.15.123:0/3666978661 wait complete. 2024-06-02T04:20:14.698 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-06-02T04:20:14.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.823+0000 7f17c64a0700 1 -- 172.21.15.123:0/975293956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17c00ffe70 msgr2=0x7f17c0100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:14.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.823+0000 7f17c64a0700 1 --2- 172.21.15.123:0/975293956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17c00ffe70 0x7f17c0100290 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f17b0009990 tx=0x7f17b0009ca0 comp rx=0 tx=0).stop 2024-06-02T04:20:14.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.823+0000 7f17c64a0700 1 -- 172.21.15.123:0/975293956 shutdown_connections 2024-06-02T04:20:14.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.823+0000 7f17c64a0700 1 --2- 172.21.15.123:0/975293956 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17c0101980 0x7f17c01082a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:14.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.823+0000 7f17c64a0700 1 --2- 172.21.15.123:0/975293956 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17c00ffe70 0x7f17c0100290 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:14.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.823+0000 7f17c64a0700 1 --2- 172.21.15.123:0/975293956 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17c0100fc0 0x7f17c0101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:14.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.823+0000 7f17c64a0700 1 -- 172.21.15.123:0/975293956 >> 172.21.15.123:0/975293956 conn(0x7f17c00fb400 msgr2=0x7f17c00fd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:20:14.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.824+0000 7f17c64a0700 1 -- 172.21.15.123:0/975293956 shutdown_connections 2024-06-02T04:20:14.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.824+0000 7f17c64a0700 1 -- 172.21.15.123:0/975293956 wait complete. 2024-06-02T04:20:14.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.824+0000 7f17c64a0700 1 Processor -- start 2024-06-02T04:20:14.823 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.824+0000 7f17c64a0700 1 -- start start 2024-06-02T04:20:14.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.824+0000 7f17c64a0700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17c00ffe70 0x7f17c0069f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:14.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.824+0000 7f17c64a0700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17c0100fc0 0x7f17c019bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:14.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.824+0000 7f17c64a0700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17c0101980 0x7f17c019e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:14.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.824+0000 7f17c64a0700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c019eab0 con 0x7f17c00ffe70 2024-06-02T04:20:14.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.824+0000 7f17c64a0700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c019ec20 con 0x7f17c0101980 2024-06-02T04:20:14.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.824+0000 7f17c64a0700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c019ede0 con 0x7f17c0100fc0 2024-06-02T04:20:14.826 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.824+0000 7f17bffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17c00ffe70 0x7f17c0069f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:14.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.825+0000 7f17bffff700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17c00ffe70 0x7f17c0069f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45738/0 (socket says 172.21.15.123:45738) 2024-06-02T04:20:14.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.825+0000 7f17bffff700 1 -- 172.21.15.123:0/2892741911 learned_addr learned my addr 172.21.15.123:0/2892741911 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:20:14.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.825+0000 7f17c4a3d700 1 --2- 172.21.15.123:0/2892741911 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17c0101980 0x7f17c019e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:14.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.825+0000 7f17bf7fe700 1 --2- 172.21.15.123:0/2892741911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17c0100fc0 0x7f17c019bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:14.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.825+0000 7f17bffff700 1 -- 172.21.15.123:0/2892741911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17c0100fc0 msgr2=0x7f17c019bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:14.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.825+0000 7f17bffff700 1 --2- 172.21.15.123:0/2892741911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17c0100fc0 0x7f17c019bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:14.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.825+0000 7f17bffff700 1 -- 172.21.15.123:0/2892741911 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17c0101980 msgr2=0x7f17c019e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:14.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.825+0000 7f17bffff700 1 --2- 172.21.15.123:0/2892741911 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17c0101980 0x7f17c019e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:14.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.825+0000 7f17bffff700 1 -- 172.21.15.123:0/2892741911 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b00095f0 con 0x7f17c00ffe70 2024-06-02T04:20:14.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.825+0000 7f17bf7fe700 1 --2- 172.21.15.123:0/2892741911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17c0100fc0 0x7f17c019bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:20:14.827 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.825+0000 7f17c4a3d700 1 --2- 172.21.15.123:0/2892741911 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17c0101980 0x7f17c019e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:20:14.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.825+0000 7f17bffff700 1 --2- 172.21.15.123:0/2892741911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17c00ffe70 0x7f17c0069f90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f17b0005910 tx=0x7f17b0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:20:14.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.825+0000 7f17bd7fa700 1 -- 172.21.15.123:0/2892741911 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b001d070 con 0x7f17c00ffe70 2024-06-02T04:20:14.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.825+0000 7f17bd7fa700 1 -- 172.21.15.123:0/2892741911 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17b00041c0 con 0x7f17c00ffe70 2024-06-02T04:20:14.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.825+0000 7f17c64a0700 1 -- 172.21.15.123:0/2892741911 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c019f000 con 0x7f17c00ffe70 2024-06-02T04:20:14.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.825+0000 7f17bd7fa700 1 -- 172.21.15.123:0/2892741911 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b000f460 con 0x7f17c00ffe70 2024-06-02T04:20:14.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.825+0000 7f17c64a0700 1 -- 172.21.15.123:0/2892741911 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c019f420 con 0x7f17c00ffe70 2024-06-02T04:20:14.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.826+0000 7f17c64a0700 1 -- 172.21.15.123:0/2892741911 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c0107230 con 0x7f17c00ffe70 2024-06-02T04:20:14.828 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.827+0000 7f17bd7fa700 1 -- 172.21.15.123:0/2892741911 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f17b0022650 con 0x7f17c00ffe70 2024-06-02T04:20:14.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.828+0000 7f17bd7fa700 1 --2- 172.21.15.123:0/2892741911 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f17a80a1120 0x7f17a80a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:14.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.828+0000 7f17bd7fa700 1 -- 172.21.15.123:0/2892741911 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8124+0+0 (secure 0 0 0) 0x7f17b00cdda0 con 0x7f17c00ffe70 2024-06-02T04:20:14.829 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.828+0000 7f17bf7fe700 1 --2- 172.21.15.123:0/2892741911 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f17a80a1120 0x7f17a80a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:14.830 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.828+0000 7f17bf7fe700 1 --2- 172.21.15.123:0/2892741911 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f17a80a1120 0x7f17a80a35e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f17b4005fd0 tx=0x7f17b4005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:20:14.831 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:14.832+0000 7f17bd7fa700 1 -- 172.21.15.123:0/2892741911 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f17b0097680 con 0x7f17c00ffe70 2024-06-02T04:20:15.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:14 smithi162 ceph-mon[47009]: pgmap v737: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 KiB/s wr, 12 op/s 2024-06-02T04:20:15.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:14 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/2102975678' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:20:15.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:14 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/394926477' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:20:15.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:14 smithi123 ceph-mon[42885]: pgmap v737: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 KiB/s wr, 12 op/s 2024-06-02T04:20:15.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:14 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2102975678' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:20:15.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:14 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/394926477' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:20:15.074 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.075+0000 7f17c64a0700 1 -- 172.21.15.123:0/2892741911 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f17c0068140 con 0x7f17c00ffe70 2024-06-02T04:20:15.087 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.088+0000 7f17bd7fa700 1 -- 172.21.15.123:0/2892741911 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v29) v1 ==== 161+0+0 (secure 0 0 0) 0x7f17b009aca0 con 0x7f17c00ffe70 2024-06-02T04:20:15.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:14 smithi136 ceph-mon[47443]: pgmap v737: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 KiB/s wr, 12 op/s 2024-06-02T04:20:15.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:14 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/2102975678' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:20:15.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:14 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/394926477' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-06-02T04:20:15.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.091+0000 7f17c64a0700 1 -- 172.21.15.123:0/2892741911 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f17a80a1120 msgr2=0x7f17a80a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:15.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.091+0000 7f17c64a0700 1 --2- 172.21.15.123:0/2892741911 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f17a80a1120 0x7f17a80a35e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f17b4005fd0 tx=0x7f17b4005dc0 comp rx=0 tx=0).stop 2024-06-02T04:20:15.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.091+0000 7f17c64a0700 1 -- 172.21.15.123:0/2892741911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17c00ffe70 msgr2=0x7f17c0069f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:15.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.091+0000 7f17c64a0700 1 --2- 172.21.15.123:0/2892741911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17c00ffe70 0x7f17c0069f90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f17b0005910 tx=0x7f17b0004730 comp rx=0 tx=0).stop 2024-06-02T04:20:15.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.092+0000 7f17c64a0700 1 -- 172.21.15.123:0/2892741911 shutdown_connections 2024-06-02T04:20:15.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.092+0000 7f17c64a0700 1 --2- 172.21.15.123:0/2892741911 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f17a80a1120 0x7f17a80a35e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:15.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.092+0000 7f17c64a0700 1 --2- 172.21.15.123:0/2892741911 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17c0101980 0x7f17c019e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:15.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.092+0000 7f17c64a0700 1 --2- 172.21.15.123:0/2892741911 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f17c00ffe70 0x7f17c0069f90 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:15.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.092+0000 7f17c64a0700 1 --2- 172.21.15.123:0/2892741911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17c0100fc0 0x7f17c019bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:15.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.092+0000 7f17c64a0700 1 -- 172.21.15.123:0/2892741911 >> 172.21.15.123:0/2892741911 conn(0x7f17c00fb400 msgr2=0x7f17c0104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:20:15.091 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.092+0000 7f17c64a0700 1 -- 172.21.15.123:0/2892741911 shutdown_connections 2024-06-02T04:20:15.092 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.092+0000 7f17c64a0700 1 -- 172.21.15.123:0/2892741911 wait complete. 2024-06-02T04:20:15.092 INFO:teuthology.orchestra.run.smithi123.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-06-02T04:20:15.104 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-06-02T04:20:15.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.235+0000 7f3038031700 1 -- 172.21.15.123:0/1782858447 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3030101990 msgr2=0x7f30301082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:15.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.235+0000 7f3038031700 1 --2- 172.21.15.123:0/1782858447 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3030101990 0x7f30301082b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f302800b0a0 tx=0x7f302800b3b0 comp rx=0 tx=0).stop 2024-06-02T04:20:15.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.235+0000 7f3038031700 1 -- 172.21.15.123:0/1782858447 shutdown_connections 2024-06-02T04:20:15.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.235+0000 7f3038031700 1 --2- 172.21.15.123:0/1782858447 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f3030101990 0x7f30301082b0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:15.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.235+0000 7f3038031700 1 --2- 172.21.15.123:0/1782858447 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f30300ffe80 0x7f30301002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:15.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.235+0000 7f3038031700 1 --2- 172.21.15.123:0/1782858447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3030100fd0 0x7f3030101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:15.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.235+0000 7f3038031700 1 -- 172.21.15.123:0/1782858447 >> 172.21.15.123:0/1782858447 conn(0x7f30300fb3f0 msgr2=0x7f30300fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:20:15.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.235+0000 7f3038031700 1 -- 172.21.15.123:0/1782858447 shutdown_connections 2024-06-02T04:20:15.236 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.235+0000 7f3038031700 1 -- 172.21.15.123:0/1782858447 wait complete. 2024-06-02T04:20:15.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.235+0000 7f3038031700 1 Processor -- start 2024-06-02T04:20:15.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.235+0000 7f3038031700 1 -- start start 2024-06-02T04:20:15.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.236+0000 7f3038031700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30300ffe80 0x7f303006a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:15.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.236+0000 7f3038031700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3030100fd0 0x7f303019bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:15.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.236+0000 7f3038031700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3030101990 0x7f303019e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:15.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.236+0000 7f3038031700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303019eaf0 con 0x7f30300ffe80 2024-06-02T04:20:15.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.236+0000 7f3038031700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303019ec60 con 0x7f3030101990 2024-06-02T04:20:15.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.236+0000 7f3038031700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303019ee20 con 0x7f3030100fd0 2024-06-02T04:20:15.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.236+0000 7f3035dcd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30300ffe80 0x7f303006a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:15.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.236+0000 7f30355cc700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3030100fd0 0x7f303019bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:15.237 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.236+0000 7f3035dcd700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30300ffe80 0x7f303006a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45802/0 (socket says 172.21.15.123:45802) 2024-06-02T04:20:15.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.236+0000 7f3035dcd700 1 -- 172.21.15.123:0/2113841851 learned_addr learned my addr 172.21.15.123:0/2113841851 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:20:15.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.236+0000 7f30365ce700 1 --2- 172.21.15.123:0/2113841851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3030101990 0x7f303019e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:15.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.236+0000 7f30355cc700 1 -- 172.21.15.123:0/2113841851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3030101990 msgr2=0x7f303019e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:15.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.236+0000 7f30355cc700 1 --2- 172.21.15.123:0/2113841851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3030101990 0x7f303019e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:15.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.236+0000 7f30355cc700 1 -- 172.21.15.123:0/2113841851 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30300ffe80 msgr2=0x7f303006a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:15.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.236+0000 7f30355cc700 1 --2- 172.21.15.123:0/2113841851 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30300ffe80 0x7f303006a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:15.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.236+0000 7f30355cc700 1 -- 172.21.15.123:0/2113841851 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3028009d00 con 0x7f3030100fd0 2024-06-02T04:20:15.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.236+0000 7f3035dcd700 1 --2- 172.21.15.123:0/2113841851 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30300ffe80 0x7f303006a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-06-02T04:20:15.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.236+0000 7f30365ce700 1 --2- 172.21.15.123:0/2113841851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3030101990 0x7f303019e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:20:15.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.236+0000 7f30355cc700 1 --2- 172.21.15.123:0/2113841851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3030100fd0 0x7f303019bd60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f302c00e9f0 tx=0x7f302c00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:20:15.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.236+0000 7f3026ffd700 1 -- 172.21.15.123:0/2113841851 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c00eee0 con 0x7f3030100fd0 2024-06-02T04:20:15.238 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.236+0000 7f3038031700 1 -- 172.21.15.123:0/2113841851 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f303019f100 con 0x7f3030100fd0 2024-06-02T04:20:15.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.236+0000 7f3026ffd700 1 -- 172.21.15.123:0/2113841851 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f302c00cbd0 con 0x7f3030100fd0 2024-06-02T04:20:15.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.236+0000 7f3026ffd700 1 -- 172.21.15.123:0/2113841851 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c018680 con 0x7f3030100fd0 2024-06-02T04:20:15.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.236+0000 7f3038031700 1 -- 172.21.15.123:0/2113841851 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f303019f610 con 0x7f3030100fd0 2024-06-02T04:20:15.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.237+0000 7f3038031700 1 -- 172.21.15.123:0/2113841851 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3030107220 con 0x7f3030100fd0 2024-06-02T04:20:15.239 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.239+0000 7f3026ffd700 1 -- 172.21.15.123:0/2113841851 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f302c00cd40 con 0x7f3030100fd0 2024-06-02T04:20:15.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.239+0000 7f3026ffd700 1 --2- 172.21.15.123:0/2113841851 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f301c0a1120 0x7f301c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:15.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.239+0000 7f3035dcd700 1 --2- 172.21.15.123:0/2113841851 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f301c0a1120 0x7f301c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:15.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.239+0000 7f3026ffd700 1 -- 172.21.15.123:0/2113841851 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8554+0+0 (secure 0 0 0) 0x7f302c014070 con 0x7f3030100fd0 2024-06-02T04:20:15.240 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.240+0000 7f3035dcd700 1 --2- 172.21.15.123:0/2113841851 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f301c0a1120 0x7f301c0a35e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3020011550 tx=0x7f3020009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:20:15.242 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.243+0000 7f3026ffd700 1 -- 172.21.15.123:0/2113841851 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f302c096500 con 0x7f3030100fd0 2024-06-02T04:20:15.485 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:15.486+0000 7f3038031700 1 -- 172.21.15.123:0/2113841851 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f303010b6d0 con 0x7f3030100fd0 2024-06-02T04:20:15.548 INFO:journalctl@ceph.mds.f.smithi162.stdout:Jun 02 04:20:15 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-f[82945]: ignoring --setuser ceph since I am not root 2024-06-02T04:20:15.548 INFO:journalctl@ceph.mds.f.smithi162.stdout:Jun 02 04:20:15 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-f[82945]: ignoring --setgroup ceph since I am not root 2024-06-02T04:20:15.548 INFO:journalctl@ceph.mds.f.smithi162.stdout:Jun 02 04:20:15 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-f[82945]: starting mds.f at 2024-06-02T04:20:15.548 INFO:journalctl@ceph.mds.l.smithi162.stdout:Jun 02 04:20:15 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-l[82601]: ignoring --setuser ceph since I am not root 2024-06-02T04:20:15.549 INFO:journalctl@ceph.mds.l.smithi162.stdout:Jun 02 04:20:15 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-l[82601]: ignoring --setgroup ceph since I am not root 2024-06-02T04:20:15.549 INFO:journalctl@ceph.mds.l.smithi162.stdout:Jun 02 04:20:15 smithi162 ceph-mds[82625]: -- 172.21.15.162:0/4267915044 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55960f0161a0 con 0x55960efed000 2024-06-02T04:20:15.549 INFO:journalctl@ceph.mds.l.smithi162.stdout:Jun 02 04:20:15 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-l[82601]: starting mds.l at 2024-06-02T04:20:15.549 INFO:journalctl@ceph.mds.c.smithi162.stdout:Jun 02 04:20:15 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-c[83286]: ignoring --setuser ceph since I am not root 2024-06-02T04:20:15.549 INFO:journalctl@ceph.mds.c.smithi162.stdout:Jun 02 04:20:15 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-c[83286]: ignoring --setgroup ceph since I am not root 2024-06-02T04:20:15.549 INFO:journalctl@ceph.mds.c.smithi162.stdout:Jun 02 04:20:15 smithi162 ceph-mds[83309]: -- 172.21.15.162:0/2961433149 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559a17bf21a0 con 0x559a17bc8800 2024-06-02T04:20:15.549 INFO:journalctl@ceph.mds.c.smithi162.stdout:Jun 02 04:20:15 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-c[83286]: starting mds.c at 2024-06-02T04:20:15.550 INFO:journalctl@ceph.mds.i.smithi162.stdout:Jun 02 04:20:15 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-i[83629]: ignoring --setuser ceph since I am not root 2024-06-02T04:20:15.550 INFO:journalctl@ceph.mds.i.smithi162.stdout:Jun 02 04:20:15 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-i[83629]: ignoring --setgroup ceph since I am not root 2024-06-02T04:20:15.550 INFO:journalctl@ceph.mds.i.smithi162.stdout:Jun 02 04:20:15 smithi162 ceph-mds[83652]: -- 172.21.15.162:0/2446825095 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5629e24041a0 con 0x5629e23da800 2024-06-02T04:20:15.550 INFO:journalctl@ceph.mds.i.smithi162.stdout:Jun 02 04:20:15 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-i[83629]: starting mds.i at 2024-06-02T04:20:15.572 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:15 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mon-a[42861]: 2024-06-02T04:20:15.076+0000 7f56b9757700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-02T04:20:15.573 INFO:journalctl@ceph.mds.a.smithi123.stdout:Jun 02 04:20:15 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-a[93605]: ignoring --setuser ceph since I am not root 2024-06-02T04:20:15.573 INFO:journalctl@ceph.mds.a.smithi123.stdout:Jun 02 04:20:15 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-a[93605]: ignoring --setgroup ceph since I am not root 2024-06-02T04:20:15.573 INFO:journalctl@ceph.mds.a.smithi123.stdout:Jun 02 04:20:15 smithi123 ceph-mds[93636]: -- 172.21.15.123:0/1130077509 <== mon.0 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5653d88181a0 con 0x5653d87eec00 2024-06-02T04:20:15.573 INFO:journalctl@ceph.mds.a.smithi123.stdout:Jun 02 04:20:15 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-a[93605]: starting mds.a at 2024-06-02T04:20:15.573 INFO:journalctl@ceph.mds.g.smithi123.stdout:Jun 02 04:20:15 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-g[93241]: ignoring --setuser ceph since I am not root 2024-06-02T04:20:15.573 INFO:journalctl@ceph.mds.g.smithi123.stdout:Jun 02 04:20:15 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-g[93241]: ignoring --setgroup ceph since I am not root 2024-06-02T04:20:15.573 INFO:journalctl@ceph.mds.g.smithi123.stdout:Jun 02 04:20:15 smithi123 ceph-mds[93284]: -- 172.21.15.123:0/1078545257 <== mon.0 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5621181ee1a0 con 0x5621181c4c00 2024-06-02T04:20:15.573 INFO:journalctl@ceph.mds.g.smithi123.stdout:Jun 02 04:20:15 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-g[93241]: starting mds.g at 2024-06-02T04:20:15.588 INFO:journalctl@ceph.mds.b.smithi136.stdout:Jun 02 04:20:15 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-b[84767]: ignoring --setuser ceph since I am not root 2024-06-02T04:20:15.588 INFO:journalctl@ceph.mds.b.smithi136.stdout:Jun 02 04:20:15 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-b[84767]: ignoring --setgroup ceph since I am not root 2024-06-02T04:20:15.588 INFO:journalctl@ceph.mds.b.smithi136.stdout:Jun 02 04:20:15 smithi136 ceph-mds[84790]: -- 172.21.15.136:0/922697170 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5653081b81a0 con 0x56530818ec00 2024-06-02T04:20:15.588 INFO:journalctl@ceph.mds.b.smithi136.stdout:Jun 02 04:20:15 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-b[84767]: starting mds.b at 2024-06-02T04:20:15.589 INFO:journalctl@ceph.mds.e.smithi136.stdout:Jun 02 04:20:15 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-e[84083]: ignoring --setuser ceph since I am not root 2024-06-02T04:20:15.589 INFO:journalctl@ceph.mds.e.smithi136.stdout:Jun 02 04:20:15 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-e[84083]: ignoring --setgroup ceph since I am not root 2024-06-02T04:20:15.589 INFO:journalctl@ceph.mds.e.smithi136.stdout:Jun 02 04:20:15 smithi136 ceph-mds[84106]: -- 172.21.15.136:0/338444379 <== mon.0 v2:172.21.15.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555b77ffa1a0 con 0x555b77fd0c00 2024-06-02T04:20:15.589 INFO:journalctl@ceph.mds.e.smithi136.stdout:Jun 02 04:20:15 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-e[84083]: starting mds.e at 2024-06-02T04:20:15.589 INFO:journalctl@ceph.mds.e.smithi136.stdout:Jun 02 04:20:15 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-e[84083]: 2024-06-02T04:20:15.132+0000 7f245506a700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-06-02T04:20:15.589 INFO:journalctl@ceph.mds.h.smithi136.stdout:Jun 02 04:20:15 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-h[84426]: ignoring --setuser ceph since I am not root 2024-06-02T04:20:15.590 INFO:journalctl@ceph.mds.h.smithi136.stdout:Jun 02 04:20:15 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-h[84426]: ignoring --setgroup ceph since I am not root 2024-06-02T04:20:15.590 INFO:journalctl@ceph.mds.h.smithi136.stdout:Jun 02 04:20:15 smithi136 ceph-mds[84449]: -- 172.21.15.136:0/3560439258 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559cb2f361a0 con 0x559cb2f0cc00 2024-06-02T04:20:15.590 INFO:journalctl@ceph.mds.h.smithi136.stdout:Jun 02 04:20:15 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-h[84426]: starting mds.h at 2024-06-02T04:20:15.590 INFO:journalctl@ceph.mds.k.smithi136.stdout:Jun 02 04:20:15 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-k[83742]: ignoring --setuser ceph since I am not root 2024-06-02T04:20:15.590 INFO:journalctl@ceph.mds.k.smithi136.stdout:Jun 02 04:20:15 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-k[83742]: ignoring --setgroup ceph since I am not root 2024-06-02T04:20:15.590 INFO:journalctl@ceph.mds.k.smithi136.stdout:Jun 02 04:20:15 smithi136 ceph-mds[83765]: -- 172.21.15.136:0/690503139 <== mon.1 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55afd3b661a0 con 0x55afd3b3d000 2024-06-02T04:20:15.590 INFO:journalctl@ceph.mds.k.smithi136.stdout:Jun 02 04:20:15 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-k[83742]: starting mds.k at 2024-06-02T04:20:16.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:15 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/3666978661' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:20:16.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:15 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/2892741911' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-02T04:20:16.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:15 smithi162 ceph-mon[47009]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-06-02T04:20:16.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:15 smithi162 ceph-mon[47009]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-02T04:20:16.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:15 smithi162 ceph-mon[47009]: osdmap e85: 12 total, 12 up, 12 in 2024-06-02T04:20:16.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:15 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/2892741911' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-06-02T04:20:16.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:15 smithi162 ceph-mon[47009]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-06-02T04:20:16.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:15 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/2113841851' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-02T04:20:16.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:15 smithi162 ceph-mon[47009]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-02T04:20:16.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:15 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/3666978661' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:20:16.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:15 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2892741911' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-02T04:20:16.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:15 smithi123 ceph-mon[42885]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-06-02T04:20:16.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:15 smithi123 ceph-mon[42885]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-02T04:20:16.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:15 smithi123 ceph-mon[42885]: osdmap e85: 12 total, 12 up, 12 in 2024-06-02T04:20:16.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:15 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2892741911' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-06-02T04:20:16.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:15 smithi123 ceph-mon[42885]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-06-02T04:20:16.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:15 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/2113841851' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-02T04:20:16.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:15 smithi123 ceph-mon[42885]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-02T04:20:16.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:15 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/3666978661' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-06-02T04:20:16.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:15 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/2892741911' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-06-02T04:20:16.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:15 smithi136 ceph-mon[47443]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-06-02T04:20:16.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:15 smithi136 ceph-mon[47443]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-06-02T04:20:16.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:15 smithi136 ceph-mon[47443]: osdmap e85: 12 total, 12 up, 12 in 2024-06-02T04:20:16.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:15 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/2892741911' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-06-02T04:20:16.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:15 smithi136 ceph-mon[47443]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-06-02T04:20:16.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:15 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/2113841851' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-02T04:20:16.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:15 smithi136 ceph-mon[47443]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-06-02T04:20:16.093 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.095+0000 7f3026ffd700 1 -- 172.21.15.123:0/2113841851 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v30) v1 ==== 104+0+0 (secure 0 0 0) 0x7f302c099b20 con 0x7f3030100fd0 2024-06-02T04:20:16.098 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.100+0000 7f3038031700 1 -- 172.21.15.123:0/2113841851 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f301c0a1120 msgr2=0x7f301c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:16.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.100+0000 7f3038031700 1 --2- 172.21.15.123:0/2113841851 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f301c0a1120 0x7f301c0a35e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3020011550 tx=0x7f3020009260 comp rx=0 tx=0).stop 2024-06-02T04:20:16.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.100+0000 7f3038031700 1 -- 172.21.15.123:0/2113841851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3030100fd0 msgr2=0x7f303019bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:16.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.100+0000 7f3038031700 1 --2- 172.21.15.123:0/2113841851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3030100fd0 0x7f303019bd60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f302c00e9f0 tx=0x7f302c00ed00 comp rx=0 tx=0).stop 2024-06-02T04:20:16.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.100+0000 7f3038031700 1 -- 172.21.15.123:0/2113841851 shutdown_connections 2024-06-02T04:20:16.099 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.100+0000 7f3038031700 1 --2- 172.21.15.123:0/2113841851 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f301c0a1120 0x7f301c0a35e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:16.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.100+0000 7f3038031700 1 --2- 172.21.15.123:0/2113841851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3030101990 0x7f303019e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:16.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.100+0000 7f3038031700 1 --2- 172.21.15.123:0/2113841851 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f30300ffe80 0x7f303006a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:16.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.100+0000 7f3038031700 1 --2- 172.21.15.123:0/2113841851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3030100fd0 0x7f303019bd60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:16.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.100+0000 7f3038031700 1 -- 172.21.15.123:0/2113841851 >> 172.21.15.123:0/2113841851 conn(0x7f30300fb3f0 msgr2=0x7f3030104360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:20:16.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.100+0000 7f3038031700 1 -- 172.21.15.123:0/2113841851 shutdown_connections 2024-06-02T04:20:16.100 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.100+0000 7f3038031700 1 -- 172.21.15.123:0/2113841851 wait complete. 2024-06-02T04:20:16.113 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-06-02T04:20:16.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.242+0000 7f706e7c9700 1 -- 172.21.15.123:0/1337961166 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70680ffe60 msgr2=0x7f7068100280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:16.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.242+0000 7f706e7c9700 1 --2- 172.21.15.123:0/1337961166 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70680ffe60 0x7f7068100280 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7050009990 tx=0x7f7050009ca0 comp rx=0 tx=0).stop 2024-06-02T04:20:16.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.242+0000 7f706e7c9700 1 -- 172.21.15.123:0/1337961166 shutdown_connections 2024-06-02T04:20:16.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.242+0000 7f706e7c9700 1 --2- 172.21.15.123:0/1337961166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7068101970 0x7f7068108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:16.243 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.242+0000 7f706e7c9700 1 --2- 172.21.15.123:0/1337961166 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f70680ffe60 0x7f7068100280 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:16.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.242+0000 7f706e7c9700 1 --2- 172.21.15.123:0/1337961166 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7068100fb0 0x7f7068101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:16.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.242+0000 7f706e7c9700 1 -- 172.21.15.123:0/1337961166 >> 172.21.15.123:0/1337961166 conn(0x7f70680fb3f0 msgr2=0x7f70680fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:20:16.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.242+0000 7f706e7c9700 1 -- 172.21.15.123:0/1337961166 shutdown_connections 2024-06-02T04:20:16.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.242+0000 7f706e7c9700 1 -- 172.21.15.123:0/1337961166 wait complete. 2024-06-02T04:20:16.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.243+0000 7f706e7c9700 1 Processor -- start 2024-06-02T04:20:16.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.243+0000 7f706e7c9700 1 -- start start 2024-06-02T04:20:16.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.243+0000 7f706e7c9700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70680ffe60 0x7f7068068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:16.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.243+0000 7f706e7c9700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7068100fb0 0x7f706819bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:16.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.243+0000 7f706e7c9700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7068101970 0x7f706819e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:16.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.243+0000 7f706e7c9700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706819e920 con 0x7f7068101970 2024-06-02T04:20:16.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.243+0000 7f706e7c9700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706819ea90 con 0x7f70680ffe60 2024-06-02T04:20:16.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.243+0000 7f706e7c9700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706819ec50 con 0x7f7068100fb0 2024-06-02T04:20:16.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.243+0000 7f706cd66700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7068101970 0x7f706819e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:16.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.243+0000 7f706cd66700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7068101970 0x7f706819e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45824/0 (socket says 172.21.15.123:45824) 2024-06-02T04:20:16.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.243+0000 7f706cd66700 1 -- 172.21.15.123:0/304611376 learned_addr learned my addr 172.21.15.123:0/304611376 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:20:16.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.243+0000 7f7067fff700 1 --2- 172.21.15.123:0/304611376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70680ffe60 0x7f7068068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:16.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.243+0000 7f706cd66700 1 -- 172.21.15.123:0/304611376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7068100fb0 msgr2=0x7f706819bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:16.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.243+0000 7f706cd66700 1 --2- 172.21.15.123:0/304611376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7068100fb0 0x7f706819bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:16.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.243+0000 7f706cd66700 1 -- 172.21.15.123:0/304611376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70680ffe60 msgr2=0x7f7068068b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:16.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.243+0000 7f706cd66700 1 --2- 172.21.15.123:0/304611376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70680ffe60 0x7f7068068b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:16.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.243+0000 7f706cd66700 1 -- 172.21.15.123:0/304611376 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70500095f0 con 0x7f7068101970 2024-06-02T04:20:16.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.243+0000 7f7067fff700 1 --2- 172.21.15.123:0/304611376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70680ffe60 0x7f7068068b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:20:16.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.244+0000 7f706cd66700 1 --2- 172.21.15.123:0/304611376 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7068101970 0x7f706819e180 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7060007ee0 tx=0x7f706000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:20:16.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.244+0000 7f70657fa700 1 -- 172.21.15.123:0/304611376 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7060017070 con 0x7f7068101970 2024-06-02T04:20:16.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.244+0000 7f70657fa700 1 -- 172.21.15.123:0/304611376 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f706000f040 con 0x7f7068101970 2024-06-02T04:20:16.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.244+0000 7f706e7c9700 1 -- 172.21.15.123:0/304611376 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f706819ef30 con 0x7f7068101970 2024-06-02T04:20:16.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.244+0000 7f70657fa700 1 -- 172.21.15.123:0/304611376 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7060005740 con 0x7f7068101970 2024-06-02T04:20:16.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.244+0000 7f706e7c9700 1 -- 172.21.15.123:0/304611376 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f706819f3c0 con 0x7f7068101970 2024-06-02T04:20:16.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.245+0000 7f706e7c9700 1 -- 172.21.15.123:0/304611376 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7068107280 con 0x7f7068101970 2024-06-02T04:20:16.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.246+0000 7f70657fa700 1 -- 172.21.15.123:0/304611376 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7f70600058a0 con 0x7f7068101970 2024-06-02T04:20:16.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.246+0000 7f70657fa700 1 --2- 172.21.15.123:0/304611376 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f70540a1120 0x7f70540a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:16.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.246+0000 7f7067fff700 1 --2- 172.21.15.123:0/304611376 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f70540a1120 0x7f70540a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:16.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.246+0000 7f70657fa700 1 -- 172.21.15.123:0/304611376 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8554+0+0 (secure 0 0 0) 0x7f70600cc2e0 con 0x7f7068101970 2024-06-02T04:20:16.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.247+0000 7f7067fff700 1 --2- 172.21.15.123:0/304611376 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f70540a1120 0x7f70540a35e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f705000b5c0 tx=0x7f7050005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:20:16.249 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.251+0000 7f70657fa700 1 -- 172.21.15.123:0/304611376 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7060095930 con 0x7f7068101970 2024-06-02T04:20:16.446 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:16.447+0000 7f706e7c9700 1 -- 172.21.15.123:0/304611376 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7068067cc0 con 0x7f7068101970 2024-06-02T04:20:17.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:16 smithi162 ceph-mon[47009]: pgmap v739: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 12 op/s 2024-06-02T04:20:17.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:16 smithi162 ceph-mon[47009]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-06-02T04:20:17.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:16 smithi162 ceph-mon[47009]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-06-02T04:20:17.048 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:16 smithi162 ceph-mon[47009]: Cluster is now healthy 2024-06-02T04:20:17.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:16 smithi162 ceph-mon[47009]: mds.? [v2:172.21.15.162:6834/3097489345,v1:172.21.15.162:6835/3097489345] up:boot 2024-06-02T04:20:17.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:16 smithi162 ceph-mon[47009]: mds.? [v2:172.21.15.123:6838/431607558,v1:172.21.15.123:6839/431607558] up:boot 2024-06-02T04:20:17.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:16 smithi162 ceph-mon[47009]: mds.? [v2:172.21.15.123:6840/1535088006,v1:172.21.15.123:6841/1535088006] up:boot 2024-06-02T04:20:17.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:16 smithi162 ceph-mon[47009]: mds.? [v2:172.21.15.136:6833/561279927,v1:172.21.15.136:6835/561279927] up:boot 2024-06-02T04:20:17.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:16 smithi162 ceph-mon[47009]: mds.? [v2:172.21.15.136:6832/616638945,v1:172.21.15.136:6834/616638945] up:boot 2024-06-02T04:20:17.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:16 smithi162 ceph-mon[47009]: mds.? [v2:172.21.15.162:6832/1263943553,v1:172.21.15.162:6833/1263943553] up:boot 2024-06-02T04:20:17.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:16 smithi162 ceph-mon[47009]: mds.? [v2:172.21.15.162:6838/668398811,v1:172.21.15.162:6839/668398811] up:boot 2024-06-02T04:20:17.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:16 smithi162 ceph-mon[47009]: mds.? [v2:172.21.15.136:6836/3499692194,v1:172.21.15.136:6838/3499692194] up:boot 2024-06-02T04:20:17.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:16 smithi162 ceph-mon[47009]: mds.? [v2:172.21.15.136:6837/3968165038,v1:172.21.15.136:6839/3968165038] up:boot 2024-06-02T04:20:17.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:16 smithi162 ceph-mon[47009]: mds.? [v2:172.21.15.162:6836/1934263564,v1:172.21.15.162:6837/1934263564] up:boot 2024-06-02T04:20:17.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:16 smithi162 ceph-mon[47009]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-06-02T04:20:17.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:16 smithi162 ceph-mon[47009]: fsmap 12 up:standby 2024-06-02T04:20:17.049 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:16 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-02T04:20:17.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:16 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-02T04:20:17.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:16 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-02T04:20:17.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:16 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-02T04:20:17.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:16 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-02T04:20:17.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:16 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-02T04:20:17.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:16 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-02T04:20:17.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:16 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-02T04:20:17.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:16 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-02T04:20:17.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:16 smithi162 ceph-mon[47009]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-02T04:20:17.050 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:16 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/304611376' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-02T04:20:17.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:16 smithi123 ceph-mon[42885]: pgmap v739: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 12 op/s 2024-06-02T04:20:17.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:16 smithi123 ceph-mon[42885]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-06-02T04:20:17.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:16 smithi123 ceph-mon[42885]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-06-02T04:20:17.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:16 smithi123 ceph-mon[42885]: Cluster is now healthy 2024-06-02T04:20:17.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:16 smithi123 ceph-mon[42885]: mds.? [v2:172.21.15.162:6834/3097489345,v1:172.21.15.162:6835/3097489345] up:boot 2024-06-02T04:20:17.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:16 smithi123 ceph-mon[42885]: mds.? [v2:172.21.15.123:6838/431607558,v1:172.21.15.123:6839/431607558] up:boot 2024-06-02T04:20:17.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:16 smithi123 ceph-mon[42885]: mds.? [v2:172.21.15.123:6840/1535088006,v1:172.21.15.123:6841/1535088006] up:boot 2024-06-02T04:20:17.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:16 smithi123 ceph-mon[42885]: mds.? [v2:172.21.15.136:6833/561279927,v1:172.21.15.136:6835/561279927] up:boot 2024-06-02T04:20:17.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:16 smithi123 ceph-mon[42885]: mds.? [v2:172.21.15.136:6832/616638945,v1:172.21.15.136:6834/616638945] up:boot 2024-06-02T04:20:17.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:16 smithi123 ceph-mon[42885]: mds.? [v2:172.21.15.162:6832/1263943553,v1:172.21.15.162:6833/1263943553] up:boot 2024-06-02T04:20:17.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:16 smithi123 ceph-mon[42885]: mds.? [v2:172.21.15.162:6838/668398811,v1:172.21.15.162:6839/668398811] up:boot 2024-06-02T04:20:17.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:16 smithi123 ceph-mon[42885]: mds.? [v2:172.21.15.136:6836/3499692194,v1:172.21.15.136:6838/3499692194] up:boot 2024-06-02T04:20:17.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:16 smithi123 ceph-mon[42885]: mds.? [v2:172.21.15.136:6837/3968165038,v1:172.21.15.136:6839/3968165038] up:boot 2024-06-02T04:20:17.073 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:16 smithi123 ceph-mon[42885]: mds.? [v2:172.21.15.162:6836/1934263564,v1:172.21.15.162:6837/1934263564] up:boot 2024-06-02T04:20:17.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:16 smithi123 ceph-mon[42885]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-06-02T04:20:17.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:16 smithi123 ceph-mon[42885]: fsmap 12 up:standby 2024-06-02T04:20:17.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:16 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-02T04:20:17.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:16 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-02T04:20:17.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:16 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-02T04:20:17.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:16 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-02T04:20:17.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:16 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-02T04:20:17.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:16 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-02T04:20:17.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:16 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-02T04:20:17.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:16 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-02T04:20:17.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:16 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-02T04:20:17.074 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:16 smithi123 ceph-mon[42885]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-02T04:20:17.075 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:16 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/304611376' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-02T04:20:17.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:16 smithi136 ceph-mon[47443]: pgmap v739: 97 pgs: 97 active+clean; 1.7 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 34 KiB/s wr, 12 op/s 2024-06-02T04:20:17.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:16 smithi136 ceph-mon[47443]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-06-02T04:20:17.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:16 smithi136 ceph-mon[47443]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-06-02T04:20:17.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:16 smithi136 ceph-mon[47443]: Cluster is now healthy 2024-06-02T04:20:17.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:16 smithi136 ceph-mon[47443]: mds.? [v2:172.21.15.162:6834/3097489345,v1:172.21.15.162:6835/3097489345] up:boot 2024-06-02T04:20:17.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:16 smithi136 ceph-mon[47443]: mds.? [v2:172.21.15.123:6838/431607558,v1:172.21.15.123:6839/431607558] up:boot 2024-06-02T04:20:17.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:16 smithi136 ceph-mon[47443]: mds.? [v2:172.21.15.123:6840/1535088006,v1:172.21.15.123:6841/1535088006] up:boot 2024-06-02T04:20:17.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:16 smithi136 ceph-mon[47443]: mds.? [v2:172.21.15.136:6833/561279927,v1:172.21.15.136:6835/561279927] up:boot 2024-06-02T04:20:17.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:16 smithi136 ceph-mon[47443]: mds.? [v2:172.21.15.136:6832/616638945,v1:172.21.15.136:6834/616638945] up:boot 2024-06-02T04:20:17.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:16 smithi136 ceph-mon[47443]: mds.? [v2:172.21.15.162:6832/1263943553,v1:172.21.15.162:6833/1263943553] up:boot 2024-06-02T04:20:17.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:16 smithi136 ceph-mon[47443]: mds.? [v2:172.21.15.162:6838/668398811,v1:172.21.15.162:6839/668398811] up:boot 2024-06-02T04:20:17.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:16 smithi136 ceph-mon[47443]: mds.? [v2:172.21.15.136:6836/3499692194,v1:172.21.15.136:6838/3499692194] up:boot 2024-06-02T04:20:17.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:16 smithi136 ceph-mon[47443]: mds.? [v2:172.21.15.136:6837/3968165038,v1:172.21.15.136:6839/3968165038] up:boot 2024-06-02T04:20:17.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:16 smithi136 ceph-mon[47443]: mds.? [v2:172.21.15.162:6836/1934263564,v1:172.21.15.162:6837/1934263564] up:boot 2024-06-02T04:20:17.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:16 smithi136 ceph-mon[47443]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-06-02T04:20:17.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:16 smithi136 ceph-mon[47443]: fsmap 12 up:standby 2024-06-02T04:20:17.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:16 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-06-02T04:20:17.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:16 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-06-02T04:20:17.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:16 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-06-02T04:20:17.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:16 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-06-02T04:20:17.090 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:16 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-06-02T04:20:17.090 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:16 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-06-02T04:20:17.090 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:16 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-06-02T04:20:17.090 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:16 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-06-02T04:20:17.090 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:16 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-06-02T04:20:17.090 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:16 smithi136 ceph-mon[47443]: from='mgr.14152 172.21.15.123:0/2416612522' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-06-02T04:20:17.090 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:16 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/304611376' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-02T04:20:17.097 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.098+0000 7f70657fa700 1 -- 172.21.15.123:0/304611376 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v86) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7060098f50 con 0x7f7068101970 2024-06-02T04:20:17.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.102+0000 7f706e7c9700 1 -- 172.21.15.123:0/304611376 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f70540a1120 msgr2=0x7f70540a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:17.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.102+0000 7f706e7c9700 1 --2- 172.21.15.123:0/304611376 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f70540a1120 0x7f70540a35e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f705000b5c0 tx=0x7f7050005fb0 comp rx=0 tx=0).stop 2024-06-02T04:20:17.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.102+0000 7f706e7c9700 1 -- 172.21.15.123:0/304611376 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7068101970 msgr2=0x7f706819e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:17.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.102+0000 7f706e7c9700 1 --2- 172.21.15.123:0/304611376 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7068101970 0x7f706819e180 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7060007ee0 tx=0x7f706000d3b0 comp rx=0 tx=0).stop 2024-06-02T04:20:17.101 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.102+0000 7f706e7c9700 1 -- 172.21.15.123:0/304611376 shutdown_connections 2024-06-02T04:20:17.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.102+0000 7f706e7c9700 1 --2- 172.21.15.123:0/304611376 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7f7068101970 0x7f706819e180 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:17.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.102+0000 7f706e7c9700 1 --2- 172.21.15.123:0/304611376 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7f70540a1120 0x7f70540a35e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:17.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.102+0000 7f706e7c9700 1 --2- 172.21.15.123:0/304611376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70680ffe60 0x7f7068068b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:17.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.102+0000 7f706e7c9700 1 --2- 172.21.15.123:0/304611376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7068100fb0 0x7f706819bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:17.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.102+0000 7f706e7c9700 1 -- 172.21.15.123:0/304611376 >> 172.21.15.123:0/304611376 conn(0x7f70680fb3f0 msgr2=0x7f70681043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:20:17.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.102+0000 7f706e7c9700 1 -- 172.21.15.123:0/304611376 shutdown_connections 2024-06-02T04:20:17.102 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.102+0000 7f706e7c9700 1 -- 172.21.15.123:0/304611376 wait complete. 2024-06-02T04:20:17.102 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_metadata' removed 2024-06-02T04:20:17.115 DEBUG:teuthology.orchestra.run.smithi123:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-06-02T04:20:17.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.243+0000 7fd290a5f700 1 -- 172.21.15.123:0/3135939160 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd28c101990 msgr2=0x7fd28c1082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:17.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.243+0000 7fd290a5f700 1 --2- 172.21.15.123:0/3135939160 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd28c101990 0x7fd28c1082b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd28400b0a0 tx=0x7fd28400b3b0 comp rx=0 tx=0).stop 2024-06-02T04:20:17.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.243+0000 7fd290a5f700 1 -- 172.21.15.123:0/3135939160 shutdown_connections 2024-06-02T04:20:17.244 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.243+0000 7fd290a5f700 1 --2- 172.21.15.123:0/3135939160 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd28c101990 0x7fd28c1082b0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:17.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.243+0000 7fd290a5f700 1 --2- 172.21.15.123:0/3135939160 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd28c0ffe80 0x7fd28c1002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:17.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.243+0000 7fd290a5f700 1 --2- 172.21.15.123:0/3135939160 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd28c100fd0 0x7fd28c101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:17.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.243+0000 7fd290a5f700 1 -- 172.21.15.123:0/3135939160 >> 172.21.15.123:0/3135939160 conn(0x7fd28c0fb3f0 msgr2=0x7fd28c0fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:20:17.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.243+0000 7fd290a5f700 1 -- 172.21.15.123:0/3135939160 shutdown_connections 2024-06-02T04:20:17.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.243+0000 7fd290a5f700 1 -- 172.21.15.123:0/3135939160 wait complete. 2024-06-02T04:20:17.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.244+0000 7fd290a5f700 1 Processor -- start 2024-06-02T04:20:17.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.244+0000 7fd290a5f700 1 -- start start 2024-06-02T04:20:17.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.244+0000 7fd290a5f700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd28c0ffe80 0x7fd28c069f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:17.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.244+0000 7fd290a5f700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd28c100fd0 0x7fd28c19bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:17.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.244+0000 7fd290a5f700 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd28c101990 0x7fd28c19e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:17.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.244+0000 7fd290a5f700 1 -- --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c19eb40 con 0x7fd28c0ffe80 2024-06-02T04:20:17.245 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.244+0000 7fd290a5f700 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c19ecb0 con 0x7fd28c101990 2024-06-02T04:20:17.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.244+0000 7fd290a5f700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c19ee70 con 0x7fd28c100fd0 2024-06-02T04:20:17.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.244+0000 7fd28a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd28c0ffe80 0x7fd28c069f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:17.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.244+0000 7fd28a59c700 1 --2- >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd28c0ffe80 0x7fd28c069f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.123:3300/0 says I am v2:172.21.15.123:45836/0 (socket says 172.21.15.123:45836) 2024-06-02T04:20:17.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.244+0000 7fd28a59c700 1 -- 172.21.15.123:0/185939012 learned_addr learned my addr 172.21.15.123:0/185939012 (peer_addr_for_me v2:172.21.15.123:0/0) 2024-06-02T04:20:17.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.244+0000 7fd28ad9d700 1 --2- 172.21.15.123:0/185939012 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd28c101990 0x7fd28c19e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:17.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.244+0000 7fd289d9b700 1 --2- 172.21.15.123:0/185939012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd28c100fd0 0x7fd28c19bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:17.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.244+0000 7fd28a59c700 1 -- 172.21.15.123:0/185939012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd28c100fd0 msgr2=0x7fd28c19bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:17.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.244+0000 7fd28a59c700 1 --2- 172.21.15.123:0/185939012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd28c100fd0 0x7fd28c19bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:17.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.244+0000 7fd28a59c700 1 -- 172.21.15.123:0/185939012 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd28c101990 msgr2=0x7fd28c19e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:17.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.244+0000 7fd28a59c700 1 --2- 172.21.15.123:0/185939012 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd28c101990 0x7fd28c19e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:17.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.244+0000 7fd28a59c700 1 -- 172.21.15.123:0/185939012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd284009d00 con 0x7fd28c0ffe80 2024-06-02T04:20:17.246 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.245+0000 7fd28ad9d700 1 --2- 172.21.15.123:0/185939012 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd28c101990 0x7fd28c19e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-06-02T04:20:17.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.245+0000 7fd289d9b700 1 --2- 172.21.15.123:0/185939012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd28c100fd0 0x7fd28c19bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-06-02T04:20:17.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.245+0000 7fd28a59c700 1 --2- 172.21.15.123:0/185939012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd28c0ffe80 0x7fd28c069f90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd27c00c920 tx=0x7fd27c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:20:17.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.245+0000 7fd2837fe700 1 -- 172.21.15.123:0/185939012 <== mon.0 v2:172.21.15.123:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c007b00 con 0x7fd28c0ffe80 2024-06-02T04:20:17.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.245+0000 7fd290a5f700 1 -- 172.21.15.123:0/185939012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd28c19f0f0 con 0x7fd28c0ffe80 2024-06-02T04:20:17.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.245+0000 7fd2837fe700 1 -- 172.21.15.123:0/185939012 <== mon.0 v2:172.21.15.123:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd27c004cf0 con 0x7fd28c0ffe80 2024-06-02T04:20:17.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.245+0000 7fd2837fe700 1 -- 172.21.15.123:0/185939012 <== mon.0 v2:172.21.15.123:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27c005520 con 0x7fd28c0ffe80 2024-06-02T04:20:17.247 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.245+0000 7fd290a5f700 1 -- 172.21.15.123:0/185939012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd28c19f650 con 0x7fd28c0ffe80 2024-06-02T04:20:17.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.246+0000 7fd290a5f700 1 -- 172.21.15.123:0/185939012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd28c107220 con 0x7fd28c0ffe80 2024-06-02T04:20:17.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.247+0000 7fd2837fe700 1 -- 172.21.15.123:0/185939012 <== mon.0 v2:172.21.15.123:3300/0 4 ==== mgrmap(e 18) v1 ==== 135874+0+0 (secure 0 0 0) 0x7fd27c004750 con 0x7fd28c0ffe80 2024-06-02T04:20:17.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.248+0000 7fd2837fe700 1 --2- 172.21.15.123:0/185939012 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd2780a11a0 0x7fd2780a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-06-02T04:20:17.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.248+0000 7fd2837fe700 1 -- 172.21.15.123:0/185939012 <== mon.0 v2:172.21.15.123:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8058+0+0 (secure 0 0 0) 0x7fd27c0cc900 con 0x7fd28c0ffe80 2024-06-02T04:20:17.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.248+0000 7fd289d9b700 1 --2- 172.21.15.123:0/185939012 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd2780a11a0 0x7fd2780a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-06-02T04:20:17.248 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.248+0000 7fd289d9b700 1 --2- 172.21.15.123:0/185939012 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd2780a11a0 0x7fd2780a3660 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd274005fd0 tx=0x7fd274005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-06-02T04:20:17.250 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.251+0000 7fd2837fe700 1 -- 172.21.15.123:0/185939012 <== mon.0 v2:172.21.15.123:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd27c0960f0 con 0x7fd28c0ffe80 2024-06-02T04:20:17.450 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:17.451+0000 7fd290a5f700 1 -- 172.21.15.123:0/185939012 --> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd28c068140 con 0x7fd28c0ffe80 2024-06-02T04:20:18.105 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:18.106+0000 7fd2837fe700 1 -- 172.21.15.123:0/185939012 <== mon.0 v2:172.21.15.123:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v87) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd27c01d020 con 0x7fd28c0ffe80 2024-06-02T04:20:18.107 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:18.109+0000 7fd290a5f700 1 -- 172.21.15.123:0/185939012 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd2780a11a0 msgr2=0x7fd2780a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:18.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:18.109+0000 7fd290a5f700 1 --2- 172.21.15.123:0/185939012 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd2780a11a0 0x7fd2780a3660 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd274005fd0 tx=0x7fd274005ee0 comp rx=0 tx=0).stop 2024-06-02T04:20:18.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:18.109+0000 7fd290a5f700 1 -- 172.21.15.123:0/185939012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd28c0ffe80 msgr2=0x7fd28c069f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-06-02T04:20:18.108 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:18.109+0000 7fd290a5f700 1 --2- 172.21.15.123:0/185939012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd28c0ffe80 0x7fd28c069f90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fd27c00c920 tx=0x7fd27c00cce0 comp rx=0 tx=0).stop 2024-06-02T04:20:18.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:18.110+0000 7fd290a5f700 1 -- 172.21.15.123:0/185939012 shutdown_connections 2024-06-02T04:20:18.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:18.110+0000 7fd290a5f700 1 --2- 172.21.15.123:0/185939012 >> [v2:172.21.15.123:6800/526143134,v1:172.21.15.123:6801/526143134] conn(0x7fd2780a11a0 0x7fd2780a3660 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:18.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:18.110+0000 7fd290a5f700 1 --2- 172.21.15.123:0/185939012 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd28c101990 0x7fd28c19e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:18.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:18.110+0000 7fd290a5f700 1 --2- 172.21.15.123:0/185939012 >> [v2:172.21.15.123:3300/0,v1:172.21.15.123:6789/0] conn(0x7fd28c0ffe80 0x7fd28c069f90 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:18.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:18.110+0000 7fd290a5f700 1 --2- 172.21.15.123:0/185939012 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd28c100fd0 0x7fd28c19bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-06-02T04:20:18.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:18.110+0000 7fd290a5f700 1 -- 172.21.15.123:0/185939012 >> 172.21.15.123:0/185939012 conn(0x7fd28c0fb3f0 msgr2=0x7fd28c104360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-06-02T04:20:18.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:18.110+0000 7fd290a5f700 1 -- 172.21.15.123:0/185939012 shutdown_connections 2024-06-02T04:20:18.109 INFO:teuthology.orchestra.run.smithi123.stderr:2024-06-02T04:20:18.110+0000 7fd290a5f700 1 -- 172.21.15.123:0/185939012 wait complete. 2024-06-02T04:20:18.110 INFO:teuthology.orchestra.run.smithi123.stderr:pool 'cephfs_data' removed 2024-06-02T04:20:18.128 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-02T04:20:18.166 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-02T04:20:18.204 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-02T04:20:18.248 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-06-02T04:20:18.248 DEBUG:teuthology.orchestra.run.smithi123:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-06-02T04:20:18.267 DEBUG:teuthology.orchestra.run.smithi136:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-06-02T04:20:18.284 DEBUG:teuthology.orchestra.run.smithi162:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-06-02T04:20:18.320 INFO:tasks.cephadm:Stopping all daemons... 2024-06-02T04:20:18.320 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-06-02T04:20:18.321 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mon.a 2024-06-02T04:20:18.356 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:18 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/304611376' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-06-02T04:20:18.356 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:18 smithi123 ceph-mon[42885]: osdmap e86: 12 total, 12 up, 12 in 2024-06-02T04:20:18.356 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:18 smithi123 ceph-mon[42885]: pgmap v741: 65 pgs: 65 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:20:18.356 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:18 smithi123 ceph-mon[42885]: from='client.? 172.21.15.123:0/185939012' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-02T04:20:18.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:18 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/304611376' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-06-02T04:20:18.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:18 smithi162 ceph-mon[47009]: osdmap e86: 12 total, 12 up, 12 in 2024-06-02T04:20:18.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:18 smithi162 ceph-mon[47009]: pgmap v741: 65 pgs: 65 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:20:18.548 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:18 smithi162 ceph-mon[47009]: from='client.? 172.21.15.123:0/185939012' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-02T04:20:18.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:18 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/304611376' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-06-02T04:20:18.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:18 smithi136 ceph-mon[47443]: osdmap e86: 12 total, 12 up, 12 in 2024-06-02T04:20:18.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:18 smithi136 ceph-mon[47443]: pgmap v741: 65 pgs: 65 active+clean; 1.6 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail 2024-06-02T04:20:18.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:18 smithi136 ceph-mon[47443]: from='client.? 172.21.15.123:0/185939012' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-06-02T04:20:18.782 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:18 smithi123 systemd[1]: Stopping Ceph mon.a for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:20:18.783 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:18 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mon-a[42861]: 2024-06-02T04:20:18.552+0000 7f56bef62700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T04:20:18.783 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:18 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mon-a[42861]: 2024-06-02T04:20:18.552+0000 7f56bef62700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-06-02T04:20:19.072 INFO:journalctl@ceph.mon.a.smithi123.stdout:Jun 02 04:20:18 smithi123 bash[111986]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mon-a 2024-06-02T04:20:19.118 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mon.a.service' 2024-06-02T04:20:19.203 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T04:20:19.203 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-06-02T04:20:19.203 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-06-02T04:20:19.203 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mon.b 2024-06-02T04:20:19.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:19 smithi136 systemd[1]: Stopping Ceph mon.b for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:20:19.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:19 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mon-b[47420]: 2024-06-02T04:20:19.476+0000 7f56ff218700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T04:20:19.588 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:19 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mon-b[47420]: 2024-06-02T04:20:19.476+0000 7f56ff218700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-06-02T04:20:20.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:Jun 02 04:20:19 smithi136 bash[90014]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mon-b 2024-06-02T04:20:20.129 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mon.b.service' 2024-06-02T04:20:20.184 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T04:20:20.185 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-06-02T04:20:20.185 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-06-02T04:20:20.185 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mon.c 2024-06-02T04:20:20.549 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:20 smithi162 systemd[1]: Stopping Ceph mon.c for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:20:20.550 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:20 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mon-c[46986]: 2024-06-02T04:20:20.451+0000 7f60837db700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T04:20:20.550 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:20 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mon-c[46986]: 2024-06-02T04:20:20.451+0000 7f60837db700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-06-02T04:20:21.033 INFO:journalctl@ceph.mon.c.smithi162.stdout:Jun 02 04:20:20 smithi162 bash[89183]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mon-c 2024-06-02T04:20:21.040 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mon.c.service' 2024-06-02T04:20:21.084 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T04:20:21.084 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-06-02T04:20:21.084 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-06-02T04:20:21.084 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mgr.x 2024-06-02T04:20:21.455 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 04:20:21 smithi123 systemd[1]: Stopping Ceph mgr.x for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:20:21.455 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 04:20:21 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T04:20:21.317+0000 7fbb79160700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T04:20:21.455 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 04:20:21 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x[43134]: 2024-06-02T04:20:21.317+0000 7fbb79160700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-06-02T04:20:21.822 INFO:journalctl@ceph.mgr.x.smithi123.stdout:Jun 02 04:20:21 smithi123 bash[112127]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-x 2024-06-02T04:20:21.835 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mgr.x.service' 2024-06-02T04:20:21.871 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T04:20:21.871 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-06-02T04:20:21.872 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-06-02T04:20:21.872 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mgr.y 2024-06-02T04:20:22.238 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Jun 02 04:20:21 smithi136 systemd[1]: Stopping Ceph mgr.y for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:20:22.589 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Jun 02 04:20:22 smithi136 bash[90157]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-y 2024-06-02T04:20:22.589 INFO:journalctl@ceph.mgr.y.smithi136.stdout:Jun 02 04:20:22 smithi136 systemd[1]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-06-02T04:20:22.597 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mgr.y.service' 2024-06-02T04:20:22.634 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T04:20:22.634 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-06-02T04:20:22.634 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-06-02T04:20:22.634 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mgr.z 2024-06-02T04:20:23.022 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Jun 02 04:20:22 smithi162 systemd[1]: Stopping Ceph mgr.z for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:20:23.298 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Jun 02 04:20:23 smithi162 bash[89332]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mgr-z 2024-06-02T04:20:23.298 INFO:journalctl@ceph.mgr.z.smithi162.stdout:Jun 02 04:20:23 smithi162 systemd[1]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-06-02T04:20:23.384 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mgr.z.service' 2024-06-02T04:20:23.422 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T04:20:23.422 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-06-02T04:20:23.422 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-06-02T04:20:23.422 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.0 2024-06-02T04:20:23.822 INFO:journalctl@ceph.osd.0.smithi123.stdout:Jun 02 04:20:23 smithi123 systemd[1]: Stopping Ceph osd.0 for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:20:24.322 INFO:journalctl@ceph.osd.0.smithi123.stdout:Jun 02 04:20:24 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-0[61352]: 2024-06-02T04:20:24.052+0000 7fb05eb53700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T04:20:24.323 INFO:journalctl@ceph.osd.0.smithi123.stdout:Jun 02 04:20:24 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-0[61352]: 2024-06-02T04:20:24.052+0000 7fb05eb53700 -1 osd.0 87 *** Got signal Terminated *** 2024-06-02T04:20:24.323 INFO:journalctl@ceph.osd.0.smithi123.stdout:Jun 02 04:20:24 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-0[61352]: 2024-06-02T04:20:24.052+0000 7fb05eb53700 -1 osd.0 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T04:20:30.072 INFO:journalctl@ceph.osd.0.smithi123.stdout:Jun 02 04:20:29 smithi123 bash[112270]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-0 2024-06-02T04:20:31.012 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.0.service' 2024-06-02T04:20:31.053 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T04:20:31.054 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-06-02T04:20:31.054 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-06-02T04:20:31.054 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.1 2024-06-02T04:20:31.338 INFO:journalctl@ceph.osd.1.smithi136.stdout:Jun 02 04:20:31 smithi136 systemd[1]: Stopping Ceph osd.1 for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:20:31.338 INFO:journalctl@ceph.osd.1.smithi136.stdout:Jun 02 04:20:31 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-1[52466]: 2024-06-02T04:20:31.281+0000 7feafbb34700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T04:20:31.338 INFO:journalctl@ceph.osd.1.smithi136.stdout:Jun 02 04:20:31 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-1[52466]: 2024-06-02T04:20:31.281+0000 7feafbb34700 -1 osd.1 87 *** Got signal Terminated *** 2024-06-02T04:20:31.338 INFO:journalctl@ceph.osd.1.smithi136.stdout:Jun 02 04:20:31 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-1[52466]: 2024-06-02T04:20:31.281+0000 7feafbb34700 -1 osd.1 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T04:20:37.089 INFO:journalctl@ceph.osd.1.smithi136.stdout:Jun 02 04:20:36 smithi136 bash[90297]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-1 2024-06-02T04:20:38.143 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.1.service' 2024-06-02T04:20:38.184 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T04:20:38.185 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-06-02T04:20:38.185 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-06-02T04:20:38.185 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.2 2024-06-02T04:20:38.548 INFO:journalctl@ceph.osd.2.smithi162.stdout:Jun 02 04:20:38 smithi162 systemd[1]: Stopping Ceph osd.2 for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:20:38.548 INFO:journalctl@ceph.osd.2.smithi162.stdout:Jun 02 04:20:38 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-2[52825]: 2024-06-02T04:20:38.422+0000 7f73b1253700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T04:20:38.548 INFO:journalctl@ceph.osd.2.smithi162.stdout:Jun 02 04:20:38 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-2[52825]: 2024-06-02T04:20:38.422+0000 7f73b1253700 -1 osd.2 87 *** Got signal Terminated *** 2024-06-02T04:20:38.548 INFO:journalctl@ceph.osd.2.smithi162.stdout:Jun 02 04:20:38 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-2[52825]: 2024-06-02T04:20:38.422+0000 7f73b1253700 -1 osd.2 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T04:20:44.298 INFO:journalctl@ceph.osd.2.smithi162.stdout:Jun 02 04:20:44 smithi162 bash[89479]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-2 2024-06-02T04:20:45.242 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.2.service' 2024-06-02T04:20:45.284 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T04:20:45.284 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-06-02T04:20:45.284 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-06-02T04:20:45.284 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.3 2024-06-02T04:20:45.572 INFO:journalctl@ceph.osd.3.smithi123.stdout:Jun 02 04:20:45 smithi123 systemd[1]: Stopping Ceph osd.3 for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:20:45.572 INFO:journalctl@ceph.osd.3.smithi123.stdout:Jun 02 04:20:45 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-3[69256]: 2024-06-02T04:20:45.521+0000 7ff6ca3d6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T04:20:45.572 INFO:journalctl@ceph.osd.3.smithi123.stdout:Jun 02 04:20:45 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-3[69256]: 2024-06-02T04:20:45.521+0000 7ff6ca3d6700 -1 osd.3 87 *** Got signal Terminated *** 2024-06-02T04:20:45.573 INFO:journalctl@ceph.osd.3.smithi123.stdout:Jun 02 04:20:45 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-3[69256]: 2024-06-02T04:20:45.521+0000 7ff6ca3d6700 -1 osd.3 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T04:20:51.072 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:20:50 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:20:50.761+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:20:51.572 INFO:journalctl@ceph.osd.3.smithi123.stdout:Jun 02 04:20:51 smithi123 bash[112531]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-3 2024-06-02T04:20:52.072 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:20:51 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:20:51.760+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:20:52.486 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.3.service' 2024-06-02T04:20:52.527 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T04:20:52.527 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-06-02T04:20:52.527 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-06-02T04:20:52.527 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.4 2024-06-02T04:20:52.798 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jun 02 04:20:52 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-5[60832]: 2024-06-02T04:20:52.499+0000 7ff6ab020700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.783754+0000 front 2024-06-02T04:20:28.783596+0000 (oldest deadline 2024-06-02T04:20:52.283576+0000) 2024-06-02T04:20:52.838 INFO:journalctl@ceph.osd.4.smithi136.stdout:Jun 02 04:20:52 smithi136 systemd[1]: Stopping Ceph osd.4 for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:20:52.839 INFO:journalctl@ceph.osd.4.smithi136.stdout:Jun 02 04:20:52 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-4[61146]: 2024-06-02T04:20:52.777+0000 7fdb92672700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T04:20:52.839 INFO:journalctl@ceph.osd.4.smithi136.stdout:Jun 02 04:20:52 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-4[61146]: 2024-06-02T04:20:52.777+0000 7fdb92672700 -1 osd.4 87 *** Got signal Terminated *** 2024-06-02T04:20:52.839 INFO:journalctl@ceph.osd.4.smithi136.stdout:Jun 02 04:20:52 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-4[61146]: 2024-06-02T04:20:52.777+0000 7fdb92672700 -1 osd.4 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T04:20:53.072 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:20:52 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:20:52.761+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:20:53.798 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jun 02 04:20:53 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-5[60832]: 2024-06-02T04:20:53.501+0000 7ff6ab020700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.783754+0000 front 2024-06-02T04:20:28.783596+0000 (oldest deadline 2024-06-02T04:20:52.283576+0000) 2024-06-02T04:20:53.799 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:20:53 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:20:53.335+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.602399+0000 front 2024-06-02T04:20:27.602417+0000 (oldest deadline 2024-06-02T04:20:52.803177+0000) 2024-06-02T04:20:54.074 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:20:53 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:20:53.800+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:20:54.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:20:53 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:20:53.808+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:20:54.798 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jun 02 04:20:54 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-5[60832]: 2024-06-02T04:20:54.493+0000 7ff6ab020700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.783754+0000 front 2024-06-02T04:20:28.783596+0000 (oldest deadline 2024-06-02T04:20:52.283576+0000) 2024-06-02T04:20:54.798 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:20:54 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:20:54.669+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:20:54.810 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:20:54 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:20:54.380+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.602399+0000 front 2024-06-02T04:20:27.602417+0000 (oldest deadline 2024-06-02T04:20:52.803177+0000) 2024-06-02T04:20:55.072 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:20:54 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:20:54.811+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:20:55.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:20:54 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:20:54.785+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:20:55.777 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:20:55 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:20:55.385+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.602399+0000 front 2024-06-02T04:20:27.602417+0000 (oldest deadline 2024-06-02T04:20:52.803177+0000) 2024-06-02T04:20:55.798 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jun 02 04:20:55 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-5[60832]: 2024-06-02T04:20:55.492+0000 7ff6ab020700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.783754+0000 front 2024-06-02T04:20:28.783596+0000 (oldest deadline 2024-06-02T04:20:52.283576+0000) 2024-06-02T04:20:55.798 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:20:55 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:20:55.624+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:20:56.072 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:20:55 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:20:55.778+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:20:56.087 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:20:55 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:20:55.794+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:20:56.793 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:20:56 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:20:56.422+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.602399+0000 front 2024-06-02T04:20:27.602417+0000 (oldest deadline 2024-06-02T04:20:52.803177+0000) 2024-06-02T04:20:56.798 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jun 02 04:20:56 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-5[60832]: 2024-06-02T04:20:56.457+0000 7ff6ab020700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.783754+0000 front 2024-06-02T04:20:28.783596+0000 (oldest deadline 2024-06-02T04:20:52.283576+0000) 2024-06-02T04:20:56.798 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:20:56 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:20:56.611+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:20:57.072 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:20:56 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:20:56.794+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:20:57.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:20:56 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:20:56.828+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:20:57.762 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:20:57 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:20:57.462+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.602399+0000 front 2024-06-02T04:20:27.602417+0000 (oldest deadline 2024-06-02T04:20:52.803177+0000) 2024-06-02T04:20:57.798 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:20:57 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:20:57.591+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:20:57.798 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jun 02 04:20:57 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-5[60832]: 2024-06-02T04:20:57.418+0000 7ff6ab020700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.783754+0000 front 2024-06-02T04:20:28.783596+0000 (oldest deadline 2024-06-02T04:20:52.283576+0000) 2024-06-02T04:20:57.798 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jun 02 04:20:57 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-5[60832]: 2024-06-02T04:20:57.418+0000 7ff6ab020700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:35.184882+0000 front 2024-06-02T04:20:35.184792+0000 (oldest deadline 2024-06-02T04:20:56.884730+0000) 2024-06-02T04:20:58.072 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:20:57 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:20:57.763+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:20:58.088 INFO:journalctl@ceph.osd.4.smithi136.stdout:Jun 02 04:20:57 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-4[61146]: 2024-06-02T04:20:57.679+0000 7fdb8ec68700 -1 osd.4 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:31.661833+0000 front 2024-06-02T04:20:31.661814+0000 (oldest deadline 2024-06-02T04:20:57.561952+0000) 2024-06-02T04:20:58.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:20:57 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:20:57.867+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:20:58.588 INFO:journalctl@ceph.osd.4.smithi136.stdout:Jun 02 04:20:58 smithi136 bash[90559]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-4 2024-06-02T04:20:58.588 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:20:58 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:20:58.531+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.182179+0000 front 2024-06-02T04:20:36.182203+0000 (oldest deadline 2024-06-02T04:20:57.882345+0000) 2024-06-02T04:20:58.794 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:20:58 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:20:58.487+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.602399+0000 front 2024-06-02T04:20:27.602417+0000 (oldest deadline 2024-06-02T04:20:52.803177+0000) 2024-06-02T04:20:58.798 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:20:58 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:20:58.606+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:20:58.798 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jun 02 04:20:58 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-5[60832]: 2024-06-02T04:20:58.382+0000 7ff6ab020700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.783754+0000 front 2024-06-02T04:20:28.783596+0000 (oldest deadline 2024-06-02T04:20:52.283576+0000) 2024-06-02T04:20:58.798 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jun 02 04:20:58 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-5[60832]: 2024-06-02T04:20:58.382+0000 7ff6ab020700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:35.184882+0000 front 2024-06-02T04:20:35.184792+0000 (oldest deadline 2024-06-02T04:20:56.884730+0000) 2024-06-02T04:20:59.072 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:20:58 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:20:58.795+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:20:59.259 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:20:58 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:20:58.898+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:20:59.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jun 02 04:20:59 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-5[60832]: 2024-06-02T04:20:59.360+0000 7ff6ab020700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.783754+0000 front 2024-06-02T04:20:28.783596+0000 (oldest deadline 2024-06-02T04:20:52.283576+0000) 2024-06-02T04:20:59.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jun 02 04:20:59 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-5[60832]: 2024-06-02T04:20:59.360+0000 7ff6ab020700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:35.184882+0000 front 2024-06-02T04:20:35.184792+0000 (oldest deadline 2024-06-02T04:20:56.884730+0000) 2024-06-02T04:20:59.548 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:20:59 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:20:59.215+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:34.209783+0000 front 2024-06-02T04:20:34.209765+0000 (oldest deadline 2024-06-02T04:20:58.309904+0000) 2024-06-02T04:20:59.596 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.4.service' 2024-06-02T04:20:59.636 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T04:20:59.637 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-06-02T04:20:59.637 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-06-02T04:20:59.637 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.5 2024-06-02T04:20:59.822 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:20:59 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:20:59.515+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.602399+0000 front 2024-06-02T04:20:27.602417+0000 (oldest deadline 2024-06-02T04:20:52.803177+0000) 2024-06-02T04:20:59.838 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:20:59 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:20:59.567+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.182179+0000 front 2024-06-02T04:20:36.182203+0000 (oldest deadline 2024-06-02T04:20:57.882345+0000) 2024-06-02T04:20:59.875 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:20:59 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:20:59.572+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:20:59.875 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:20:59 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:20:59.572+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:20:59.876 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jun 02 04:20:59 smithi162 systemd[1]: Stopping Ceph osd.5 for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:20:59.876 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jun 02 04:20:59 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-5[60832]: 2024-06-02T04:20:59.876+0000 7ff6b2a32700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T04:21:00.223 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jun 02 04:20:59 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-5[60832]: 2024-06-02T04:20:59.876+0000 7ff6b2a32700 -1 osd.5 87 *** Got signal Terminated *** 2024-06-02T04:21:00.223 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jun 02 04:20:59 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-5[60832]: 2024-06-02T04:20:59.876+0000 7ff6b2a32700 -1 osd.5 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T04:21:00.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:20:59 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:20:59.831+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:00.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:20:59 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:20:59.851+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:00.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:20:59 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:20:59.851+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:00.548 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:00 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:00.223+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:34.209783+0000 front 2024-06-02T04:20:34.209765+0000 (oldest deadline 2024-06-02T04:20:58.309904+0000) 2024-06-02T04:21:00.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jun 02 04:21:00 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-5[60832]: 2024-06-02T04:21:00.336+0000 7ff6ab020700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.783754+0000 front 2024-06-02T04:20:28.783596+0000 (oldest deadline 2024-06-02T04:20:52.283576+0000) 2024-06-02T04:21:00.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jun 02 04:21:00 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-5[60832]: 2024-06-02T04:21:00.336+0000 7ff6ab020700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:35.184882+0000 front 2024-06-02T04:20:35.184792+0000 (oldest deadline 2024-06-02T04:20:56.884730+0000) 2024-06-02T04:21:00.809 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:00 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:00.557+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.182179+0000 front 2024-06-02T04:20:36.182203+0000 (oldest deadline 2024-06-02T04:20:57.882345+0000) 2024-06-02T04:21:00.822 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:00 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:00.491+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.602399+0000 front 2024-06-02T04:20:27.602417+0000 (oldest deadline 2024-06-02T04:20:52.803177+0000) 2024-06-02T04:21:00.822 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:00 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:00.491+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:32.804162+0000 front 2024-06-02T04:20:32.804209+0000 (oldest deadline 2024-06-02T04:21:00.404601+0000) 2024-06-02T04:21:01.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:00 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:00.605+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:01.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:00 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:00.605+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:01.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:00 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:00.810+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:01.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:00 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:00.810+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:01.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:00 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:00.839+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:01.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:00 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:00.839+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:01.548 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:01 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:01.218+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:34.209783+0000 front 2024-06-02T04:20:34.209765+0000 (oldest deadline 2024-06-02T04:20:58.309904+0000) 2024-06-02T04:21:01.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jun 02 04:21:01 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-5[60832]: 2024-06-02T04:21:01.337+0000 7ff6ab020700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.783754+0000 front 2024-06-02T04:20:28.783596+0000 (oldest deadline 2024-06-02T04:20:52.283576+0000) 2024-06-02T04:21:01.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jun 02 04:21:01 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-5[60832]: 2024-06-02T04:21:01.337+0000 7ff6ab020700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:35.184882+0000 front 2024-06-02T04:20:35.184792+0000 (oldest deadline 2024-06-02T04:20:56.884730+0000) 2024-06-02T04:21:01.822 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:01 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:01.533+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.602399+0000 front 2024-06-02T04:20:27.602417+0000 (oldest deadline 2024-06-02T04:20:52.803177+0000) 2024-06-02T04:21:01.822 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:01 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:01.533+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:32.804162+0000 front 2024-06-02T04:20:32.804209+0000 (oldest deadline 2024-06-02T04:21:00.404601+0000) 2024-06-02T04:21:01.838 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:01 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:01.583+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.182179+0000 front 2024-06-02T04:20:36.182203+0000 (oldest deadline 2024-06-02T04:20:57.882345+0000) 2024-06-02T04:21:01.838 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:01 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:01.800+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:01.838 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:01 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:01.800+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:02.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:01 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:01.605+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:02.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:01 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:01.605+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:02.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:01 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:01.837+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:02.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:01 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:01.837+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:02.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jun 02 04:21:02 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-5[60832]: 2024-06-02T04:21:02.335+0000 7ff6ab020700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.783754+0000 front 2024-06-02T04:20:28.783596+0000 (oldest deadline 2024-06-02T04:20:52.283576+0000) 2024-06-02T04:21:02.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jun 02 04:21:02 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-5[60832]: 2024-06-02T04:21:02.335+0000 7ff6ab020700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:35.184882+0000 front 2024-06-02T04:20:35.184792+0000 (oldest deadline 2024-06-02T04:20:56.884730+0000) 2024-06-02T04:21:02.548 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:02 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:02.208+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:34.209783+0000 front 2024-06-02T04:20:34.209765+0000 (oldest deadline 2024-06-02T04:20:58.309904+0000) 2024-06-02T04:21:02.822 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:02 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:02.568+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.602399+0000 front 2024-06-02T04:20:27.602417+0000 (oldest deadline 2024-06-02T04:20:52.803177+0000) 2024-06-02T04:21:02.822 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:02 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:02.568+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:32.804162+0000 front 2024-06-02T04:20:32.804209+0000 (oldest deadline 2024-06-02T04:21:00.404601+0000) 2024-06-02T04:21:02.838 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:02 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:02.577+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.182179+0000 front 2024-06-02T04:20:36.182203+0000 (oldest deadline 2024-06-02T04:20:57.882345+0000) 2024-06-02T04:21:02.838 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:02 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:02.800+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:02.838 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:02 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:02.800+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:03.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:02 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:02.580+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:03.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:02 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:02.580+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:03.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:02 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:02.866+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:03.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:02 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:02.866+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:03.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jun 02 04:21:03 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-5[60832]: 2024-06-02T04:21:03.323+0000 7ff6ab020700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.783754+0000 front 2024-06-02T04:20:28.783596+0000 (oldest deadline 2024-06-02T04:20:52.283576+0000) 2024-06-02T04:21:03.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jun 02 04:21:03 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-5[60832]: 2024-06-02T04:21:03.323+0000 7ff6ab020700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:35.184882+0000 front 2024-06-02T04:20:35.184792+0000 (oldest deadline 2024-06-02T04:20:56.884730+0000) 2024-06-02T04:21:03.548 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:03 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:03.232+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:34.209783+0000 front 2024-06-02T04:20:34.209765+0000 (oldest deadline 2024-06-02T04:20:58.309904+0000) 2024-06-02T04:21:03.862 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:03 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:03.601+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.602399+0000 front 2024-06-02T04:20:27.602417+0000 (oldest deadline 2024-06-02T04:20:52.803177+0000) 2024-06-02T04:21:03.863 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:03 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:03.601+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:32.804162+0000 front 2024-06-02T04:20:32.804209+0000 (oldest deadline 2024-06-02T04:21:00.404601+0000) 2024-06-02T04:21:04.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:03 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:03.569+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:04.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:03 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:03.569+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:04.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:03 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:03.590+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.182179+0000 front 2024-06-02T04:20:36.182203+0000 (oldest deadline 2024-06-02T04:20:57.882345+0000) 2024-06-02T04:21:04.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:03 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:03.800+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:04.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:03 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:03.800+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:04.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:03 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:03.864+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:04.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:03 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:03.864+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:04.548 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:04 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:04.244+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:34.209783+0000 front 2024-06-02T04:20:34.209765+0000 (oldest deadline 2024-06-02T04:20:58.309904+0000) 2024-06-02T04:21:04.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jun 02 04:21:04 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-5[60832]: 2024-06-02T04:21:04.363+0000 7ff6ab020700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.783754+0000 front 2024-06-02T04:20:28.783596+0000 (oldest deadline 2024-06-02T04:20:52.283576+0000) 2024-06-02T04:21:04.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jun 02 04:21:04 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-5[60832]: 2024-06-02T04:21:04.363+0000 7ff6ab020700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:35.184882+0000 front 2024-06-02T04:20:35.184792+0000 (oldest deadline 2024-06-02T04:20:56.884730+0000) 2024-06-02T04:21:04.548 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jun 02 04:21:04 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-5[60832]: 2024-06-02T04:21:04.363+0000 7ff6ab020700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:43.086920+0000 front 2024-06-02T04:20:43.086952+0000 (oldest deadline 2024-06-02T04:21:04.187177+0000) 2024-06-02T04:21:04.832 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:04 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:04.579+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.182179+0000 front 2024-06-02T04:20:36.182203+0000 (oldest deadline 2024-06-02T04:20:57.882345+0000) 2024-06-02T04:21:04.832 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:04 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:04.579+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.583260+0000 front 2024-06-02T04:20:39.583318+0000 (oldest deadline 2024-06-02T04:21:04.283411+0000) 2024-06-02T04:21:04.891 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:04 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:04.613+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.602399+0000 front 2024-06-02T04:20:27.602417+0000 (oldest deadline 2024-06-02T04:20:52.803177+0000) 2024-06-02T04:21:04.891 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:04 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:04.613+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:32.804162+0000 front 2024-06-02T04:20:32.804209+0000 (oldest deadline 2024-06-02T04:21:00.404601+0000) 2024-06-02T04:21:05.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:04 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:04.601+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:05.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:04 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:04.601+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:05.087 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:04 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:04.832+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:05.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:04 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:04.832+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:05.323 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:04 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:04.892+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:05.323 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:04 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:04.892+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:05.323 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:04 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:04.892+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.851441+0000 front 2024-06-02T04:20:39.851551+0000 (oldest deadline 2024-06-02T04:21:04.551414+0000) 2024-06-02T04:21:05.505 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:05 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:05.249+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:34.209783+0000 front 2024-06-02T04:20:34.209765+0000 (oldest deadline 2024-06-02T04:20:58.309904+0000) 2024-06-02T04:21:05.505 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:05 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:05.249+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.911407+0000 front 2024-06-02T04:20:42.911440+0000 (oldest deadline 2024-06-02T04:21:05.211518+0000) 2024-06-02T04:21:05.798 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jun 02 04:21:05 smithi162 bash[89732]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-5 2024-06-02T04:21:05.798 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:05 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:05.637+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:05.798 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:05 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:05.637+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:05.931 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:05 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:05.605+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.602399+0000 front 2024-06-02T04:20:27.602417+0000 (oldest deadline 2024-06-02T04:20:52.803177+0000) 2024-06-02T04:21:05.932 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:05 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:05.605+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:32.804162+0000 front 2024-06-02T04:20:32.804209+0000 (oldest deadline 2024-06-02T04:21:00.404601+0000) 2024-06-02T04:21:05.932 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:05 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:05.605+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.905653+0000 front 2024-06-02T04:20:40.905722+0000 (oldest deadline 2024-06-02T04:21:05.605408+0000) 2024-06-02T04:21:06.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:05 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:05.848+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:06.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:05 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:05.848+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:06.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:05 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:05.612+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.182179+0000 front 2024-06-02T04:20:36.182203+0000 (oldest deadline 2024-06-02T04:20:57.882345+0000) 2024-06-02T04:21:06.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:05 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:05.612+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.583260+0000 front 2024-06-02T04:20:39.583318+0000 (oldest deadline 2024-06-02T04:21:04.283411+0000) 2024-06-02T04:21:06.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:05 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:05.933+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:06.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:05 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:05.933+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:06.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:05 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:05.933+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.851441+0000 front 2024-06-02T04:20:39.851551+0000 (oldest deadline 2024-06-02T04:21:04.551414+0000) 2024-06-02T04:21:06.459 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:06 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:06.287+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:34.209783+0000 front 2024-06-02T04:20:34.209765+0000 (oldest deadline 2024-06-02T04:20:58.309904+0000) 2024-06-02T04:21:06.459 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:06 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:06.287+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.911407+0000 front 2024-06-02T04:20:42.911440+0000 (oldest deadline 2024-06-02T04:21:05.211518+0000) 2024-06-02T04:21:06.796 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:06 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:06.652+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:06.796 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:06 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:06.652+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:06.796 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:06 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:06.652+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:06.803 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.5.service' 2024-06-02T04:21:06.845 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T04:21:06.845 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-06-02T04:21:06.846 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-06-02T04:21:06.846 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.6 2024-06-02T04:21:06.878 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:06 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:06.577+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.602399+0000 front 2024-06-02T04:20:27.602417+0000 (oldest deadline 2024-06-02T04:20:52.803177+0000) 2024-06-02T04:21:06.878 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:06 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:06.577+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:32.804162+0000 front 2024-06-02T04:20:32.804209+0000 (oldest deadline 2024-06-02T04:21:00.404601+0000) 2024-06-02T04:21:06.878 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:06 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:06.577+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.905653+0000 front 2024-06-02T04:20:40.905722+0000 (oldest deadline 2024-06-02T04:21:05.605408+0000) 2024-06-02T04:21:07.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:06 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:06.661+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.182179+0000 front 2024-06-02T04:20:36.182203+0000 (oldest deadline 2024-06-02T04:20:57.882345+0000) 2024-06-02T04:21:07.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:06 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:06.661+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.583260+0000 front 2024-06-02T04:20:39.583318+0000 (oldest deadline 2024-06-02T04:21:04.283411+0000) 2024-06-02T04:21:07.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:06 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:06.834+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:07.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:06 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:06.834+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:07.310 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:06 smithi123 systemd[1]: Stopping Ceph osd.6 for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:21:07.310 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:07 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:07.310+0000 7f1e863e9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T04:21:07.311 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:06 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:06.883+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:07.311 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:06 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:06.883+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:07.311 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:06 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:06.883+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.851441+0000 front 2024-06-02T04:20:39.851551+0000 (oldest deadline 2024-06-02T04:21:04.551414+0000) 2024-06-02T04:21:07.548 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:07 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:07.265+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:34.209783+0000 front 2024-06-02T04:20:34.209765+0000 (oldest deadline 2024-06-02T04:20:58.309904+0000) 2024-06-02T04:21:07.548 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:07 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:07.265+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.911407+0000 front 2024-06-02T04:20:42.911440+0000 (oldest deadline 2024-06-02T04:21:05.211518+0000) 2024-06-02T04:21:07.572 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:07 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:07.310+0000 7f1e863e9700 -1 osd.6 87 *** Got signal Terminated *** 2024-06-02T04:21:07.572 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:07 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:07.310+0000 7f1e863e9700 -1 osd.6 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T04:21:07.902 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:07 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:07.615+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.602399+0000 front 2024-06-02T04:20:27.602417+0000 (oldest deadline 2024-06-02T04:20:52.803177+0000) 2024-06-02T04:21:07.902 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:07 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:07.615+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:32.804162+0000 front 2024-06-02T04:20:32.804209+0000 (oldest deadline 2024-06-02T04:21:00.404601+0000) 2024-06-02T04:21:07.902 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:07 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:07.615+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.905653+0000 front 2024-06-02T04:20:40.905722+0000 (oldest deadline 2024-06-02T04:21:05.605408+0000) 2024-06-02T04:21:08.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:07 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:07.674+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:08.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:07 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:07.674+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:08.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:07 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:07.674+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:08.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:07 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:07.867+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:08.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:07 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:07.867+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:08.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:07 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:07.690+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.182179+0000 front 2024-06-02T04:20:36.182203+0000 (oldest deadline 2024-06-02T04:20:57.882345+0000) 2024-06-02T04:21:08.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:07 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:07.690+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.583260+0000 front 2024-06-02T04:20:39.583318+0000 (oldest deadline 2024-06-02T04:21:04.283411+0000) 2024-06-02T04:21:08.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:07 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:07.902+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:08.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:07 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:07.902+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:08.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:07 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:07.902+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.851441+0000 front 2024-06-02T04:20:39.851551+0000 (oldest deadline 2024-06-02T04:21:04.551414+0000) 2024-06-02T04:21:08.548 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:08 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:08.230+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:34.209783+0000 front 2024-06-02T04:20:34.209765+0000 (oldest deadline 2024-06-02T04:20:58.309904+0000) 2024-06-02T04:21:08.548 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:08 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:08.230+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.911407+0000 front 2024-06-02T04:20:42.911440+0000 (oldest deadline 2024-06-02T04:21:05.211518+0000) 2024-06-02T04:21:08.910 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:08 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:08.659+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.602399+0000 front 2024-06-02T04:20:27.602417+0000 (oldest deadline 2024-06-02T04:20:52.803177+0000) 2024-06-02T04:21:08.911 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:08 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:08.659+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:32.804162+0000 front 2024-06-02T04:20:32.804209+0000 (oldest deadline 2024-06-02T04:21:00.404601+0000) 2024-06-02T04:21:08.911 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:08 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:08.659+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.905653+0000 front 2024-06-02T04:20:40.905722+0000 (oldest deadline 2024-06-02T04:21:05.605408+0000) 2024-06-02T04:21:09.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:08 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:08.673+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:09.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:08 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:08.673+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:09.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:08 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:08.673+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:09.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:08 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:08.648+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.182179+0000 front 2024-06-02T04:20:36.182203+0000 (oldest deadline 2024-06-02T04:20:57.882345+0000) 2024-06-02T04:21:09.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:08 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:08.648+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.583260+0000 front 2024-06-02T04:20:39.583318+0000 (oldest deadline 2024-06-02T04:21:04.283411+0000) 2024-06-02T04:21:09.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:08 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:08.822+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:09.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:08 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:08.822+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:09.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:08 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:08.822+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:09.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:08 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:08.910+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:09.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:08 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:08.910+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:09.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:08 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:08.910+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.851441+0000 front 2024-06-02T04:20:39.851551+0000 (oldest deadline 2024-06-02T04:21:04.551414+0000) 2024-06-02T04:21:09.548 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:09 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:09.217+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:34.209783+0000 front 2024-06-02T04:20:34.209765+0000 (oldest deadline 2024-06-02T04:20:58.309904+0000) 2024-06-02T04:21:09.548 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:09 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:09.217+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.911407+0000 front 2024-06-02T04:20:42.911440+0000 (oldest deadline 2024-06-02T04:21:05.211518+0000) 2024-06-02T04:21:09.914 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:09 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:09.649+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.602399+0000 front 2024-06-02T04:20:27.602417+0000 (oldest deadline 2024-06-02T04:20:52.803177+0000) 2024-06-02T04:21:09.914 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:09 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:09.649+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:32.804162+0000 front 2024-06-02T04:20:32.804209+0000 (oldest deadline 2024-06-02T04:21:00.404601+0000) 2024-06-02T04:21:09.915 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:09 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:09.649+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.905653+0000 front 2024-06-02T04:20:40.905722+0000 (oldest deadline 2024-06-02T04:21:05.605408+0000) 2024-06-02T04:21:10.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:09 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:09.693+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:10.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:09 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:09.693+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:10.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:09 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:09.693+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:10.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:09 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:09.685+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.182179+0000 front 2024-06-02T04:20:36.182203+0000 (oldest deadline 2024-06-02T04:20:57.882345+0000) 2024-06-02T04:21:10.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:09 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:09.685+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.583260+0000 front 2024-06-02T04:20:39.583318+0000 (oldest deadline 2024-06-02T04:21:04.283411+0000) 2024-06-02T04:21:10.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:09 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:09.841+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:10.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:09 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:09.841+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:10.089 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:09 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:09.841+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:10.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:09 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:09.914+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:10.329 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:09 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:09.914+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:10.329 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:09 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:09.914+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.851441+0000 front 2024-06-02T04:20:39.851551+0000 (oldest deadline 2024-06-02T04:21:04.551414+0000) 2024-06-02T04:21:10.548 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:10 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:10.263+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:34.209783+0000 front 2024-06-02T04:20:34.209765+0000 (oldest deadline 2024-06-02T04:20:58.309904+0000) 2024-06-02T04:21:10.548 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:10 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:10.263+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.911407+0000 front 2024-06-02T04:20:42.911440+0000 (oldest deadline 2024-06-02T04:21:05.211518+0000) 2024-06-02T04:21:10.902 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:10 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:10.622+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.602399+0000 front 2024-06-02T04:20:27.602417+0000 (oldest deadline 2024-06-02T04:20:52.803177+0000) 2024-06-02T04:21:10.903 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:10 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:10.622+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:32.804162+0000 front 2024-06-02T04:20:32.804209+0000 (oldest deadline 2024-06-02T04:21:00.404601+0000) 2024-06-02T04:21:10.903 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:10 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:10.622+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.905653+0000 front 2024-06-02T04:20:40.905722+0000 (oldest deadline 2024-06-02T04:21:05.605408+0000) 2024-06-02T04:21:11.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:10 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:10.738+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:11.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:10 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:10.738+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:11.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:10 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:10.738+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:11.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:10 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:10.655+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.182179+0000 front 2024-06-02T04:20:36.182203+0000 (oldest deadline 2024-06-02T04:20:57.882345+0000) 2024-06-02T04:21:11.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:10 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:10.655+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.583260+0000 front 2024-06-02T04:20:39.583318+0000 (oldest deadline 2024-06-02T04:21:04.283411+0000) 2024-06-02T04:21:11.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:10 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:10.806+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:11.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:10 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:10.806+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:11.089 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:10 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:10.806+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:11.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:10 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:10.903+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:11.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:10 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:10.903+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:11.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:10 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:10.903+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.851441+0000 front 2024-06-02T04:20:39.851551+0000 (oldest deadline 2024-06-02T04:21:04.551414+0000) 2024-06-02T04:21:11.548 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:11 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:11.228+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:34.209783+0000 front 2024-06-02T04:20:34.209765+0000 (oldest deadline 2024-06-02T04:20:58.309904+0000) 2024-06-02T04:21:11.548 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:11 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:11.228+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.911407+0000 front 2024-06-02T04:20:42.911440+0000 (oldest deadline 2024-06-02T04:21:05.211518+0000) 2024-06-02T04:21:11.923 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:11 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:11.662+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.602399+0000 front 2024-06-02T04:20:27.602417+0000 (oldest deadline 2024-06-02T04:20:52.803177+0000) 2024-06-02T04:21:11.923 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:11 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:11.662+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:32.804162+0000 front 2024-06-02T04:20:32.804209+0000 (oldest deadline 2024-06-02T04:21:00.404601+0000) 2024-06-02T04:21:11.923 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:11 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6[77215]: 2024-06-02T04:21:11.662+0000 7f1e829df700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.905653+0000 front 2024-06-02T04:20:40.905722+0000 (oldest deadline 2024-06-02T04:21:05.605408+0000) 2024-06-02T04:21:12.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:11 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:11.772+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:12.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:11 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:11.772+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:12.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:11 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:11.772+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:12.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:11 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:11.696+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.182179+0000 front 2024-06-02T04:20:36.182203+0000 (oldest deadline 2024-06-02T04:20:57.882345+0000) 2024-06-02T04:21:12.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:11 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:11.696+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.583260+0000 front 2024-06-02T04:20:39.583318+0000 (oldest deadline 2024-06-02T04:21:04.283411+0000) 2024-06-02T04:21:12.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:11 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:11.696+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:45.384665+0000 front 2024-06-02T04:20:45.384651+0000 (oldest deadline 2024-06-02T04:21:11.284753+0000) 2024-06-02T04:21:12.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:11 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:11.825+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:12.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:11 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:11.825+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:12.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:11 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:11.825+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:12.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:11 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:11.825+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:48.311832+0000 front 2024-06-02T04:20:48.311957+0000 (oldest deadline 2024-06-02T04:21:11.211958+0000) 2024-06-02T04:21:12.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:11 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:11.923+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:12.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:11 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:11.923+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:12.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:11 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:11.923+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.851441+0000 front 2024-06-02T04:20:39.851551+0000 (oldest deadline 2024-06-02T04:21:04.551414+0000) 2024-06-02T04:21:12.548 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:12 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:12.260+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:34.209783+0000 front 2024-06-02T04:20:34.209765+0000 (oldest deadline 2024-06-02T04:20:58.309904+0000) 2024-06-02T04:21:12.548 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:12 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:12.260+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.911407+0000 front 2024-06-02T04:20:42.911440+0000 (oldest deadline 2024-06-02T04:21:05.211518+0000) 2024-06-02T04:21:13.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:12 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:12.775+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:13.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:12 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:12.775+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:13.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:12 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:12.775+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:13.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:12 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:12.712+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.182179+0000 front 2024-06-02T04:20:36.182203+0000 (oldest deadline 2024-06-02T04:20:57.882345+0000) 2024-06-02T04:21:13.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:12 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:12.712+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.583260+0000 front 2024-06-02T04:20:39.583318+0000 (oldest deadline 2024-06-02T04:21:04.283411+0000) 2024-06-02T04:21:13.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:12 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:12.712+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:45.384665+0000 front 2024-06-02T04:20:45.384651+0000 (oldest deadline 2024-06-02T04:21:11.284753+0000) 2024-06-02T04:21:13.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:12 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:12.786+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:13.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:12 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:12.786+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:13.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:12 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:12.786+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:13.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:12 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:12.786+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:48.311832+0000 front 2024-06-02T04:20:48.311957+0000 (oldest deadline 2024-06-02T04:21:11.211958+0000) 2024-06-02T04:21:13.322 INFO:journalctl@ceph.osd.6.smithi123.stdout:Jun 02 04:21:12 smithi123 bash[112792]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-6 2024-06-02T04:21:13.323 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:12 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:12.943+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:13.323 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:12 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:12.943+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:13.323 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:12 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:12.943+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.851441+0000 front 2024-06-02T04:20:39.851551+0000 (oldest deadline 2024-06-02T04:21:04.551414+0000) 2024-06-02T04:21:13.548 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:13 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:13.255+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:34.209783+0000 front 2024-06-02T04:20:34.209765+0000 (oldest deadline 2024-06-02T04:20:58.309904+0000) 2024-06-02T04:21:13.549 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:13 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:13.255+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.911407+0000 front 2024-06-02T04:20:42.911440+0000 (oldest deadline 2024-06-02T04:21:05.211518+0000) 2024-06-02T04:21:13.549 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:13 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:13.255+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.912550+0000 front 2024-06-02T04:20:46.912567+0000 (oldest deadline 2024-06-02T04:21:12.812451+0000) 2024-06-02T04:21:14.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:13 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:13.738+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:14.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:13 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:13.738+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:14.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:13 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:13.738+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:14.072 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:13 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:13.935+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:14.072 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:13 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:13.935+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:14.072 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:13 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:13.935+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.851441+0000 front 2024-06-02T04:20:39.851551+0000 (oldest deadline 2024-06-02T04:21:04.551414+0000) 2024-06-02T04:21:14.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:13 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:13.736+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.182179+0000 front 2024-06-02T04:20:36.182203+0000 (oldest deadline 2024-06-02T04:20:57.882345+0000) 2024-06-02T04:21:14.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:13 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:13.736+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.583260+0000 front 2024-06-02T04:20:39.583318+0000 (oldest deadline 2024-06-02T04:21:04.283411+0000) 2024-06-02T04:21:14.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:13 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:13.736+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:45.384665+0000 front 2024-06-02T04:20:45.384651+0000 (oldest deadline 2024-06-02T04:21:11.284753+0000) 2024-06-02T04:21:14.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:13 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:13.782+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:14.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:13 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:13.782+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:14.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:13 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:13.782+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:14.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:13 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:13.782+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:48.311832+0000 front 2024-06-02T04:20:48.311957+0000 (oldest deadline 2024-06-02T04:21:11.211958+0000) 2024-06-02T04:21:14.155 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.6.service' 2024-06-02T04:21:14.235 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T04:21:14.235 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-06-02T04:21:14.235 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-06-02T04:21:14.235 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.7 2024-06-02T04:21:14.548 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:14 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:14.263+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:34.209783+0000 front 2024-06-02T04:20:34.209765+0000 (oldest deadline 2024-06-02T04:20:58.309904+0000) 2024-06-02T04:21:14.548 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:14 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:14.263+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.911407+0000 front 2024-06-02T04:20:42.911440+0000 (oldest deadline 2024-06-02T04:21:05.211518+0000) 2024-06-02T04:21:14.548 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:14 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:14.263+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.912550+0000 front 2024-06-02T04:20:46.912567+0000 (oldest deadline 2024-06-02T04:21:12.812451+0000) 2024-06-02T04:21:14.588 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:14 smithi136 systemd[1]: Stopping Ceph osd.7 for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:21:14.588 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:14 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:14.514+0000 7f0672275700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T04:21:14.588 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:14 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:14.514+0000 7f0672275700 -1 osd.7 87 *** Got signal Terminated *** 2024-06-02T04:21:14.588 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:14 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:14.514+0000 7f0672275700 -1 osd.7 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T04:21:15.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:14 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:14.733+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:15.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:14 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:14.733+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:15.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:14 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:14.733+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:15.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:14 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:14.689+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.182179+0000 front 2024-06-02T04:20:36.182203+0000 (oldest deadline 2024-06-02T04:20:57.882345+0000) 2024-06-02T04:21:15.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:14 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:14.689+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.583260+0000 front 2024-06-02T04:20:39.583318+0000 (oldest deadline 2024-06-02T04:21:04.283411+0000) 2024-06-02T04:21:15.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:14 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:14.689+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:45.384665+0000 front 2024-06-02T04:20:45.384651+0000 (oldest deadline 2024-06-02T04:21:11.284753+0000) 2024-06-02T04:21:15.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:14 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:14.805+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:15.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:14 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:14.805+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:15.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:14 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:14.805+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:15.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:14 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:14.805+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:48.311832+0000 front 2024-06-02T04:20:48.311957+0000 (oldest deadline 2024-06-02T04:21:11.211958+0000) 2024-06-02T04:21:15.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:14 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:14.900+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:15.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:14 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:14.900+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:15.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:14 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:14.900+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.851441+0000 front 2024-06-02T04:20:39.851551+0000 (oldest deadline 2024-06-02T04:21:04.551414+0000) 2024-06-02T04:21:15.548 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:15 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:15.287+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:34.209783+0000 front 2024-06-02T04:20:34.209765+0000 (oldest deadline 2024-06-02T04:20:58.309904+0000) 2024-06-02T04:21:15.548 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:15 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:15.287+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.911407+0000 front 2024-06-02T04:20:42.911440+0000 (oldest deadline 2024-06-02T04:21:05.211518+0000) 2024-06-02T04:21:15.548 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:15 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:15.287+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.912550+0000 front 2024-06-02T04:20:46.912567+0000 (oldest deadline 2024-06-02T04:21:12.812451+0000) 2024-06-02T04:21:16.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:15 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:15.746+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:16.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:15 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:15.746+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:16.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:15 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:15.746+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:16.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:15 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:15.657+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.182179+0000 front 2024-06-02T04:20:36.182203+0000 (oldest deadline 2024-06-02T04:20:57.882345+0000) 2024-06-02T04:21:16.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:15 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:15.657+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.583260+0000 front 2024-06-02T04:20:39.583318+0000 (oldest deadline 2024-06-02T04:21:04.283411+0000) 2024-06-02T04:21:16.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:15 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:15.657+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:45.384665+0000 front 2024-06-02T04:20:45.384651+0000 (oldest deadline 2024-06-02T04:21:11.284753+0000) 2024-06-02T04:21:16.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:15 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:15.800+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:16.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:15 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:15.800+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:16.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:15 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:15.800+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:16.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:15 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:15.800+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:48.311832+0000 front 2024-06-02T04:20:48.311957+0000 (oldest deadline 2024-06-02T04:21:11.211958+0000) 2024-06-02T04:21:16.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:15 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:15.929+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:16.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:15 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:15.929+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:16.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:15 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:15.929+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.851441+0000 front 2024-06-02T04:20:39.851551+0000 (oldest deadline 2024-06-02T04:21:04.551414+0000) 2024-06-02T04:21:16.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:15 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:15.929+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.852350+0000 front 2024-06-02T04:20:46.852438+0000 (oldest deadline 2024-06-02T04:21:15.053010+0000) 2024-06-02T04:21:16.548 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:16 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:16.272+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:34.209783+0000 front 2024-06-02T04:20:34.209765+0000 (oldest deadline 2024-06-02T04:20:58.309904+0000) 2024-06-02T04:21:16.548 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:16 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:16.272+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.911407+0000 front 2024-06-02T04:20:42.911440+0000 (oldest deadline 2024-06-02T04:21:05.211518+0000) 2024-06-02T04:21:16.548 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:16 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:16.272+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.912550+0000 front 2024-06-02T04:20:46.912567+0000 (oldest deadline 2024-06-02T04:21:12.812451+0000) 2024-06-02T04:21:17.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:16 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:16.758+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:17.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:16 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:16.758+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:17.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:16 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:16.758+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:17.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:16 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:16.639+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.182179+0000 front 2024-06-02T04:20:36.182203+0000 (oldest deadline 2024-06-02T04:20:57.882345+0000) 2024-06-02T04:21:17.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:16 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:16.639+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.583260+0000 front 2024-06-02T04:20:39.583318+0000 (oldest deadline 2024-06-02T04:21:04.283411+0000) 2024-06-02T04:21:17.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:16 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:16.639+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:45.384665+0000 front 2024-06-02T04:20:45.384651+0000 (oldest deadline 2024-06-02T04:21:11.284753+0000) 2024-06-02T04:21:17.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:16 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:16.821+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:17.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:16 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:16.821+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:17.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:16 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:16.821+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:17.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:16 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:16.821+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:48.311832+0000 front 2024-06-02T04:20:48.311957+0000 (oldest deadline 2024-06-02T04:21:11.211958+0000) 2024-06-02T04:21:17.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:16 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:16.942+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:17.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:16 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:16.942+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:17.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:16 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:16.942+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.851441+0000 front 2024-06-02T04:20:39.851551+0000 (oldest deadline 2024-06-02T04:21:04.551414+0000) 2024-06-02T04:21:17.323 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:16 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:16.942+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.852350+0000 front 2024-06-02T04:20:46.852438+0000 (oldest deadline 2024-06-02T04:21:15.053010+0000) 2024-06-02T04:21:17.548 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:17 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:17.286+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:34.209783+0000 front 2024-06-02T04:20:34.209765+0000 (oldest deadline 2024-06-02T04:20:58.309904+0000) 2024-06-02T04:21:17.548 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:17 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:17.286+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.911407+0000 front 2024-06-02T04:20:42.911440+0000 (oldest deadline 2024-06-02T04:21:05.211518+0000) 2024-06-02T04:21:17.548 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:17 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:17.286+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.912550+0000 front 2024-06-02T04:20:46.912567+0000 (oldest deadline 2024-06-02T04:21:12.812451+0000) 2024-06-02T04:21:18.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:17 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:17.795+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:18.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:17 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:17.795+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:18.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:17 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:17.795+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:18.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:17 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:17.639+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.182179+0000 front 2024-06-02T04:20:36.182203+0000 (oldest deadline 2024-06-02T04:20:57.882345+0000) 2024-06-02T04:21:18.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:17 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:17.639+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.583260+0000 front 2024-06-02T04:20:39.583318+0000 (oldest deadline 2024-06-02T04:21:04.283411+0000) 2024-06-02T04:21:18.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:17 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:17.639+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:45.384665+0000 front 2024-06-02T04:20:45.384651+0000 (oldest deadline 2024-06-02T04:21:11.284753+0000) 2024-06-02T04:21:18.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:17 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:17.855+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:18.089 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:17 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:17.855+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:18.089 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:17 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:17.855+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:18.089 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:17 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:17.855+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:48.311832+0000 front 2024-06-02T04:20:48.311957+0000 (oldest deadline 2024-06-02T04:21:11.211958+0000) 2024-06-02T04:21:18.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:17 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:17.977+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:18.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:17 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:17.977+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:18.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:17 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:17.977+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.851441+0000 front 2024-06-02T04:20:39.851551+0000 (oldest deadline 2024-06-02T04:21:04.551414+0000) 2024-06-02T04:21:18.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:17 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:17.977+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.852350+0000 front 2024-06-02T04:20:46.852438+0000 (oldest deadline 2024-06-02T04:21:15.053010+0000) 2024-06-02T04:21:18.751 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:18 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:18.313+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:34.209783+0000 front 2024-06-02T04:20:34.209765+0000 (oldest deadline 2024-06-02T04:20:58.309904+0000) 2024-06-02T04:21:18.752 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:18 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:18.313+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.911407+0000 front 2024-06-02T04:20:42.911440+0000 (oldest deadline 2024-06-02T04:21:05.211518+0000) 2024-06-02T04:21:18.752 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:18 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:18.313+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.912550+0000 front 2024-06-02T04:20:46.912567+0000 (oldest deadline 2024-06-02T04:21:12.812451+0000) 2024-06-02T04:21:19.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:18 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:18.752+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:19.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:18 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:18.752+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:19.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:18 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:18.752+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:19.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:18 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:18.665+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.182179+0000 front 2024-06-02T04:20:36.182203+0000 (oldest deadline 2024-06-02T04:20:57.882345+0000) 2024-06-02T04:21:19.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:18 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:18.665+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.583260+0000 front 2024-06-02T04:20:39.583318+0000 (oldest deadline 2024-06-02T04:21:04.283411+0000) 2024-06-02T04:21:19.088 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:18 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7[69868]: 2024-06-02T04:21:18.665+0000 7f066e86b700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:45.384665+0000 front 2024-06-02T04:20:45.384651+0000 (oldest deadline 2024-06-02T04:21:11.284753+0000) 2024-06-02T04:21:19.089 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:18 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:18.845+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:19.089 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:18 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:18.845+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:19.089 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:18 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:18.845+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:19.089 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:18 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:18.845+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:48.311832+0000 front 2024-06-02T04:20:48.311957+0000 (oldest deadline 2024-06-02T04:21:11.211958+0000) 2024-06-02T04:21:19.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:18 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:18.957+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:19.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:18 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:18.957+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:19.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:18 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:18.957+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.851441+0000 front 2024-06-02T04:20:39.851551+0000 (oldest deadline 2024-06-02T04:21:04.551414+0000) 2024-06-02T04:21:19.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:18 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:18.957+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.852350+0000 front 2024-06-02T04:20:46.852438+0000 (oldest deadline 2024-06-02T04:21:15.053010+0000) 2024-06-02T04:21:19.780 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:19 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:19.312+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:34.209783+0000 front 2024-06-02T04:20:34.209765+0000 (oldest deadline 2024-06-02T04:20:58.309904+0000) 2024-06-02T04:21:19.780 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:19 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:19.312+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.911407+0000 front 2024-06-02T04:20:42.911440+0000 (oldest deadline 2024-06-02T04:21:05.211518+0000) 2024-06-02T04:21:19.780 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:19 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:19.312+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.912550+0000 front 2024-06-02T04:20:46.912567+0000 (oldest deadline 2024-06-02T04:21:12.812451+0000) 2024-06-02T04:21:20.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:19 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:19.780+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:20.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:19 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:19.780+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:20.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:19 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:19.780+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:20.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:19 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:19.818+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:20.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:19 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:19.818+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:20.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:19 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:19.818+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:20.088 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:19 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:19.818+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:48.311832+0000 front 2024-06-02T04:20:48.311957+0000 (oldest deadline 2024-06-02T04:21:11.211958+0000) 2024-06-02T04:21:20.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:19 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:19.984+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:20.323 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:19 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:19.984+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:20.323 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:19 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:19.984+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.851441+0000 front 2024-06-02T04:20:39.851551+0000 (oldest deadline 2024-06-02T04:21:04.551414+0000) 2024-06-02T04:21:20.323 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:19 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:19.984+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.852350+0000 front 2024-06-02T04:20:46.852438+0000 (oldest deadline 2024-06-02T04:21:15.053010+0000) 2024-06-02T04:21:20.588 INFO:journalctl@ceph.osd.7.smithi136.stdout:Jun 02 04:21:20 smithi136 bash[90820]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-7 2024-06-02T04:21:20.791 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:20 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:20.358+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:34.209783+0000 front 2024-06-02T04:20:34.209765+0000 (oldest deadline 2024-06-02T04:20:58.309904+0000) 2024-06-02T04:21:20.791 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:20 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:20.358+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.911407+0000 front 2024-06-02T04:20:42.911440+0000 (oldest deadline 2024-06-02T04:21:05.211518+0000) 2024-06-02T04:21:20.791 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:20 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:20.358+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.912550+0000 front 2024-06-02T04:20:46.912567+0000 (oldest deadline 2024-06-02T04:21:12.812451+0000) 2024-06-02T04:21:21.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:20 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:20.791+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:21.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:20 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:20.791+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:21.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:20 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:20.791+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:21.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:20 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:20.791+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.188280+0000 front 2024-06-02T04:20:57.188379+0000 (oldest deadline 2024-06-02T04:21:20.688199+0000) 2024-06-02T04:21:21.092 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:20 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:20.856+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:21.092 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:20 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:20.856+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:21.092 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:20 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:20.856+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:21.092 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:20 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:20.856+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:48.311832+0000 front 2024-06-02T04:20:48.311957+0000 (oldest deadline 2024-06-02T04:21:11.211958+0000) 2024-06-02T04:21:21.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:20 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:20.984+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:21.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:20 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:20.984+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:21.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:20 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:20.984+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.851441+0000 front 2024-06-02T04:20:39.851551+0000 (oldest deadline 2024-06-02T04:21:04.551414+0000) 2024-06-02T04:21:21.323 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:20 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:20.984+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.852350+0000 front 2024-06-02T04:20:46.852438+0000 (oldest deadline 2024-06-02T04:21:15.053010+0000) 2024-06-02T04:21:21.417 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.7.service' 2024-06-02T04:21:21.458 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T04:21:21.458 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-06-02T04:21:21.458 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-06-02T04:21:21.458 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.8 2024-06-02T04:21:21.704 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:21 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:21.357+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:34.209783+0000 front 2024-06-02T04:20:34.209765+0000 (oldest deadline 2024-06-02T04:20:58.309904+0000) 2024-06-02T04:21:21.704 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:21 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:21.357+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.911407+0000 front 2024-06-02T04:20:42.911440+0000 (oldest deadline 2024-06-02T04:21:05.211518+0000) 2024-06-02T04:21:21.705 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:21 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:21.357+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.912550+0000 front 2024-06-02T04:20:46.912567+0000 (oldest deadline 2024-06-02T04:21:12.812451+0000) 2024-06-02T04:21:21.705 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:21 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:21.357+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:56.913357+0000 front 2024-06-02T04:20:56.913411+0000 (oldest deadline 2024-06-02T04:21:20.413377+0000) 2024-06-02T04:21:21.705 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:21 smithi162 systemd[1]: Stopping Ceph osd.8 for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:21:22.048 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:21 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:21.704+0000 7feca3eb9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T04:21:22.048 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:21 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:21.704+0000 7feca3eb9700 -1 osd.8 87 *** Got signal Terminated *** 2024-06-02T04:21:22.048 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:21 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:21.704+0000 7feca3eb9700 -1 osd.8 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T04:21:22.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:21 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:21.754+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:22.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:21 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:21.754+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:22.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:21 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:21.754+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:22.049 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:21 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:21.754+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.188280+0000 front 2024-06-02T04:20:57.188379+0000 (oldest deadline 2024-06-02T04:21:20.688199+0000) 2024-06-02T04:21:22.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:22 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:22.011+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:22.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:22 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:22.011+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:22.323 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:22 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:22.011+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.851441+0000 front 2024-06-02T04:20:39.851551+0000 (oldest deadline 2024-06-02T04:21:04.551414+0000) 2024-06-02T04:21:22.323 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:22 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:22.011+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.852350+0000 front 2024-06-02T04:20:46.852438+0000 (oldest deadline 2024-06-02T04:21:15.053010+0000) 2024-06-02T04:21:22.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:21 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:21.856+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:22.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:21 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:21.856+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:22.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:21 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:21.856+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:22.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:21 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:21.856+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:48.311832+0000 front 2024-06-02T04:20:48.311957+0000 (oldest deadline 2024-06-02T04:21:11.211958+0000) 2024-06-02T04:21:22.738 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:22 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:22.340+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:34.209783+0000 front 2024-06-02T04:20:34.209765+0000 (oldest deadline 2024-06-02T04:20:58.309904+0000) 2024-06-02T04:21:22.738 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:22 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:22.340+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.911407+0000 front 2024-06-02T04:20:42.911440+0000 (oldest deadline 2024-06-02T04:21:05.211518+0000) 2024-06-02T04:21:22.738 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:22 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:22.340+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.912550+0000 front 2024-06-02T04:20:46.912567+0000 (oldest deadline 2024-06-02T04:21:12.812451+0000) 2024-06-02T04:21:22.738 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:22 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:22.340+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:56.913357+0000 front 2024-06-02T04:20:56.913411+0000 (oldest deadline 2024-06-02T04:21:20.413377+0000) 2024-06-02T04:21:23.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:22 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:22.738+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:23.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:22 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:22.738+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:23.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:22 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:22.738+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:23.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:22 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:22.738+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.188280+0000 front 2024-06-02T04:20:57.188379+0000 (oldest deadline 2024-06-02T04:21:20.688199+0000) 2024-06-02T04:21:23.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:23 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:23.024+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:23.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:23 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:23.024+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:23.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:23 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:23.024+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.851441+0000 front 2024-06-02T04:20:39.851551+0000 (oldest deadline 2024-06-02T04:21:04.551414+0000) 2024-06-02T04:21:23.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:23 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:23.024+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.852350+0000 front 2024-06-02T04:20:46.852438+0000 (oldest deadline 2024-06-02T04:21:15.053010+0000) 2024-06-02T04:21:23.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:23 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:23.024+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.254362+0000 front 2024-06-02T04:20:57.254239+0000 (oldest deadline 2024-06-02T04:21:22.554211+0000) 2024-06-02T04:21:23.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:22 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:22.881+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:23.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:22 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:22.881+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:23.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:22 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:22.881+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:23.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:22 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:22.881+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:48.311832+0000 front 2024-06-02T04:20:48.311957+0000 (oldest deadline 2024-06-02T04:21:11.211958+0000) 2024-06-02T04:21:23.774 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:23 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:23.370+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:34.209783+0000 front 2024-06-02T04:20:34.209765+0000 (oldest deadline 2024-06-02T04:20:58.309904+0000) 2024-06-02T04:21:23.774 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:23 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:23.370+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.911407+0000 front 2024-06-02T04:20:42.911440+0000 (oldest deadline 2024-06-02T04:21:05.211518+0000) 2024-06-02T04:21:23.774 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:23 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:23.370+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.912550+0000 front 2024-06-02T04:20:46.912567+0000 (oldest deadline 2024-06-02T04:21:12.812451+0000) 2024-06-02T04:21:23.774 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:23 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:23.370+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:56.913357+0000 front 2024-06-02T04:20:56.913411+0000 (oldest deadline 2024-06-02T04:21:20.413377+0000) 2024-06-02T04:21:24.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:23 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:23.775+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:24.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:23 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:23.775+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:24.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:23 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:23.775+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:24.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:23 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:23.775+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.188280+0000 front 2024-06-02T04:20:57.188379+0000 (oldest deadline 2024-06-02T04:21:20.688199+0000) 2024-06-02T04:21:24.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:24 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:24.044+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:24.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:24 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:24.044+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:24.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:24 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:24.044+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.851441+0000 front 2024-06-02T04:20:39.851551+0000 (oldest deadline 2024-06-02T04:21:04.551414+0000) 2024-06-02T04:21:24.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:24 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:24.044+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.852350+0000 front 2024-06-02T04:20:46.852438+0000 (oldest deadline 2024-06-02T04:21:15.053010+0000) 2024-06-02T04:21:24.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:24 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:24.044+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.254362+0000 front 2024-06-02T04:20:57.254239+0000 (oldest deadline 2024-06-02T04:21:22.554211+0000) 2024-06-02T04:21:24.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:23 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:23.872+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:24.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:23 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:23.872+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:24.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:23 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:23.872+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:24.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:23 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:23.872+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:48.311832+0000 front 2024-06-02T04:20:48.311957+0000 (oldest deadline 2024-06-02T04:21:11.211958+0000) 2024-06-02T04:21:24.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:23 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:23.872+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.513922+0000 front 2024-06-02T04:20:57.513954+0000 (oldest deadline 2024-06-02T04:21:23.414062+0000) 2024-06-02T04:21:24.765 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:24 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:24.350+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:34.209783+0000 front 2024-06-02T04:20:34.209765+0000 (oldest deadline 2024-06-02T04:20:58.309904+0000) 2024-06-02T04:21:24.766 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:24 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:24.350+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.911407+0000 front 2024-06-02T04:20:42.911440+0000 (oldest deadline 2024-06-02T04:21:05.211518+0000) 2024-06-02T04:21:24.766 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:24 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:24.350+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.912550+0000 front 2024-06-02T04:20:46.912567+0000 (oldest deadline 2024-06-02T04:21:12.812451+0000) 2024-06-02T04:21:24.766 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:24 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:24.350+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:56.913357+0000 front 2024-06-02T04:20:56.913411+0000 (oldest deadline 2024-06-02T04:21:20.413377+0000) 2024-06-02T04:21:25.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:24 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:24.766+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:25.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:24 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:24.766+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:25.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:24 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:24.766+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:25.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:24 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:24.766+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.188280+0000 front 2024-06-02T04:20:57.188379+0000 (oldest deadline 2024-06-02T04:21:20.688199+0000) 2024-06-02T04:21:25.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:25 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:25.046+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:25.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:25 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:25.046+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:25.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:25 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:25.046+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.851441+0000 front 2024-06-02T04:20:39.851551+0000 (oldest deadline 2024-06-02T04:21:04.551414+0000) 2024-06-02T04:21:25.323 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:25 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:25.046+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.852350+0000 front 2024-06-02T04:20:46.852438+0000 (oldest deadline 2024-06-02T04:21:15.053010+0000) 2024-06-02T04:21:25.323 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:25 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:25.046+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.254362+0000 front 2024-06-02T04:20:57.254239+0000 (oldest deadline 2024-06-02T04:21:22.554211+0000) 2024-06-02T04:21:25.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:24 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:24.856+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:25.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:24 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:24.856+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:25.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:24 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:24.856+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:25.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:24 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:24.856+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:48.311832+0000 front 2024-06-02T04:20:48.311957+0000 (oldest deadline 2024-06-02T04:21:11.211958+0000) 2024-06-02T04:21:25.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:24 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:24.856+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.513922+0000 front 2024-06-02T04:20:57.513954+0000 (oldest deadline 2024-06-02T04:21:23.414062+0000) 2024-06-02T04:21:25.797 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:25 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:25.325+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:34.209783+0000 front 2024-06-02T04:20:34.209765+0000 (oldest deadline 2024-06-02T04:20:58.309904+0000) 2024-06-02T04:21:25.798 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:25 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:25.325+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.911407+0000 front 2024-06-02T04:20:42.911440+0000 (oldest deadline 2024-06-02T04:21:05.211518+0000) 2024-06-02T04:21:25.798 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:25 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:25.325+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.912550+0000 front 2024-06-02T04:20:46.912567+0000 (oldest deadline 2024-06-02T04:21:12.812451+0000) 2024-06-02T04:21:25.798 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:25 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:25.325+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:56.913357+0000 front 2024-06-02T04:20:56.913411+0000 (oldest deadline 2024-06-02T04:21:20.413377+0000) 2024-06-02T04:21:26.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:25 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:25.798+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:26.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:25 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:25.798+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:26.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:25 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:25.798+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:26.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:25 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:25.798+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.188280+0000 front 2024-06-02T04:20:57.188379+0000 (oldest deadline 2024-06-02T04:21:20.688199+0000) 2024-06-02T04:21:26.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:26 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:26.029+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:26.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:26 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:26.029+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:26.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:26 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:26.029+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.851441+0000 front 2024-06-02T04:20:39.851551+0000 (oldest deadline 2024-06-02T04:21:04.551414+0000) 2024-06-02T04:21:26.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:26 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:26.029+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.852350+0000 front 2024-06-02T04:20:46.852438+0000 (oldest deadline 2024-06-02T04:21:15.053010+0000) 2024-06-02T04:21:26.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:26 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:26.029+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.254362+0000 front 2024-06-02T04:20:57.254239+0000 (oldest deadline 2024-06-02T04:21:22.554211+0000) 2024-06-02T04:21:26.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:25 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:25.847+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:26.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:25 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:25.847+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:26.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:25 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:25.847+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:26.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:25 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:25.847+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:48.311832+0000 front 2024-06-02T04:20:48.311957+0000 (oldest deadline 2024-06-02T04:21:11.211958+0000) 2024-06-02T04:21:26.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:25 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:25.847+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.513922+0000 front 2024-06-02T04:20:57.513954+0000 (oldest deadline 2024-06-02T04:21:23.414062+0000) 2024-06-02T04:21:26.798 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:26 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:26.346+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:34.209783+0000 front 2024-06-02T04:20:34.209765+0000 (oldest deadline 2024-06-02T04:20:58.309904+0000) 2024-06-02T04:21:26.798 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:26 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:26.346+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.911407+0000 front 2024-06-02T04:20:42.911440+0000 (oldest deadline 2024-06-02T04:21:05.211518+0000) 2024-06-02T04:21:26.798 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:26 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:26.346+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.912550+0000 front 2024-06-02T04:20:46.912567+0000 (oldest deadline 2024-06-02T04:21:12.812451+0000) 2024-06-02T04:21:26.798 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:26 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:26.346+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:56.913357+0000 front 2024-06-02T04:20:56.913411+0000 (oldest deadline 2024-06-02T04:21:20.413377+0000) 2024-06-02T04:21:26.798 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:26 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8[68901]: 2024-06-02T04:21:26.346+0000 7fec9c4a7700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:00.413658+0000 front 2024-06-02T04:21:00.413684+0000 (oldest deadline 2024-06-02T04:21:25.713787+0000) 2024-06-02T04:21:27.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:26 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:26.805+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:27.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:26 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:26.805+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:27.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:26 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:26.805+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:27.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:26 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:26.805+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.188280+0000 front 2024-06-02T04:20:57.188379+0000 (oldest deadline 2024-06-02T04:21:20.688199+0000) 2024-06-02T04:21:27.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:27 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:27.026+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:27.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:27 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:27.026+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:27.323 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:27 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:27.026+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.851441+0000 front 2024-06-02T04:20:39.851551+0000 (oldest deadline 2024-06-02T04:21:04.551414+0000) 2024-06-02T04:21:27.323 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:27 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:27.026+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.852350+0000 front 2024-06-02T04:20:46.852438+0000 (oldest deadline 2024-06-02T04:21:15.053010+0000) 2024-06-02T04:21:27.323 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:27 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:27.026+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.254362+0000 front 2024-06-02T04:20:57.254239+0000 (oldest deadline 2024-06-02T04:21:22.554211+0000) 2024-06-02T04:21:27.323 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:27 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:27.026+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:02.554745+0000 front 2024-06-02T04:21:02.554733+0000 (oldest deadline 2024-06-02T04:21:26.654697+0000) 2024-06-02T04:21:27.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:26 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:26.885+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:27.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:26 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:26.885+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:27.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:26 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:26.885+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:27.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:26 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:26.885+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:48.311832+0000 front 2024-06-02T04:20:48.311957+0000 (oldest deadline 2024-06-02T04:21:11.211958+0000) 2024-06-02T04:21:27.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:26 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:26.885+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.513922+0000 front 2024-06-02T04:20:57.513954+0000 (oldest deadline 2024-06-02T04:21:23.414062+0000) 2024-06-02T04:21:27.798 INFO:journalctl@ceph.osd.8.smithi162.stdout:Jun 02 04:21:27 smithi162 bash[89996]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-8 2024-06-02T04:21:28.089 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:27 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:27.830+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:28.089 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:27 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:27.830+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:28.090 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:27 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:27.830+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:28.090 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:27 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:27.830+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.188280+0000 front 2024-06-02T04:20:57.188379+0000 (oldest deadline 2024-06-02T04:21:20.688199+0000) 2024-06-02T04:21:28.090 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:27 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:27.830+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:02.889321+0000 front 2024-06-02T04:21:02.889358+0000 (oldest deadline 2024-06-02T04:21:27.589478+0000) 2024-06-02T04:21:28.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:27 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:27.996+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:28.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:27 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:27.996+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:28.323 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:27 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:27.996+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.851441+0000 front 2024-06-02T04:20:39.851551+0000 (oldest deadline 2024-06-02T04:21:04.551414+0000) 2024-06-02T04:21:28.323 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:27 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:27.996+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.852350+0000 front 2024-06-02T04:20:46.852438+0000 (oldest deadline 2024-06-02T04:21:15.053010+0000) 2024-06-02T04:21:28.323 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:27 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:27.996+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.254362+0000 front 2024-06-02T04:20:57.254239+0000 (oldest deadline 2024-06-02T04:21:22.554211+0000) 2024-06-02T04:21:28.323 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:27 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:27.996+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:02.554745+0000 front 2024-06-02T04:21:02.554733+0000 (oldest deadline 2024-06-02T04:21:26.654697+0000) 2024-06-02T04:21:28.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:27 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:27.911+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:28.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:27 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:27.911+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:28.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:27 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:27.911+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:28.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:27 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:27.911+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:48.311832+0000 front 2024-06-02T04:20:48.311957+0000 (oldest deadline 2024-06-02T04:21:11.211958+0000) 2024-06-02T04:21:28.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:27 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:27.911+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.513922+0000 front 2024-06-02T04:20:57.513954+0000 (oldest deadline 2024-06-02T04:21:23.414062+0000) 2024-06-02T04:21:28.782 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.8.service' 2024-06-02T04:21:28.823 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T04:21:28.823 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-06-02T04:21:28.824 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-06-02T04:21:28.824 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.9 2024-06-02T04:21:29.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:28 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:28.840+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:29.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:28 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:28.840+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:29.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:28 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:28.840+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:29.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:28 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:28.840+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.188280+0000 front 2024-06-02T04:20:57.188379+0000 (oldest deadline 2024-06-02T04:21:20.688199+0000) 2024-06-02T04:21:29.048 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:28 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:28.840+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:02.889321+0000 front 2024-06-02T04:21:02.889358+0000 (oldest deadline 2024-06-02T04:21:27.589478+0000) 2024-06-02T04:21:29.131 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:28 smithi123 systemd[1]: Stopping Ceph osd.9 for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:21:29.131 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:28 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:28.981+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:29.132 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:28 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:28.981+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:29.132 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:28 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:28.981+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.851441+0000 front 2024-06-02T04:20:39.851551+0000 (oldest deadline 2024-06-02T04:21:04.551414+0000) 2024-06-02T04:21:29.132 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:28 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:28.981+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.852350+0000 front 2024-06-02T04:20:46.852438+0000 (oldest deadline 2024-06-02T04:21:15.053010+0000) 2024-06-02T04:21:29.132 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:28 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:28.981+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.254362+0000 front 2024-06-02T04:20:57.254239+0000 (oldest deadline 2024-06-02T04:21:22.554211+0000) 2024-06-02T04:21:29.132 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:28 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:28.981+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:02.554745+0000 front 2024-06-02T04:21:02.554733+0000 (oldest deadline 2024-06-02T04:21:26.654697+0000) 2024-06-02T04:21:29.132 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:29 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:29.131+0000 7f93c822c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T04:21:29.132 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:29 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:29.131+0000 7f93c822c700 -1 osd.9 87 *** Got signal Terminated *** 2024-06-02T04:21:29.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:28 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:28.927+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:29.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:28 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:28.927+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:29.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:28 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:28.927+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:29.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:28 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:28.927+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:48.311832+0000 front 2024-06-02T04:20:48.311957+0000 (oldest deadline 2024-06-02T04:21:11.211958+0000) 2024-06-02T04:21:29.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:28 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:28.927+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.513922+0000 front 2024-06-02T04:20:57.513954+0000 (oldest deadline 2024-06-02T04:21:23.414062+0000) 2024-06-02T04:21:29.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:28 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:28.927+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:03.414816+0000 front 2024-06-02T04:21:03.414734+0000 (oldest deadline 2024-06-02T04:21:28.114665+0000) 2024-06-02T04:21:29.572 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:29 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:29.131+0000 7f93c822c700 -1 osd.9 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T04:21:30.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:29 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:29.873+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:30.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:29 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:29.873+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:30.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:29 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:29.873+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:30.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:29 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:29.873+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.188280+0000 front 2024-06-02T04:20:57.188379+0000 (oldest deadline 2024-06-02T04:21:20.688199+0000) 2024-06-02T04:21:30.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:29 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:29.873+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:02.889321+0000 front 2024-06-02T04:21:02.889358+0000 (oldest deadline 2024-06-02T04:21:27.589478+0000) 2024-06-02T04:21:30.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:30 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:30.024+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:30.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:30 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:30.024+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:30.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:30 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:30.024+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.851441+0000 front 2024-06-02T04:20:39.851551+0000 (oldest deadline 2024-06-02T04:21:04.551414+0000) 2024-06-02T04:21:30.323 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:30 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:30.024+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.852350+0000 front 2024-06-02T04:20:46.852438+0000 (oldest deadline 2024-06-02T04:21:15.053010+0000) 2024-06-02T04:21:30.323 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:30 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:30.024+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.254362+0000 front 2024-06-02T04:20:57.254239+0000 (oldest deadline 2024-06-02T04:21:22.554211+0000) 2024-06-02T04:21:30.323 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:30 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:30.024+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:02.554745+0000 front 2024-06-02T04:21:02.554733+0000 (oldest deadline 2024-06-02T04:21:26.654697+0000) 2024-06-02T04:21:30.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:29 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:29.916+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:30.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:29 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:29.916+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:30.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:29 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:29.916+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:30.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:29 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:29.916+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:48.311832+0000 front 2024-06-02T04:20:48.311957+0000 (oldest deadline 2024-06-02T04:21:11.211958+0000) 2024-06-02T04:21:30.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:29 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:29.916+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.513922+0000 front 2024-06-02T04:20:57.513954+0000 (oldest deadline 2024-06-02T04:21:23.414062+0000) 2024-06-02T04:21:30.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:29 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:29.916+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:03.414816+0000 front 2024-06-02T04:21:03.414734+0000 (oldest deadline 2024-06-02T04:21:28.114665+0000) 2024-06-02T04:21:31.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:30 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:30.897+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:31.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:30 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:30.897+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:31.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:30 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:30.897+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:31.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:30 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:30.897+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.188280+0000 front 2024-06-02T04:20:57.188379+0000 (oldest deadline 2024-06-02T04:21:20.688199+0000) 2024-06-02T04:21:31.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:30 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:30.897+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:02.889321+0000 front 2024-06-02T04:21:02.889358+0000 (oldest deadline 2024-06-02T04:21:27.589478+0000) 2024-06-02T04:21:31.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:31 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:31.034+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:31.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:31 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:31.034+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:31.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:31 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:31.034+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.851441+0000 front 2024-06-02T04:20:39.851551+0000 (oldest deadline 2024-06-02T04:21:04.551414+0000) 2024-06-02T04:21:31.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:31 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:31.034+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.852350+0000 front 2024-06-02T04:20:46.852438+0000 (oldest deadline 2024-06-02T04:21:15.053010+0000) 2024-06-02T04:21:31.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:31 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:31.034+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.254362+0000 front 2024-06-02T04:20:57.254239+0000 (oldest deadline 2024-06-02T04:21:22.554211+0000) 2024-06-02T04:21:31.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:31 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:31.034+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:02.554745+0000 front 2024-06-02T04:21:02.554733+0000 (oldest deadline 2024-06-02T04:21:26.654697+0000) 2024-06-02T04:21:31.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:30 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:30.959+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:31.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:30 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:30.959+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:31.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:30 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:30.959+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:31.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:30 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:30.959+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:48.311832+0000 front 2024-06-02T04:20:48.311957+0000 (oldest deadline 2024-06-02T04:21:11.211958+0000) 2024-06-02T04:21:31.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:30 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:30.959+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.513922+0000 front 2024-06-02T04:20:57.513954+0000 (oldest deadline 2024-06-02T04:21:23.414062+0000) 2024-06-02T04:21:31.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:30 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:30.959+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:03.414816+0000 front 2024-06-02T04:21:03.414734+0000 (oldest deadline 2024-06-02T04:21:28.114665+0000) 2024-06-02T04:21:32.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:31 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:31.888+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:32.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:31 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:31.888+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:32.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:31 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:31.888+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:32.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:31 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:31.888+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.188280+0000 front 2024-06-02T04:20:57.188379+0000 (oldest deadline 2024-06-02T04:21:20.688199+0000) 2024-06-02T04:21:32.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:31 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:31.888+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:02.889321+0000 front 2024-06-02T04:21:02.889358+0000 (oldest deadline 2024-06-02T04:21:27.589478+0000) 2024-06-02T04:21:32.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:32 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:32.056+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:32.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:32 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:32.056+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:32.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:32 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:32.056+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.851441+0000 front 2024-06-02T04:20:39.851551+0000 (oldest deadline 2024-06-02T04:21:04.551414+0000) 2024-06-02T04:21:32.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:32 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:32.056+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.852350+0000 front 2024-06-02T04:20:46.852438+0000 (oldest deadline 2024-06-02T04:21:15.053010+0000) 2024-06-02T04:21:32.323 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:32 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:32.056+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.254362+0000 front 2024-06-02T04:20:57.254239+0000 (oldest deadline 2024-06-02T04:21:22.554211+0000) 2024-06-02T04:21:32.323 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:32 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:32.056+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:02.554745+0000 front 2024-06-02T04:21:02.554733+0000 (oldest deadline 2024-06-02T04:21:26.654697+0000) 2024-06-02T04:21:32.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:31 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:31.987+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:32.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:31 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:31.987+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:32.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:31 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:31.987+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:32.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:31 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:31.987+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:48.311832+0000 front 2024-06-02T04:20:48.311957+0000 (oldest deadline 2024-06-02T04:21:11.211958+0000) 2024-06-02T04:21:32.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:31 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:31.987+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.513922+0000 front 2024-06-02T04:20:57.513954+0000 (oldest deadline 2024-06-02T04:21:23.414062+0000) 2024-06-02T04:21:32.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:31 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:31.987+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:03.414816+0000 front 2024-06-02T04:21:03.414734+0000 (oldest deadline 2024-06-02T04:21:28.114665+0000) 2024-06-02T04:21:33.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:32 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:32.896+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:33.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:32 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:32.896+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:33.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:32 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:32.896+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:33.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:32 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:32.896+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.188280+0000 front 2024-06-02T04:20:57.188379+0000 (oldest deadline 2024-06-02T04:21:20.688199+0000) 2024-06-02T04:21:33.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:32 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:32.896+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:02.889321+0000 front 2024-06-02T04:21:02.889358+0000 (oldest deadline 2024-06-02T04:21:27.589478+0000) 2024-06-02T04:21:33.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:33 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:33.066+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:33.325 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:33 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:33.066+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:33.325 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:33 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:33.066+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.851441+0000 front 2024-06-02T04:20:39.851551+0000 (oldest deadline 2024-06-02T04:21:04.551414+0000) 2024-06-02T04:21:33.325 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:33 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:33.066+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.852350+0000 front 2024-06-02T04:20:46.852438+0000 (oldest deadline 2024-06-02T04:21:15.053010+0000) 2024-06-02T04:21:33.325 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:33 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:33.066+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.254362+0000 front 2024-06-02T04:20:57.254239+0000 (oldest deadline 2024-06-02T04:21:22.554211+0000) 2024-06-02T04:21:33.325 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:33 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:33.066+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:02.554745+0000 front 2024-06-02T04:21:02.554733+0000 (oldest deadline 2024-06-02T04:21:26.654697+0000) 2024-06-02T04:21:33.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:32 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:32.945+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:33.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:32 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:32.945+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:33.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:32 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:32.945+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:33.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:32 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:32.945+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:48.311832+0000 front 2024-06-02T04:20:48.311957+0000 (oldest deadline 2024-06-02T04:21:11.211958+0000) 2024-06-02T04:21:33.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:32 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:32.945+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.513922+0000 front 2024-06-02T04:20:57.513954+0000 (oldest deadline 2024-06-02T04:21:23.414062+0000) 2024-06-02T04:21:33.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:32 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:32.945+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:03.414816+0000 front 2024-06-02T04:21:03.414734+0000 (oldest deadline 2024-06-02T04:21:28.114665+0000) 2024-06-02T04:21:34.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:33 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:33.879+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:34.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:33 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:33.879+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:34.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:33 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:33.879+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:34.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:33 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:33.879+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.188280+0000 front 2024-06-02T04:20:57.188379+0000 (oldest deadline 2024-06-02T04:21:20.688199+0000) 2024-06-02T04:21:34.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:33 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:33.879+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:02.889321+0000 front 2024-06-02T04:21:02.889358+0000 (oldest deadline 2024-06-02T04:21:27.589478+0000) 2024-06-02T04:21:34.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:34 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:34.066+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:26.349703+0000 front 2024-06-02T04:20:26.349606+0000 (oldest deadline 2024-06-02T04:20:50.449756+0000) 2024-06-02T04:21:34.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:34 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:34.066+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:30.450352+0000 front 2024-06-02T04:20:30.450337+0000 (oldest deadline 2024-06-02T04:20:59.850994+0000) 2024-06-02T04:21:34.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:34 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:34.066+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:39.851441+0000 front 2024-06-02T04:20:39.851551+0000 (oldest deadline 2024-06-02T04:21:04.551414+0000) 2024-06-02T04:21:34.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:34 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:34.066+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:46.852350+0000 front 2024-06-02T04:20:46.852438+0000 (oldest deadline 2024-06-02T04:21:15.053010+0000) 2024-06-02T04:21:34.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:34 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:34.066+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.254362+0000 front 2024-06-02T04:20:57.254239+0000 (oldest deadline 2024-06-02T04:21:22.554211+0000) 2024-06-02T04:21:34.322 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:34 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9[85220]: 2024-06-02T04:21:34.066+0000 7f93c081a700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:02.554745+0000 front 2024-06-02T04:21:02.554733+0000 (oldest deadline 2024-06-02T04:21:26.654697+0000) 2024-06-02T04:21:34.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:33 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:33.913+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:34.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:33 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:33.913+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:34.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:33 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:33.913+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:34.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:33 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:33.913+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:48.311832+0000 front 2024-06-02T04:20:48.311957+0000 (oldest deadline 2024-06-02T04:21:11.211958+0000) 2024-06-02T04:21:34.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:33 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:33.913+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.513922+0000 front 2024-06-02T04:20:57.513954+0000 (oldest deadline 2024-06-02T04:21:23.414062+0000) 2024-06-02T04:21:34.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:33 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:33.913+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:03.414816+0000 front 2024-06-02T04:21:03.414734+0000 (oldest deadline 2024-06-02T04:21:28.114665+0000) 2024-06-02T04:21:34.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:33 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:33.913+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-06-02T04:21:08.115292+0000 front 2024-06-02T04:21:08.115422+0000 (oldest deadline 2024-06-02T04:21:33.415211+0000) 2024-06-02T04:21:35.072 INFO:journalctl@ceph.osd.9.smithi123.stdout:Jun 02 04:21:34 smithi123 bash[113049]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-9 2024-06-02T04:21:35.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:34 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:34.864+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:35.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:34 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:34.864+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:35.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:34 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:34.864+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:35.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:34 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:34.864+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.188280+0000 front 2024-06-02T04:20:57.188379+0000 (oldest deadline 2024-06-02T04:21:20.688199+0000) 2024-06-02T04:21:35.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:34 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:34.864+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:02.889321+0000 front 2024-06-02T04:21:02.889358+0000 (oldest deadline 2024-06-02T04:21:27.589478+0000) 2024-06-02T04:21:35.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:34 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:34.864+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-06-02T04:21:11.090762+0000 front 2024-06-02T04:21:11.090685+0000 (oldest deadline 2024-06-02T04:21:34.590632+0000) 2024-06-02T04:21:35.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:34 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:34.911+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:35.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:34 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:34.911+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:35.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:34 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:34.911+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:35.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:34 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:34.911+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:48.311832+0000 front 2024-06-02T04:20:48.311957+0000 (oldest deadline 2024-06-02T04:21:11.211958+0000) 2024-06-02T04:21:35.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:34 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:34.911+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.513922+0000 front 2024-06-02T04:20:57.513954+0000 (oldest deadline 2024-06-02T04:21:23.414062+0000) 2024-06-02T04:21:35.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:34 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:34.911+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:03.414816+0000 front 2024-06-02T04:21:03.414734+0000 (oldest deadline 2024-06-02T04:21:28.114665+0000) 2024-06-02T04:21:35.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:34 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:34.911+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-06-02T04:21:08.115292+0000 front 2024-06-02T04:21:08.115422+0000 (oldest deadline 2024-06-02T04:21:33.415211+0000) 2024-06-02T04:21:36.002 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.9.service' 2024-06-02T04:21:36.042 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T04:21:36.042 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-06-02T04:21:36.042 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-06-02T04:21:36.042 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.10 2024-06-02T04:21:36.285 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:35 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:35.910+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:36.285 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:35 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:35.910+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:36.285 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:35 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:35.910+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:36.285 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:35 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:35.910+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:48.311832+0000 front 2024-06-02T04:20:48.311957+0000 (oldest deadline 2024-06-02T04:21:11.211958+0000) 2024-06-02T04:21:36.285 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:35 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:35.910+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.513922+0000 front 2024-06-02T04:20:57.513954+0000 (oldest deadline 2024-06-02T04:21:23.414062+0000) 2024-06-02T04:21:36.285 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:35 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:35.910+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:03.414816+0000 front 2024-06-02T04:21:03.414734+0000 (oldest deadline 2024-06-02T04:21:28.114665+0000) 2024-06-02T04:21:36.285 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:35 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:35.910+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-06-02T04:21:08.115292+0000 front 2024-06-02T04:21:08.115422+0000 (oldest deadline 2024-06-02T04:21:33.415211+0000) 2024-06-02T04:21:36.285 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:36 smithi136 systemd[1]: Stopping Ceph osd.10 for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:21:36.285 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:36 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:36.285+0000 7f57ef6b4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T04:21:36.285 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:36 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:36.285+0000 7f57ef6b4700 -1 osd.10 87 *** Got signal Terminated *** 2024-06-02T04:21:36.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:35 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:35.838+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:36.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:35 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:35.838+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:36.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:35 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:35.838+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:36.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:35 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:35.838+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.188280+0000 front 2024-06-02T04:20:57.188379+0000 (oldest deadline 2024-06-02T04:21:20.688199+0000) 2024-06-02T04:21:36.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:35 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:35.838+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:02.889321+0000 front 2024-06-02T04:21:02.889358+0000 (oldest deadline 2024-06-02T04:21:27.589478+0000) 2024-06-02T04:21:36.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:35 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:35.838+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-06-02T04:21:11.090762+0000 front 2024-06-02T04:21:11.090685+0000 (oldest deadline 2024-06-02T04:21:34.590632+0000) 2024-06-02T04:21:36.588 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:36 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:36.285+0000 7f57ef6b4700 -1 osd.10 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T04:21:37.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:36 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:36.803+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:37.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:36 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:36.803+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:37.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:36 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:36.803+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:37.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:36 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:36.803+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.188280+0000 front 2024-06-02T04:20:57.188379+0000 (oldest deadline 2024-06-02T04:21:20.688199+0000) 2024-06-02T04:21:37.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:36 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:36.803+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:02.889321+0000 front 2024-06-02T04:21:02.889358+0000 (oldest deadline 2024-06-02T04:21:27.589478+0000) 2024-06-02T04:21:37.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:36 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:36.803+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-06-02T04:21:11.090762+0000 front 2024-06-02T04:21:11.090685+0000 (oldest deadline 2024-06-02T04:21:34.590632+0000) 2024-06-02T04:21:37.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:36 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:36.906+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:37.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:36 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:36.906+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:37.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:36 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:36.906+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:37.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:36 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:36.906+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:48.311832+0000 front 2024-06-02T04:20:48.311957+0000 (oldest deadline 2024-06-02T04:21:11.211958+0000) 2024-06-02T04:21:37.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:36 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:36.906+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.513922+0000 front 2024-06-02T04:20:57.513954+0000 (oldest deadline 2024-06-02T04:21:23.414062+0000) 2024-06-02T04:21:37.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:36 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:36.906+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:03.414816+0000 front 2024-06-02T04:21:03.414734+0000 (oldest deadline 2024-06-02T04:21:28.114665+0000) 2024-06-02T04:21:37.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:36 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:36.906+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-06-02T04:21:08.115292+0000 front 2024-06-02T04:21:08.115422+0000 (oldest deadline 2024-06-02T04:21:33.415211+0000) 2024-06-02T04:21:38.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:37 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:37.843+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:38.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:37 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:37.843+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:38.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:37 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:37.843+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:38.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:37 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:37.843+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.188280+0000 front 2024-06-02T04:20:57.188379+0000 (oldest deadline 2024-06-02T04:21:20.688199+0000) 2024-06-02T04:21:38.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:37 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:37.843+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:02.889321+0000 front 2024-06-02T04:21:02.889358+0000 (oldest deadline 2024-06-02T04:21:27.589478+0000) 2024-06-02T04:21:38.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:37 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:37.843+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-06-02T04:21:11.090762+0000 front 2024-06-02T04:21:11.090685+0000 (oldest deadline 2024-06-02T04:21:34.590632+0000) 2024-06-02T04:21:38.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:37 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:37.952+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:38.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:37 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:37.952+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:38.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:37 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:37.952+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:38.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:37 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:37.952+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:48.311832+0000 front 2024-06-02T04:20:48.311957+0000 (oldest deadline 2024-06-02T04:21:11.211958+0000) 2024-06-02T04:21:38.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:37 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:37.952+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.513922+0000 front 2024-06-02T04:20:57.513954+0000 (oldest deadline 2024-06-02T04:21:23.414062+0000) 2024-06-02T04:21:38.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:37 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:37.952+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:03.414816+0000 front 2024-06-02T04:21:03.414734+0000 (oldest deadline 2024-06-02T04:21:28.114665+0000) 2024-06-02T04:21:38.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:37 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:37.953+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-06-02T04:21:08.115292+0000 front 2024-06-02T04:21:08.115422+0000 (oldest deadline 2024-06-02T04:21:33.415211+0000) 2024-06-02T04:21:39.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:38 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:38.876+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:39.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:38 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:38.876+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:39.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:38 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:38.876+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:39.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:38 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:38.876+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.188280+0000 front 2024-06-02T04:20:57.188379+0000 (oldest deadline 2024-06-02T04:21:20.688199+0000) 2024-06-02T04:21:39.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:38 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:38.876+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:02.889321+0000 front 2024-06-02T04:21:02.889358+0000 (oldest deadline 2024-06-02T04:21:27.589478+0000) 2024-06-02T04:21:39.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:38 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:38.876+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-06-02T04:21:11.090762+0000 front 2024-06-02T04:21:11.090685+0000 (oldest deadline 2024-06-02T04:21:34.590632+0000) 2024-06-02T04:21:39.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:38 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:38.913+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:39.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:38 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:38.913+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:39.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:38 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:38.913+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:39.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:38 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:38.913+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:48.311832+0000 front 2024-06-02T04:20:48.311957+0000 (oldest deadline 2024-06-02T04:21:11.211958+0000) 2024-06-02T04:21:39.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:38 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:38.913+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.513922+0000 front 2024-06-02T04:20:57.513954+0000 (oldest deadline 2024-06-02T04:21:23.414062+0000) 2024-06-02T04:21:39.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:38 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:38.913+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:03.414816+0000 front 2024-06-02T04:21:03.414734+0000 (oldest deadline 2024-06-02T04:21:28.114665+0000) 2024-06-02T04:21:39.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:38 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:38.913+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-06-02T04:21:08.115292+0000 front 2024-06-02T04:21:08.115422+0000 (oldest deadline 2024-06-02T04:21:33.415211+0000) 2024-06-02T04:21:40.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:39 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:39.880+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:40.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:39 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:39.880+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:40.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:39 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:39.880+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:40.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:39 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:39.880+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.188280+0000 front 2024-06-02T04:20:57.188379+0000 (oldest deadline 2024-06-02T04:21:20.688199+0000) 2024-06-02T04:21:40.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:39 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:39.880+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:02.889321+0000 front 2024-06-02T04:21:02.889358+0000 (oldest deadline 2024-06-02T04:21:27.589478+0000) 2024-06-02T04:21:40.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:39 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:39.880+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-06-02T04:21:11.090762+0000 front 2024-06-02T04:21:11.090685+0000 (oldest deadline 2024-06-02T04:21:34.590632+0000) 2024-06-02T04:21:40.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:39 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:39.896+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:40.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:39 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:39.896+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:40.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:39 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:39.896+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:40.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:39 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:39.896+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:48.311832+0000 front 2024-06-02T04:20:48.311957+0000 (oldest deadline 2024-06-02T04:21:11.211958+0000) 2024-06-02T04:21:40.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:39 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:39.896+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.513922+0000 front 2024-06-02T04:20:57.513954+0000 (oldest deadline 2024-06-02T04:21:23.414062+0000) 2024-06-02T04:21:40.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:39 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:39.896+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:03.414816+0000 front 2024-06-02T04:21:03.414734+0000 (oldest deadline 2024-06-02T04:21:28.114665+0000) 2024-06-02T04:21:40.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:39 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:39.896+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-06-02T04:21:08.115292+0000 front 2024-06-02T04:21:08.115422+0000 (oldest deadline 2024-06-02T04:21:33.415211+0000) 2024-06-02T04:21:41.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:40 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:40.851+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:41.299 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:40 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:40.851+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:41.299 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:40 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:40.851+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:41.299 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:40 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:40.851+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.188280+0000 front 2024-06-02T04:20:57.188379+0000 (oldest deadline 2024-06-02T04:21:20.688199+0000) 2024-06-02T04:21:41.299 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:40 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:40.851+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:02.889321+0000 front 2024-06-02T04:21:02.889358+0000 (oldest deadline 2024-06-02T04:21:27.589478+0000) 2024-06-02T04:21:41.299 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:40 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:40.851+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-06-02T04:21:11.090762+0000 front 2024-06-02T04:21:11.090685+0000 (oldest deadline 2024-06-02T04:21:34.590632+0000) 2024-06-02T04:21:41.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:40 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:40.925+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:27.808862+0000 front 2024-06-02T04:20:27.808807+0000 (oldest deadline 2024-06-02T04:20:53.108861+0000) 2024-06-02T04:21:41.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:40 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:40.925+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:33.109387+0000 front 2024-06-02T04:20:33.109457+0000 (oldest deadline 2024-06-02T04:20:58.910072+0000) 2024-06-02T04:21:41.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:40 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:40.925+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:42.411786+0000 front 2024-06-02T04:20:42.411436+0000 (oldest deadline 2024-06-02T04:21:08.311225+0000) 2024-06-02T04:21:41.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:40 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:40.925+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6814 osd.3 since back 2024-06-02T04:20:48.311832+0000 front 2024-06-02T04:20:48.311957+0000 (oldest deadline 2024-06-02T04:21:11.211958+0000) 2024-06-02T04:21:41.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:40 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:40.925+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.513922+0000 front 2024-06-02T04:20:57.513954+0000 (oldest deadline 2024-06-02T04:21:23.414062+0000) 2024-06-02T04:21:41.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:40 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:40.925+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:03.414816+0000 front 2024-06-02T04:21:03.414734+0000 (oldest deadline 2024-06-02T04:21:28.114665+0000) 2024-06-02T04:21:41.339 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:40 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10[77887]: 2024-06-02T04:21:40.925+0000 7f57ebcaa700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-06-02T04:21:08.115292+0000 front 2024-06-02T04:21:08.115422+0000 (oldest deadline 2024-06-02T04:21:33.415211+0000) 2024-06-02T04:21:42.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:41 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:41.805+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:42.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:41 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:41.805+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:42.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:41 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:41.805+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:42.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:41 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:41.805+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.188280+0000 front 2024-06-02T04:20:57.188379+0000 (oldest deadline 2024-06-02T04:21:20.688199+0000) 2024-06-02T04:21:42.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:41 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:41.805+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:02.889321+0000 front 2024-06-02T04:21:02.889358+0000 (oldest deadline 2024-06-02T04:21:27.589478+0000) 2024-06-02T04:21:42.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:41 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:41.805+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-06-02T04:21:11.090762+0000 front 2024-06-02T04:21:11.090685+0000 (oldest deadline 2024-06-02T04:21:34.590632+0000) 2024-06-02T04:21:42.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:41 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:41.805+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6820 osd.7 since back 2024-06-02T04:21:14.591050+0000 front 2024-06-02T04:21:14.590998+0000 (oldest deadline 2024-06-02T04:21:40.991608+0000) 2024-06-02T04:21:42.338 INFO:journalctl@ceph.osd.10.smithi136.stdout:Jun 02 04:21:41 smithi136 bash[91077]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-10 2024-06-02T04:21:43.112 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.10.service' 2024-06-02T04:21:43.153 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T04:21:43.153 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-06-02T04:21:43.154 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-06-02T04:21:43.154 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.11 2024-06-02T04:21:43.184 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:42 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:42.801+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:43.184 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:42 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:42.801+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:43.184 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:42 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:42.801+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:43.184 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:42 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:42.801+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.188280+0000 front 2024-06-02T04:20:57.188379+0000 (oldest deadline 2024-06-02T04:21:20.688199+0000) 2024-06-02T04:21:43.184 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:42 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:42.801+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:02.889321+0000 front 2024-06-02T04:21:02.889358+0000 (oldest deadline 2024-06-02T04:21:27.589478+0000) 2024-06-02T04:21:43.184 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:42 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:42.801+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-06-02T04:21:11.090762+0000 front 2024-06-02T04:21:11.090685+0000 (oldest deadline 2024-06-02T04:21:34.590632+0000) 2024-06-02T04:21:43.184 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:42 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:42.801+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6820 osd.7 since back 2024-06-02T04:21:14.591050+0000 front 2024-06-02T04:21:14.590998+0000 (oldest deadline 2024-06-02T04:21:40.991608+0000) 2024-06-02T04:21:43.548 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:43 smithi162 systemd[1]: Stopping Ceph osd.11 for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:21:43.548 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:43 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:43.391+0000 7f8566903700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T04:21:43.548 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:43 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:43.391+0000 7f8566903700 -1 osd.11 87 *** Got signal Terminated *** 2024-06-02T04:21:43.548 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:43 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:43.391+0000 7f8566903700 -1 osd.11 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-06-02T04:21:44.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:43 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:43.848+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:44.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:43 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:43.848+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:44.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:43 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:43.848+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:44.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:43 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:43.848+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.188280+0000 front 2024-06-02T04:20:57.188379+0000 (oldest deadline 2024-06-02T04:21:20.688199+0000) 2024-06-02T04:21:44.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:43 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:43.848+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:02.889321+0000 front 2024-06-02T04:21:02.889358+0000 (oldest deadline 2024-06-02T04:21:27.589478+0000) 2024-06-02T04:21:44.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:43 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:43.848+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-06-02T04:21:11.090762+0000 front 2024-06-02T04:21:11.090685+0000 (oldest deadline 2024-06-02T04:21:34.590632+0000) 2024-06-02T04:21:44.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:43 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:43.848+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6820 osd.7 since back 2024-06-02T04:21:14.591050+0000 front 2024-06-02T04:21:14.590998+0000 (oldest deadline 2024-06-02T04:21:40.991608+0000) 2024-06-02T04:21:45.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:44 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:44.856+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:45.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:44 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:44.856+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:45.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:44 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:44.856+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:45.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:44 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:44.856+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.188280+0000 front 2024-06-02T04:20:57.188379+0000 (oldest deadline 2024-06-02T04:21:20.688199+0000) 2024-06-02T04:21:45.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:44 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:44.856+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:02.889321+0000 front 2024-06-02T04:21:02.889358+0000 (oldest deadline 2024-06-02T04:21:27.589478+0000) 2024-06-02T04:21:45.299 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:44 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:44.856+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-06-02T04:21:11.090762+0000 front 2024-06-02T04:21:11.090685+0000 (oldest deadline 2024-06-02T04:21:34.590632+0000) 2024-06-02T04:21:45.299 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:44 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:44.856+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6820 osd.7 since back 2024-06-02T04:21:14.591050+0000 front 2024-06-02T04:21:14.590998+0000 (oldest deadline 2024-06-02T04:21:40.991608+0000) 2024-06-02T04:21:46.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:45 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:45.883+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:46.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:45 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:45.883+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:46.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:45 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:45.883+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:46.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:45 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:45.883+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.188280+0000 front 2024-06-02T04:20:57.188379+0000 (oldest deadline 2024-06-02T04:21:20.688199+0000) 2024-06-02T04:21:46.299 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:45 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:45.883+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:02.889321+0000 front 2024-06-02T04:21:02.889358+0000 (oldest deadline 2024-06-02T04:21:27.589478+0000) 2024-06-02T04:21:46.299 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:45 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:45.883+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-06-02T04:21:11.090762+0000 front 2024-06-02T04:21:11.090685+0000 (oldest deadline 2024-06-02T04:21:34.590632+0000) 2024-06-02T04:21:46.299 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:45 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:45.883+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6820 osd.7 since back 2024-06-02T04:21:14.591050+0000 front 2024-06-02T04:21:14.590998+0000 (oldest deadline 2024-06-02T04:21:40.991608+0000) 2024-06-02T04:21:47.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:46 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:46.909+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:47.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:46 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:46.909+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:47.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:46 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:46.909+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:47.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:46 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:46.909+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.188280+0000 front 2024-06-02T04:20:57.188379+0000 (oldest deadline 2024-06-02T04:21:20.688199+0000) 2024-06-02T04:21:47.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:46 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:46.909+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:02.889321+0000 front 2024-06-02T04:21:02.889358+0000 (oldest deadline 2024-06-02T04:21:27.589478+0000) 2024-06-02T04:21:47.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:46 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:46.909+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-06-02T04:21:11.090762+0000 front 2024-06-02T04:21:11.090685+0000 (oldest deadline 2024-06-02T04:21:34.590632+0000) 2024-06-02T04:21:47.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:46 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:46.909+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6820 osd.7 since back 2024-06-02T04:21:14.591050+0000 front 2024-06-02T04:21:14.590998+0000 (oldest deadline 2024-06-02T04:21:40.991608+0000) 2024-06-02T04:21:48.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:47 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:47.943+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6806 osd.0 since back 2024-06-02T04:20:28.683333+0000 front 2024-06-02T04:20:28.683516+0000 (oldest deadline 2024-06-02T04:20:54.484203+0000) 2024-06-02T04:21:48.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:47 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:47.943+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6804 osd.1 since back 2024-06-02T04:20:36.185293+0000 front 2024-06-02T04:20:36.185272+0000 (oldest deadline 2024-06-02T04:20:59.085373+0000) 2024-06-02T04:21:48.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:47 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:47.943+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6804 osd.2 since back 2024-06-02T04:20:40.186310+0000 front 2024-06-02T04:20:40.186195+0000 (oldest deadline 2024-06-02T04:21:06.086355+0000) 2024-06-02T04:21:48.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:47 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:47.943+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6812 osd.4 since back 2024-06-02T04:20:57.188280+0000 front 2024-06-02T04:20:57.188379+0000 (oldest deadline 2024-06-02T04:21:20.688199+0000) 2024-06-02T04:21:48.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:47 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:47.943+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.162:6812 osd.5 since back 2024-06-02T04:21:02.889321+0000 front 2024-06-02T04:21:02.889358+0000 (oldest deadline 2024-06-02T04:21:27.589478+0000) 2024-06-02T04:21:48.298 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:47 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:47.943+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.123:6822 osd.6 since back 2024-06-02T04:21:11.090762+0000 front 2024-06-02T04:21:11.090685+0000 (oldest deadline 2024-06-02T04:21:34.590632+0000) 2024-06-02T04:21:48.299 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:47 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11[77051]: 2024-06-02T04:21:47.943+0000 7f855eef1700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.136:6820 osd.7 since back 2024-06-02T04:21:14.591050+0000 front 2024-06-02T04:21:14.590998+0000 (oldest deadline 2024-06-02T04:21:40.991608+0000) 2024-06-02T04:21:49.548 INFO:journalctl@ceph.osd.11.smithi162.stdout:Jun 02 04:21:49 smithi162 bash[90256]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-osd-11 2024-06-02T04:21:50.393 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@osd.11.service' 2024-06-02T04:21:50.474 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T04:21:50.474 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-06-02T04:21:50.474 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-06-02T04:21:50.474 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.a 2024-06-02T04:21:50.822 INFO:journalctl@ceph.mds.a.smithi123.stdout:Jun 02 04:21:50 smithi123 systemd[1]: Stopping Ceph mds.a for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:21:50.822 INFO:journalctl@ceph.mds.a.smithi123.stdout:Jun 02 04:21:50 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-a[93605]: 2024-06-02T04:21:50.711+0000 7f2ccf043700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T04:21:50.822 INFO:journalctl@ceph.mds.a.smithi123.stdout:Jun 02 04:21:50 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-a[93605]: 2024-06-02T04:21:50.711+0000 7f2ccf043700 -1 mds.a *** got signal Terminated *** 2024-06-02T04:21:55.173 INFO:journalctl@ceph.mds.a.smithi123.stdout:Jun 02 04:21:54 smithi123 bash[113305]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-a 2024-06-02T04:21:55.179 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.a.service' 2024-06-02T04:21:55.215 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T04:21:55.215 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-06-02T04:21:55.215 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-06-02T04:21:55.215 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.d 2024-06-02T04:21:55.468 INFO:journalctl@ceph.mds.d.smithi123.stdout:Jun 02 04:21:55 smithi123 systemd[1]: Stopping Ceph mds.d for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:21:55.822 INFO:journalctl@ceph.mds.d.smithi123.stdout:Jun 02 04:21:55 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-d[92695]: 2024-06-02T04:21:55.468+0000 7f1c491ef700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T04:21:55.822 INFO:journalctl@ceph.mds.d.smithi123.stdout:Jun 02 04:21:55 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-d[92695]: 2024-06-02T04:21:55.468+0000 7f1c491ef700 -1 mds.d *** got signal Terminated *** 2024-06-02T04:21:59.929 INFO:journalctl@ceph.mds.d.smithi123.stdout:Jun 02 04:21:59 smithi123 bash[113444]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-d 2024-06-02T04:21:59.936 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.d.service' 2024-06-02T04:21:59.970 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T04:21:59.970 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-06-02T04:21:59.971 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-06-02T04:21:59.971 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.g 2024-06-02T04:22:00.225 INFO:journalctl@ceph.mds.g.smithi123.stdout:Jun 02 04:22:00 smithi123 systemd[1]: Stopping Ceph mds.g for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:22:00.572 INFO:journalctl@ceph.mds.g.smithi123.stdout:Jun 02 04:22:00 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-g[93241]: 2024-06-02T04:22:00.225+0000 7f6e2c734700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T04:22:00.572 INFO:journalctl@ceph.mds.g.smithi123.stdout:Jun 02 04:22:00 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-g[93241]: 2024-06-02T04:22:00.225+0000 7f6e2c734700 -1 mds.g *** got signal Terminated *** 2024-06-02T04:22:03.676 INFO:journalctl@ceph.mds.g.smithi123.stdout:Jun 02 04:22:03 smithi123 bash[113583]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-g 2024-06-02T04:22:03.682 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.g.service' 2024-06-02T04:22:03.718 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T04:22:03.719 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-06-02T04:22:03.719 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-06-02T04:22:03.719 DEBUG:teuthology.orchestra.run.smithi123:> sudo systemctl stop ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.j 2024-06-02T04:22:03.976 INFO:journalctl@ceph.mds.j.smithi123.stdout:Jun 02 04:22:03 smithi123 systemd[1]: Stopping Ceph mds.j for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:22:04.322 INFO:journalctl@ceph.mds.j.smithi123.stdout:Jun 02 04:22:03 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-j[92308]: 2024-06-02T04:22:03.975+0000 7fdfcae4e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T04:22:04.322 INFO:journalctl@ceph.mds.j.smithi123.stdout:Jun 02 04:22:03 smithi123 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-j[92308]: 2024-06-02T04:22:03.975+0000 7fdfcae4e700 -1 mds.j *** got signal Terminated *** 2024-06-02T04:22:06.322 INFO:journalctl@ceph.mds.j.smithi123.stdout:Jun 02 04:22:06 smithi123 bash[113729]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-j 2024-06-02T04:22:06.409 DEBUG:teuthology.orchestra.run.smithi123:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.j.service' 2024-06-02T04:22:06.445 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T04:22:06.446 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-06-02T04:22:06.446 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-06-02T04:22:06.446 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.b 2024-06-02T04:22:06.838 INFO:journalctl@ceph.mds.b.smithi136.stdout:Jun 02 04:22:06 smithi136 systemd[1]: Stopping Ceph mds.b for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:22:06.838 INFO:journalctl@ceph.mds.b.smithi136.stdout:Jun 02 04:22:06 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-b[84767]: 2024-06-02T04:22:06.685+0000 7fd99aa37700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T04:22:06.838 INFO:journalctl@ceph.mds.b.smithi136.stdout:Jun 02 04:22:06 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-b[84767]: 2024-06-02T04:22:06.685+0000 7fd99aa37700 -1 mds.b *** got signal Terminated *** 2024-06-02T04:22:11.088 INFO:journalctl@ceph.mds.b.smithi136.stdout:Jun 02 04:22:10 smithi136 bash[91329]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-b 2024-06-02T04:22:11.168 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.b.service' 2024-06-02T04:22:11.206 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T04:22:11.207 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-06-02T04:22:11.207 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-06-02T04:22:11.207 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.e 2024-06-02T04:22:11.468 INFO:journalctl@ceph.mds.e.smithi136.stdout:Jun 02 04:22:11 smithi136 systemd[1]: Stopping Ceph mds.e for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:22:11.838 INFO:journalctl@ceph.mds.e.smithi136.stdout:Jun 02 04:22:11 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-e[84083]: 2024-06-02T04:22:11.467+0000 7f2453066700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T04:22:11.838 INFO:journalctl@ceph.mds.e.smithi136.stdout:Jun 02 04:22:11 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-e[84083]: 2024-06-02T04:22:11.467+0000 7f2453066700 -1 mds.e *** got signal Terminated *** 2024-06-02T04:22:15.588 INFO:journalctl@ceph.mds.e.smithi136.stdout:Jun 02 04:22:15 smithi136 bash[91475]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-e 2024-06-02T04:22:15.669 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.e.service' 2024-06-02T04:22:15.703 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T04:22:15.703 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-06-02T04:22:15.704 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-06-02T04:22:15.704 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.h 2024-06-02T04:22:15.975 INFO:journalctl@ceph.mds.h.smithi136.stdout:Jun 02 04:22:15 smithi136 systemd[1]: Stopping Ceph mds.h for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:22:16.338 INFO:journalctl@ceph.mds.h.smithi136.stdout:Jun 02 04:22:15 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-h[84426]: 2024-06-02T04:22:15.975+0000 7fa794026700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T04:22:16.338 INFO:journalctl@ceph.mds.h.smithi136.stdout:Jun 02 04:22:15 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-h[84426]: 2024-06-02T04:22:15.975+0000 7fa794026700 -1 mds.h *** got signal Terminated *** 2024-06-02T04:22:19.698 INFO:journalctl@ceph.mds.h.smithi136.stdout:Jun 02 04:22:19 smithi136 bash[91614]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-h 2024-06-02T04:22:19.704 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.h.service' 2024-06-02T04:22:19.738 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T04:22:19.739 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-06-02T04:22:19.739 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-06-02T04:22:19.739 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.k 2024-06-02T04:22:19.990 INFO:journalctl@ceph.mds.k.smithi136.stdout:Jun 02 04:22:19 smithi136 systemd[1]: Stopping Ceph mds.k for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:22:20.338 INFO:journalctl@ceph.mds.k.smithi136.stdout:Jun 02 04:22:19 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-k[83742]: 2024-06-02T04:22:19.991+0000 7f79c18ca700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T04:22:20.338 INFO:journalctl@ceph.mds.k.smithi136.stdout:Jun 02 04:22:19 smithi136 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-k[83742]: 2024-06-02T04:22:19.991+0000 7f79c18ca700 -1 mds.k *** got signal Terminated *** 2024-06-02T04:22:23.531 INFO:journalctl@ceph.mds.k.smithi136.stdout:Jun 02 04:22:23 smithi136 bash[91753]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-k 2024-06-02T04:22:23.538 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.k.service' 2024-06-02T04:22:23.572 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T04:22:23.572 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-06-02T04:22:23.572 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-06-02T04:22:23.573 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.c 2024-06-02T04:22:24.048 INFO:journalctl@ceph.mds.c.smithi162.stdout:Jun 02 04:22:23 smithi162 systemd[1]: Stopping Ceph mds.c for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:22:24.048 INFO:journalctl@ceph.mds.c.smithi162.stdout:Jun 02 04:22:23 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-c[83286]: 2024-06-02T04:22:23.823+0000 7fbbdf2e8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T04:22:24.048 INFO:journalctl@ceph.mds.c.smithi162.stdout:Jun 02 04:22:23 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-c[83286]: 2024-06-02T04:22:23.823+0000 7fbbdf2e8700 -1 mds.c *** got signal Terminated *** 2024-06-02T04:22:27.590 INFO:journalctl@ceph.mds.c.smithi162.stdout:Jun 02 04:22:27 smithi162 bash[90519]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-c 2024-06-02T04:22:27.596 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.c.service' 2024-06-02T04:22:27.634 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T04:22:27.634 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-06-02T04:22:27.634 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-06-02T04:22:27.635 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.f 2024-06-02T04:22:27.915 INFO:journalctl@ceph.mds.f.smithi162.stdout:Jun 02 04:22:27 smithi162 systemd[1]: Stopping Ceph mds.f for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:22:28.298 INFO:journalctl@ceph.mds.f.smithi162.stdout:Jun 02 04:22:27 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-f[82945]: 2024-06-02T04:22:27.915+0000 7fdecd2ca700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T04:22:28.298 INFO:journalctl@ceph.mds.f.smithi162.stdout:Jun 02 04:22:27 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-f[82945]: 2024-06-02T04:22:27.915+0000 7fdecd2ca700 -1 mds.f *** got signal Terminated *** 2024-06-02T04:22:31.548 INFO:journalctl@ceph.mds.f.smithi162.stdout:Jun 02 04:22:31 smithi162 bash[90657]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-f 2024-06-02T04:22:31.650 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.f.service' 2024-06-02T04:22:31.684 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T04:22:31.685 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-06-02T04:22:31.685 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-06-02T04:22:31.685 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.i 2024-06-02T04:22:31.980 INFO:journalctl@ceph.mds.i.smithi162.stdout:Jun 02 04:22:31 smithi162 systemd[1]: Stopping Ceph mds.i for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:22:32.298 INFO:journalctl@ceph.mds.i.smithi162.stdout:Jun 02 04:22:31 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-i[83629]: 2024-06-02T04:22:31.980+0000 7f1543afa700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T04:22:32.298 INFO:journalctl@ceph.mds.i.smithi162.stdout:Jun 02 04:22:31 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-i[83629]: 2024-06-02T04:22:31.980+0000 7f1543afa700 -1 mds.i *** got signal Terminated *** 2024-06-02T04:22:35.548 INFO:journalctl@ceph.mds.i.smithi162.stdout:Jun 02 04:22:35 smithi162 bash[90794]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-i 2024-06-02T04:22:35.651 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.i.service' 2024-06-02T04:22:35.685 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T04:22:35.685 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-06-02T04:22:35.685 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-06-02T04:22:35.686 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.l 2024-06-02T04:22:35.953 INFO:journalctl@ceph.mds.l.smithi162.stdout:Jun 02 04:22:35 smithi162 systemd[1]: Stopping Ceph mds.l for 1b432ae0-2094-11ef-bc9b-c7b262605968... 2024-06-02T04:22:36.298 INFO:journalctl@ceph.mds.l.smithi162.stdout:Jun 02 04:22:35 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-l[82601]: 2024-06-02T04:22:35.953+0000 7fa8c847f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-06-02T04:22:36.298 INFO:journalctl@ceph.mds.l.smithi162.stdout:Jun 02 04:22:35 smithi162 ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-l[82601]: 2024-06-02T04:22:35.953+0000 7fa8c847f700 -1 mds.l *** got signal Terminated *** 2024-06-02T04:22:39.741 INFO:journalctl@ceph.mds.l.smithi162.stdout:Jun 02 04:22:39 smithi162 bash[90932]: ceph-1b432ae0-2094-11ef-bc9b-c7b262605968-mds-l 2024-06-02T04:22:39.748 DEBUG:teuthology.orchestra.run.smithi162:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1b432ae0-2094-11ef-bc9b-c7b262605968@mds.l.service' 2024-06-02T04:22:39.782 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-06-02T04:22:39.782 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-06-02T04:22:39.782 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 --force --keep-logs 2024-06-02T04:22:39.966 INFO:teuthology.orchestra.run.smithi123.stdout:Deleting cluster with fsid: 1b432ae0-2094-11ef-bc9b-c7b262605968 2024-06-02T04:22:41.433 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 --force --keep-logs 2024-06-02T04:22:41.624 INFO:teuthology.orchestra.run.smithi136.stdout:Deleting cluster with fsid: 1b432ae0-2094-11ef-bc9b-c7b262605968 2024-06-02T04:22:43.016 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 --force --keep-logs 2024-06-02T04:22:43.206 INFO:teuthology.orchestra.run.smithi162.stdout:Deleting cluster with fsid: 1b432ae0-2094-11ef-bc9b-c7b262605968 2024-06-02T04:22:44.716 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-02T04:22:44.753 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-02T04:22:44.790 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-06-02T04:22:44.820 INFO:tasks.cephadm:Archiving crash dumps... 2024-06-02T04:22:44.822 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi/7733635/remote/smithi123/crash 2024-06-02T04:22:44.823 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/crash -- . 2024-06-02T04:22:44.869 INFO:teuthology.orchestra.run.smithi123.stderr:tar: /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/crash: Cannot open: No such file or directory 2024-06-02T04:22:44.869 INFO:teuthology.orchestra.run.smithi123.stderr:tar: Error is not recoverable: exiting now 2024-06-02T04:22:44.871 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi/7733635/remote/smithi136/crash 2024-06-02T04:22:44.872 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/crash -- . 2024-06-02T04:22:44.914 INFO:teuthology.orchestra.run.smithi136.stderr:tar: /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/crash: Cannot open: No such file or directory 2024-06-02T04:22:44.914 INFO:teuthology.orchestra.run.smithi136.stderr:tar: Error is not recoverable: exiting now 2024-06-02T04:22:44.916 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi/7733635/remote/smithi162/crash 2024-06-02T04:22:44.917 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/crash -- . 2024-06-02T04:22:44.983 INFO:teuthology.orchestra.run.smithi162.stderr:tar: /var/lib/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/crash: Cannot open: No such file or directory 2024-06-02T04:22:44.983 INFO:teuthology.orchestra.run.smithi162.stderr:tar: Error is not recoverable: exiting now 2024-06-02T04:22:44.984 INFO:tasks.cephadm:Checking cluster log for badness... 2024-06-02T04:22:44.984 DEBUG:teuthology.orchestra.run.smithi123:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-06-02T04:22:45.018 INFO:teuthology.orchestra.run.smithi123.stderr:grep: /var/log/ceph/1b432ae0-2094-11ef-bc9b-c7b262605968/ceph.log: No such file or directory 2024-06-02T04:22:45.020 INFO:tasks.cephadm:Compressing logs... 2024-06-02T04:22:45.020 DEBUG:teuthology.orchestra.run.smithi123:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-02T04:22:45.063 DEBUG:teuthology.orchestra.run.smithi136:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-02T04:22:45.065 DEBUG:teuthology.orchestra.run.smithi162:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-02T04:22:45.094 INFO:teuthology.orchestra.run.smithi136.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-06-02T04:22:45.102 INFO:teuthology.orchestra.run.smithi123.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-06-02T04:22:45.117 INFO:teuthology.orchestra.run.smithi162.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-06-02T04:27:29.009 INFO:tasks.cephadm:Archiving logs... 2024-06-02T04:27:29.010 DEBUG:teuthology.misc:Transferring archived files from smithi123:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi/7733635/remote/smithi123/log 2024-06-02T04:27:29.011 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-02T04:28:04.421 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi/7733635/remote/smithi136/log 2024-06-02T04:28:04.422 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-02T04:28:38.468 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi/7733635/remote/smithi162/log 2024-06-02T04:28:38.469 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/log/ceph -- . 2024-06-02T04:29:17.860 INFO:tasks.cephadm:Removing cluster... 2024-06-02T04:29:17.860 DEBUG:teuthology.orchestra.run.smithi123:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 --force 2024-06-02T04:29:18.049 INFO:teuthology.orchestra.run.smithi123.stdout:Deleting cluster with fsid: 1b432ae0-2094-11ef-bc9b-c7b262605968 2024-06-02T04:29:18.600 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 --force 2024-06-02T04:29:18.787 INFO:teuthology.orchestra.run.smithi136.stdout:Deleting cluster with fsid: 1b432ae0-2094-11ef-bc9b-c7b262605968 2024-06-02T04:29:19.316 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1b432ae0-2094-11ef-bc9b-c7b262605968 --force 2024-06-02T04:29:19.505 INFO:teuthology.orchestra.run.smithi162.stdout:Deleting cluster with fsid: 1b432ae0-2094-11ef-bc9b-c7b262605968 2024-06-02T04:29:20.082 INFO:tasks.cephadm:Removing cephadm ... 2024-06-02T04:29:20.083 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf /home/ubuntu/cephtest/cephadm 2024-06-02T04:29:20.105 DEBUG:teuthology.orchestra.run.smithi136:> rm -rf /home/ubuntu/cephtest/cephadm 2024-06-02T04:29:20.126 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf /home/ubuntu/cephtest/cephadm 2024-06-02T04:29:20.151 INFO:tasks.cephadm:Teardown complete 2024-06-02T04:29:20.151 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-06-02T04:29:20.163 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-06-02T04:29:20.163 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-02T04:29:20.166 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-02T04:29:20.168 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-06-02T04:29:20.303 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-06-02T04:29:20.313 INFO:teuthology.task.clock:Checking final clock skew... 2024-06-02T04:29:20.313 DEBUG:teuthology.orchestra.run.smithi123:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T04:29:20.316 DEBUG:teuthology.orchestra.run.smithi136:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T04:29:20.319 DEBUG:teuthology.orchestra.run.smithi162:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-06-02T04:29:20.332 INFO:teuthology.orchestra.run.smithi123.stderr:bash: ntpq: command not found 2024-06-02T04:29:20.334 INFO:teuthology.orchestra.run.smithi136.stderr:bash: ntpq: command not found 2024-06-02T04:29:20.335 INFO:teuthology.orchestra.run.smithi162.stderr:bash: ntpq: command not found 2024-06-02T04:29:20.340 INFO:teuthology.orchestra.run.smithi136.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T04:29:20.340 INFO:teuthology.orchestra.run.smithi136.stdout:=============================================================================== 2024-06-02T04:29:20.340 INFO:teuthology.orchestra.run.smithi136.stdout:^* hv01.front.sepia.ceph.com 3 6 377 54 +503us[ +519us] +/- 64ms 2024-06-02T04:29:20.340 INFO:teuthology.orchestra.run.smithi136.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 54 -485us[ -469us] +/- 80ms 2024-06-02T04:29:20.340 INFO:teuthology.orchestra.run.smithi136.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 54 -130us[ -130us] +/- 70ms 2024-06-02T04:29:20.340 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T04:29:20.374 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T04:29:20.374 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-06-02T04:29:20.374 INFO:teuthology.orchestra.run.smithi162.stdout:^* hv01.front.sepia.ceph.com 3 6 377 56 +498us[ +506us] +/- 64ms 2024-06-02T04:29:20.375 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 56 -467us[ -458us] +/- 80ms 2024-06-02T04:29:20.375 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 56 -136us[ -128us] +/- 70ms 2024-06-02T04:29:20.375 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T04:29:20.400 INFO:teuthology.orchestra.run.smithi123.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-06-02T04:29:20.401 INFO:teuthology.orchestra.run.smithi123.stdout:=============================================================================== 2024-06-02T04:29:20.401 INFO:teuthology.orchestra.run.smithi123.stdout:^* hv01.front.sepia.ceph.com 3 6 377 54 +513us[ +524us] +/- 64ms 2024-06-02T04:29:20.401 INFO:teuthology.orchestra.run.smithi123.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 52 -459us[ -459us] +/- 80ms 2024-06-02T04:29:20.401 INFO:teuthology.orchestra.run.smithi123.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 54 -134us[ -134us] +/- 70ms 2024-06-02T04:29:20.401 INFO:teuthology.orchestra.run.smithi123.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-06-02T04:29:20.401 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-06-02T04:29:20.411 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-06-02T04:29:20.412 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-06-02T04:29:20.422 DEBUG:teuthology.orchestra.run.smithi123:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-02T04:29:20.518 DEBUG:teuthology.orchestra.run.smithi136:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-02T04:29:20.592 DEBUG:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-06-02T04:29:20.697 DEBUG:teuthology.orchestra.run.smithi123:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-06-02T04:29:20.729 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T04:29:20.729 DEBUG:teuthology.orchestra.run.smithi136:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-06-02T04:29:20.763 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T04:29:20.763 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-06-02T04:29:20.793 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T04:29:20.794 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-06-02T04:29:20.804 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-06-02T04:29:20.814 INFO:teuthology.task.internal:Duration was 2818.699414 seconds 2024-06-02T04:29:20.814 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-06-02T04:29:20.824 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-06-02T04:29:20.824 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-02T04:29:20.826 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-02T04:29:20.828 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-06-02T04:29:20.876 INFO:teuthology.orchestra.run.smithi136.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T04:29:20.895 INFO:teuthology.orchestra.run.smithi123.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T04:29:20.930 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-06-02T04:29:21.351 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-06-02T04:29:21.351 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi123.front.sepia.ceph.com 2024-06-02T04:29:21.351 DEBUG:teuthology.orchestra.run.smithi123:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-02T04:29:21.374 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi136.front.sepia.ceph.com 2024-06-02T04:29:21.374 DEBUG:teuthology.orchestra.run.smithi136:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-02T04:29:21.398 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi162.front.sepia.ceph.com 2024-06-02T04:29:21.398 DEBUG:teuthology.orchestra.run.smithi162:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-06-02T04:29:21.421 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-06-02T04:29:21.421 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-02T04:29:21.423 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-02T04:29:21.440 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-06-02T04:29:21.513 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-06-02T04:29:21.513 DEBUG:teuthology.orchestra.run.smithi123:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-02T04:29:21.516 DEBUG:teuthology.orchestra.run.smithi136:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-02T04:29:21.518 DEBUG:teuthology.orchestra.run.smithi162:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-06-02T04:29:21.650 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-06-02T04:29:21.662 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-06-02T04:29:21.663 DEBUG:teuthology.orchestra.run.smithi123:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-02T04:29:21.690 DEBUG:teuthology.orchestra.run.smithi136:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-02T04:29:21.717 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-06-02T04:29:21.782 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-06-02T04:29:21.793 DEBUG:teuthology.orchestra.run.smithi123:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-02T04:29:21.795 DEBUG:teuthology.orchestra.run.smithi136:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-02T04:29:21.797 DEBUG:teuthology.orchestra.run.smithi162:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-06-02T04:29:21.821 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = core 2024-06-02T04:29:21.828 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = core 2024-06-02T04:29:21.830 INFO:teuthology.orchestra.run.smithi123.stdout:kernel.core_pattern = core 2024-06-02T04:29:21.856 DEBUG:teuthology.orchestra.run.smithi123:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-02T04:29:21.900 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T04:29:21.901 DEBUG:teuthology.orchestra.run.smithi136:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-02T04:29:21.917 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T04:29:21.918 DEBUG:teuthology.orchestra.run.smithi162:> test -e /home/ubuntu/cephtest/archive/coredump 2024-06-02T04:29:21.933 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-06-02T04:29:21.934 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-06-02T04:29:21.945 INFO:teuthology.task.internal:Transferring archived files... 2024-06-02T04:29:21.947 DEBUG:teuthology.misc:Transferring archived files from smithi123:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi/7733635/remote/smithi123 2024-06-02T04:29:21.947 DEBUG:teuthology.orchestra.run.smithi123:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-02T04:29:21.989 DEBUG:teuthology.misc:Transferring archived files from smithi136:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi/7733635/remote/smithi136 2024-06-02T04:29:21.990 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-02T04:29:22.032 DEBUG:teuthology.misc:Transferring archived files from smithi162:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-05-29_22:24:02-fs-reef-distro-default-smithi/7733635/remote/smithi162 2024-06-02T04:29:22.033 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-06-02T04:29:22.073 INFO:teuthology.task.internal:Removing archive directory... 2024-06-02T04:29:22.073 DEBUG:teuthology.orchestra.run.smithi123:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-02T04:29:22.076 DEBUG:teuthology.orchestra.run.smithi136:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-02T04:29:22.078 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf -- /home/ubuntu/cephtest/archive 2024-06-02T04:29:22.123 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-06-02T04:29:22.136 INFO:teuthology.task.internal:Not uploading archives. 2024-06-02T04:29:22.136 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-06-02T04:29:22.147 INFO:teuthology.task.internal:Tidying up after the test... 2024-06-02T04:29:22.148 DEBUG:teuthology.orchestra.run.smithi123:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-02T04:29:22.150 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-02T04:29:22.155 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-06-02T04:29:22.164 INFO:teuthology.orchestra.run.smithi123.stdout: 262179 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 2 04:29 /home/ubuntu/cephtest 2024-06-02T04:29:22.169 INFO:teuthology.orchestra.run.smithi136.stdout: 262157 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 2 04:29 /home/ubuntu/cephtest 2024-06-02T04:29:22.180 INFO:teuthology.orchestra.run.smithi162.stdout: 262164 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 2 04:29 /home/ubuntu/cephtest 2024-06-02T04:29:22.181 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-06-02T04:29:22.192 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-06-02T04:29:22.217 INFO:teuthology.run:Summary data: description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/postgres}} duration: 2818.699413537979 failure_reason: 'The following counters failed to be set on mds daemons: {''mds.imported'', ''mds.exported''}' flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-06-02T04:29:22.218 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-06-02T04:29:22.344 INFO:teuthology.run:FAIL